o ÚÜÓh®ã @sNddlmZddlmZmZdgZ d dejdeedeeefdd„ZdS) é)Únn)ÚListÚOptionalÚpartition_modelNÚmoduleÚbalanceÚdevicesc Cszd}d}g}|D]/}g}t|ƒD] }| ||¡|d7}q|dur$|n||} | tj|Ž | ¡¡|d7}qtj|ŽS)a, Given an :class:`nn.Sequential ` module, partitions the model across multiple GPU devices according the provided ``balance`` and ``devices``. Args: module (:class:`nn.Sequential `): Sequential model representing the pipe. balance (List[int]): List indicating the number of layers in each partition. devices (List[int], optional): List indicating the device to use for each partition. Defaults to ``range(len(balance))`` réN)ÚrangeÚappendrÚ SequentialÚto) rrrÚ device_idxÚpipe_idxÚ balanced_pipeÚ num_layersÚlayersÚiÚdevice©rú[/var/www/html/ai/venv/lib/python3.10/site-packages/torch/distributed/pipeline/sync/utils.pyrs    )N) ÚtorchrÚtypingrrÚ__all__r ÚintrrrrrÚs ýÿþ ý