o óÜÓhàã@s ddlmZdd„Zdd„ZdS)é)ÚceilcsÎttd|ƒƒ‰dd„t| ¡ƒDƒ‰g}ˆD]}ˆ |¡dkr(||vr(| |¡q‡fdd„ˆDƒ}‡fdd„ˆDƒ}t|ƒdkrItdt|ƒƒ‚t|ƒdkrWtdt|ƒƒ‚t|ƒdkretd t|ƒƒ‚dS) NrcSsg|] }|D]}|‘qqS©r)Ú.0ÚsublistÚitemrrú]/var/www/html/ai/venv/lib/python3.10/site-packages/transformers/utils/model_parallel_utils.pyÚ sz%assert_device_map..écóg|]}|ˆvr|‘qSrr©rÚi)Údevice_map_blocksrrrócr rrr )ÚblocksrrrrzœDuplicate attention blocks specified in device_map. Attention blocks must be specified to one device. These attention blocks were specified more than once: zŽThere are attention blocks for this model that are not specified in the device_map. Add these attention blocks to a device on the device_map: zdThe device_map contains more attention blocks than this model has. Remove these from the device_map:)ÚlistÚrangeÚvaluesÚcountÚappendÚlenÚ ValueErrorÚstr)Ú device_mapÚ num_blocksÚduplicate_blocksr Úmissing_blocksÚ extra_blocksr)rr rÚassert_device_maps8 € ÿÿ ÿÿ ÿÿÿrcsJtt|ƒƒ‰tt|t|ƒƒƒ‰‡‡fdd„td|ˆƒDƒ}tt||ƒƒS)zEReturns a dictionary of layers distributed evenly across all devices.csg|] }ˆ||ˆ…‘qSrrr ©ÚlayersÚn_blocksrrr6sz"get_device_map..r)rrÚintrrÚdictÚzip)Ún_layersÚdevicesÚ layers_listrrrÚget_device_map2s r'N)Úmathrrr'rrrrÚs