o h@srddlmZddlZddlmZmZddlmZmZddl m Z dZ d ed fd e d e fd dZddZddZdS))PathN)is_npu_availableis_xpu_available) ClusterConfigdefault_json_config_file)SubcommandHelpFormatterzFCreate a default config file for Accelerate with only a few flags set.noF save_locationuse_xpucCsXt|}|jjddd|rtd|ddS|}|dvr)td|d|d }tj rNtj }||d <d|d <|d krId |d<nQd|d<nLt rn|rntj }||d <d|d <|d krid|d<n1d|d<n,t rtj }||d <d|d <|d krd|d<nd|d<nd}d|d <d |d <d|d<d|d<tdi|}|||S)aA Creates and saves a basic cluster config to be used on a local machine with potentially multiple GPUs. Will also set CPU if it is a CPU-only machine. Args: mixed_precision (`str`, *optional*, defaults to "no"): Mixed Precision to use. Should be one of "no", "fp16", or "bf16" save_location (`str`, *optional*, defaults to `default_json_config_file`): Optional custom save location. Should be passed to `--config_file` when using `accelerate launch`. Default location is inside the huggingface cache folder (`~/.cache/huggingface`) but can be overriden by setting the `HF_HOME` environmental variable, followed by `accelerate/default_config.yaml`. use_xpu (`bool`, *optional*, defaults to `False`): Whether to use XPU if available. T)parentsexist_okz Configuration already exists at zZ, will not override. Run `accelerate config` manually or pass a different `save_location`.F)r fp16bf16fp8zL`mixed_precision` should be one of 'no', 'fp16', 'bf16', or 'fp8'. Received LOCAL_MACHINE)compute_environmentmixed_precision num_processesuse_cpur MULTI_GPUdistributed_typeNO MULTI_XPU MULTI_NPUrdebugN)rparentmkdirexistsprintlower ValueErrortorchcuda is_available device_countrxpurnpur to_json_file)rr r pathconfignum_gpusnum_xpusnum_npusrrX/var/www/html/ai/venv/lib/python3.10/site-packages/accelerate/commands/config/default.pywrite_basic_configsX             r1cCsL|jd|ttd}|jdtddd|jdgdtd d d |jtd |S) Ndefault)r helpformatter_classz --config_fileaTThe path to use to store the config file. Will default to a file named default_config.yaml in the cache location, which is the content of the environment `HF_HOME` suffixed with 'accelerate', or if you don't have such an environment variable, your cache directory ('~/.cache' or the content of `XDG_CACHE_HOME`) suffixed with 'huggingface'.r )r2r3destz--mixed_precision)r rrzWhether or not to use mixed precision training. Choose between FP16 and BF16 (bfloat16) training. BF16 training is only supported on Nvidia Ampere GPUs and PyTorch 1.10 or later.r )choicestyper3r2)func) add_parser descriptionr add_argumentrstr set_defaultsdefault_config_command)parserr rrr0default_command_parser_s   r@cCs(t|j|j}|rtd|dSdS)Nz"accelerate configuration saved at )r1rr r!)args config_filerrr0r>zsr>)pathlibrr$utilsrr config_argsrr config_utilsr r:r<boolr1r@r>rrrr0s  B