o h@sddlZddlZddlZzddlZdZWn eydZYnwddlmZgdZ Gdddej j j Z ddZ ddd d d Zd d ZdS)NT)Any)autocast custom_fwd custom_bwdcsleZdZdZdejdfdedejdeffdd Zfdd Z d e d e d e ffd d Z fddZ Z S)rz See :class:`torch.autocast`. ``torch.cuda.amp.autocast(args...)`` is equivalent to ``torch.autocast("cuda", args...)`` Tenableddtype cache_enabledcs8tjr||_d|_||_dStjd|||ddS)Ncuda)rrr)torch _jit_internal is_scripting_enableddevice fast_dtypesuper__init__)selfrrr __class__R/var/www/html/ai/venv/lib/python3.10/site-packages/torch/cuda/amp/autocast_mode.pyrs  zautocast.__init__cstjr|StSN)r r r r __enter__)rrrrr&s  zautocast.__enter__exc_typeexc_valexc_tbcstjrdSt|||Sr)r r r r__exit__)rrrrrrrr,s zautocast.__exit__cstjr|St|Sr)r r r r__call__)rfuncrrrr1s  zautocast.__call__)__name__ __module__ __qualname____doc__r float16boolrrrrrr __classcell__rrrrrs rcst|tjr|o|jo|jtju}|r|S|St|tt fr%|St r/t|t j r/|St|t jjrAfdd|DSt|t jjr`fdd|D}t|ttfr^t||S|S|S)Ncs"i|] \}}t|t|qSr_cast).0kvrrr Fs"z_cast..c3s|]}t|VqdSrr&)r(r*r+rr Hsz_cast..) isinstancer Tensoris_floating_pointis_cudarfloat64tostrbytes HAS_NUMPYnpndarray collectionsabcMappingitemsIterablelisttupletype)valuer is_eligibleiterablerr+rr'9s&   r' cast_inputscs2dur tjtdStfdd}|S)a> Helper decorator for ``forward`` methods of custom autograd functions (subclasses of :class:`torch.autograd.Function`). See the :ref:`example page` for more detail. Args: cast_inputs (:class:`torch.dtype` or None, optional, default=None): If not ``None``, when ``forward`` runs in an autocast-enabled region, casts incoming floating-point CUDA Tensors to the target dtype (non-floating-point Tensors are not affected), then executes ``forward`` with autocast disabled. If ``None``, ``forward``'s internal ops execute with the current autocast state. .. note:: If the decorated ``forward`` is called outside an autocast-enabled region, :func:`custom_fwd` is a no-op and ``cast_inputs`` has no effect. NrDcst|d_durt|d_|i|St}d|d_|rHtddt|it|WdS1sAwYdS|i|S)NrF)r)r get_autocast_gpu_dtype_dtypeis_autocast_enabled_fwd_used_autocastrr')argskwargsautocast_contextrEfwdrr decorate_fwdls  $z custom_fwd..decorate_fwd) functoolspartialrwraps)rNrErOrrMrrYs rcstfdd}|S)a Helper decorator for backward methods of custom autograd functions (subclasses of :class:`torch.autograd.Function`). Ensures that ``backward`` executes with the same autocast state as ``forward``. See the :ref:`example page` for more detail. csJt|dj|djd|i|WdS1swYdS)Nr)rr)rrIrG)rJrKbwdrr decorate_bwds $z custom_bwd..decorate_bwd)rPrR)rTrUrrSrrsrr)r9rPr numpyr7r6ModuleNotFoundErrortypingr__all__amp autocast_moderr'rrrrrrs  ( (