o h@sJUdZddlmZddlmZmZmZmZddlZgdZ ee e d<GdddZ e Z eejje fZd ejd efd d Zd ejd efd dZd ejd efddZed ejd edfddZeded edfddZded ejfddZdeded dfddZdejded dfddZded efd d!Zded ejjfd"d#ZdS)$zWUtilities for eliminating boilerplate code to handle abstract streams with CPU device. )contextmanager) GeneratorListUnioncastN) CPUStreamType new_streamcurrent_streamdefault_stream use_device use_stream get_device wait_stream record_streamis_cudaas_cuda__all__c@s eZdZdS)rN)__name__ __module__ __qualname__rr\/var/www/html/ai/venv/lib/python3.10/site-packages/torch/distributed/pipeline/sync/stream.pyrsrdevicereturncC|jdkrtStj|S)z3Creates a new stream for either CPU or CUDA device.cuda)type CPUStreamtorchrStreamrrrrr  rcCr)z@:func:`torch.cuda.current_stream` for either CPU or CUDA device.r)rrrrr r rrrr &r!r cCr)z@:func:`torch.cuda.default_stream` for either CPU or CUDA device.r)rrrrr r rrrr -r!r )NNNccsN|jdkr dVdStj| dVWddS1s wYdS)z8:func:`torch.cuda.device` for either CPU or CUDA device.rN)rrrrr rrrr 4s "r streamccsPt|s dVdStjt| dVWddS1s!wYdS)z8:func:`torch.cuda.stream` for either CPU or CUDA stream.N)rrrr"rr"rrrr ?s"r cCst|r t|jStdS)z(Gets the device from CPU or CUDA stream.cpu)rrrrr#rrrr Js  r sourcetargetcCs:t|rt|rt|t|dSt|dSdS)z:meth:`torch.cuda.Stream.wait_stream` for either CPU or CUDA stream. It makes the source stream wait until the target stream completes work queued. N)rrr synchronize)r%r&rrrrQs rtensorcCs4t|r|dg|}|t|dSdS)zA:meth:`torch.Tensor.record_stream` for either CPU or CUDA stream.rN)r new_emptyset__typed_storagerr)r(r"rrrr`s rcCs|tuS)zs(