o h@sddlmZddlmZddlmZmZddlZddlm m Z ddl m Z dZgdZdd Zd d Zd d Zd!ddZddZd!ddZGdddZGdddeeZd"dejdedejfddZd"dejdedejfdd ZdS)#)update_wrapper)Number)AnyDictNis_tensor_likegox?) broadcast_alllogits_to_probs clamp_probsprobs_to_logits lazy_propertytril_matrix_to_vecvec_to_tril_matrixcstdd|Ds tdtdd|Ds@ttd|D]}t|tjr1t|j|jdnqfdd|D}tj |Stj |S) a Given a list of values (possibly containing numbers), returns a list where each value is broadcasted based on the following rules: - `torch.*Tensor` instances are broadcasted as per :ref:`_broadcasting-semantics`. - numbers.Number instances (scalars) are upcast to tensors having the same size and type as the first tensor passed to `values`. If all the values are scalars, then they are upcasted to scalar Tensors. Args: values (list of `numbers.Number`, `torch.*Tensor` or objects implementing __torch_function__) Raises: ValueError: if any of the values is not a `numbers.Number` instance, a `torch.*Tensor` instance, or an instance implementing __torch_function__ css"|] }t|p t|tVqdSN)r isinstancer.0vrO/var/www/html/ai/venv/lib/python3.10/site-packages/torch/distributions/utils.py &s z broadcast_all..zqInput arguments must all be instances of numbers.Number, torch.Tensor or objects implementing __torch_function__.css|]}t|VqdSrrrrrrr+s)dtyperdevicecs*g|]}t|r |ntj|fiqSr)rtorchtensorroptionsrr 1sz!broadcast_all..) all ValueErrordictrget_default_dtyperTensorrrbroadcast_tensors)valuesvalue new_valuesrrrrs     rcCsBtjrttj|||dtj|||dStj|||dS)Nr)r_C_get_tracing_statenormalzerosonesemptynormal_)shaperrrrr_standard_normal8s r0cCs0|dkr|S|jd| d}||dS)z Sum out ``dim`` many rightmost dimensions of a given tensor. Args: value (Tensor): A tensor of ``.dim()`` at least ``dim``. dim (int): The number of rightmost dims to sum out. rN)r1)r/reshapesum)r&dimrequired_shaperrr_sum_rightmostBsr6FcCs|rt|Stj|ddS)a Converts a tensor of logits into probabilities. Note that for the binary case, each value denotes log odds, whereas for the multi-dimensional case, the values along the last dimension denote the log probabilities (possibly unnormalized) of the events. r1)r4)rsigmoidFsoftmax)logits is_binaryrrrr Ps r cCs t|jj}|j|d|dS)N)minmax)rfinforepsclamp)probsr@rrrr \sr cCs,t|}|rt|t| St|S)a$ Converts a tensor of probabilities into logits. For the binary case, this denotes the probability of occurrence of the event indexed by `1`. For the multi-dimensional case, the values along the last dimension denote the probabilities of occurrence of each of the events. )r rloglog1p)rBr; ps_clampedrrrr as r c@s"eZdZdZddZdddZdS)r z Used as a decorator for lazy loading of class attributes. This uses a non-data descriptor that calls the wrapped method to compute the property on first call; thereafter replacing the wrapped method into an instance attribute. cCs||_t||dSr)wrappedrselfrFrrr__init__vszlazy_property.__init__NcCsX|dur t|jSt ||}Wdn1swYt||jj||Sr)_lazy_property_and_propertyrFr enable_gradsetattr__name__)rHinstanceobj_typer&rrr__get__zs   zlazy_property.__get__r)rM __module__ __qualname____doc__rIrPrrrrr nsr c@seZdZdZddZdS)rJzWe want lazy properties to look like multiple things. * property when Sphinx autodoc looks * lazy_property when Distribution validate_args looks cCst||dSr)propertyrIrGrrrrIsz$_lazy_property_and_property.__init__N)rMrQrRrSrIrrrrrJs rJmatdiagreturncCs|jd}tjs$|| ks||kr$td|d| d|ddtj||jd}||dd|dk}|d|f}|S) z Convert a `D x D` matrix or a batch of matrices into a (batched) vector which comprises of lower triangular elements from the matrix in row order. r1zdiag (z) provided is outside [z, r<z].r.)r/rr(r)r arangerview)rUrVnrY tril_maskvecrrrr s " r r]cCsdd| dd|dd|jddt||ddd}t|jj}tjsEt|||krEt d|jddd t |tj rQt| nt|}| |jd dt||f}tj||jd }||dd|dk}||d |f<|S) z Convert a vector or a batch of vectors into a batched `D x D` lower triangular matrix containing elements from the vector in row order. r<r1g?zThe size of last dimension is z which cannot be expressed as z3the lower triangular part of a square D x D matrix.NrX.)r/absrr?rr@r(r)roundr rr#item new_zerosSizerYrrZ)r]rVr[r@rUrYr\rrrrs$ 4 " r)F)r) functoolsrnumbersrtypingrrrtorch.nn.functionalnn functionalr8torch.overridesreuler_constant__all__rr0r6r r r r rTrJr#intr rrrrrs$   "