o hq @s<ddlmZddlmZmZmZmZmZmZddl m m Z ddl m Z ddlmZmZmZddlmZddlmZmZmZmZmZmZmZmZmZmZmZm Z m!Z!m"Z"m#Z#m$Z$m%Z%ddl&m'Z'd d gZ(d d gZ)gd Z*dgZ+dee deeee$e fffddZ,dee-de-fddZ.dedefddZ/dedefddZ0dedeee#eeffddZ1dedefddZ2de d e$dee eeed!fffd"d#Z3d$ee d%eeee"effddfd&d'Z4d(ee#d)fd*ee-de-fd+d,Z5ded-e-dee-fd.d/Z6ed0e!dee-fd1d2Z7ed0e!dee-fd3d4Z8dS)5) defaultdict)DictListOptionalSequenceTupleUnionN) translate)BindingDispatcherSignatureExpr)with_native_function) AnnotationArgument BackendIndexBackendMetadataBaseOperatorNameBaseTyBaseTypeDEFAULT_KERNEL_NAMESPACEDeviceCheckType DispatchKeyFunctionSchemaNativeFunctionNativeFunctionsGroup OperatorNameReturn SchemaKindVariant) concatMapz'adaptive_avg_pool3d_backward.grad_inputz _slow_conv2d_backward.grad_input_cummax_helper_cummin_helper) _assert_asyncz_assert_async.msg_dimI_dimV_has_same_storage_numel_linalg_check_errors_local_scalar_dense%_nested_tensor_from_mask_left_aligned_nnz_use_cudnn_ctc_lossz_use_cudnn_ctc_loss.Tensor#_validate_compressed_sparse_indicesallclose dense_dimequal is_coalesced is_pinned is_same_size is_set_toq_per_channel_axisq_scale q_zero_pointqscheme record_stream sparse_dimsym_constrain_rangesym_constrain_range_for_size_nested_tensor_storage_offsets'_chunk_grad_outputs_efficient_attention_fused_sdp_choice polygamma_native_functionsreturncCsDtt}|D]}||j}|j|vsJ|||j<q|SN)rdictfunc signaturekind)r?pre_grouped_native_functionsfdrIY/var/www/html/ai/venv/lib/python3.10/site-packages/torchgen/native_function_generation.pypre_group_native_functionsasrK overload_namecCs|sdS|dS)Nout_outrI)rLrIrIrJ&get_expected_out_variant_overload_nameosrOrCc Csp|tjks J|jjdusJt|jt |jj |j t d|jjjjd|jjjjdg|jdS)NrMnametypedefault annotationrQ argumentsreturns)rErinplacerVself_argrrQremove_inplace with_overloadrOrLremove_self_annotation with_out_argsrargumentrRrTrW)rCrIrIrJself_to_out_signaturexs"      r_cCsL|tjks Jt|\}}t|jt|jj|j |t |dSNrU) rEr functionalgenerate_out_args_from_schemarrQr[rOrLrVrDr]tuplerC new_returns new_out_argsrIrIrJfunctional_to_out_signatures   rgc stdd|jDr Jdd|jD}t|dksJtdd|jjfddd D}td d|jD}g}g}t|jD]A\}}|j r}t t|jd krTd nd ||jdt ||d d}| ||r|td|j|jd} | | qA| |qA||fS)Ncss"|] }|jduo |jjVqdSrA)rTis_write.0rrIrIrJ s z0generate_out_args_from_schema..cSsg|] }|jr|qSrIrRis_tensor_likerirIrIrJ sz1generate_out_args_from_schema..rcSs|jdurgS|jjSrA)rT alias_set)arIrIrJsz/generate_out_args_from_schema..csg|]}|vr|qSrIrI)rjxused_annotationsrIrJrosabcdefghijklmnopqrstuvwxyzcss |] }|jttjkVqdSrA)rRrrTensorrirIrIrJrlsrM!rP)rQrRrT)anyrWlenrrVflat_allall enumeraterRrnrrparseappendrrT) rCtensorlike_retsvalid_annotationsall_rets_are_tensorsrfreirknew_outnew_retrIrtrJrbs@       rbcCsL|tjks Jt|\}}t|jt|jj |j |t |dSr`) rErmutablerbrrQrZr[rOrLrVr]rcrdrIrIrJmutable_to_out_signatures    rrGk)rrc Csddlm}|tjkr;|jtjksJ|jjddtt |jj j j d|jj j j |jtj kd|jj jd}n7|tjkrn|jtjkrNt|j}n$|jtj kr\t|j}n|jtjkrjt|j}ntdtd |tjkr~|j n| |}|jr|d 7}tj|j t|dtd ii}d ht|jd dh@B}td'id|d|jdtj hdddddddddgdidddddddddddt!j"d|j#dtd |j$d!dd"dd#dd$dd%|d&|j%|fS)(Nr)cppT)keep_return_namesF)baserX dunder_methodfunctional_overload)rQrLz^We only bother generating out= functions from either inplace or mutable or functional variantszDWe currently only generate either functional or out= NativeFunctions_symint)kernel structured cpp_namespace generatednondeterministic_seeded view_copyrC!use_const_ref_for_mutable_tensorsvariantsrstructured_delegatestructured_inherits precomputedautogenufunc_inner_loopmanual_kernel_registrationmanual_cpp_binding python_modulecategory_override device_guard device_checkloccpp_no_default_args is_abstract&has_composite_implicit_autograd_kernel4has_composite_implicit_autograd_nested_tensor_kernel&has_composite_explicit_autograd_kernel5has_composite_explicit_autograd_non_functional_kerneltags namespacerI)& torchgen.apirrrarCrErD with_namerrrQrrrrLrMrXr_rrgAssertionErrorunambiguous_name has_symintrCompositeExplicitAutogradrrsetrrrrfunctionrNoCheckrrr)rGrrrC kernel_namebackend_metadatarrIrIrJgenerate_functions                rrsindicescCs8t|}|D]}tj|v}tj|v}tj|v}tj|v}|s(|s(|s(|rtdd|D}tdd|D} tdd|D} |sO| sO| rPq|rst |dkrst |tjj j t vrrtdt |tjj q|rt |tjj j tvrq|r|tjn|r|tjn |r|tjn|tj} | j tjkptdd| j jD} tdd| jD} | o| o| }|s| st | j j tvrt | j j tvrtd t | j d |rt| tj\}}||tj<t|||||s|s|rt| tj\}}||tj<t||||qdS) Ncs|]}|jVqdSrA)rrjrGrIrIrJrlz1add_generated_native_functions..csrrA) is_view_oprrIrIrJrlrcsrrA)rrrIrIrJrls rxzEFound an out= operator that we could not find any other variants of: css|]}|jVqdSrArmrirIrIrJrls  css|] }dt|vVqdS)rMN)str)rjop_namerIrIrJrlszBFound an operator that we could not generate an out= variant for: z. This type of operators don't have tensor-like return, making it difficult to generate a proper out= variant. If out= variant is not needed, please add the function name into FUNCTIONAL_OPS_THAT_CANNOT_GET_AN_OUT_VARIANT list.)rKvaluesrrarXrrMr}rzr{rrCrQ&OUT_OPS_THAT_DONT_GET_GROUPED_PROPERLYr*INPLACE_OPS_THAT_DONT_GET_GROUPED_PROPERLYrErWr*MUTABLE_OPS_THAT_CANNOT_GET_AN_OUT_VARIANT-FUNCTIONAL_OPS_THAT_CANNOT_GET_AN_OUT_VARIANTrr grow_indexr)rrrFrHhas_functional has_inplace has_mutablehas_out are_manual has_view_opsare_composite_implicitbase_fn base_fn_valid needs_outgets_out_variantfnmetadatarIrIrJadd_generated_native_functionsrs~                 rrets.namescCsbt|t|ks Jt|dkrdSt|dkr d|ddSdt|dd|dS) Nrrxzreturn ;(, );)r{ dispatcher returns_typecpp_typejoin)rrrIrIrJ return_strs   "rout_varcCsX|}g}t|jdk}t|D]\}}|dur)||r&d|d|dn|q|S)Nrx std::get<>())aliased_return_namesr{rWr~r)rCr aliased_retsnon_aliased_namesis_out_var_a_tuplerrkrIrIrJgather_nonaliased_inner_retssrgc Csd|jjvrdS|jdurd|jjvr|j}n|jdur&d|jjvr&|j}ntt|jjt|jj}t|j}g}g}g}tt |jjt |jD]@\}}|j dur|j j r| d|jd|jd| t|jdt j||jdd| |jdqM| t |qMdd d t||D} d } t|jjd krd| d nd} t|j| } t|jjj| |} d|}d|j||jjrdnddd|d| d|jjd| d| d S)Nrzauto z_clone = clone_arg(r_clone)binds)exprrRrcSg|]}|jqSrIrrjerIrIrJro-z3gen_composite_functional_kernel..outputrz = r rrQz {  z at::_ops::::call();  } )rarrXrrrrCr zipr jit_argumentsrTrhrrQr argument_typer^rr rVr{rWrrdefnrMrr)rtarget_fsig target_sigcontextclone_mutable_inputscloned_return_namesa_curra_tgtexprsout_name maybe_assigninner_return_namesret_strclone_mutable_inputs_strrIrIrJgen_composite_functional_kernelsb          " r c Csd|jjvrdSt|jj}t|jj}dddt||D}g}d}t|jjjjD],\}}t |jjj dkr@|nd|d|d }| d |j d|d |j d|d q1g} t|jj D]'\}} | durv| | qht |jjj dkr|nd|d|d }| |qhd |} d |j|jjj |jjrdnddd|d|jjj d|d| dt|jjj | d S)NrrcSrrIrrrIrIrJroPrz,gen_composite_out_kernel.. tmp_outputrxrrrz resize_out_helper(z); copy_arg(rrrrrz { auto z = at::_ops::rrrr)rMrr rCrarr rVr~r{rWrrQrrrrr) rrrr copy_outsrrout_argfunctional_return_namerret_name copy_outs_strrIrIrJgen_composite_out_kernelBs`      ( r)9 collectionsrtypingrrrrrrtorchgen.api.dispatcherapirtorchgen.api.translater torchgen.api.typesr r r torchgen.contextr torchgen.modelrrrrrrrrrrrrrrrrrtorchgen.utilsrrrrrrKrrOr_rgrbrrrrrr rrIrIrIrJsf   L  '  ! 5# l "w >