o h)'@s|UddlZddlZddlZddlZddlZddlmZmZmZm Z m Z ddZ ddZ ddZ d d Zd'd d ZddZddddZejje ejje eje ejjjeejjeejeejeiZeeefed<ddZGdddejjZGdddeZ Gddde Z!ddZ"Gdddejj#Z$  d(d e ejj%ed!effd"e ee&ej'fd#e ee&efd$ejj(fd%d&Z)dS))N)AnyCallableDictOptionalUnioncCs$tjg|j|jjdRddiS)Ndevicemeta)torchemptyshapeweightselfinputrW/var/www/html/ai/venv/lib/python3.10/site-packages/torch/fx/experimental/meta_tracer.pyembedding_override s$rcC|SNrrrrrnn_layernorm_override rcCs|Srr)xrrrtorch_relu_overriderrcCrrr)rrrrrtorch_nn_relu_overriderrFcCs|rJd|S)Nz.wrapper..check_has_proxy call_function)r r&node map_aggregatetracer create_proxy)argskwargsr,targetr*rwrapper3s z(gen_constructor_wrapper..wrapper) functoolswraps)r5r6rr4rgen_constructor_wrapper2sr9c@sReZdZddZdddZddZedd Zed d Zed d Z ddZ dS) MetaProxycCs ||_dSr) _tensor_meta)r tensor_metarrrinstall_tensor_metaE zMetaProxy.install_tensor_metaNcCsPt|dr|jdur|jj|r|gSgS|jdd|r#||fiS|fiS)Nr; call_methodsize)hasattrr;r@r0r1)rdimrrrr@Hs$zMetaProxy.sizecCs2t|dr|jdur|jS|jdd|fiS)Nr;r?rB)rAr;rBr0r1rrrrrBMs z MetaProxy.dimcC4t|dr|jdur|jjS|jdtj|dfiS)Nr;r-r )rAr;r r0r1builtinsgetattrrCrrrr RzMetaProxy.shapecCrD)Nr;r-dtype)rAr;rHr0r1rErFrCrrrrHXrGzMetaProxy.dtypecCs t|dS)Nr)MetaDeviceAttributerCrrrr^s zMetaProxy.devicecCs|dkr ||St||S)Nr;)__getattribute__ MetaAttribute)rkrrr __getattr__ds  zMetaProxy.__getattr__r) __name__ __module__ __qualname__r=r@rBpropertyr rHrrMrrrrr:Ds     r:c@s.eZdZdefddZeddZddZdS) rKattrcCs||_||_|j|_d|_dSr)rootrRr0_node)rrSrRrrr__init__ls zMetaAttribute.__init__cCs.|jdur|jdt|j|jfij|_|jS)Nr-)rTr0r1rFrSrRr.rCrrrr.ss zMetaAttribute.nodecOs|jd|j|jf||S)Nr?)r0r1rRrS)rr2r3rrr__call__{szMetaAttribute.__call__N)rNrOrPstrrUrQr.rVrrrrrKks   rKc@s eZdZdS)rIN)rNrOrPrrrrrI~srIcCsTt|trdSt|tjjr(t|tsJdt|t|ds%Jd|jS|S)Nr zExpected MetaProxy but got r;z*MetaProxy does not have an associated meta) r%rIr r&r'r:typerAr;r(rrrproxys_to_metass rYcseZdZUdZeed<gdZdfdd ZfddZfd d Z d e j j d e fd dZd e j j d e ffdd ZddZddee e jfffdd ZZS) MetaTracerTallow_insert_stateless_mods)arangezerosones full_likeeyeNc st|||||||}|dkr||jvr||j||S||jvr,d|vr,d|d<ztjj|t } tjj|t } |dkrOt ||} | | i| } n|dkrdt | d|| ddi| } np|dkrt |d soJd |_z)|j|} t| }|t vrt || g| Ri| } n|j| i| } Wd |_n8d |_w|d krd |_z%|j}|d }|D]}t ||}qt|tjsJ|jdd} Wd |_nd |_w|WSt|tjjsJd|| W|Sty}ztd|d|d|WYd}~|Sd}~ww)N placeholderrr r-r?r call_module orig_forwardTFget_attr.rz!Dont support composite output yetzCould not compute metadata for z target z: )superr1 meta_argsr=orig_fnsr r&r.r/rYr$getrFrA_disable_module_getattrrS get_submodulerXrdsplitr%Tensorrr' Exceptionwarningswarn)rkindr5r2r3name type_exprproxy_factory_fnrv args_metas kwargs_metas meta_targetmeta_outmodmod_typeattr_itratomsatome __class__rrr1sZ  "    &zMetaTracer.create_proxycs t|ddr|St|||S)NrkF)rFrg)rrRattr_valparameter_proxy_cacherrrrFs zMetaTracer.getattrcs||_t||||Sr)rdrgrc)rmforwardr2r3rrrrcszMetaTracer.call_moduler{returncCs^d}|jj}|d|}t|j|r&|d|}|d7}t|j|s|j|||S)zb Helper method which tries to insert a module that was not declared as submodule. r_rb)rrNlowerrArS add_module)rr{idxmod_namepathrrr_insert_module_as_submodules   z&MetaTracer._insert_module_as_submodulec sxzt|WSty;}z(|jr6tt|dkr6tt|dkr6||}||_ |WYd}~Sd}~ww)Nr) rgpath_of_module NameErrorr[lenlist parametersbuffersr prev_module)rr{rrrrrrs. zMetaTracer.path_of_modulecCs t||Sr)r:)rr.rrrr+r>zMetaTracer.proxyrhc st|tsJ||_dd|jD|_t|_|jD]\}\}}tt |||j |qz!t ||}d|i|_ |W|jD] \}\}}tt ||qCS|jD] \}\}}tt ||qVw)NcSsi|] }|ttt|qSr)r9rFr ).0r5rrr sz$MetaTracer.trace..rh)r%dictrh_TORCH_METHODS_TO_PATCHpatched_torch_methodssetriitemssetattrr addrgtrace_tracer_extras) rrSrh concrete_argsrsr6origgraphrrrrrs$  zMetaTracer.trace)NNNr)rNrOrPr[bool__annotations__rr1rFrcr nnModulerWrrr+rrnr __classcell__rrrrrZs  ;  &rZrS.rhrrcCsFt}||||}t|tjjr|jjn|j}tj |j ||}|Sr) rZrr%r rrrrNr& GraphModulerS)rSrhrr0rrsgmrrrsymbolic_traces r)F)NN)*r torch.fxrpr7rEtypingrrrrrrrrrrr!r#r Embedding LayerNormrelu functionalReLUwhereabsr$rr9r&r'r:rKrIrYTracerrZrrWrnrrrrrrsH    ' |