o h4@s2dZddlZddlZddlZddlZddlZddlmZddlm Z ddl m Z m Z m Z mZejdkr:ddl mZnddlmZddlmZdd lmZed Zed Zed ZejZejd dGdddZededefddZde dee effddZ!de dede fddZ"de dee e effddZ#de de de fddZ$de dee e effd d!Z%de dee e effd"d#Z&de d$e ede fd%d&Z'd'ej(deej)fd(d)Z*d*e ej(de e fd+d,Z+ejd dGd-d.d.Z,Gd/d0d0ej-Z.ejd dGd1d2d2Z/Gd3d4d4ej-Z0dS)5z)Functions to process IPython magics with.N) lru_cache) find_spec)DictListOptionalTuple) ) TypeGuard)out)NothingChanged)zget_ipython().run_cell_magiczget_ipython().systemzget_ipython().getoutputzget_ipython().run_line_magic) ENDMARKERNLNEWLINECOMMENTDEDENTUNIMPORTANT_WS ESCAPED_NL)captureprunpypypythonpython3timetimeitT)frozenc@seZdZUeed<eed<dS) ReplacementmasksrcN)__name__ __module__ __qualname__str__annotations__r$r$O/var/www/html/ai/venv/lib/python3.10/site-packages/black/handle_ipynb_magics.pyr5  rwarnreturncCs0tdduo tddu}|s|rd}t||S)N tokenize_rtIPythonz}Skipping .ipynb files as Jupyter dependencies are not installed. You can fix this by running ``pip install "black[jupyter]"``)rr )r' installedmsgr$r$r%"jupyter_dependencies_are_installed;sr-rcCstddlm}m}m}||}d}||D]\}}|jtvrq|jdkr-|jdkr-||=d}|s4|dfS||dfS)aRemove trailing semicolon from Jupyter notebook cell. For example, fig, ax = plt.subplots() ax.plot(x_data, y_data); # plot data would become fig, ax = plt.subplots() ax.plot(x_data, y_data) # plot data Mirrors the logic in `quiet` from `IPython.core.displayhook`, but uses ``tokenize_rt`` so that round-tripping works fine. rreversed_enumerate src_to_tokens tokens_to_srcFOP;T)r)r/r0r1nameTOKENS_TO_IGNOREr)rr/r0r1tokenstrailing_semicolonidxtokenr$r$r%remove_trailing_semicolonIs  r:has_trailing_semicoloncCsp|s|Sddlm}m}m}||}||D]\}}|jtvr q|j|jdd||<ntddt ||S)zPut trailing semicolon back if cell originally had it. Mirrors the logic in `quiet` from `IPython.core.displayhook`, but uses ``tokenize_rt`` so that round-tripping works fine. rr.r3)rz{INTERNAL ERROR: Was not able to reinstate trailing semicolon. Please report a bug on https://github.com/psf/black/issues. N) r)r/r0r1r4r5_replacerAssertionErrorr")rr;r/r0r1r6r8r9r$r$r%put_trailing_semicolon_backis  r>cCsg}z t|W||fStyYnwddlm}|}||}t|\}}||7}||}t|\}}t| t| krGt ||7}||fS)zMask IPython magics so content becomes parseable Python code. For example, %matplotlib inline 'foo' becomes "25716f358c32750e" 'foo' The replacements are returned, along with the transformed code. r)TransformerManager) astparse SyntaxErrorIPython.core.inputtransformer2r?transform_cellreplace_cell_magicsreplace_magicslen splitlinesr )r replacementsr?transformer_manager transformedcell_magic_replacementsmagic_replacementsr$r$r% mask_cells$       rNmagiccCs|sJtt|ddd}t|}d}||vr1t|}|d7}|dkr-td|d||vst|dt|kr@|d}d|dS) aDReturn randomly generated token to mask IPython magic with. For example, if 'magic' was `%matplotlib inline`, then a possible token to mask it with would be `"43fdd17f7e5ddc83"`. The token will be the same length as the magic, and we make sure that it was not already present anywhere else in the cell. rdzINTERNAL ERROR: Black was not able to replace IPython magic. Please report a bug on https://github.com/psf/black/issues. The magic might be helpful: N.")maxrG TOKEN_HEXr=)rrOnbytesr9counterr$r$r% get_tokens&  rYcCsjg}t|}t}|||jdur||fS|jj}t||}|t||d|d|jj |fS)aNReplace cell magic with token. Note that 'src' will already have been processed by IPython's TransformerManager().transform_cell. Example, get_ipython().run_cell_magic('t', '-n1', 'ls =!ls\n') becomes "a794." ls =!ls The replacement, along with the transformed code, is returned. Nrr ) r@rACellMagicFindervisit cell_magicheaderrYappendrbody)rrItreecell_magic_finderr_rr$r$r%rEs    rEc Csg}t}|t|g}t|ddD]B\}}||jvrT|j|}t|dkr3td|d|dj |dj }}t ||} | t | |d|d|| }| |qd||fS) aoReplace magics within body of cell. Note that 'src' will already have been processed by IPython's TransformerManager().transform_cell. Example, this get_ipython().run_line_magic('matplotlib', 'inline') 'foo' becomes "5e67db56d490fd39" 'foo' The replacement, along with the transformed code, are returned. rQ)startz#Expecting one magic per line, got: z< Please report a bug on https://github.com/psf/black/issues.rrZNr[) MagicFinderr]r@rA enumeraterHmagicsrGr= col_offsetrOrYr`rjoin) rrI magic_findernew_srcsilineoffsets_and_magicsrhrOrr$r$r%rFs&      rFrIcCs|D] }||j|j}q|S)zRemove replacements from cell. For example "9b20" foo = bar becomes %%time foo = bar )replacerr)rrI replacementr$r$r% unmask_cell s rqnodecCs8t|tjot|jtjot|jjtjo|jjjdkS)zCheck if attribute is IPython magic. Note that the source of the abstract syntax tree will already have been processed by IPython's TransformerManager().transform_cell. get_ipython) isinstancer@ AttributevalueCallfuncNameid)rrr$r$r%_is_ipython_magics   r{argscCs.g}|D]}t|tjsJ||jq|SN)rtr@Strr`s)r|str_argsargr$r$r% _get_str_args,s rc@s<eZdZUeed<eeed<eed<edefddZdS) CellMagicr4paramsrar(cCs&|jr d|jd|jSd|jS)Nz%% )rr4selfr$r$r%r_:s zCellMagic.headerN)rr r!r"r#rpropertyr_r$r$r$r%r4s  rc@s<eZdZdZd deeddfddZdejddfdd Z dS) r\agFind cell magics. Note that the source of the abstract syntax tree will already have been processed by IPython's TransformerManager().transform_cell. For example, %%time foo() would have been transformed to get_ipython().run_cell_magic('time', '', 'foo()\n') and we look for instances of the latter. Nr^r(cCs ||_dSr})r^)rr^r$r$r%__init__Us zCellMagicFinder.__init__rrcCs^t|jtjr(t|jjr(|jjjdkr(t|jj}t |d|d|dd|_ | |dS)z)Find cell magic, extract header and body.run_cell_magicrrQrP)r4rraN) rtrvr@rwr{rxattrrr|rr^ generic_visit)rrrr|r$r$r% visit_ExprXs   zCellMagicFinder.visit_Exprr}) rr r!__doc__rrrr@Exprrr$r$r$r%r\Bsr\c@seZdZUeed<eed<dS)OffsetAndMagicrhrON)rr r!intr#r"r$r$r$r%rdr&rc@sBeZdZdZd ddZdejddfddZdejddfd d Z dS) reaVisit cell to look for get_ipython calls. Note that the source of the abstract syntax tree will already have been processed by IPython's TransformerManager().transform_cell. For example, %matplotlib inline would have been transformed to get_ipython().run_line_magic('matplotlib', 'inline') and we look for instances of the latter (and likewise for other types of magics). r(NcCstt|_dSr}) collections defaultdictlistrgrr$r$r%rszMagicFinder.__init__rrcCst|jtjrYt|jjrYt|jj}|jjjdkr"d|d}n(|jjjdkr>d|d}|dr=|d|d7}n t d|jjjd d |j |jj  t |jj|||d S) a{Look for system assign magics. For example, black_version = !black --version env = %env var would have been (respectively) transformed to black_version = get_ipython().getoutput('black --version') env = get_ipython().run_line_magic('env', 'var') and we look for instances of any of the latter. getoutput!rrun_line_magic%rQrzUnexpected IPython magic zC found. Please report a bug on https://github.com/psf/black/issues.N)rtrvr@rwr{rxrr|rr=rglinenor`rrhrrrrr|rr$r$r% visit_Assigns$  zMagicFinder.visit_AssigncCst|jtjrzt|jjrzt|jj}|jjjdkrK|ddkr(d|d}nC|ddkr6d|d}n5d|d}|drJ|d |d7}n |jjjd krZd |d}n|jjjd krid |d}nt |j |jj  t |jj|||dS)aLook for magics in body of cell. For examples, !ls !!ls ?ls ??ls would (respectively) get transformed to get_ipython().system('ls') get_ipython().getoutput('ls') get_ipython().run_line_magic('pinfo', 'ls') get_ipython().run_line_magic('pinfo2', 'ls') and we look for instances of any of the latter. rrpinfo?rQpinfo2z??rrsystemrrz!!N)rtrvr@rwr{rxrr|rr rgrr`rrhrrr$r$r%rs(    zMagicFinder.visit_Expr)r(N) rr r!rrr@Assignrrrr$r$r$r%rels  !re)1rr@r dataclassessecretssys functoolsrimportlib.utilrtypingrrrr version_infor typing_extensions black.outputr black.reportr frozensetTRANSFORMED_MAGICSr5PYTHON_CELL_MAGICS token_hexrV dataclassrboolr-r"r:r>rNrYrErFrqexprrur{rr NodeVisitorr\rrer$r$r$r%sV          ()  "