7 fEddlZddlZddlZddlZddlZddlZddlmZddlmZm Z m Z ddl m Z m Z mZmZmZmZmZmZmZmZmZddlmZerTddlmZGdd e ZeeefZejdd kreeeeeefeeefefZ nej Z d Z!Gd d ej"d dZ#ejdkrej$Z%n GddZ%d7dZ&d7dZ'ejdkrdZ(ndZ(dZ)dZ*d8dZ+deej,DZ-d8dZ.deej,DZ/deej,DhdzZ0d Z1d!Z2d"Z3d#Z4d$Z5d%Z6d&Z7e8Z9d'Z:d8d(Z;d)Z<Gd*d+e8Z=ejdd krd,Z>nd-Z>d.Z?d/Z@ejdd d0kr dd1lAmBZBeBd2d3ZCd4ZDdSd5ZCd6ZDdS)9N)ABCMeta)ModuleexprAST) CallableDictIterableIteratorListOptionalTupleUnioncastAny TYPE_CHECKING) iteritems)NodeNGceZdZdZdZdZdS) EnhancedASTNr)__name__ __module__ __qualname__ first_token last_tokenlinenoD/var/www/equiseq/venv/lib/python3.11/site-packages/asttokens/util.pyrr!sKJ FFFrrcptj|dt|dS)zRReturns a human-friendly representation of a token with the given type and string.:u)tokentok_namereprlstrip)tok_typestrings r token_reprr*/s3N8,,,d6ll.A.A#.F.F.F GGrceZdZdZdZdS)Tokena TokenInfo is an 8-tuple containing the same 5 fields as the tokens produced by the tokenize module, and 3 additional ones useful for this module: - [0] .type Token type (see token.py) - [1] .string Token (a string) - [2] .start Starting (row, column) indices of the token (a 2-tuple of ints) - [3] .end Ending (row, column) indices of the token (a 2-tuple of ints) - [4] .line Original line (string) - [5] .index Index of the token in the list of tokens that it belongs to. - [6] .startpos Starting character offset into the input text. - [7] .endpos Ending character offset into the input text. c6t|j|jSN)r*typer)selfs r__str__z Token.__str__Ds di - --rN)rrr__doc__r2rrrr,r,6s-  .....rr,z0type string start end line index startpos endpos)c"eZdZeZdS) AstConstantN)rrrobjectvaluerrrr7r7Ls FHHEEErr7c6|j|ko|dup |j|kS)zVReturns true if token is of the given type and, if a string is given, has that string.N)r/r)r$r(tok_strs r match_tokenr=Ps& x  PW_%O 8OPrc t|||sOtdt||dt|d|jdd|jddzdS)z Verifies that the given token is of the expected type. If tok_str is given, the token string is verified too. If the token doesn't match, raises an informative ValueError. zExpected token z, got z on line rz col rN)r= ValueErrorr*strstartr;s r expect_tokenrBVsw UHg . .+ *7####SZZZZ k!nnnek!nq((* + ++++r)r4cL|tjtjtjfvSzW These are considered non-coding tokens, as they don't affect the syntax tree. )r$NLCOMMENTENCODING token_types ris_non_coding_tokenrKds %(EM5>B BBrc"|tjkSrE)r$N_TOKENSrIs rrKrKks  ''rctjttgtft j|jS)z; Generates standard library tokens for the given code. )tokenizegenerate_tokensrrr@ioStringIOreadline)texts rrPrPss5  !$xC'8"+d:K:K:T"U"U V VVrc>t|drtntS)z Returns a function which yields all direct children of a AST node, skipping children that are singleton nodes. The function depends on whether ``node`` is from ``ast`` or from the ``astroid`` module. get_children)hasattriter_children_astroiditer_children_astnodes riter_children_funcr\~s #*$"?"? V  EVVrFcP|st|rgS|Sr.) is_joined_strrV)r[include_joined_strs rrXrXs0  d 3 3 I    rc h|]c\}}t|tt|tjtjtjtjtjfa|dSr) isinstancer/ issubclassast expr_contextboolopoperatorunaryopcmpop.0ncs r rmskcccDAqz!T7J7JcS-sz3<VYV_`aacacccrc#K|st|rdSt|tjr,t |j|jD]\}}||V|VdStj|D]}|jtvr|VdSr.) r^rarcrzipkeysvaluesiter_child_nodes __class__ SINGLETONS)r[r_keyr9childs rrYrYs  d 3 3  Fch DIt{33 e  kkkk F#D))e j(( kkk rcvh|]6\}}t|tt|tj4|7Sr)rar/rbrcstmtris rrmrmsVHHH$!Q!!T**H/9!SX/F/FHAHHHrcvh|]6\}}t|tt|tj4|7Sr)rar/rbrcrris rrmrmsVHHH41a!!T**H/9!SX/F/FHQHHHr>ConstDelAttrDelName AssignAttr AssignNamec(|jjtvS)z+Returns whether node is an expression node.)rsrexpr_class_namesrZs ris_exprr  $4 44rc(|jjtvS)z)Returns whether node is a statement node.)rsrstmt_class_namesrZs ris_stmtrrrc"|jjdkS)z&Returns whether node is a module node.rrsrrZs r is_modulers  H ,,rc"|jjdkS)zFReturns whether node is a JoinedStr node, used to represent f-strings. JoinedStrrrZs rr^r^s  K //rc"|jjdkS)z2Returns whether node is a starred expression node.StarredrrZs r is_starredrs  I --rc |jjdvpN|jjdko>tttt t j|jS)z?Returns whether node represents a slice, e.g. `1:2` in `x[1:2]`)SliceExtSlicer ) rsranymapis_slicerrcr eltsrZs rrrsR  n!66 . !W , =#hSY 5 5 :;;<< rc|jjdko:t|tj o|j|jcxuo |jcxuoduncS)Nr)rsrrarcrloweruppersteprZs ris_empty_astroid_slicerse n(8sw'' '8 * 7 7 7 7di 7 7 7 74 7 7 7 7rc|sd}t|}t}d}|dtfg}|r|\}}} | tur~||vsJ|||||\} } |||| ft |} ||D] } || | | tf!n+|||ttt| }||S)a5 Scans the tree under the node depth-first using an explicit stack. It avoids implicit recursion via the function call stack to avoid hitting 'maximum recursion depth exceeded' error. It calls ``previsit()`` and ``postvisit()`` as follows: * ``previsit(node, par_value)`` - should return ``(par_value, value)`` ``par_value`` is as returned from ``previsit()`` of the parent. * ``postvisit(node, par_value, value)`` - should return ``value`` ``par_value`` is as returned from ``previsit()`` of the parent, and ``value`` is as returned from ``previsit()`` of this node itself. The return ``value`` is ignored except the one for the root node, which is returned from the overall ``visit_tree()`` call. For the initial node, ``par_value`` is None. ``postvisit`` may be None. cdSr.r)r[pvaluer9s rzvisit_tree..sDrN) r\set _PREVISITpopaddappendleninsertrr r,)r[previsit postvisit iter_childrendoneretstackcurrent par_valuer9r post_valueinsrks r visit_treers6$ 100I$T**- $ # $ " #% H % GY  D  hhw#8GY77fj llGY 3444 JJc}W%%22! S1fi011112 Igy$x*F*F G Gc H *rc#$Kt|}t}|g}|rk|}||vsJ|||Vt |}|||D]}||||idSdS)a1 Recursively yield all descendant nodes in the tree starting at ``node`` (including ``node`` itself), using depth-first pre-order traversal (yieling parents before their children). This is similar to ``ast.walk()``, but with a different order, and it works for both ``ast`` and ``astroid`` trees. Also, as ``iter_children()``, it skips singleton nodes generated by ``ast``. By default, ``JoinedStr`` (f-string) nodes and their contents are skipped because they previously couldn't be handled. Set ``include_joined_str`` to True to include them. N)r\rrrrr)r[r_rrrrrrls rwalkrs%T**- $ &% iikkG $    HHW MMM e**C ]7$6 7 7 ll3      rcd}g}t|D]:\}}}|||||||};|||dd|S)ah Replaces multiple slices of text with new values. This is a convenience method for making code modifications of ranges e.g. as identified by ``ASTTokens.get_text_range(node)``. Replacements is an iterable of ``(start, end, new_text)`` tuples. For example, ``replace("this is a test", [(0, 4, "X"), (8, 9, "THE")])`` produces ``"X is THE test"``. rN)sortedrjoin)rT replacementsppartsrAendnew_texts rreplacer1s! % &| 4 4  uc8 LLag LL AA,,tABBx rceZdZdZdZdZdS) NodeMethodsz[ Helper to get `visit_{node_type}` methods given a node's class and cache the results. ci|_dSr.)_cacher0s r__init__zNodeMethods.__init__Is DKKKrc|j|}|sz!combine_tokens..}s,@@3sx8..@@@@@@rch|] }|j Sr)liners rrmz!combine_tokens..}sHcHcHcVYHcHcHcrrrc3$K|] }|jV dSr.)r))rjts rrz!combine_tokens..s$//Aqx//////rrr)r/r)rArr) rrrO TokenInforrrArr)rs rrr{s @@%@@@ @ @CHcHc]bHcHcHcDdDdhiDiDi l ]ww///////Ahn "IM 1X]  rcxdt||D}|rt|dS|S)zq If the given AST node contains multiple statements, return the last one. Otherwise, just return the node. c\g|])}t|st|jdv'|*S)) excepthandler ExceptHandler match_case MatchCase TryExcept TryFinally)rr/r)rjrvs r zlast_stmt..sQ   u~~ e-2 rr)r\ last_stmt)r[ child_stmtss rrrsT  /)$//55   +& [_ % %% +r)r4) lru_cache)maxsizecdtj}dtj|D}d|D}tt |t|k}t fd|D}|o|S)a The positions attached to nodes inside f-string FormattedValues have some bugs that were fixed in Python 3.9.7 in https://github.com/python/cpython/pull/27729. This checks for those bugs more concretely without relying on the Python version. Specifically this checks: - Values with a format spec or conversion - Repeated (i.e. identical-looking) expressions - f-strings implicitly concatenated over multiple lines. - Multiline, triple-quoted f-strings. z( f"a {b}{b} c {d!r} e {f:g} h {i:{j}} k {l:{m:n}}" f"a {b}{b} c {d!r} e {f:g} h {i:{j}} k {l:{m:n}}" f"{x + y + z} {x} {y} {z} {z} {z!a} {z:z}" f''' {s} {t} {u} {v} ''' )cFg|]}t|tj|Sr)rarcNamerjr[s rrz*fstring_positions_work..s)PPP4Zch5O5OP$PPPrc*g|]}|j|jfSr)r col_offsetrs rrz*fstring_positions_work..s!LLLt{DO4LLLrc3TK|]"}tj||jkV#dSr.)rcget_source_segmentid)rjr[sources rrz)fstring_positions_work..sK""  VT**dg5""""""r)rcparserrrall)tree name_nodesname_positionspositions_are_uniquecorrect_source_segmentsrs @rfstring_positions_workrs F 9V  DPP38D>>PPPJLLLLLNs>2233s>7J7JJ!""""""" ;$;;rctjdkrdSt|dD]}t|tjs|jD]}t|ddt|tjrSts(t|j D]}t|dd|j rt|j dddS)z Add a special attribute `_broken_positions` to nodes inside f-strings if the lineno/col_offset cannot be trusted. )r4 NT)r__broken_positions) sys version_inforrarcrrqsetattrFormattedValuerr9 format_spec)r joinedstrpartrvs rannotate_fstring_nodesr s  7"" f$4888AA  3= 1 1" A A$)4000 dC. / / A')) 8dj)) 8 8e0$7777   A D$&94 @ @ @ AAArcdS)NFrrrrrrs 5rcdSr.r)_trees rr r sDrr.)F)Erc collectionsrQrr$rOabcrrrrtypingrrr r r r r rrrrsixrastroid_compatrrAstNoderintr@rr* namedtupler,Constantr7r=rBrKrPr\rX__dict__rtrYrrrrrr^rrrr8rrrrrrrr functoolsrrr rrrrs  !!!!!!!!!!mmmmmmmmmmmmmmmmmmmmmmmmmm#$$$$$$C +v% &'aAc3c3hsCx#EFII"IHHH..... "K "7,^ _ _...&v ++QQQQ + + + +vCCCC(((WWWWWWccIIcl33ccc ,HH))CL"9"9HHHHH99S\#:#:HHHOOOP 555 555 --- 000...    FHH ( ( ( V:(&,A!!!!!2   ,BQB6!!!!!!!! 9T<<<>AAAAA6     r