sgsBddlmZmZddlmZddlZddlZddlmZm Z ddl m Z ddl m Z mZmZmZmZmZddlZddlZddgZd ZeZe d eGd dZe d Gd dZy)) dataclassfield) defaultdictN)NodeGraph) compatibility)DictListSetAnyUnionTupleSubgraphMatcher InternalMatchc|tjt}tjj ddj }|j|tj}tjd}|j||j||j|d|_ |S)NPYTORCH_MATCHER_LOGLEVELWARNINGz%(filename)s > %(message)sF) logging getLogger__name__osenvirongetuppersetLevel StreamHandler Formatter setFormatter addHandler propagate)loggerlevelconsole formatters V/var/www/html/venv/lib/python3.12/site-packages/torch/fx/passes/utils/matcher_utils.py _init_loggerr&s   x (F JJNN5y A G G IE OOE##%G!!">?I # U gF MF)is_backward_compatibleceZdZUeeed<eeZe eefed<ee Z eeed<ee Z eeed<eeZ e eefed<dZy) ranchors)default_factory nodes_mapplaceholder_nodesreturning_nodes name_node_mapct|j|jj|jj|j jS)N)r*r,r-r.)rr*r,copyr-r.)selfs r%__copy__zInternalMatch.__copy__4sJT\\T^^=P=P=R/3/E/E/J/J/L-1-A-A-F-F-HJ Jr'N)r __module__ __qualname__r r__annotations__rdictr,r listr-r.r/strr3r'r%rr"sp$Z"'"=ItD$J=%*$$?tDz?#("=OT$Z=&+4%@M4T ?@Jr'c eZdZ ddedededededdf dZd ed edefd Zd ed edefd Zd e eefdefdZ de e de e fdZ d ed ede defdZd ed ede defdZdede e fdZy)rpattern match_outputmatch_placeholderremove_overlapping_matchesignore_literalsreturnNc||_||_||_||_||_t |j dk(r td|j D]1}|jdk7st |jdkDr,Jd|j Dcgc]}|jdk(s|c}|_ ttt|j }|j|_g|_|r |g|_y|jDcgc]}t |jdk(s|c}|_ycc}wcc}w)a Args: pattern: the targeted matching pattern, represented in fx.Graph. match_output: If True, output node in the pattern graph will be treated as a part of the targeted pattern. If False, output node is ignored during match. match_placeholder: If True, placeholder node in the pattern graph will be treated as a part of the targeted pattern. If False, placeholder nodes will be used a wildcard. remove_overlapping_matches: If True, in the case of overlapping matches, only the first match will be returned. ignore_literals: If True, will not check if literals are equal and will instead treat them as wildcards. rz;SubgraphMatcher cannot be initialized with an empty patternoutputzDSubgraphMatcher cannot be initialized with an pattern with dead code placeholderN)r<r=r>r?r@lennodes ValueErroropuserspattern_placeholder_nodesnextiterreversedall_input_nodespattern_returning_nodespattern_anchors) r2r<r=r>r?r@noden output_nodes r%__init__zSubgraphMatcher.__init__;s$$ (!2*D'. w}}  "Z[ [MM ^Dww("4::*^]^* ^6=]])\addmF[!)\&4 789 3>3N3N$+- $/=D 0;/J/J#`!cRSRYRYl^_N_A#`D *]$asD9*D9D>,D>pngncXt|jtsJd|jdt|jtsJd|jddtjj dtfd}||j j|j}||j j|j}t|t|k7ryt|tjrt|tjStd|d ) Nz pn.target z must be a string.z gn.target model attr_namecv|jd^}}|}|D]}t||d}|Jt||S)N.)splitgetattr)rYrZprefixrtitems r%_getattrz3SubgraphMatcher._match_attributes.._getattrpsO&__S1NVUA %AtT*}$} %1e$ $r'FzUnsupported type z when matching attributes) isinstancetargetr9torchfx GraphModulegraph owning_moduletypeTensor RuntimeError)r2rVrWrbpn_valuegn_values r%_match_attributesz!SubgraphMatcher._match_attributesjs"))S)UZ {BT+UU)"))S)UZ {BT+UU) %EHH00 %S %BHH22BII>BHH22BII> >T(^ + h -h 5 5!28*rIrord)r2rVrWs r%_nodes_are_equalz SubgraphMatcher._nodes_are_equalsw%%"%%=*@ 55BEE>uu %():*$--b"5599 ) )r'r,c|jDcic]\}}|jdk7s||}}}|jD],\}}||jvr|jD] }||vsy.ycc}}w)NrDFT)itemsrIrPrJ)r2r,rVrWlookupusers r% _is_containedzSubgraphMatcher._is_containeds ;D//:K#fBruuXeOeBG#f#flln !FBT111 !v%  ! !$gs A4A4matchescNg}t}|D]}d}|jjD]\}}|jdvs||vsd}n|rA|j ||jjD]%\}}|jdvs|j |'|S)NF>rCrDT)setr,rtrIappendadd)r2rxnon_overlapping_matches nodes_matchedmatch found_overlaprVrWs r%_remove_overlapping_matchesz+SubgraphMatcher._remove_overlapping_matchess79#&5  .E!M////1 B55 99bM>Q$(M  !'..u5#oo335.FBuu$==%))"-. .'&r'rct|trt|trJdt|trPt|ts@|jdk(r0||jvr|j||k(S||j|<yyt|tst|tryt |t |k(xr||k(S)Nzpn and gn cannot both be NoderDTF)rcrrIr,rj)r2rVrWrs r%_match_literalszSubgraphMatcher._match_literalssr4(ZD-AcDccB b$  2t(<uu %( ??2."44&(#B%*R*>8tBx'4B"H 4r'c tjd||t|trt|tsJt d|d||j vrj ||k(S|j j vryj||sytj}|j |<|jdk(ryd}dtttfdtttfd tf fd d \}}t|jt|jk7sGt!|j"j%t!|j"j%k7r|jd k(rt|j&t(j*j,ra|j&j.j0 fd }||j|j"}||j|j"}nt|jt|jk(rt!|j"j%t!|j"j%k(rt!|j}t!|j}|j3t!|j"j |j3t!|j"j nd}|xr|duxr|duxr  ||}|stj|yy)Nz matching %s to %szpn and gn must be Node, pn: z, gn: FrDTargs1args2rAc|t|t|k7ryt||D]\}}t|tr$t|trj ||}nWt|t t fr t|t t fr ||}n!j||xs j}|ryy)NFT) rFziprcr _match_nodesr8tuplerr@)rra1a2matched _match_argsrr2s r%rz1SubgraphMatcher._match_nodes.._match_argss5zSZ'eU+ !Bb$'Jr4,@"//B>GT5M2z"tUm7T)"b1G"222r5AYTEYEYG  !r')NN call_functionc g}tD]|\}}|j|vr|j||j3|js#|t |kr|j||b|j|j ~|S)N) enumeratenamer{ kwarg_onlyrF default_value) orig_args orig_kwargsall_argsischema args_schemas r%get_all_argumentsz7SubgraphMatcher._match_nodes..get_all_argumentss~!*;!7>IAv{{k1  FKK(@A#..1s9~3E  ! 5 (<(<= > r')r!inforcrr9r,valuesrrr1rIr r rboolrFargsr8kwargskeysrdre_ops OpOverload_schema argumentsextend) r2rVrWr saved_match match_foundpn_argsgn_argsrrrs ` ` @@r%rzSubgraphMatcher._match_nodess )2r2"d# 2t(<pcD`ac`ddjkmjnBo>pp<  ??2&", , '') )$$R,ii&   55M !  uT5[1 %e :L QU $& \S\ )T"))..2B-CtBIINNL\G]-] EE_ $ ryy%**"7"7 8))++55K (;G';G \S\ )d299>>3C.DRYY^^M]H^.^277mG277mG NN4 0 0 23 4 NN4 0 0 23 4K  * 4  * 4  *  ) IIk*Er'rhcd ddlm}tt}jD]:}|j D])}j ||s||j|+<t|jtjdg fd tj}r  d|t}Dcgc] }j|js|"c}t}||k7rtjd||z g} D]X}|jjD cgc]\} } | jdvs| c} } } || sH| j|Zt| tk7r+tjdtt| z j rEt| }j#| t}||k7rtjd ||z tjd Scc}wcc} } w) a Returns: The matched subgraphs. Thre returned subgraph would be fully self-contained, meaning the nodes (except placeholder and nodes returned by output) can only be consumed by nodes within the matched subgraph. Subgraph pattern matcher is implemented with the backtracking style in the following steps: 1. We first identify all the anchor nodes in the pattern graph. The anchor nodes are the "sinks" (nodes with no user other than the output node) of the pattern graph. One pattern graph could have multiple anchors if it has multiple return values. 2. In the target graph, we identify the potential candidate nodes that can be matched with each anchor. These anchor-candidate pairs are the starting points for pairwise per-node matching. 3. For each anchor-candidate pair, we simultaneously traverse backwards (DFS) in both pattern and target graphs. For every pattern nodes along traversal path, we compare it against the target nodes. In case any comparison failed, the match for this anchor-candidate pair fails. A match is found when DFS completes traversing the graph. See `self._match_nodes` for more details. 4. In the case of multiple anchors, every anchor will need to find a match using step 3. In addition, the matches found between anchors need to have a common intersection node in order for the match to be valid. This is implemented with backtracking. See `backtracking` for more details. Notice: graph traversal must be done in the reverser order because a tensor can have multiple consumers, but can only have a single producer. Only with reverser order, we can we jointly traverse the pattern and target graph in a deterministic path. Warning: In theory, this backtracking algorithm have an **exponential** time complexity. However, in practice, it's unlikely to blow up. r)validate_partitionz"Initial match_candidates_list: %s cH|t k(r jDcgc]}|j|c}|_ jDcgc]}|j|c}|_ j |tjd|y |\}}tj|}|D]g}tjd|| j|||}|r |dz|ntjd||tj|}iycc}wcc}w)NzFound a match: %s zTrying to match anchor %s to %srEz Failed to match anchor %s to %s ) rFrKr,r-rPr.r{r!rr1r) anchor_indexrrVpattern_anchorcandidate_nodesrrRr backtrackingmatch_candidates_listrxr2s r%rz+SubgraphMatcher.match..backtrackingYss#899IMIgIg*h25??2+>*h'GKGcGc(d)<(d%u% 159.CL.Q +NO))E*K' / =~tT"//eL  !159KK C^UYZ +. /+i(ds D D)r*zrCrDzfFiltered out %s matches because matched subgraph would form a cycle if fusedzAFiltered out %s matches because matched subgraphs are overlappingzMatches returned: %s)!torch.fx.passes.utils.fuser_utilsrrr8rQrGrrr{rtr!rrrFrwr,rIr?r)r2rhrmatch_candidatesrrRrbeforeafter valid_matchesrVrWmatched_compute_nodesrrrxs` @@@r%rzSubgraphMatcher.match's H I4?t3D"22 BN  B((>$^4;;DA B B!%%5%;%;%= > 9;PQ') /2d&:&:; E "W&-UU1C1CEOO1T5UG  U? KKVX^afXf g  ,E"'//"7"7"9dBRUUJc=cd "!"78$$U+  , } W - KKHILWX[\iXjIj l  * *'F66}EGLE _agjoaop *G43Ves H'-H'H,H,)FFTF)rr4r5rrrUrrorrr rwr rrr rrrr:r'r%rr9s#',+048). -a-a#-a$(-a.2-a#' -a48 -a^Ddt8 4 T d tD$J'7D&'4 3F'4P]K^'$5#535}55&ZtZZmZZxj5jT-%8jr') dataclassesrr collectionsrr1retorch.fxrrtorch.fx._compatibilityrtypingr r r r r rrr__all__r&r!rrr:r'r%rs(# 255 o .  e, JJ -J*e,WW-Wr'