sgxddlZddlmZddlmZddlmZddlZddlZddl m Z m Z m Z dejde ejde ejd ffd Zdd ed ed efdZde efdZdej$j&fdZy)N)Node)symbolic_trace)legalize_graph)DictListTupleresultinputsreturn.ct|tjjrdgt |z}n|Dcgc]}|j d}}tj ||Scc}w)a A free function for use in the merge_matmul graph transformation below that splits the output from a merged matmul into the individual results for each input tensor. Arguments: result: The merged matmul result tensor. inputs: The list of inputs that were merged into one for the matmul. Returns: List of matmul results for each input tensor. r) isinstancetorchfxProxylenshapesplit)r r splitsxs U/var/www/html/venv/lib/python3.12/site-packages/torch/fx/experimental/merge_matmul.pysplit_result_tensorsr sW"&%((..)s6{"&,-!''!*-- ;;vv &&.sA'ab search_depthc||k(ryt|jdk(ry|dk(ry|jD]}t|||dz syy)a^ Determine if one node depends on another in a torch.fx.Graph. Arguments: a: The node that may have a dependency on b. b: The node that a may have a dependency on. search_depth: In the case of an indirect dependency, this function searches upto this many nodes away in search of a data dependency. If none is found, the function makes the conservative assumption that there is a dependency. Returns: True if a may depend on b, False if it definitely does not. TrF)rall_input_nodes may_depend_on)rrrinps rrr&sc" Av 1  "q   a!1 2 nodescttj|dD]\}}t||s t||syy)z Check if all of the given nodes are pairwise-data independent. Arguments: nodes: The nodes to check for data dependencies. Returns: True if any pair in nodes has a data dependency. FT) itertools combinationsr)r!ijs rare_nodes_independentr(Ks?&&ua01 A -1"5 r in_modc t|}i}i}|jjD]}|jdk7s|jt j ur/|j\}}|jdk(r |jn|}|jdk(r |jn|}|j|gj||j|gj||jD]\}}t|dkrt|s"|Dcgc]}|jd} }| D cgc]/} t| tr|jj| n| 1}} t|tr|jj|n|}|jj!t j"|fi} |jj!t j | |fi} |jj!t$| |fi} t't|Dcgc]/}|jj!t(j*| |fi1}}t-||D]1\}}|j/||jj1|3t3||j5|jj7|Scc}wcc} wcc}w)a A graph transformation that merges matrix multiplication operations that share the same right-hand side operand into one large matrix multiplication. ____ _________ _________ ---- | | | | M| A * C | M| A | T| B | * K| C | = |---------| ---- , | | | | T| B * C | K ---- --------- --------- K R R call_functionget_attrr#r)rgraphr!optargetrmatmulargs setdefaultappenditemsrr(r strr,r+catrrangeoperatorgetitemzipreplace_all_uses_with erase_noder recompilelint)r)gm rhs_users lhs_usersnodelhsrhsmmsmmlhs_valsl merge_mm_catmerge_mmmerge_mm_splitout merge_mm_resoldnews r merge_matmulrP]s  B(*I(*I 3 77o %ELL)H 99S  FFj0cjjcFFj0cjjcS"%,,T2S"%,,T2 3OO%*S s8a< %S) ),-2BGGAJ--KSSQz!S'9rxx  #q@SS(23(r[s 37$$' LL'"&u||"4' 5<< '2"T"d"#"Jd$OOr