sg ddlmZmZmZmZmZmZmZddlZddl m Z ddl m cm Z ddlmZmZddlmZddlmZddlmZddlmZddlmZd d lmZej:j<Zd ee eefd eeeeffd Z!eee ee effZ"eee"e"fee"e"e"e"ffZ#d eee#e$ffdZ%dede#dedeed e&f dZ'y))AnyCallableDictListSetTupleUnionN)FakeQuantizeBase ObserverBase)get_native_backend_config)!_get_pattern_to_quantize_handlers)getattr_from_fqn) GraphModule)Node)NSNodeTargetType base_name_to_sets_of_related_opsreturnc&t}|jD]s}t|}tdt |D]N}t|t |D]4}|j ||||f|j ||||f6Pu|S)Nr)setvalueslistrangelenadd)rtype_a_related_to_bss_listidx_0idx_1s O/var/www/html/venv/lib/python3.12/site-packages/torch/ao/ns/fx/pattern_utils.pyget_type_a_related_to_br"s KN% - 4 4 6Ha1c&k* HEuc&k2 H#''u (FG#''u (FG H HH c g}tt}d}|jD]}t|trFt |dk(r8t|dtr%t |ddk(r|d|dd|ddf}t|tr|j ||fttfD]0}t|tr|g|}n||f}|j ||f2d}dtjftjtjdf|ftjtj f|ftj"tj$f|ftj&tj(f|ftj*tjtj f|ftj*tj"tj$f|ftj*tj&tj(f|fg}|D]U}|j ||j tg|d|df|j tg|d|dfW|S)a Set of potential fusions, in reverse order. The order is reversed to match how fusion patterns are defined in quantization code. Fusion format: ((fusion_op_0, fusion_op_1), base_op_idx) Where base_op_idx is the idx of the op we should use to match other related ops. Note: base_op_idx is specified in non-reverse order, i.e. a base_op_idx of 0 represents the first op in regular (non-reverse) order, 1 represents the second op, etc. rrto dequantize)r r keys isinstancetuplerappendr r torchfloat16Frelulinearnn BatchNorm1dConv1d BatchNorm2dConv2d BatchNorm3dConv3dReLU) resultsall_quant_patternsdefault_base_op_idx quant_patterncls new_patternfp16_em_base_op_idxpatterns_to_addps r!get_reversed_fusionsrB3s9/1G;;T;VW+002? }e ,M"a'=+U3M!$%*+1-}Q/?/BMRSDTUVDWXM mU + NNM+>? @ !"23 ?C-/"3]3 "M2 NNK)<= >  ?/?F EMM "AFFAHHl C  ..")) $&9: ..")) $&9: ..")) $&9: ''2>>299 -/BC ''2>>299 -/BC ''2>>299 -/BCO :q-!-qt45)1AaD11Q489: Nr#end_nodereversed_fusiongm seen_nodesc|}tt|D]Q}||vry||}|jdk(rt|t xrt|t  }|rX|j |k7ryt|jdkDr-t|jdtr|jd}yy|jdk(rt|t }|rt|j tsJt||j } t|t syt| |syt|jdkDr.t|jdtr|jd}Wyy|jdk(rt|txrt|dk(} t|t} | s| r| r|j |k7rYyt|tsJ|j |dk7ryt|jdkry|jd|dk7ryt|jdkDr.t|jdtr|jd}Nyyyy) zZ Returns true if a pattern ending with `end_node` matches the fusion pattern. F call_functionr call_module call_methodr%rT) rropr)strtypetargetargsrrr*) rCrDrErFcur_node fusion_idx cur_fusion_elfusion_el_is_funfusion_el_is_mod target_mod!fusion_el_is_meth_with_second_argfusion_el_is_meth_without_argss r! end_node_matches_reversed_fusionrXs&HC01> z !' 3 ;;/ )$.}c$B B }d33  ??m3 x}}%)jq9I4.P'}}Q/H  [[M ))-> !(//3777-b(//B !-6 !*m< x}}%)jq9I4.P'}}Q/H  [[M )=%0LS5G15L ..8 s-K *-1R1-7$%mU;;;-*::$X]]+a/$!q)]1-==$x}}%)jq9I4.P'}}Q/H }>@ r#)(typingrrrrrrr r,torch.nnr1torch.nn.functional functionalr.torch.ao.quantizationr r $torch.ao.quantization.backend_configr )torch.ao.quantization.fx.quantize_handlerr torch.ao.quantization.utilsrtorch.fxrtorch.fx.graphrns_typesrops quantizedtoqrLr"NSFusionElType NSFusionTypeintrBboolrXr#r!rls'??? @JW8 & ii&*34D0E+E&F!11 23&   S .. () .... HIK Pd5s):#;<PfKK!K KD K  Kr#