sg zddlZddlmZddlmcmZddlmZddlm Z m Z m Z dgZ GddejZ y)N) LinearReLU)is_parametrized$transfer_parametrizations_and_paramstype_before_parametrizationsLinearcfeZdZdZej Z d dfd ZdZe ddZ dZ xZ S) ra A linear module attached with FakeQuantize modules for weight, used for quantization aware training. We adopt the same interface as `torch.nn.Linear`, please see https://pytorch.org/docs/stable/nn.html#torch.nn.Linear for documentation. Similar to `torch.nn.Linear`, with FakeQuantize modules initialized to default. Attributes: weight: fake quant module for weight c||d}t||||fi||sJd||_|j||_y)N)devicedtypez'qconfig must be provided for QAT module)factory_kwargs)super__init__qconfigweightweight_fake_quant) self in_features out_featuresbiasrr r r __class__s Q/var/www/html/venv/lib/python3.12/site-packages/torch/ao/nn/qat/modules/linear.pyrzLinear.__init__!sM%+U; lDKNKAAAw !(~!Ncvtj||j|j|jSN)Flinearrrr)rinputs rforwardzLinear.forward0s(xxt55dkkBDIINNrc*t||jk(s.Jd|jzdz|jjzt|dsJd|jsJdt|t k(r|d}|j}||j |j|jdu|}t|d rt||d n|j|_ t|d rt||d |S|j|_|S) zCreate a qat module from a float module or qparams_dict Args: `mod` a float module, either produced by torch.ao.quantization utilities or directly from user z qat.z.from_float only works for rz,Input float module must have qconfig definedz,Input float module must have a valid qconfigrN)rrrr) r _FLOAT_MODULE__name__hasattrrrrrrrrr)clsmoduse_precomputed_fake_quantr qat_linears r from_floatzLinear.from_float3s ,C0C4E4EE ll + ,(( ) E sI&V(VV&{{JJJ{ ' , :a&C++ OO   %   3 ) 0j( K # J  3 ' 0j& I"hhJOrctjj|j|j|j du}tjj |jj|_|j r=s9 , *PRYYPr