sgsVdZddlZddlZddlZddlZddlZddlZddlZddlZddl Z ddl Z ddl Z ddl Z ddl mZddlmZddl mZmZmZmZmZddlmZddlmZmZmZmZmZmZej>e Z!e jDZ#d Z$d ee%ejLfd dfd Z'd ee%ejLfd ee%fdZ(d ee%ejLfd ee%fdZ)dee%ejLfd ee%fdZ*dee%ejLfd ee%fdZ+ddde%dee%ejLfde,d e jZfdZ. d.dee%ejLfd e%deee%ejLfde,dee,deee%e%fdeee,e%fdee%d e,d!ee%d"ee%d e%fd#Z/ d.d$e%dee%ejLfdeee%ejLfde,dee,deee%e%fdeee,e%fdee%d e,d!ee%d%ee%d e jZfd&Z0d/d'ed(ee%ejLfd)eed ee%fd*Z1d+Z2d,Z3d-Z4y)0z3Utilities to dynamically load objects from the Hub.N)Path) ModuleType)AnyDictListOptionalUnion)try_to_load_from_cache)HF_MODULES_CACHE TRANSFORMERS_DYNAMIC_MODULE_NAME cached_fileextract_commit_hashis_offline_modeloggingc<ttjvrytjjtt j tdt tdz }|js%|jtjyy)z_ Creates the cache directory for modules with an init, and adds it to the Python path. NTexist_ok __init__.py) r syspathappendosmakedirsrexiststouch importlibinvalidate_caches) init_paths T/var/www/html/venv/lib/python3.12/site-packages/transformers/dynamic_module_utils.pyinit_hf_modulesr!1sj 388#HHOO$%KK 40%&6I    ##% namereturncXttt|z j}|jj st |jtj|d|dz }|j s%|jtjyy)z Creates a dynamic module in the cache directory for modules. Args: name (`str` or `os.PathLike`): The name of the dynamic module to create. TrrN) r!rr resolveparentrcreate_dynamic_modulerrrrr)r#dynamic_module_pathrs r r(r(As 01D8AAC  % % , , .1889KK#d3#m3I     ##% r" module_filec.t|dd5}|j}dddtjdtj}|tjd|tjz }t t |S#1swYlxYw)z Get the list of modules that are relatively imported in a module file. Args: module_file (`str` or `os.PathLike`): The module file to inspect. Returns: `List[str]`: The list of relative imports in the module. rutf-8encodingNz^\s*import\s+\.(\S+)\s*$flagsz^\s*from\s+\.(\S+)\s+import)openreadrefindall MULTILINElistset)r*fcontentrelative_importss r get_relative_importsr<Ws} k3 1Q&&(zz"=wbll[ #A7RTR^R^__ $% &&s B  Bcld}|g}g}|sg}|D]}|jt|t|j}|Dcgc]}t ||z }}|Dcgc] }||vs| }}|Dcgc]}|d }}t |dk(}|j||s|Scc}wcc}wcc}w)a Get the list of all files that are needed for a given module. Note that this function recurses through the relative imports (if a imports b and b imports c, it will return module files for b and c). Args: module_file (`str` or `os.PathLike`): The module file to inspect. Returns: `List[str]`: The list of all relative imports a given module needs (recursively), which will give us the list of module files a given module needs. F.pyr)extendr<rr'strlen) r* no_changefiles_to_checkall_relative_imports new_importsr9 module_pathmnew_import_filess r get_relative_import_filesrIlsI!]N  8A   3A6 7 8;'.. :EFQC a0FF'7Y!1DX;XAYY-=>QCs)>>()Q. ##N3 GY>sB'! B,+B,5 B1filenamec:t|dd5}|j}dddtjddtj}tjdd|tj }tj d |tj }|tj d |tj z }|Dcgc](}|jd r|jd d *}}tt|S#1swYxYwcc}w) a Extracts all the libraries (not relative imports this time) that are imported in a file. Args: filename (`str` or `os.PathLike`): The module file to inspect. Returns: `List[str]`: The list of all packages required to use the input module. r,r-r.Nz\s*try\s*:.*?except.*?:r0zHif is_flash_attn[a-zA-Z0-9_]+available\(\):\s*(from flash_attn\s*.*\s*)+z^\s*import\s+(\S+)\s*$z^\s*from\s+(\S+)\s+import.r) r2r3r4subDOTALLr6r5 startswithsplitr7r8)rJr9r:importsimps r get_importsrTs hg .!&&(ff/WBIINGffSUWY`hjhthtG jj2G2<<PG rzz6r||TTG,3OS3>>#;Nsyy~a OGO G # PsD  D D Dct|}g}|D]} tj|t|dkDr0tddj|dd j|d t|S#t$rE}tj d|d|dt |vr|j|nYd}~d}~wwxYw) a. Check if the current Python environment contains all the libraries that are imported in a file. Will raise if a library is missing. Args: filename (`str` or `os.PathLike`): The module file to check. Returns: `List[str]`: The list of relative imports in the file. z&Encountered exception while importing z: zNo module namedNrz\This modeling file requires the following packages that were not found in your environment: z, z. Run `pip install  `) rTr import_module ImportErrorloggerwarningr@rrAjoinr<)rJrRmissing_packagesrS exceptions r check_importsr_s(#G    # #C (  q  jyy)*++>sxxHX?Y>ZZ[ ]   ))!  NNCC59+V W!C N2 '',-  sA44 C=;B==CF force_reload class_namerFrac tjj|}|jdr|dd}|j tjj d}t t|z }t5|r4tjj|dtjtjj|}tjj!||}|gt#t%t t'|z}t)j*dj-d|Dj/}|3tjj1|} | tj|<n|} t3| dd |k7r"|j4j7| || _t3| |cdddS#1swYyxYw) a Import a module on the cache directory for modules and extract a class from it. Args: class_name (`str`): The name of the class to import. module_path (`str` or `os.PathLike`): The path to the module to import. force_reload (`bool`, *optional*, defaults to `False`): Whether to reload the dynamic module from file if it already exists in `sys.modules`. Otherwise, the module is only reloaded if the file has changed. Returns: `typing.Type`: The class looked for. r>NrM)locationr"c3TK|] }t||jz"ywN)bytes read_bytes).0r9s r z&get_class_in_module..s 2cQR58alln3L2cs&(__transformers_module_hash__rL)rrnormpathendswithreplaceseprr _HF_REMOTE_CODE_LOCKrmodulespoprrgetutilspec_from_file_locationsortedmaprIhashlibsha256r\ hexdigestmodule_from_specgetattrloader exec_modulerl) rbrFrar#r* cached_module module_spec module_files module_hashmodules r get_class_in_modulersj& 77  K (D }}UCRy << S )D-.>#((2cVb2c*cdnnp   ^^44[AF &CKK "F 692 >+ M    * *6 22=F /vz*-+++s 8E G  Gpretrained_model_name_or_path cache_dirforce_downloadresume_downloadproxiestokenrevisionlocal_files_only repo_type _commit_hashc | jdd} | )tjdt| t d| }t r|st jdd}t|}tjj|} | r tjj|}n:|jdtjj}t|||| | }g} t!|||||||||| | }| s|k7r|j#|t)|}t*tjjz|z}t-|t/t0|z }|tjj|k(r||z j3r"t5j6|t||z s-t9j:|||z t=j>|D]}|d }tjjA||}||z j3r#t5j6|t||z r^t9j:|||z t=j>ntC|| }||z }|tjjz|z}t-|||z j3s-t9j:|||z t=j>|D]E}||d z j3rtE||d |||||||| |j#|d GtG|dkDrP|NdjA|Dcgc]}d| c}}| dn| d}d||}t jId|d|dtjjA||S#t$$rt j'd |d |d wxYwcc}w)a Prepares Downloads a module from a local folder or a distant repo and returns its path inside the cached Transformers module. Args: pretrained_model_name_or_path (`str` or `os.PathLike`): This can be either: - a string, the *model id* of a pretrained model configuration hosted inside a model repo on huggingface.co. - a path to a *directory* containing a configuration file saved using the [`~PreTrainedTokenizer.save_pretrained`] method, e.g., `./my_model_directory/`. module_file (`str`): The name of the module file containing the class to look for. cache_dir (`str` or `os.PathLike`, *optional*): Path to a directory in which a downloaded pretrained model configuration should be cached if the standard cache should not be used. force_download (`bool`, *optional*, defaults to `False`): Whether or not to force to (re-)download the configuration files and override the cached versions if they exist. resume_download: Deprecated and ignored. All downloads are now resumed by default when possible. Will be removed in v5 of Transformers. proxies (`Dict[str, str]`, *optional*): A dictionary of proxy servers to use by protocol or endpoint, e.g., `{'http': 'foo.bar:3128', 'http://hostname': 'foo.bar:4012'}.` The proxies are used on each request. token (`str` or *bool*, *optional*): The token to use as HTTP bearer authorization for remote files. If `True`, will use the token generated when running `huggingface-cli login` (stored in `~/.huggingface`). revision (`str`, *optional*, defaults to `"main"`): The specific model version to use. It can be a branch name, a tag name, or a commit id, since we use a git-based system for storing models and other artifacts on huggingface.co, so `revision` can be any identifier allowed by git. local_files_only (`bool`, *optional*, defaults to `False`): If `True`, will only try to load the tokenizer configuration from local files. repo_type (`str`, *optional*): Specify the repo type (useful when downloading from a space for instance). Passing `token=True` is required when you want to use a private model. Returns: `str`: The path to the module inside the cache. use_auth_tokenNrThe `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.V`token` and `use_auth_token` are both specified. Please set only the argument `token`.z+Offline mode: forcing local_files_only=TrueT/)rrr) rrrrrrrrrzCould not locate the z inside rMr>)rrrrrrrrr z- rLzs/zhttps://huggingface.co/z9A new version of the following files was downloaded from z: z . Make sure to double-check they do not contain any added malicious code. To avoid downloading new versions of the code file, you can pin a revision.)%rswarningswarn FutureWarning ValueErrorrrZinfor@rrisdirbasenamerorpr rrEnvironmentErrorerrorr_r r(rr rfilecmpcmpshutilcopyrrr\rget_cached_module_filerAr[)rr*rrrrrrrrrdeprecated_kwargsris_local submoduler new_filesresolved_module_filemodules_neededfull_submodulesubmodule_path module_neededmodule_needed_file commit_hashr9 repo_type_strurls r rrs|'**+;TBN!  A    uv v!1 AB%((E$F!ww}}:;HGG$$%BC 199#rww{{K . );)Vbnw I* ) )+-% M-AA   [ )##78N6 CiON.)*+n M (+5'"''++5 Cn-,446 KK,n{.J K  ' ' )+ 8M" c%::BBD&1$oS)'#1$3#%%5!,   M?#!67 8  9~h.II;AA3x;< '/ {"5E ' 7T6UVGuCPY{ A A 77<< 44G  ,[MB_A``abc t Extracts a class from a module file, present in the local folder or repository of a model. Calling this function will execute the code in the module file found locally or downloaded from the Hub. It should therefore only be called on trusted repos. Args: class_reference (`str`): The full name of the class to load, including its module and optionally its repo. pretrained_model_name_or_path (`str` or `os.PathLike`): This can be either: - a string, the *model id* of a pretrained model configuration hosted inside a model repo on huggingface.co. - a path to a *directory* containing a configuration file saved using the [`~PreTrainedTokenizer.save_pretrained`] method, e.g., `./my_model_directory/`. This is used when `class_reference` does not specify another repo. module_file (`str`): The name of the module file containing the class to look for. class_name (`str`): The name of the class to import in the module. cache_dir (`str` or `os.PathLike`, *optional*): Path to a directory in which a downloaded pretrained model configuration should be cached if the standard cache should not be used. force_download (`bool`, *optional*, defaults to `False`): Whether or not to force to (re-)download the configuration files and override the cached versions if they exist. resume_download: Deprecated and ignored. All downloads are now resumed by default when possible. Will be removed in v5 of Transformers. proxies (`Dict[str, str]`, *optional*): A dictionary of proxy servers to use by protocol or endpoint, e.g., `{'http': 'foo.bar:3128', 'http://hostname': 'foo.bar:4012'}.` The proxies are used on each request. token (`str` or `bool`, *optional*): The token to use as HTTP bearer authorization for remote files. If `True`, will use the token generated when running `huggingface-cli login` (stored in `~/.huggingface`). revision (`str`, *optional*, defaults to `"main"`): The specific model version to use. It can be a branch name, a tag name, or a commit id, since we use a git-based system for storing models and other artifacts on huggingface.co, so `revision` can be any identifier allowed by git. local_files_only (`bool`, *optional*, defaults to `False`): If `True`, will only try to load the tokenizer configuration from local files. repo_type (`str`, *optional*): Specify the repo type (useful when downloading from a space for instance). code_revision (`str`, *optional*, defaults to `"main"`): The specific revision to use for the code on the Hub, if the code leaves in a different repository than the rest of the model. It can be a branch name, a tag name, or a commit id, since we use a git-based system for storing models and other artifacts on huggingface.co, so `revision` can be any identifier allowed by git. Passing `token=True` is required when you want to use a private model. Returns: `typing.Type`: The class, dynamically imported from the module. Examples: ```python # Download module `modeling.py` from huggingface.co and cache then extract the class `MyBertModel` from this # module. cls = get_class_from_dynamic_module("modeling.MyBertModel", "sgugger/my-bert-model") # Download module `modeling.py` from a given repo and cache then extract the class `MyBertModel` from this # module. cls = get_class_from_dynamic_module("sgugger/my-bert-model--modeling.MyBertModel", "sgugger/another-bert-model") ```rNrrz--rMr>)rrrrrrrrr`)rsrrrrrQrr)rrrrrrrrrrrkwargsrrepo_idr*rb final_modules r get_class_from_dynamic_modulerstZZ 0$7N!  A    uv v #2#8#8#> /-33C8K!>'!I )e%') L z._set_auto_map_in_configBsqmm.. !'',R0 "m1S]]%;%;$<= ) ##' #' }}%%..v6*5a 8N8N7O'P$3 6=I%,S2H%IN+9+D+D(+?+E+Ec+J2+N(.B-C1^E\E\D]+^(+6a 8N8N7O'P$-/CDI gt ${{:r2H(1HS__ %"*GJ  Wj$ / ;09G  S__ - #;G r")rrZr[rr7tuplerrr__file__rr#rrrrI) rrrrcfgresult object_file dest_file needed_files ` r custom_object_saver,s ~~#.se4x@  <@&4-( )C #C ( )  ' F++cnn-66KV [ 1 6 67I KK Y' MM)1=! LD$5$:$:;  K+ i ! Mr"ctd)NzLoading this model requires you to execute custom code contained in the model repository on your local machine. Please set the option `trust_remote_code=True` to permit loading of this model.)r)signumframes r _raise_timeout_errorrxs  c r"c||rd}n|rtdkDrd} tjtjt}tjt|>t d|d|d}|j dvrd}n|j dvrd}|>tjd |Htjtj|tjdn|r tdd|r|s|std |d |S#t$rtd|d|d wxYw#|:tjtj|tjdwwxYw) NFrzThe repository for z contains custom code which must be executed to correctly load the model. You can inspect the repository content at https://hf.co/z. You can avoid this prompt in future by passing the argument `trust_remote_code=True`. Do you wish to run the custom code? [y/N] )yesy1T)non0rLzS. Please pass the argument `trust_remote_code=True` to allow custom code to be run.zLoading z requires you to execute the configuration file in that repo on your local machine. Make sure you have read the code there to avoid malicious use, then set the option `trust_remote_code=True` to remove this error.) TIME_OUT_REMOTE_CODEsignalSIGALRMralarminputlower Exceptionr)trust_remote_code model_namehas_local_codehas_remote_codeprev_sig_handleranswers r resolve_trust_remote_coders  %  !5!9#  $#)==AU#V  12'/"-j\:ccmbnoEFF ||~)::,0)+??,1)(/ Q$/MM&..2BCLLO  t ,~6Gzl#M M  -  )*6__i^jkhi $/MM&..2BCLLO0sBDDD**D-->E+) NFNNNNFNNrg)5__doc__rryrimportlib.utilrr4rrr threadingtypingrpathlibrtypesrrrrrr huggingface_hubr utilsr r rrrr get_loggerrrZLockrqr!r@PathLiker(r<rIrTr_boolTyperrrrrrrr"r rs:  332   H %%y~~' & &c2;;&6 7&D&,'eC,<&='$s)'* 5bkk1A+B tCy B%R[[ 01d3i< *E#r{{"23 *S *N .+.+sBKK'(.+ .+  [[ .+h48 &*(,(,""#"&m5#(bkk)9#:m5m5c2;;./0m5 m5 d^ m5 d38n % m5 E$)$ %m5smm5m5}m53-m5 m5f48 &*(,(,""##'zVzV#(bkk)9#:zVc2;;./0zV zV d^ zV d38n % zV E$)$ %zVsmzVzV}zVC=zV [[zVzICIsBKK/?)@I(SW.IdhildmIX+r"