sgIbddlZddlZddlZddlZddlmZddlmZmZm Z m Z m Z m Z m Z mZddlZddlZddlmZddlmZddlmZmZmZmZmZmZmZmZm Z m!Z!m"Z"e!rddl#m$Z$e d d Z%e"jLe'Z(Gd d eZGdd eZ)ee)jTe)_*e)jTjV8e)jTjVjYddde)jT_+yy)N)BytesIO)AnyDictListOptionalTupleTypeTypeVarUnion)custom_object_save) BatchFeature) IMAGE_PROCESSOR_NAMEPushToHubMixinadd_model_info_to_auto_map"add_model_info_to_custom_pipelines cached_file copy_func download_urlis_offline_mode is_remote_urlis_vision_availablelogging)ImageImageProcessorTypeImageProcessingMixin)boundceZdZdZy)ra Holds the output of the image processor specific `__call__` methods. This class is derived from a python dictionary and can be used as a dictionary. Args: data (`dict`): Dictionary of lists/arrays/tensors returned by the __call__ method ('pixel_values', etc.). tensor_type (`Union[None, str, TensorType]`, *optional*): You can give a tensor_type here to convert the lists of integers in PyTorch/TensorFlow/Numpy Tensors at initialization. N)__name__ __module__ __qualname____doc__U/var/www/html/venv/lib/python3.12/site-packages/transformers/image_processing_base.pyrr8s r$rceZdZdZdZdZdefdZe dde e de ee jfdee ee jfd ed ed ee eefd ed e fdZd de ee jfdefdZede ee jfd eeeefeeefffdZedeeeffdZd eeeffdZede ee jffdZd efdZde ee jffdZdZed!dZde eeeffdZy)"rz This is an image processor mixin used to provide saving/loading functionality for sequential and image feature extractors. Nc |jdd|jdd|_|jD]\}} t|||y#t$r%}t j d|d|d||d}~wwxYw)z'Set elements of `kwargs` as attributes.feature_extractor_typeNprocessor_classz Can't set z with value z for )pop_processor_classitemssetattrAttributeErrorloggererror)selfkwargskeyvalueerrs r%__init__zImageProcessingMixin.__init__Ps  +T2 & + To test a pull request you made on the Hub, you can pass `revision="refs/pr/"`. return_unused_kwargs (`bool`, *optional*, defaults to `False`): If `False`, then this function returns just the final image processor object. If `True`, then this functions returns a `Tuple(image_processor, unused_kwargs)` where *unused_kwargs* is a dictionary consisting of the key/value pairs whose keys are not image processor attributes: i.e., the part of `kwargs` which has not been used to update `image_processor` and is otherwise ignored. subfolder (`str`, *optional*, defaults to `""`): In case the relevant files are located inside a subfolder of the model repo on huggingface.co, you can specify the folder name here. kwargs (`Dict[str, Any]`, *optional*): The values in kwargs of any keys which are image processor attributes will be used to override the loaded values. Behavior concerning key/value pairs whose keys are *not* image processor attributes is controlled by the `return_unused_kwargs` keyword parameter. Returns: A image processor of type [`~image_processing_utils.ImageProcessingMixin`]. Examples: ```python # We can't instantiate directly the base class *ImageProcessingMixin* so let's show the examples on a # derived class: *CLIPImageProcessor* image_processor = CLIPImageProcessor.from_pretrained( "openai/clip-vit-base-patch32" ) # Download image_processing_config from huggingface.co and cache. image_processor = CLIPImageProcessor.from_pretrained( "./test/saved_model/" ) # E.g. image processor (or model) was saved using *save_pretrained('./test/saved_model/')* image_processor = CLIPImageProcessor.from_pretrained("./test/saved_model/preprocessor_config.json") image_processor = CLIPImageProcessor.from_pretrained( "openai/clip-vit-base-patch32", do_normalize=False, foo=False ) assert image_processor.do_normalize is False image_processor, unused_kwargs = CLIPImageProcessor.from_pretrained( "openai/clip-vit-base-patch32", do_normalize=False, foo=False, return_unused_kwargs=True ) assert image_processor.do_normalize is False assert unused_kwargs == {"foo": False} ```r;r<r=r?use_auth_tokenNrThe `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.V`token` and `use_auth_token` are both specified. Please set only the argument `token`.r>)r*warningswarn FutureWarning ValueErrorget_image_processor_dict from_dict) r9r:r;r<r=r>r?r2rBimage_processor_dicts r%from_pretrainedz$ImageProcessingMixin.from_pretrainedcst({#1 %5!"%z$4d;  % MME   l#E  #F7O'Cs'C'CDa'lek'l$fs}}1rDzProvided path (z#) should be a directory, not a fileT)exist_okcommit_messagerepo_id)configzImage processor saved in )rQr>)r*rErFrGgetrHospathisfileAssertionErrormakedirssplitsep _create_repo_get_files_timestamps _auto_classr joinr to_json_filer/info_upload_modified_files) r1rMrNr2rBrQrRfiles_timestampsoutput_image_processor_files r%save_pretrainedz$ImageProcessingMixin.save_pretraineds $4d;  % MME zz'4(4 l-F7O 77>>. ) ?>2BBe!fg g NT2 #ZZ(8$?NjjN,@,@,Mb,QRG'd'':6:G#99.I     ' t^D A')ggll>CW&X# 56 /0K/LMN   ' ' -jj) ( ,,,r$c |jdd}|jdd}|jdd}|jdd}|jdd}|jdd}|jd d} |jd d} |jd d } |jd d} |jdd} |)tjdt| t d|}d| d}| | |d<t r| st jdd} t|}tjj|}tjj|r$tjj|t}tjj|r|}d}n6t|r|}t!|}nt} t#||||||| ||| |  } t)|dd5}|j+}dddt-j.}|rt jd |nt jd d!||s,d"|vrt3|d"||d"<d#|vrt5|d#||d#<||fS#t$$rt&$rt%d|d|dtdwxYw#1swYxYw#t,j0$rt%d|dwxYw)$a From a `pretrained_model_name_or_path`, resolve to a dictionary of parameters, to be used for instantiating a image processor of type [`~image_processor_utils.ImageProcessingMixin`] using `from_dict`. Parameters: pretrained_model_name_or_path (`str` or `os.PathLike`): The identifier of the pre-trained checkpoint from which we want the dictionary of parameters. subfolder (`str`, *optional*, defaults to `""`): In case the relevant files are located inside a subfolder of the model repo on huggingface.co, you can specify the folder name here. Returns: `Tuple[Dict, Dict]`: The dictionary(ies) that will be used to instantiate the image processor object. r;Nr<Fresume_downloadproxiesr>rBr=r? subfolder_from_pipeline _from_autorCrDimage processor) file_typefrom_auto_classusing_pipelinez+Offline mode: forcing local_files_only=TrueT) r;r<rirhr=r> user_agentr?rjz Can't load image processor for 'z'. If you were trying to load it from 'https://huggingface.co/models', make sure you don't have a local directory with the same name. Otherwise, make sure 'z2' is the correct path to a directory containing a z filerutf-8encodingz"It looks like the config file at 'z' is not a valid JSON file.zloading configuration file z from cache at auto_mapcustom_pipelines)r*rErFrGrHrr/rbstrrVrWisdirr`rrXrrrEnvironmentError ExceptionopenreadjsonloadsJSONDecodeErrorrr)r9r:r2r;r<rhrir>rBr=r?rj from_pipelinerprris_localimage_processor_fileresolved_image_processor_filereadertextrKs r%rIz-ImageProcessingMixin.get_image_processor_dictsC$JJ{D1 $4e< **%6=**Y- 7D)$4d;!::&8%@::j$/JJ{B/  #3T:  **\59  % MME   l#E#4Y  $+8J' (  %5 KKE F# (+,I(J%77==!>? 77==6 7#%77<<0MOc#d 77>>7 8,I )H 8 9#@ ,89V,W )#7  0;1('#1#$3%5)%' 1-4 3S7K %v{{} %#'::d#3   KK56S5TU V KK-.B-C?SpRqr 113M(46S4$Z0"%99;]();<>[<$%78$V++Q$  &67T6UV99V8WX//C.DEK  % %## "45R4SSno  s0J )K7J<K ,J9<KK#K+rKc |j}|jdd}d|vrd|vr|jd|d<d|vrd|vr|jd|d<|di|}g}|jD]0\}}t||st ||||j |2|D]}|j|dt jd||r||fS|S)a Instantiates a type of [`~image_processing_utils.ImageProcessingMixin`] from a Python dictionary of parameters. Args: image_processor_dict (`Dict[str, Any]`): Dictionary that will be used to instantiate the image processor object. Such a dictionary can be retrieved from a pretrained checkpoint by leveraging the [`~image_processing_utils.ImageProcessingMixin.to_dict`] method. kwargs (`Dict[str, Any]`): Additional parameters from which to initialize the image processor object. Returns: [`~image_processing_utils.ImageProcessingMixin`]: The image processor object instantiated from those parameters. return_unused_kwargsFsize crop_sizeNzImage processor r#)copyr*r,hasattrr-appendr/rb)r9rKr2rimage_processor to_remover3r4s r%rJzImageProcessingMixin.from_dicts " 488:%zz*@%H V *> >+1::f+=  ( & [4H%H06 ;0G  -5 45  ,,. &JC,e4  % & "C JJsD ! "  &&789 "F* *" "r$cvtj|j}|jj|d<|S)z Serializes this instance to a Python dictionary. Returns: `Dict[str, Any]`: Dictionary of all the attributes that make up this image processor instance. image_processor_type)rdeepcopy__dict__ __class__r)r1outputs r%to_dictzImageProcessingMixin.to_dicts0t}}-)-)@)@%& r$ json_filect|dd5}|j}dddtj}|di|S#1swY&xYw)a Instantiates a image processor of type [`~image_processing_utils.ImageProcessingMixin`] from the path to a JSON file of parameters. Args: json_file (`str` or `os.PathLike`): Path to the JSON file containing the parameters. Returns: A image processor of type [`~image_processing_utils.ImageProcessingMixin`]: The image_processor object instantiated from that JSON file. rsrtruNr#)r}r~rr)r9rrrrKs r%from_json_filez#ImageProcessingMixin.from_json_filesP)S7 3 !v;;=D !#zz$/*)** ! !s AAc|j}|jD]3\}}t|tjs!|j ||<5|j dd}|||d<tj|dddzS)z Serializes this instance to a JSON string. Returns: `str`: String containing all the attributes that make up this feature_extractor instance in JSON format. r+Nr)T)indent sort_keys ) rr, isinstancenpndarraytolistr*rdumps)r1 dictionaryr3r4r+s r%to_json_stringz#ImageProcessingMixin.to_json_strings\\^ $**, 1JC%,"',,. 3 1 &>>* This API is experimental and may have some slight breaking changes in the next releases. Args: auto_class (`str` or `type`, *optional*, defaults to `"AutoImageProcessor "`): The auto class to register this new image processor with. rNz is not a valid auto class.) rryrtransformers.models.automodelsautorrHr_)r9 auto_class auto_modules r%register_for_auto_classz,ImageProcessingMixin.register_for_auto_classsC *c*#,,J66{J/ |+FGH H$r$image_url_or_urlsc`ddi}t|tr|Dcgc]}|j|c}St|trPt j |d|}|j tjt|jStdt|cc}w)z Convert a single or a list of urls into the corresponding `PIL.Image` objects. If a single url is passed, the return value will be a single object. If a list is passed a list of objects is returned. z User-AgentzuMozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/114.0.0.0 Safari/537.36T)streamheadersz=only a single or a list of entries is supported but got type=) rlist fetch_imagesryrequestsrUraise_for_statusrr}rcontent TypeErrortype)r1rrxresponses r%rz!ImageProcessingMixin.fetch_imagess !  ' .2CDQD%%a(D D )3 /||$5dGTH  % % '::gh&6&678 8[\`ar\s[tuv v EsB+)NFFNmain)F)AutoImageProcessor)rr r!r"r_r6ryr8 classmethodr rr rVPathLikerboolrLrfrrrrIrJrrrrarrrrr#r$r%rrHs K 0C08<$!&,0o= $ %o=',S"++-='>o=E#r{{"234o= o=  o= c4i() o=o= o=o=b;-eC4D.E;-TX;-zt,,1#r{{2B,Ct, tCH~tCH~- .t,t,l*#T#s(^*#*#X c3h +uS"++-='>++$GG* 05bkk1A+B 0D%%2weCcN.Cwr$rnrzimage processor file)object object_class object_files)-rrrVrEiortypingrrrrrr r r numpyrrdynamic_module_utilsr feature_extraction_utilsrBaseBatchFeatureutilsrrrrrrrrrrrPILrr get_loggerrr/rrNr"formatr#r$r%rs" III4F    19OP   H % #  ^w>^wB$--A-M-M#N ##++7/C/O/O/W/W/^/^ /CRh0_0$$,8r$