sgG d Z ddlmZmZmZmZ ddlZddlm Z m
Z
ddl m Z m
Z
mZmZmZmZ ej$ e Z G d de
Zy) zZ
Sequence feature extraction class for common feature extractors to preprocess sequences.
)DictListOptionalUnionN ) BatchFeatureFeatureExtractionMixin)PaddingStrategy
TensorType is_tf_tensoris_torch_tensorloggingto_numpyc e Zd ZdZdededef fd Z ddeee e e
e ef e
e e e f e e
e ef f dee e e
f d ee d
e d ee d ee d
eee ef defdZde
j" ddfdee
e ej& f ef d ee de
d ee d ee def dZ ddee
e ej& f ef d ee d ee d
ee fdZddZ xZS )SequenceFeatureExtractora
This is a general feature extraction class for speech recognition.
Args:
feature_size (`int`):
The feature dimension of the extracted features.
sampling_rate (`int`):
The sampling rate at which the audio files should be digitalized expressed in hertz (Hz).
padding_value (`float`):
The value that is used to fill the padding values / vectors.
feature_size
sampling_rate
padding_valuec || _ || _ || _ |j dd | _ |j dd | _ t
| di | y )N padding_siderightreturn_attention_maskT )r r r popr r super__init__)selfr r r kwargs __class__s a/var/www/html/venv/lib/python3.12/site-packages/transformers/feature_extraction_sequence_utils.pyr z!SequenceFeatureExtractor.__init__+ sR ( * * "JJ~w ?%+ZZ0G%N"
"6" Nprocessed_featurespadding
max_length
truncationpad_to_multiple_ofr return_tensorsreturnc
t |t t f rMt |d t t f r4|d j D ci c] }||D cg c] } | | c} }}} j d |vr5t d j d dt |j | j d }
||n j }t |
dk( r |rg |d< |S |
d } t | t t f r@d} t |
| dk( r| dz
} t |
| dk( r| t |
k r|
| d } |it | rd}n[t | rd}nMt | t t t t t j f rd}nt d | d
t! | d |j# D ]I \ }}
t |
d t t f rt% |
||< .|
D cg c]
}t% | c}||< K j' || }| j d }
t |
t) fd
|j+ D s t d g }t- D ]N }|j# D ci c] \ }}|||
}}} j/ |||| }|j1 | P |t2 j4 k( r$t7 fd|D }t2 j8 }i }t- D ] } j; || |||| }|j# D ]p \ }}
||vrg ||< |
j< t j< t j> u r |
jA t jB }
|| j1 |
r t || S c c} w c c} }w c c}w c c}}w )a
Pad input values / input vectors or a batch of input values / input vectors up to predefined length or to the
max sequence length in the batch.
Padding side (left/right) padding values are defined at the feature extractor level (with `self.padding_side`,
`self.padding_value`)
If the `processed_features` passed are dictionary of numpy arrays, PyTorch tensors or TensorFlow tensors, the
result will use the same type unless you provide a different tensor type with `return_tensors`. In the case of
PyTorch tensors, you will lose the specific device of your tensors however.
Args:
processed_features ([`BatchFeature`], list of [`BatchFeature`], `Dict[str, List[float]]`, `Dict[str, List[List[float]]` or `List[Dict[str, List[float]]]`):
Processed inputs. Can represent one input ([`BatchFeature`] or `Dict[str, List[float]]`) or a batch of
input values / vectors (list of [`BatchFeature`], *Dict[str, List[List[float]]]* or *List[Dict[str,
List[float]]]*) so you can use this method during preprocessing as well as in a PyTorch Dataloader
collate function.
Instead of `List[float]` you can have tensors (numpy arrays, PyTorch tensors or TensorFlow tensors),
see the note above for the return type.
padding (`bool`, `str` or [`~utils.PaddingStrategy`], *optional*, defaults to `True`):
Select a strategy to pad the returned sequences (according to the model's padding side and padding
index) among:
- `True` or `'longest'`: Pad to the longest sequence in the batch (or no padding if only a single
sequence if provided).
- `'max_length'`: Pad to a maximum length specified with the argument `max_length` or to the maximum
acceptable input length for the model if that argument is not provided.
- `False` or `'do_not_pad'` (default): No padding (i.e., can output a batch with sequences of different
lengths).
max_length (`int`, *optional*):
Maximum length of the returned list and optionally padding length (see above).
truncation (`bool`):
Activates truncation to cut input sequences longer than `max_length` to `max_length`.
pad_to_multiple_of (`int`, *optional*):
If set will pad the sequence to a multiple of the provided value.
This is especially useful to enable the use of Tensor Cores on NVIDIA hardware with compute capability
`>= 7.5` (Volta), or on TPUs which benefit from having sequence lengths be a multiple of 128.
return_attention_mask (`bool`, *optional*):
Whether to return the attention mask. If left to the default, will return the attention mask according
to the specific feature_extractor's default.
[What are attention masks?](../glossary#attention-mask)
return_tensors (`str` or [`~utils.TensorType`], *optional*):
If set, will return tensors instead of list of python integers. Acceptable values are:
- `'tf'`: Return TensorFlow `tf.constant` objects.
- `'pt'`: Return PyTorch `torch.Tensor` objects.
- `'np'`: Return Numpy `np.ndarray` objects.
r zYou should supply an instance of `transformers.BatchFeature` or list of `transformers.BatchFeature` to this method that includes z, but you provided attention_maskr tfptnpztype of z
unknown: zA. Should be one of a python, numpy, pytorch or tensorflow object.)r# r$ c 3 : K | ] }t | k( y w)N)len).0v
batch_sizes r z/SequenceFeatureExtractor.pad.. s MA3q6Z'Ms zLSome items in the output dictionary have a different batch size than others.)r$ r& r% c 3 T K | ] }t |j d ! yw)r N)r/ model_input_names)r0 input_slicer s r r3 z/SequenceFeatureExtractor.pad.. s& m[ST-C-CA-F!G H ms %()r$ padding_strategyr& r ) tensor_type)"
isinstancelisttupledictr keysr5
ValueErrorr r/ r r
intfloatr- ndarraytypeitemsr _get_padding_strategiesallvaluesrange _truncateappendr
LONGESTmax
MAX_LENGTH_paddtypefloat64astypefloat32)r r" r# r$ r% r& r r' keyexamplerequired_input
first_elementindexvaluer1 r7 truncated_inputsikinputs inputs_slice
batch_outputsoutputsr2 s ` @r padz SequenceFeatureExtractor.pad5 s R (4- 8ZHZ[\H]`dfr_s=tQcdeQfQkQkQm"JM2DEwgclEE" "
! !! $,> > 1151G1G1J0K L+002346
,D,B,B1,EF%:%F !DLfLf ~ ! #$79"#34% % 'q)
mdE] 3EnU+,1
nU+,1s>** .u 5a 8
!M*!% /!%MCeRZZ+PQ!% }oZ]8K7L MV V
-224 GJC%(S%L1*25/"3'@E*F18A;*F"3' G 77T^7_+D,B,B1,EF (
M1C1J1J1LMM kl l z" 2A*<*B*B*DE$!Qa1gEFE >>%#5% * L
# #L 1 2 6 6 6 m\l mmJ . 9 9
z" 1Aii #%!1#5&; G &mmo
1
Um+)+M#&;;"((2::"66 !LL 4E c"))%0
1 1" M~FFC F"h +G Fs$
N9 N4 N9-N?O4N9r7 c || j d }|t j k( r t | }||||z dk7 r ||z dz |z }|t j k7 xr t | |k }|r5d|vr1t j t | t
j |d< |r)|t | z
}| j dk( rn|r t j |d d|f |d< | j dkD rd|fdfnd|f} t j || d| j || j d < |S | j d k( rn|r t j |d |df |d< | j dkD r|dfdfn|df} t j || d| j || j d < |S t d
t | j z |S ) a
Pad inputs (on left/right and up to predefined length or max length in the batch)
Args:
processed_features (`Union[Dict[str, np.ndarray], BatchFeature]`):
Dictionary of input values (`np.ndarray[float]`) / input vectors (`List[np.ndarray[float]]`) or batch
of inputs values (`List[np.ndarray[int]]`) / input vectors (`List[np.ndarray[int]]`)
max_length (`int`, *optional*):
Maximum length of the returned list and optionally padding length (see below)
padding_strategy (`PaddingStrategy`, *optional*, default to `PaddingStrategy.DO_NOT_PAD`):
PaddingStrategy to use for padding.
- PaddingStrategy.LONGEST Pad to the longest sequence in the batch
- PaddingStrategy.MAX_LENGTH: Pad to the max length (default)
- PaddingStrategy.DO_NOT_PAD: Do not pad
The feature_extractor padding sides are defined in self.padding_side:
- 'left': pads on the left of the sequences
- 'right': pads on the right of the sequences
pad_to_multiple_of (`int`, *optional*):
Integer if set will pad the sequence to a multiple of the provided value. This is especially useful to
enable the use of Tensor Core on NVIDIA hardware with compute capability `>= 7.5` (Volta), or on TPUs
which benefit from having sequence lengths be a multiple of 128.
return_attention_mask (`bool`, *optional*):
Set to False to avoid returning attention mask (default: set to model specifics)
r r r* )rN r )r r constant)constant_valuesleftzInvalid padding strategy:)r5 r
rJ r/
DO_NOT_PADr- onesint32r r_ r r r> str)
r r" r$ r7 r& r rT needs_to_be_padded
difference
padding_shapes
r rM z SequenceFeatureExtractor._pad s D ,D,B,B1,EF 6 6 6 ^,J !&8&D*WiJimnJn%);;q@DVVJ - 1K1K K pPSTbPcfpPp %5=O%O35773~;NVXV^V^3_ / 0 #c.&99J G+(;=66*+;B=N=NQR=R!Z & 9YZ\fXg
@B"M:tOaOaA"4#9#9!#<= "! ""f,(;=66*+;B=N=NQR=R*a & 9YcefXg
@B"M:tOaOaA"4#9#9!#<= "! !!= 7.5` (Volta), or on TPUs
which benefit from having sequence lengths be a multiple of 128.
truncation (`bool`, *optional*):
Activates truncation to cut input sequences longer than `max_length` to `max_length`.
NzKWhen setting ``truncation=True``, make sure that ``max_length`` is defined.r r r* )r> r5 r/ )r r" r$ r& r% rT needs_to_be_truncateds r rH z"SequenceFeatureExtractor._truncate+ s . % %
J . jk k+D,B,B1,EF !&8&D*WiJimnJn%);;q@DVVJ #N 3j @ r )r r# r$ r7 s r rD z0SequenceFeatureExtractor._get_padding_strategiesV s % $#2#:#: 9#27#; G_5#* . 9 9 ?#=#== -o.H.H-IIqr
9 9 9t?Q?Q?Y ]
r! )TNFNNN)NNN)FN)__name__
__module__ __qualname____doc__r? r@ r r r r r rg boolr
r r r_ rd r- rA r< rM rH rD
__classcell__)r s @r r r s
#S # #U #& 6:$( ,004;? lG ! l" # d<(( ) c<'( )
+
lG tS/12lG SMlG lG %SMlG (~lG !sJ!78 lG
lGb %),;,F,F,004
F" !$sBJJ"7 "E FF" SMF" * F"
%SM F" (~
F"
F"V %),0%) )" !$sBJJ"7 "E F)" SM)" %SM )"
TN )"V r! r )rq typingr r r r numpyr- feature_extraction_utilsr r utilsr
r r r
r r
get_loggerrn loggerr r r! r rz sA / . J ` `
H %V 5 V r!