sgdZddlmZddlmZddlmZmZm Z ddl m Z eje Zd Zd ej d ed ed ej fdZGdde ZGddeZGddeZy)zFlax mT5 model.N)logging)FlaxT5EncoderModelFlaxT5ForConditionalGeneration FlaxT5Model) MT5ConfigT5Config input_ids pad_token_iddecoder_start_token_idreturnctj|}|jddddfj|ddddf}|jdddfj|}tj|dk(||}|S)z1 Shift input ids one token to the right. Nr ri)jnp zeros_likeatsetwhere)r r rshifted_input_idss \/var/www/html/venv/lib/python3.12/site-packages/transformers/models/mt5/modeling_flax_mt5.pyshift_tokens_rightrsy1),,QU377 !SbS&8IJ),,QT2667MN "3t";\K\] ceZdZdZdZeZy) FlaxMT5Modela This class overrides [`FlaxT5Model`]. Please check the superclass for the appropriate documentation alongside usage examples. Examples: ```python >>> from transformers import FlaxMT5Model, AutoTokenizer >>> model = FlaxMT5Model.from_pretrained("google/mt5-small") >>> tokenizer = AutoTokenizer.from_pretrained("google/mt5-small") >>> article = "UN Offizier sagt, dass weiter verhandelt werden muss in Syrien." >>> summary = "Weiter Verhandlung in Syrien." >>> inputs = tokenizer(article, return_tensors="np") >>> decoder_input_ids = tokenizer(text_target=summary, return_tensors="np").input_ids >>> outputs = model(input_ids=inputs["input_ids"], decoder_input_ids=decoder_input_ids) >>> hidden_states = outputs.last_hidden_state ```mt5N__name__ __module__ __qualname____doc__ model_typer config_classrrrr* ,JLrrceZdZdZdZeZy)FlaxMT5EncoderModela  This class overrides [`FlaxT5EncoderModel`]. Please check the superclass for the appropriate documentation alongside usage examples. Examples: ```python >>> from transformers import FlaxT5EncoderModel, AutoTokenizer >>> model = FlaxT5EncoderModel.from_pretrained("google/mt5-small") >>> tokenizer = AutoTokenizer.from_pretrained("google/mt5-small") >>> article = "UN Offizier sagt, dass weiter verhandelt werden muss in Syrien." >>> summary = "Weiter Verhandlung in Syrien." >>> inputs = tokenizer(article, return_tensors="np") >>> decoder_input_ids = tokenizer(text_target=summary, return_tensors="np").input_ids >>> outputs = model(input_ids=inputs["input_ids"]) >>> hidden_states = outputs.last_hidden_state ```rNrr%rrr(r(Er&rr(ceZdZdZdZeZy)FlaxMT5ForConditionalGenerationa- This class overrides [`FlaxT5ForConditionalGeneration`]. Please check the superclass for the appropriate documentation alongside usage examples. Examples: ```python >>> from transformers import FlaxMT5ForConditionalGeneration, AutoTokenizer >>> model = FlaxMT5ForConditionalGeneration.from_pretrained("google/mt5-small") >>> tokenizer = AutoTokenizer.from_pretrained("google/mt5-small") >>> article = "UN Offizier sagt, dass weiter verhandelt werden muss in Syrien." >>> summary = "Weiter Verhandlung in Syrien." >>> inputs = tokenizer(article, return_tensors="np") >>> decoder_input_ids = tokenizer(text_target=summary, return_tensors="np").input_ids >>> outputs = model(**inputs, decoder_input_ids=decoder_input_ids) >>> logits = outputs.logits ```rNrr%rrr*r*`r&rr*)r" jax.numpynumpyrutilsrt5.modeling_flax_t5rrrconfiguration_mt5r get_loggerrlogger_CONFIG_FOR_DOCndarrayintrrr(r*r%rrr5saa(   H % #++ S Z] bebmbm ;6,6&Dr