sg ~dZddlZddlmZddlmZmZej eZGddeZ d e iZ d d iZ d diZ y) z+XNLI utils (dataset loading and evaluation)N)logging) DataProcessor InputExamplec*eZdZdZddZdZdZdZy) XnliProcessorz Processor for the XNLI dataset. Adapted from https://github.com/google-research/bert/blob/f39e881b169b9d53bea03d2d341b31707a6c052b/run_classifier.py#L207 Nc ||_||_yN)languagetrain_language)selfr r s T/var/www/html/venv/lib/python3.12/site-packages/transformers/data/processors/xnli.py__init__zXnliProcessor.__init__!s  ,c |j |jn |j}|jtjj |d|d}g}t |D]\}}|dk(r d|}|d}|d} |ddk(rdn|d} t|tstd |d t| tstd | d t| tstd | d |jt||| | |S) See base class.z$XNLI-MT-1.0/multinli/multinli.train.z.tsvrztrain-r contradictory contradictionTraining input  is not a stringTraining label guidtext_atext_blabel) r r _read_tsvospathjoin enumerate isinstancestr TypeErrorappendr) rdata_dirlglinesexamplesilinerrrrs rget_train_examplesz XnliProcessor.get_train_examples%s "119T]]t?R?Rrww||H8\]_\``d6efg ' `GAtAvA3rDsa 2 .   H %8:M8:x M    Ar