sg< d dl Z d dlZd dlmZ d dlmZ ddlmZ ddl m
Z
m Z d Z ddZ
d Z G d d
Z G d d e Z G d
de Zy) N)Optional )TrainerCallback)IntervalStrategy
has_lengthc p t | } | dz | dz dz | dz }}}|dk7 r | d|dd|dS |dd|dS )z$Format `t` (in seconds) to (h):mm:ssi < r :02d)int)thmss N/var/www/html/venv/lib/python3.12/site-packages/transformers/utils/notebook.py format_timer s] AA4i!r'R R!qA%&!VaS!C!C !CAc7!Ac71CC c & d| d| d| d| d| d S )Nz
)valuetotalprefixlabelwidths r html_progress_barr ! s<
h wgeWOE7 C g r c d}|dz
}| d D ] }|d| dz
}
|dz
}| dd D ]; }|d z
}|D ]* }t |t r|d
n
t | }|d | d z
}, |d
z
}= |dz
}|S )z*Put the texts in `items` in an HTML table.z%
z*
r z
| z |
z
Nz
z.6fz
| z |
z
z
)
isinstancefloatstr)items html_codeilineelts r text_to_html_tabler& , s | j# n-| j !| j | j |z
z | _ | j | || _ || _ | j | j dk( rd| _ yt% t' | j( | j z d | _ yy)a
The main method to update the progress bar to `value`.
Args:
value (`int`):
The value to use. Must be between 0 and `total`.
force_update (`bool`, *optional*, defaults to `False`):
Whether or not to force and update of the internal state and display (by default, the bar will wait for
`value` to reach the value it predicted corresponds to a time of more than the `update_every` attribute
since the last update to avoid adding boilerplate).
comment (`str`, *optional*):
A comment to add on the left of the progress bar.
Nr r )r r0 r/ time
start_time last_time start_value elapsed_timepredicted_remainingwarmup first_callswait_for
update_barminr average_time_per_itemr* closemaxr update_every)r2 r r4 r0 current_times r updatezNotebookProgressBar.updatex s
"DL ?? "/3yy{ :DOdn16 6D t;? ?D 8 #{{D DM OOE "
doo
%l
T - - 1Uc$//TXTaTaBacgcmcm>n5n !# A% 99;L ,t >D t'''-1->->%$JZJZBZ-[*-1*
"
+/(zzJJL++7+/+E+EV[I[+\( OOE " #DO )DN**28R8RVW8W !
#C(9(9DDJ
%
%
- \N!DJJ4::,a D e Zd ZdZd fd Zd Zd ZddZd Z xZ S ) r, a
An object tracking the updates of an ongoing training with progress bars and a nice table reporting metrics.
Args:
num_steps (`int`): The number of steps during training. column_names (`List[str]`, *optional*):
The list of column names for the metrics table (will be inferred from the first call to
[`~utils.notebook.NotebookTrainingTracker.write_line`] if not set).
c J t | | |d n|g| _ d | _ y rX )superr3 inner_table child_bar)r2 num_steps column_names __class__s r r3 z NotebookTrainingTracker.__init__ s(
##/#74l^ r c ^ t | j | j | j | j | j
| _ | j (| xj t | j z
c_ | j )| xj | j j z
c_ | j :t j t j | j d | _
y | j j t j | j y rQ )r r r r r r r" ra r& rb r1 rS rN rT rF rU s r rN z NotebookTrainingTracker.display s *4::tzz4;;PTPZPZ\`\f\fg ' NN 01A1A B BN >> % NNdnn 6 6 6N ;; ,,tyy '@TRDK KK tyy 8 9r c * | j 8t |j t |j g| _ y| j d }|j D ] }||vs|j | || j d< t | j dkD r| j d }| j d d }|d || k7 r3| j j |D cg c]
}||v r|| nd c} y|}|D ], }||j vs||j
| ||< . |D cg c] }|| c}| j d< y| j j |D cg c] }|| c} yc c}w c c}w c c}w )z
Write the values in the inner table.
Args:
values (`Dict[str, float]`): The values to display.
Nr r zNo Log)ra listkeysvaluesappendrM index)r2 rk columnskey last_values first_columnc
new_valuess r
write_linez"NotebookTrainingTracker.write_line s # $V[[] 3T&--/5J KD &&q)G {{}
(g%NN3'
( #*D Q 4##$q( " . .r 2 # / / 21 5 q>VL%99$$++]d,eXY!v+VAY8-S,ef "(J $ J JOO$55,7
a8H,IJqMJ DK+KaJqM+KD$$R( ''G(Dq(DE -f ,L(Ds +F< F 2 Fc B t ||| | | _ | j S )a
Add a child progress bar displayed under the table of metrics. The child progress bar is returned (so it can be
easily updated).
Args:
total (`int`): The number of iterations for the child progress bar.
prefix (`str`, *optional*): A prefix to write on the left of the progress bar.
width (`int`, *optional*, defaults to 300): The width (in pixels) of the progress bar.
)r r+ r )r( rb )r2 r r r s r add_childz!NotebookTrainingTracker.add_child s! -U6$V[\~~ r c 2 d| _ | j y)z0
Closes the child progress bar.
N)rb rN rU s r remove_childz$NotebookTrainingTracker.remove_child s r rX )NrW )
rY rZ r[ r\ r3 rN rt rv rx
__classcell__)re s @r r, r, s"
: F> r r, c F e Zd ZdZd Zd Zd Zd dZd Zd dZ d d Z
d
Z y) NotebookProgressCallbackz
A [`TrainerCallback`] that displays the progress of training or evaluation, optimized for Jupyter Notebooks or
Google colab.
c . d | _ d | _ d| _ y )NF)training_trackerprediction_bar_force_next_updaterU s r r3 z!NotebookProgressCallback.__init__# s $ ""' r c |j t j k( rdnd| _ d| _ d| _ | j gdgz }|j t j k7 r|j d t |j | | _
y )NEpochStepr
Training LossValidation Loss)
eval_strategyr EPOCHrq
training_losslast_logNOrl r, max_stepsr} )r2 argsstatecontrolkwargsrd s r on_train_beginz'NotebookProgressCallback.on_train_begin( s} '+'9'9=M=S=S'SGY_
))*o->> !1!4!4 4 1 2 7 V r c & t |j |j k( rt |j n
|j d}| j j |j dz d| d|j
| j d| _ y )NrK r Epoch rJ r0 r4 F)r epochr} rF global_stepnum_train_epochsr )r2 r r r r r s r on_step_endz$NotebookProgressCallback.on_step_end1 s $' $4 $CEKK EKKX[K\ $$ ! UG1U%;%;$<= 00 %
#( r Nc n t | sy | j k| j *| j j t | | _ nt t | | _ | j j
d y | j j
| j j dz y )Nr )r r~ r} rv rM r( rF r )r2 r r r eval_dataloaderr s r on_prediction_stepz+NotebookProgressCallback.on_prediction_step: s /* &$$0&*&;&;&E&Ec/FZ&[#&9#o:N&O# & &q ) & &t':':'@'@1'D Er c ^ | j | j j d | _ y rX )r~ rB r2 r r r r s r
on_predictz#NotebookProgressCallback.on_predictF s( * % % ' "r c |j t j k( r7d|v r2d|d i}|j |d< | j j | y y y )Nlossr r )r r r r r} rt )r2 r r r logsr rk s r on_logz NotebookProgressCallback.on_logK sW !1!4!4 44 %tF|4F " . .F6N ! ! , ,V 4 :H 4r c | j ddd}t |j D ] }d|v s|d |d< n | j dk( rt |j
|d< n|j |d< d}|D ]+ } | j d st j d d
| }- |j d d }
|j d d }
|j | d
d }
|j | dd }
|j | dd }
|j | dd }
|j D ]R \ } } | j d } dj | dd D
cg c] }
|
j c}
}|dk( rd}| ||< T | j j | | j j! d | _ d| _ y y c c}
w )NzNo log)r r r r r r eval_lossz\_loss$r.
total_flosr _runtime_samples_per_second_steps_per_second_jit_compilation_time_rH r Lossr T)r} reversed log_historyrq r r r endswithresubpopr! splitjoin
capitalizert rx r~ r )r2 r r r metricsr rk logmetric_key_prefixkr vsplitspartnames r on_evaluatez$NotebookProgressCallback.on_evaluateS s ,'/HMF 1 12
S=.1&kF?+
G+"%ekk"2w!&!2!2v &
B::g&(*z2q(A%
B L$/A GT*A 0 1 :DAA 0 11D EtLA 0 11B CTJA 0 11F GNA
!1 xxvabz Jt !2 JK6>,D t
!
! ! , ,V 4 ! ! . . 0"&D &*D #A -. !Ks G
c | j j |j dt |j d|j
d d | _ y )Nr rJ Tr )r} rF r r r r r s r on_train_endz%NotebookProgressCallback.on_train_endv sR $$ S - .a0F0F/GH %
!% r rX ) rY rZ r[ r\ r3 r r r r r r r r r r r{ r{ s2
(
W(
F#
5!+F%r r{ )rW )r r6 typingr IPython.displayrN rS trainer_callbackr
trainer_utilsr r r r r& r( r, r{ r r r r sT
. 8D"O. O.dK 1 K\_% _%r