sg@ddlmZddlmZddlmZerddlmZddZy) ) annotations) TYPE_CHECKING)is_torch_available)nnctsyddl}t||jjj xs t |ddS)NFr_is_fsdp_managed_module)rtorch.distributed.fsdp isinstance distributedfsdpFullyShardedDataParallelgetattr)moduletorchs Q/var/www/html/venv/lib/python3.12/site-packages/transformers/integrations/fsdp.pyis_fsdp_managed_modulersE  ! fe//44MM N RY)5SN)rz nn.Modulereturnbool) __future__rtypingrutilsrrrrrrrs# &r