sg!dZddlZddlmZmZmZmZddlmZddl m Z ddl m Z m Z  dejdefdZdejdeee eejffd Zdejdee fd Zdejdefd Zy) z NOTE: This file must be imported like ``import torch.distributed.fsdp._traversal_utils`` and not like ``from torch.distirbuted.fsdp._traversal_utils import ...`` to avoid circular imports. For brevity, we may import the file as ``traversal_utils``. N)DequeListSetTuple _get_registry) _FSDPState_get_module_fsdp_statemodulereturnc&t|}|yd|vS)zA Returns if ``module`` can compose with ``fully_shard``. T replicater)r registrys Z/var/www/html/venv/lib/python3.12/site-packages/torch/distributed/fsdp/_traversal_utils.py _composabler#s" V$H h &&cg}g}t}t}tj|g}|r|j}|j |t |s/t t|jD]}||vs|j|t|}|7||vr3|j ||j||j||r||fS)a Returns a tuple containing: 1. A list of the ``_FSDPState`` instances in the module tree rooted at ``module`` without any duplicates and following the ``module.modules()`` traversal order (which is assumed to be depth-first). 2. A corresponding list of the modules owning the states in the first list. For the wrapper code path, both returned lists are the same, each containing all ``FullyShardedDataParallel`` instances. For the composable code path, this returns a list of all composable state instances and a list of the corresponding fully sharded modules. See [Note: Fully Sharded Module]. NOTE: The traversal does not proceed into any module annotated by an incompatible API (e.g. ``replicate``). ) set collectionsdequepopleftaddrreversedlistchildren appendleftr append) r fsdp_states fsdp_modulesvisited_fsdp_statesvisited_modulesr submodule child_moduleoptional_states r_get_fsdp_states_with_modulesr%1s&%'K$&L,/5'*eO *//9E MMO I&9% $T)*<*<*>%?@ /L?2  . /0 :  %.@S*S  # #N 3   ~ .    *   $$rc"t|\}}|S)z*See :func:`_get_fsdp_states_with_modules`.)r%)r r_s r_get_fsdp_statesr(as26:NK rclt|Dcgc]}|j |j}}|Scc}w)z Returns all ``FlatParamHandle`` s in the module tree rooted at ``module`` following the rules in :func:`_get_fsdp_state`. )r(_handle)r fsdp_statehandless r_get_fsdp_handlesr-gsD+62     ) G N s1)__doc__rtypingrrrrtorch.nnnn&torch.distributed._composable.contractr$torch.distributed.fsdp._common_utilsr r Moduleboolrr%r(r-rrr7s**@S&' 'd'-% II-% 4 T"))_ ,--%`RYY4 +; bii D r