Skip to content

Commit

Permalink
line
Browse files Browse the repository at this point in the history
  • Loading branch information
bigning committed Apr 10, 2024
1 parent 0ee1fad commit 379969b
Showing 1 changed file with 0 additions and 4 deletions.
4 changes: 0 additions & 4 deletions composer/trainer/mosaic_fsdp_utils.py
Original file line number Diff line number Diff line change
Expand Up @@ -1137,10 +1137,6 @@ def _shard_orig_param_state(
fqn: str,
optim_state: Dict[str, Any],
) -> Dict[str, Any]:
"""
Shard the optimizer state for the original parameter with the name ``fqn``.
This API should only be used when ``use_orig_params`` is True.
"""
if not optim_state:
return {}
fsdp_state = fsdp_param_info.state
Expand Down

0 comments on commit 379969b

Please sign in to comment.