Skip to content

Commit

Permalink
sharding debug
Browse files Browse the repository at this point in the history
fbshipit-source-id: 4a0b3c3de51d347f46f303bf37e7d64688d41d98
  • Loading branch information
s4ayub authored and facebook-github-bot committed Feb 1, 2024
1 parent 2d52760 commit 5173e5d
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions torchrec/distributed/quant_embeddingbag.py
Original file line number Diff line number Diff line change
Expand Up @@ -407,6 +407,7 @@ def __init__(
assert feature_processor is not None
device_type: str = self._device.type if self._device is not None else "cuda"
self.feature_processors_per_rank: nn.ModuleList = torch.nn.ModuleList()
breakpoint()
for i in range(env.world_size):
self.feature_processors_per_rank.append(
feature_processor
Expand Down

0 comments on commit 5173e5d

Please sign in to comment.