Fix gradient scaling to account for world_size normalization#2172

Open

mirceamironenco wants to merge 3 commits intopytorch:mainfrom mirceamironenco:fix-world-size-normalization

+18-9

Commits on Dec 18, 2024