Code

PPO Performance Improvements#2066

Code

Merged

RdoubleA merged 8 commits intopytorch:mainpytorch/torchtune:mainfrom SalmanMohammadi:ppo_performance_improvementsSalmanMohammadi/torchtune:ppo_performance_improvementsCopy head branch name to clipboardJan 15, 2025

+267-130

Commits

Commits on Nov 25, 2024

• BOOM

  SalmanMohammadi

  committed
  d328fe9

  Copy full SHA for d328fe9

• commentso

  SalmanMohammadi

  committed
  c2c284f

  Copy full SHA for c2c284f

• removing custom generate

  SalmanMohammadi

  committed
  68e7434

  Copy full SHA for 68e7434

• commentso.. 2

  SalmanMohammadi

  committed
  a7e40b8

  Copy full SHA for a7e40b8

• bring back checkpointing

  SalmanMohammadi

  committed
  19bcd13

  Copy full SHA for 19bcd13

• fixing stop tokens logits

  SalmanMohammadi

  committed
  f6c9276

  Copy full SHA for f6c9276

Commits on Dec 9, 2024

• addressing comments

  SalmanMohammadi

  committed
  2b759f9

  Copy full SHA for 2b759f9

• fixing conflicts

  SalmanMohammadi

  committed
  92927c4

  Copy full SHA for 92927c4