Skip to content

Commit

Permalink
Update general_startscript
Browse files Browse the repository at this point in the history
  • Loading branch information
r-sarma authored Dec 8, 2023
1 parent ef1cab6 commit 035464b
Showing 1 changed file with 3 additions and 4 deletions.
7 changes: 3 additions & 4 deletions experimental/trainer/general_startscript
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@ strategy='DS'
# parameters
debug=false # do debug
bs=32 # batch-size
epochs=4 # epochs
epochs=1 # epochs
lr=0.01 # learning rate

# AT
Expand Down Expand Up @@ -68,13 +68,13 @@ if [ "$SLURM_CPUS_PER_TASK" > 0 ] ; then
export OMP_NUM_THREADS=$SLURM_CPUS_PER_TASK
fi

COMMAND="general_trainer.py"
COMMAND="general_trainer_v2.py"

#launch
if [[ $strategy == *"HVD"* ]];
then
EXEC="$COMMAND \
--strat $strategy \
--strategy $strategy \
--batch-size $bs \
--epochs $epochs \
--lr $lr \
Expand Down Expand Up @@ -133,4 +133,3 @@ else
$EXEC --deepspeed_mpi --deepspeed_config DS_config.json

fi

0 comments on commit 035464b

Please sign in to comment.