Skip to content

Commit

Permalink
recog with bfloat16
Browse files Browse the repository at this point in the history
  • Loading branch information
albertz committed Jan 10, 2025
1 parent 738d2ec commit 872ac06
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -99,8 +99,8 @@ def py():
"beam_size": 1024,
"beam_size_token": 128,
"beam_threshold": 14,
"recog_version": 6,
"batch_size": 5_000 * ctc_model.definition.batch_size_factor,
"torch_amp": {"dtype": "bfloat16"},
},
search_rqmt={"cpu": 4, "mem": 30, "time": 24, "gpu_mem": 24},
)
Expand Down

0 comments on commit 872ac06

Please sign in to comment.