Skip to content

Commit

Permalink
fix(ray): fix "GPU" tag deployment
Browse files Browse the repository at this point in the history
  • Loading branch information
heiruwu committed Dec 19, 2024
1 parent 6abcfd2 commit 29f83af
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion pkg/ray/ray.go
Original file line number Diff line number Diff line change
Expand Up @@ -316,7 +316,7 @@ func (r *ray) setHardwareRunOptions(hardware string, numOfGPU string) []string {
case SupportedAcceleratorType["GPU"]:
runOptions = append(runOptions,
fmt.Sprintf("-e %s=%v", EnvTotalVRAM, config.Config.RayServer.Vram),
fmt.Sprintf("-e %s=%v", EnvNumOfGPUs, numOfGPU),
fmt.Sprintf("-e %s=%v", EnvNumOfGPUs, 1),
"--device nvidia.com/gpu=all",
)
default:
Expand Down

0 comments on commit 29f83af

Please sign in to comment.