Skip to content

Commit

Permalink
fix bug: device_str in initialize_ray_cluster requires uppercase stri…
Browse files Browse the repository at this point in the history
…ng (#297)

fix bug: device_str in initialize_ray_cluster requires uppercase string

w/o the bug fix, multi HPUs will encounter "ValueError: The number of
required hpus exceeds the total number of available hpus in the
placement group" error, as the device_str is not expected as uppercase,
then available hpus always returns 0.
  • Loading branch information
hlin99 authored Sep 20, 2024
1 parent 12d7033 commit bc39baa
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion vllm/executor/ray_utils.py
Original file line number Diff line number Diff line change
Expand Up @@ -98,7 +98,7 @@ def initialize_ray_cluster(
if is_tpu():
device_str = "TPU"
elif is_hpu():
device_str = hpu_device_string()
device_str = hpu_device_string().upper()
# Create placement group for worker processes
current_placement_group = ray.util.get_current_placement_group()
if current_placement_group:
Expand Down

0 comments on commit bc39baa

Please sign in to comment.