Skip to content

Commit

Permalink
[projects][vllm] Fix Pascal support
Browse files Browse the repository at this point in the history
  • Loading branch information
sasha0552 authored Aug 11, 2024
1 parent 84eb924 commit a2759ee
Showing 1 changed file with 5 additions and 5 deletions.
10 changes: 5 additions & 5 deletions airootfs/root/customize_airootfs/scripts/1000-vllm.sh.jinja2
Original file line number Diff line number Diff line change
Expand Up @@ -2,15 +2,15 @@
set -eu

{% if platform == "cuda" %}
# use patched vllm
# use repo with patched packages
export PIP_EXTRA_INDEX_URL="https://sasha0552.github.io/pascal-pkgs-ci/"

# install vllm
pipx install vllm
# install patched vllm
pipx install vllm-pascal

# remove triton
pipx runpip vllm uninstall -y triton
pipx runpip vllm-pascal uninstall -y triton

# install patched triton
pipx runpip vllm install triton-pascal
pipx runpip vllm-pascal install triton-pascal
{% endif %}

0 comments on commit a2759ee

Please sign in to comment.