Skip to content

Commit

Permalink
revert to new fmi (#3707)
Browse files Browse the repository at this point in the history
  • Loading branch information
Addi-11 authored Dec 26, 2024
1 parent e33b6db commit 111a530
Showing 1 changed file with 4 additions and 4 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -48,12 +48,12 @@ RUN pip install git+https://github.com/stanford-futuredata/megablocks.git@5897cd
# RUN pip install -e ./ --no-cache-dir

# When copied to assets repo, change to install from public pypi
RUN pip install llm-optimized-inference==0.2.7 --no-cache-dir
RUN pip install llm-optimized-inference==0.2.16 --no-cache-dir

RUN pip uninstall transformers -y
RUN pip uninstall -y vllm

# Install patched vllm wheel
RUN pip install https://automlsamplenotebookdata.blob.core.windows.net/vllm/vllm-0.5.3.post1-cp310-cp310-linux_x86_64.whl
RUN pip install vllm==0.6.1.post2
RUN pip install transformers==4.46.2

# clean conda and pip caches
RUN rm -rf ~/.cache/pip
Expand Down

0 comments on commit 111a530

Please sign in to comment.