Skip to content

Commit

Permalink
Release fmi version 55 (#3487)
Browse files Browse the repository at this point in the history
* Release fmi 55 that works vision models

* release fmi 55

* upgrade to 0.2.14
  • Loading branch information
QianqianNie authored Oct 19, 2024
1 parent 2f3da63 commit 40825e3
Showing 1 changed file with 1 addition and 6 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -47,12 +47,7 @@ RUN pip install git+https://github.com/stanford-futuredata/megablocks.git@5897cd
# RUN pip install -e ./ --no-cache-dir

# When copied to assets repo, change to install from public pypi
RUN pip install llm-optimized-inference==0.2.12 --no-cache-dir

RUN pip uninstall transformers -y
RUN pip uninstall -y vllm
RUN pip install https://automlsamplenotebookdata.blob.core.windows.net/vllm/transformers-4.45.0.dev0-py3-none-any.whl
RUN pip install https://automlsamplenotebookdata.blob.core.windows.net/vllm/vllm-0.6.1.post2+cu124-cp38-abi3-manylinux1_x86_64.whl
RUN pip install llm-optimized-inference==0.2.14 --no-cache-dir

# clean conda and pip caches
RUN rm -rf ~/.cache/pip
Expand Down

0 comments on commit 40825e3

Please sign in to comment.