Code

Add vllm & general improvements#1

Code

Merged

sasha0552 merged 14 commits intomainsasha0552/ToriLinux:mainfrom devsasha0552/ToriLinux:devCopy head branch name to clipboardDec 24, 2023

+146-39

Commits

Commits on Dec 24, 2023

• Enable prompt cache in llama.cpp server

  sasha0552

  authored
  5a9496e

  Copy full SHA for 5a9496e

• Add stable-diffusion-webui

  sasha0552

  authored
  34a8450

  Copy full SHA for 34a8450

• Add vllm

  sasha0552

  authored
  460026a

  Copy full SHA for 460026a

• Update README.md

  sasha0552

  authored
  9e9dec0

  Copy full SHA for 9e9dec0

• Use CI on any branches

  sasha0552

  authored
  bd78e3f

  Copy full SHA for bd78e3f

• Specify CUDA_HOME for vllm

  sasha0552

  authored
  5d70963

  Copy full SHA for 5d70963

• Fix TORCH_CUDA_ARCH_LIST env variable

  sasha0552

  authored
  f1074ff

  Copy full SHA for f1074ff

• Remove Tesla P40-specific automatic config

  sasha0552

  authored
  d095545

  Copy full SHA for d095545

• Rename workflow

  sasha0552

  authored
  50822f9

  Copy full SHA for 50822f9

• Use gcc12 in vllm

  sasha0552

  authored
  19dec98

  Copy full SHA for 19dec98

• Refactor venv activation, rewrite vllm building

  sasha0552

  authored
  253c40c

  Copy full SHA for 253c40c

• Fix deactivation

  sasha0552

  authored
  2e1d9a3

  Copy full SHA for 2e1d9a3

• Run CI on PRs

  sasha0552

  authored
  87556fa

  Copy full SHA for 87556fa

• Remove stable-diffusion-webui

  sasha0552

  authored
  285b6f2

  Copy full SHA for 285b6f2