Skip to content

adds an example of openai-compatible serving #13

adds an example of openai-compatible serving

adds an example of openai-compatible serving #13

Annotations

1 warning

Run changed example (06_gpu_and_ml/llm-serving/vllm_oai_compatible/client.py)

succeeded May 10, 2024 in 18s