The following providers are supported by LLMInterface.
| Provider Name | Interface Name | .sendMessage | .streamMessage | .embeddings | |
|---|---|---|---|---|---|
 |
AI21 Studio | ai21 |
✓ | ✓ | ✓ |
| AiLAYER | ailayer |
✓ | |||
 |
AIMLAPI | aimlapi |
✓ | ✓ | ✓ |
 |
Anthropic | anthropic |
✓ | ✓ | |
 |
Anyscale | anyscale |
✓ | ✓ | |
 |
Cloudflare AI | cloudflareai |
✓ | ✓ | |
 |
Cohere | cohere |
✓ | ✓ | ✓ |
 |
Corcel | corcel |
✓ | ✓ | |
 |
DeepInfra | deepinfra |
✓ | ✓ | ✓ |
 |
DeepSeek | deepseek |
✓ | ✓ | |
| Fireworks AI | fireworksai |
✓ | ✓ | ✓ | |
 |
Forefront AI | forefront |
✓ | ||
| FriendliAI | friendliai |
✓ | ✓ | ||
| Google Gemini | gemini |
✓ | ✓ | ✓ | |
 |
GooseAI | gooseai |
✓ | ✓ | |
| Groq | groq |
✓ | ✓ | ||
| Hugging Face Inference | huggingface |
✓ | ✓ | ||
| HyperBee AI | hyperbeeai |
✓ | ✓ | ||
 |
Lamini | lamini |
✓ | ✓ | |
| LLaMA.CPP | llamacpp |
✓ | ✓ | ✓ | |
 |
Mistral AI | mistralai |
✓ | ✓ | ✓ |
 |
Monster API | monsterapi |
✓ | ✓ | |
 |
Neets.ai | neetsai |
✓ | ✓ | |
| Novita AI | novitaai |
✓ | ✓ | ||
| NVIDIA AI | nvidia |
✓ | ✓ | ||
| OctoAI | octoai |
✓ | |||
| Ollama | ollama |
✓ | ✓ | ✓ | |
| OpenAI | openai |
✓ | ✓ | ✓ | |
 |
Perplexity AI | perplexity |
✓ | ✓ | |
 |
Reka AI | rekaai |
✓ | ✓ | |
 |
Replicate | replicate |
✓ | ✓ | |
 |
Shuttle AI | shuttleai |
✓ | ✓ | |
| TheB.ai | thebai |
✓ | ✓ | ||
 |
Together AI | togetherai |
✓ | ✓ | ✓ |
| Voyage AI | voyage |
✓ | |||
| Watsonx AI | watsonxai |
✓ | ✓ | ||
 |
Writer | writer |
✓ | ✓ | |
| Zhipu AI | zhipuai |
✓ | ✓ |