v0.9.0
What's Changed
- Add LiteLLM backend by @jackmpcollins in #54
Full Changelog: v0.8.0...v0.9.0
Example of LiteLLM backend
from magentic import prompt
from magentic.chat_model.litellm_chat_model import LitellmChatModel
@prompt(
"Talk to me! ",
model=LitellmChatModel("ollama/llama2"),
)
def say_hello() -> str:
...
say_hello()
See the Backend/LLM Configuration section of the README for how to set the LiteLLM backend as the default.