Skip to content

v0.9.0

Compare
Choose a tag to compare
@jackmpcollins jackmpcollins released this 06 Nov 05:08
· 190 commits to main since this release

What's Changed

Full Changelog: v0.8.0...v0.9.0


Example of LiteLLM backend

from magentic import prompt
from magentic.chat_model.litellm_chat_model import LitellmChatModel


@prompt(
    "Talk to me! ",
    model=LitellmChatModel("ollama/llama2"),
)
def say_hello() -> str:
    ...


say_hello()

See the Backend/LLM Configuration section of the README for how to set the LiteLLM backend as the default.