Litellm Support ?

[Greatz08]

Some changes in this project can be done i guess so that we can use any litellm supported models. It will help each and everyone to run 100+ LLM's easily without any issue so people can enjoy all open source models plus other proprietary llms . It will be great start for this project as team wont have to read each and every different llm's documentations for adding support to this project in my opinion. Later on popular llms native support can be added too for those who dont know how to use litellm

Litellm docs -> https://docs.litellm.ai/docs/

Btw thankyou very much for this great project :-))

[PieBru]

+1, and to take advantage of the open source LLM wave, it would be nice also to add direct support to Ollama, either via API or incorporating its library like this https://github.com/ollama/ollama-js