RateLimit configuration

[robomotic]

Hi there,
I know that dspy uses LiteLLM and that langchain also has a memory rate limiter that you can pass into the chat model.
However I can't figure what should I do for example to retrict to N requests/second or T tokens/seconds etc.
Any example would be great.
Cheers.

[arnavsinghvi11]

Hi @robomotic ,

DSPy doesn't support LiteLLM Router integrations yet, but the mentioned documentation's instructions and an existing PR might be helpful in understanding some examples on how this would work.

Leaving this open!