You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
For most models there exists some kind of ratelimit, from free providers like Groq it is easier to reach.
Steps:
creation of first version of SlowSchema <: AbstractTracerSchema
creation of methods for initialize_tracer, finalize_tracer (it has some defaults, but you might to simply use it as a passthrough)
wrapping the GroqSchema to create FreeGroqOpenAISchema into the one above FreeGroqOpenAISchema = RateLimitSchema(GroqOpenAISchema, 30, Minute(1)) (So it is still callable like any other schema.
The text was updated successfully, but these errors were encountered:
For most models there exists some kind of ratelimit, from free providers like Groq it is easier to reach.
Steps:
creation of first version of
SlowSchema <: AbstractTracerSchema
creation of methods for i
nitialize_tracer
,finalize_tracer
(it has some defaults, but you might to simply use it as a passthrough)wrapping the GroqSchema to create
FreeGroqOpenAISchema
into the one aboveFreeGroqOpenAISchema = RateLimitSchema(GroqOpenAISchema, 30, Minute(1))
(So it is still callable like any other schema.The text was updated successfully, but these errors were encountered: