You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Problem Statement
For model serving with optimized routes we need to be able to send significantly larger volume of concurrent requests. it would be great to be able to control the pooling config.
Proposed Solution
Pass the pooling config as part of the setting the databricks config.
Additional Context
Alternative is to maintain a custom http client implementation with custom pooling manager configurations.
The text was updated successfully, but these errors were encountered:
Problem Statement
For model serving with optimized routes we need to be able to send significantly larger volume of concurrent requests. it would be great to be able to control the pooling config.
Proposed Solution
Pass the pooling config as part of the setting the databricks config.
Additional Context
Alternative is to maintain a custom http client implementation with custom pooling manager configurations.
The text was updated successfully, but these errors were encountered: