You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I am wondering if we can add a parameter to control the maximum token limit for the scraped web page content? I am currently bugged that the length of the returned content for each search result is extremely varied and unpredictable, from 200 tokens to over 10,000. It would be great if we can set a range or limit, in order to have a more reliable expectation of the searched output and manage our token budget better for projects.
The text was updated successfully, but these errors were encountered:
Hi! I really appreciate your product!
I am wondering if we can add a parameter to control the maximum token limit for the scraped web page content? I am currently bugged that the length of the returned content for each search result is extremely varied and unpredictable, from 200 tokens to over 10,000. It would be great if we can set a range or limit, in order to have a more reliable expectation of the searched output and manage our token budget better for projects.
The text was updated successfully, but these errors were encountered: