You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Allow a dry run that reports stats on # calls, # unique prompts, # tokens in all those prompts.
This might be a command on the CLI, that overrides config with use of a test.Tracking generator which keeps track of how many prompts it sees and how many tokens that is, and perhaps returns some modulated version of the input as output to allow adaptive probes to get estimated to some extent.
The text was updated successfully, but these errors were encountered:
Summary
Allow a dry run that reports stats on # calls, # unique prompts, # tokens in all those prompts.
This might be a
command
on the CLI, that overrides config with use of atest.Tracking
generator which keeps track of how many prompts it sees and how many tokens that is, and perhaps returns some modulated version of the input as output to allow adaptive probes to get estimated to some extent.The text was updated successfully, but these errors were encountered: