v0.10.0
PromptingTools v0.10.0
Added
- [BREAKING CHANGE] The default embedding model (
MODEL_EMBEDDING
) changes to "text-embedding-3-small" effectively immediately (lower cost, higher performance). The default chat model (MODEL_CHAT
) will be changed by OpenAI to 0125 (from 0613) by mid-February. If you have older embeddings or rely on the exact chat model version, please set the model explicitly in your code or in your preferences. - New OpenAI models added to the model registry (see the release notes).
- "gpt4t" refers to whichever is the latest GPT-4 Turbo model ("gpt-4-0125-preview" at the time of writing)
- "gpt3t" refers to the latest GPT-3.5 Turbo model version 0125, which is 25-50% cheaper and has updated knowledge (available from February 2024, you will get an error in the interim)
- "gpt3" still refers to the general endpoint "gpt-3.5-turbo", which OpenAI will move to version 0125 by mid-February (ie, "gpt3t" will be the same as "gpt3" then. We have reflected the approximate cost in the model registry but note that it will be incorrect in the transition period)
- "emb3small" refers to the small version of the new embedding model (dim=1536), which is 5x cheaper than Ada and promises higher quality
- "emb3large" refers to the large version of the new embedding model (dim=3072), which is only 30% more expensive than Ada
- Improved AgentTools: added more information and specific methods to
aicode_feedback
anderror_feedback
to pass more targeted feedback/tips to the AIAgent - Improved detection of which lines were the source of error during
AICode
evaluation + forcing the error details to be printed inAICode(...).stdout
for downstream analysis. - Improved detection of Base/Main method overrides in
AICode
evaluation (only warns about the fact), but you can usedetect_base_main_overrides(code)
for custom handling
Fixed
- Fixed typos in the documentation
- Fixed a bug when API keys set in ENV would not be picked up by the package (caused by inlining of the
get(ENV,...)
during precompilation) - Fixed string interpolation to be correctly escaped when evaluating
AICode
### Commits
Merged pull requests:
- Fix tests on model costs (#58) (@svilupp)
- Re-apply format (#59) (@svilupp)
- Add devcontainer.json (#60) (@svilupp)
- Fix API key getter with @noinline (#61) (@svilupp)
- Improve code feedback (#62) (@svilupp)
- Improve error capture + error lines capture (#63) (@svilupp)
- Escape fix in code loading (#64) (@svilupp)
- Detect Base method overrides (#65) (@svilupp)
- Tag v0.10 (#66) (@svilupp)
Closed issues:
- ERROR: ArgumentError: api_key cannot be empty (#57)