v0.5.0

PromptingTools v0.5.0

Diff since v0.4.0

Added

• Experimental sub-module RAGTools providing basic Retrieval-Augmented Generation functionality. See ?RAGTools for more information. It's all nested inside of PromptingTools.Experimental.RAGTools to signify that it might change in the future. Key functions are build_index and airag, but it also provides a suite to make evaluation easier (see ?build_qa_evals and ?run_qa_evals or just see the example examples/building_RAG.jl)

Fixed

• Stricter code parsing in AICode to avoid false positives (code blocks must end with "```\n" to catch comments inside text)
• Introduced an option skip_invalid=true for AICode, which allows you to include only code blocks that parse successfully (useful when the code definition is good, but the subsequent examples are not), and an option capture_stdout=false to avoid capturing stdout if you want to evaluate AICode in parallel (Pipe() that we use is NOT thread-safe)
• OllamaManagedSchema was passing an incorrect model name to the Ollama server, often serving the default llama2 model instead of the requested model. This is now fixed.
• Fixed a bug in kwarg model handling when leveraging PT.MODEL_REGISTRY

Commits

Merged pull requests:

• fix AICode parser (#31) (@svilupp)
• Make stdout capture optional (#32) (@svilupp)
• Fallback parser to expect newlines (#33) (@svilupp)
• Fix model kwarg in Ollama (#34) (@svilupp)
• Enable ollama tests (#35) (@svilupp)
• Add RAG Tools (#36) (@svilupp)
• Update docs (#37) (@svilupp)
• Fix params kwarg in run_qa_evals (#38) (@svilupp)