v0.0.6
Fix bugs in API tools (to fix #348) (#349) * Use litellm.utils.get_max_tokens appropriatel * Set max_tokens appropriately * Use 16k model for HyDE * Use updated max_tokens logic in async call * Reduce context size needed for HyDE
Fix bugs in API tools (to fix #348) (#349) * Use litellm.utils.get_max_tokens appropriatel * Set max_tokens appropriately * Use 16k model for HyDE * Use updated max_tokens logic in async call * Reduce context size needed for HyDE