Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DOC: Bedrock Embeddings support for expect class in langsmith unit testing? #1152

Open
sreyakumar opened this issue Oct 29, 2024 · 0 comments

Comments

@sreyakumar
Copy link

sreyakumar commented Oct 29, 2024

Issue with current documentation:

The langsmith unit testing expect class and functions like embedding_distance only seems to work with the OpenAI embedding model and not any of the bedrock models.
https://docs.smith.langchain.com/evaluation/how_to_guides/evaluation/unit_testing

Idea or request for content:

Is it possible to allow access to the bedrock models?

vishwamartur added a commit to vishwamartur/langsmith-sdk that referenced this issue Oct 30, 2024
Related to langchain-ai#1152

Add unit test for embedding_distance function with bedrock model encoder.

* Mock the bedrock encoder function.
* Test embedding_distance function with bedrock encoder.
* Verify functionality with various assertions.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant