Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Seed questions for guiding test generation #1642

Open
ableiweiss opened this issue Nov 7, 2024 · 1 comment
Open

Seed questions for guiding test generation #1642

ableiweiss opened this issue Nov 7, 2024 · 1 comment
Labels
module-testsetgen Module testset generation question Further information is requested

Comments

@ableiweiss
Copy link

Is there a way to guide the RAGAS test generation process with specific seed questions as input, so that generated questions will be of similar nature to the seed questions?
@ableiweiss ableiweiss added the question Further information is requested label Nov 7, 2024
@dosubot dosubot bot added the module-testsetgen Module testset generation label Nov 7, 2024
@shahules786
Copy link
Member

Hey, we have this in our roadmap. We will be pushing something along these lines in the coming months. I would love to understand your requirements more to make sure that we consider it too while building for it. Open to Chat?

@shahules786 shahules786 mentioned this issue Nov 8, 2024
Open
10 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
module-testsetgen Module testset generation question Further information is requested
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@shahules786 @ableiweiss