Skip to content

Issues: explodinggradients/ragas

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

261 Open 620 Closed
261 Open 620 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Explicit the "Failed to parse output. Returning None." of RagasoutputParser or add a way to catch it. enhancement New feature or request
#1681 opened Nov 15, 2024 by Gwenn-LR
The example in ’https://docs.ragas.io/en/latest/getstarted/rag_testset_generation/‘ is not available bug Something isn't working module-testsetgen Module testset generation
#1677 opened Nov 14, 2024 by Createsnow
2
[R-314] Cost estimation for Transforms enhancement New feature or request
#1671 opened Nov 14, 2024 by jjmachan
Timeout Error bug Something isn't working question Further information is requested
#1667 opened Nov 13, 2024 by Dormiveglia-elf
3
Exceeding model token limit issues with open-source models locally hosted via vLLM bug Something isn't working
#1663 opened Nov 12, 2024 by YuffieHuang
Testset generation broken after migrating from 0.1.x to 0.2.4 bug Something isn't working module-testsetgen Module testset generation
#1660 opened Nov 12, 2024 by malikbrh
4
testset_generation：the max_wait not works bug Something isn't working module-testsetgen Module testset generation
#1659 opened Nov 12, 2024 by jackqdldd
2
Issue about tool call metrics. module-metrics this is part of metrics module question Further information is requested
#1658 opened Nov 12, 2024 by MattZ-99
2
testset-generation: Embedding issues in apply_transforms bug Something isn't working module-testsetgen Module testset generation
#1657 opened Nov 12, 2024 by shashi792
1
Can I control the concurrency of calling LLM bug Something isn't working question Further information is requested
#1654 opened Nov 11, 2024 by jackqdldd
1
WARNING:ragas.metrics._faithfulness:No statements were generated from the answer. bug Something isn't working module-metrics this is part of metrics module question Further information is requested
#1651 opened Nov 9, 2024 by kyuz0
1
FaithfulnesswithHHEM doesn't match original prompt, leading to inconsistent scores bug Something isn't working module-metrics this is part of metrics module
#1648 opened Nov 9, 2024 by AshishSardana
Seed questions for guiding test generation module-testsetgen Module testset generation question Further information is requested
#1642 opened Nov 7, 2024 by ableiweiss
1
Issue with SSL certificate verification bug Something isn't working
#1637 opened Nov 6, 2024 by AkileshSivaswamy
6
Subject: Issue with Agentic AI Metrics (Topic Adherence and Agent Goal Accuracy) bug Something isn't working module-metrics this is part of metrics module question Further information is requested
#1633 opened Nov 6, 2024 by Nari995
8
Error while using Gemini models with RAGAS bug Something isn't working question Further information is requested
#1632 opened Nov 6, 2024 by a-s-poorna
3
Faithfulness and Response Relevancy have high parse error rate with non-OpenAI model bug Something isn't working
#1631 opened Nov 5, 2024 by ahgraber
4
failed to parse the output bug Something isn't working question Further information is requested
#1630 opened Nov 5, 2024 by amin-kh96
Number of generated examples module-testsetgen Module testset generation question Further information is requested
#1628 opened Nov 5, 2024 by MariosKef
@jjmachan
Prompt adaptation fails to save to file with unicode error (metric.save_prompts() function) bug Something isn't working module-metrics this is part of metrics module
#1624 opened Nov 5, 2024 by LukaszDejneka
1
Can the generated dataset be filled in the blank or true/false questions question Further information is requested
#1620 opened Nov 4, 2024 by SummerDream233
2
[R-313] Adding more LLM/Embedding Providers enhancement New feature or request
#1617 opened Nov 4, 2024 by jjmachan
3
Creating a Test Dataset fails with IndexError: list index out of range bug Something isn't working module-testsetgen Module testset generation
#1615 opened Nov 2, 2024 by dipanjanS
[R-312] support adding metadata into testset generation enhancement New feature or request module-testsetgen Module testset generation
#1614 opened Nov 1, 2024 by jjmachan
Event loop stopped before Future completed -generator.generate_with_langchain_docs bug Something isn't working module-testsetgen Module testset generation question Further information is requested
#1608 opened Oct 31, 2024 by jackqdldd
4
ProTip! What’s not been updated in a month: updated:<2024-10-15.