[go: nahoru, domu]
Skip to content

Issues: confident-ai/deepeval

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
55 Open 150 Closed
55 Open 150 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Having so many random errors while scoring
#489 opened Feb 20, 2024 by ktoprakucar
5
Add JudgeLM as a way to evaluate and compare historical test runs enhancement New feature or request help wanted Extra attention is needed
#262 opened Oct 30, 2023 by penguine-ip
3
Disk Error When Attempting to Run Tests
#286 opened Nov 14, 2023 by pgarz
34
Faithfulness score and SummaC model parameters are not very much clear.
#310 opened Nov 26, 2023 by Anindyadeep
Integration of LM Evaluation Harness.
#332 opened Dec 6, 2023 by Anindyadeep
@Anindyadeep
2
Add metric for NER
#352 opened Dec 13, 2023 by RigvedRocks
2
Make Own Implementation of Dbias and Detoxify help wanted Extra attention is needed
#382 opened Dec 21, 2023 by penguine-ip
@Anindyadeep
Rich Progress Context overwrites one another when running pytest in parallel bug Something isn't working help wanted Extra attention is needed
#397 opened Jan 3, 2024 by penguine-ip
llama index integration broken at latest versions
#441 opened Jan 26, 2024 by nictuku
6
AttributeError: 'AIMessage' object has no attribute 'find'
#482 opened Feb 15, 2024 by makoto-velux
9
retrieval_context
#483 opened Feb 17, 2024 by Jiajing-Chen
12
ValueError: Number of verdicts generated does not equal length of retrieved nodes.
#484 opened Feb 17, 2024 by Jiajing-Chen
5
A metrics class containing different definitions of metrics ordered by some taxonomy.
#238 opened Oct 25, 2023 by Anindyadeep
@Anindyadeep
3
No such file or directory: 'temp_test_run_data.json'_
#488 opened Feb 20, 2024 by jonathansoong
15
Trainer needs some further definition in DeepEvalHuggingFaceCallback
#496 opened Feb 21, 2024 by judebowyer
3
Parallelization of Evaluations
#500 opened Feb 22, 2024 by AndresPrez
7
Support popular benchmarks enhancement New feature or request help wanted Extra attention is needed
#508 opened Feb 22, 2024 by penguine-ip
3
Evaluation Dataset Generation enhancement New feature or request help wanted Extra attention is needed
#530 opened Feb 26, 2024 by penguine-ip
@penguine-ip
1
Make multithreading optional
#538 opened Feb 27, 2024 by AndresPrez
6
Summarization metric generates <1 score for exactly the same input and output
#565 opened Mar 5, 2024 by Peilun-Li
1
Custom dataset evaluation giving ValueError: Input, actual output, and retrieval context cannot be None
#568 opened Mar 6, 2024 by piseabhijeet
13
Store computed metrics in a dataframe
#595 opened Mar 13, 2024 by piseabhijeet
1
Consideration behind a "stateful" metric UX
#597 opened Mar 14, 2024 by Peilun-Li
@penguine-ip
9
temp_test_run.json contains partial entries when running in bulk
#605 opened Mar 16, 2024 by piseabhijeet
1
Error when generating an evaluation dataset according to the official documentation
#856 opened Jun 28, 2024 by gechaoq
ProTip! Exclude everything labeled bug with -label:bug.