Skip to content

Issues: huggingface/evaluate

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

156 Open 141 Closed
156 Open 141 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

TypeError: 'NoneType' object is not callable
#647 opened Oct 30, 2024 by Yichangfa
FileNotFoundError: Couldn't find a module script at /mnt/data/dingtian/exact_match/exact_match.py. Module 'exact_match' doesn't exist on the Hugging Face Hub either.
#645 opened Oct 21, 2024 by Tiannn0703
[FR] Binoculars as a new metric
#644 opened Oct 20, 2024 by MayankChaturvedi
Perplexity for quantized models
#643 opened Oct 17, 2024 by Hongao0611
1
ImportError: To be able to use evaluate-metric/glue, you need to install the following dependencies['scipy', 'scikit-learn'] using 'pip install scipy sklearn' for instance'
#642 opened Sep 24, 2024 by JINO-ROHIT
3
Optionally stop data deletion after compute
#641 opened Sep 24, 2024 by sizhky
Typo in Types of Evaluations in 🤗 Evaluate documentation
#639 opened Sep 18, 2024 by sergiopaniego
1
Perplexity for Left Padded Models
#636 opened Sep 15, 2024 by Lawhy
CI parity test is broken due to FileNotFoundError
#632 opened Sep 12, 2024 by albertvillanova
1
@albertvillanova
list_evaluation_modules returns empty list
#616 opened Aug 23, 2024 by MohamedAliRashad
2
Benchmark evaluation for language models.
#615 opened Aug 19, 2024 by mina58
1
Unable to compute f1 score - Throwing Value Error trying to convert a string in non english Language to integer
#610 opened Aug 1, 2024 by alans3321
AttributeError: module 'evaluate' has no attribute 'load'
#609 opened Jul 31, 2024 by Adesoji1
7
[Metrics] ValueError: Expected to find locked file from process x but it doesn't exist.
#607 opened Jul 11, 2024 by raghavm1
1
AttributeError: 'CombinedEvaluations' object has no attribute 'evaluation_modules'
#603 opened Jun 23, 2024 by shunk031
1
2
Gradio dependency issue
#602 opened Jun 21, 2024 by bnaman50
2
Evaluation of form feed symbol with BLEU results in error
#601 opened Jun 11, 2024 by lowlypalace
LocalModuleTest.test_load_metric_code_eval fails with "The "code_eval" metric executes untrusted model-generated code in Python."
#597 opened Jun 8, 2024 by jpodivin
Execution of example from the Using the evaluator docs fails due to unspecified tokenizer
#594 opened Jun 2, 2024 by jpodivin
1
Evaluation of empty strings with MAUVE results in error
#593 opened May 24, 2024 by lowlypalace
SyntaxError: closing parenthesis '}'
#592 opened May 12, 2024 by wangxiuwen
3
Problems during run initial step
#590 opened May 7, 2024 by simplelifetime
12
Can't load exist dataset for evaluation
#589 opened May 6, 2024 by IsmaelMousa
1
[Question]Shall we adding a faster BLEU score calculator?
#586 opened Apr 30, 2024 by shenxiangzhuang
How to pass generation_kwargs to the TextGeneration evaluator ?
#582 opened Apr 25, 2024 by swarnava112
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.