Skip to content

Pull requests: huggingface/lighteval

New pull request New
61 Open 635 Closed
61 Open 635 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Fix TypeError in aa_omniscience_prompt
#1161 opened Jan 22, 2026 by pjavanrood Loading…
1
Fix split loading error in bigbench
#1159 opened Jan 22, 2026 by pjavanrood Loading…
1
Fix CoQA metric and support multi-doc loading
#1157 opened Jan 22, 2026 by pjavanrood • Draft
1
Fix RecursionError in imdb_contrastset_prompt
#1155 opened Jan 22, 2026 by pjavanrood Loading…
1
Fix legal_summarization keys and SummaC metric
#1153 opened Jan 22, 2026 by pjavanrood • Draft
1
Fix non-existent evaluation splits in lextreme
#1151 opened Jan 22, 2026 by pjavanrood Loading…
1
Fix evaluation split config in lsat_qa
#1149 opened Jan 22, 2026 by pjavanrood Loading…
1
Improve NarrativeQA metrics and prompt structure
#1147 opened Jan 22, 2026 by pjavanrood Loading…
1
Fix schema validation in olympiad_bench Doc.specific
#1145 opened Jan 22, 2026 by pjavanrood Loading…
1
Fix key mismatch and context access in PubMedQA
#1143 opened Jan 22, 2026 by pjavanrood Loading…
1
Fix TypeError in real_toxicity_prompts
#1141 opened Jan 22, 2026 by pjavanrood Loading…
1
Fix column mismatch and metric in SimpleQA
#1139 opened Jan 22, 2026 by pjavanrood Loading…
1
Fix subset names in StoryCloze
#1137 opened Jan 22, 2026 by pjavanrood Loading…
1
Fix Doc init and missing metadata in Summarization tasks
#1135 opened Jan 22, 2026 by pjavanrood Loading…
1
Fix hardcoded path in tiny_benchmarks
#1133 opened Jan 22, 2026 by pjavanrood Loading…
1
Fix KeyError in truthful_qa_generative_prompt
#1131 opened Jan 22, 2026 by pjavanrood Loading…
1
Fix MT-Bench multi-turn evaluation logic
#1129 opened Jan 22, 2026 by pjavanrood • Draft
1
Fix specific error in truthfulqa
#1127 opened Jan 22, 2026 by ChenZiHong-Gavin Loading…
1
Support for retriever-augmented models.
#1125 opened Jan 19, 2026 by akshathmangudi Loading…
1
41
Integrate alyah benchmark
#1117 opened Jan 12, 2026 by amztheorytii Loading…
2
When customizing the save path, modify the "save_details" location
#1092 opened Nov 29, 2025 by Guncuke Loading…
1
fix(tasks): print also tasks not prefixed by the suite name
#1087 opened Nov 27, 2025 by bram-pramono Loading…
5
[EVAL] SciCode new-task
#1086 opened Nov 27, 2025 by akshathmangudi Loading…
1
23
Evals on the hub
#1082 opened Nov 24, 2025 by NathanHB Loading…
1
Feature/tvd mi metric feature
#1080 opened Nov 22, 2025 by zrobertson466920 Loading…
8
ProTip! Type g i on any issue or pull request to go back to the issue listing page.