Search results

Fix TypeError in aa_omniscience_prompt

Status: Open.

#1160 In huggingface/lighteval;

· pjavanrood opened on Jan 22, 2026

Fix split loading error in bigbench

Status: Open.

#1158 In huggingface/lighteval;

· pjavanrood opened on Jan 22, 2026

Fix RecursionError in imdb_contrastset_prompt

Status: Open.

#1154 In huggingface/lighteval;

· pjavanrood opened on Jan 22, 2026

Fix non-existent evaluation splits in lextreme

Status: Open.

#1150 In huggingface/lighteval;

· pjavanrood opened on Jan 22, 2026

Fix evaluation split config in lsat_qa

Status: Open.

#1148 In huggingface/lighteval;

· pjavanrood opened on Jan 22, 2026

Improve NarrativeQA metrics and prompt structure

Status: Open.

#1146 In huggingface/lighteval;

· pjavanrood opened on Jan 22, 2026

Fix schema validation in olympiad_bench Doc.specific

Status: Open.

#1144 In huggingface/lighteval;

· pjavanrood opened on Jan 22, 2026

Fix key mismatch and context access in PubMedQA

Status: Open.

#1142 In huggingface/lighteval;

· pjavanrood opened on Jan 22, 2026

Fix TypeError in real_toxicity_prompts due to None choices

Status: Open.

#1140 In huggingface/lighteval;

· pjavanrood opened on Jan 22, 2026

Fix column mismatch and metric in SimpleQA

Status: Open.

#1138 In huggingface/lighteval;

· pjavanrood opened on Jan 22, 2026

Fix subset names in StoryCloze

Status: Open.

#1136 In huggingface/lighteval;

· pjavanrood opened on Jan 22, 2026

Fix Doc init and missing metadata in Summarization tasks

Status: Open.

#1134 In huggingface/lighteval;

· pjavanrood opened on Jan 22, 2026