feat(accuracy): BigBench-Hard DeepEval-backed benchmark (AIP-878)#924

Merged

ajcasagrande merged 10 commits into

mainfrom

dbermudez/aip-878-implement-bigbench-benchmark-loader

May 23, 2026

Commits on May 22, 2026

feat(accuracy): BigBench-Hard DeepEval-backed benchmark loader (AIP-878)
debermudez
committed
fix(accuracy): reject 'all' mixed with other BBH task selectors (AIP-878)
debermudez
committed
test(accuracy): expand adversarial coverage for BigBench-Hard (AIP-878)
debermudez
committed
[pre-commit.ci] auto fixes from pre-commit.com hooks

pre-commit-ci[bot]
authored and
debermudez
committed
test(accuracy): fake-deepeval harness lifts BigBench CI coverage (AIP-878)
debermudez
committed
docs(accuracy): sync Method Count Summary with status summary (AIP-878)
debermudez
committed
docs(accuracy): refresh Suggested Implementation Order for remaining stubs (AIP-878)
debermudez
committed
test(accuracy): type-annotate BigBench test helpers (AIP-878)
debermudez
committed
fix(accuracy): append DeepEval confinement to BigBench prompt (AIP-878)
debermudez
committed

Commits on May 23, 2026

Merge branch 'main' into dbermudez/aip-878-implement-bigbench-benchmark-loader
ajcasagrande
authored