Labels

• agent

  agent

  The maintainer agent

• benchmark

  benchmark

  Evaluation harness

• benchmark-change-approved

  benchmark-change-approved

  Maintainer-approved scope for a benchmark-integrity PR

• bug

  bug

  Something isn't working

• chore

  chore

  Chore / maintenance

• ci

  ci

  CI / tooling / workflows

• dependencies

  dependencies

  Pull requests that update a dependency file

• documentation

  documentation

  Improvements or additions to documentation

• duplicate

  duplicate

  This issue or pull request already exists

• enhancement

  enhancement

  New feature or request

• flagged:gaming

  flagged:gaming

  Anti-cheating review flagged this PR -- closed regardless of measured delta

• github_actions

  github_actions

  Pull requests that update GitHub Actions code

• good first issue

  good first issue

  Good for newcomers

• help wanted

  help wanted

  Extra attention is needed

• invalid

  invalid

  This doesn't seem right

• leakage

  leakage

  Anti-leakage / task integrity

• maintainer-only

  maintainer-only

• mult:contribution

  mult:contribution

  Value tier x0.05 -- benchmark/tests/docs/ci work (flat rate, not benchmark-measured)

• perf:l

  perf:l

  Value tier x2.5 -- measured composite delta >= 0.08

• perf:m

  perf:m

  Value tier x1.5 -- measured composite delta >= 0.04

• perf:s

  perf:s

  Value tier x1.0 -- measured composite delta >= 0.02

• perf:xl

  perf:xl

  Value tier x4.0 -- measured composite delta >= 0.15 (both public+private targets)

• perf:xs

  perf:xs

  Value tier x0.5 -- measured composite delta >= 0.01 (noise floor)

• python

  python

  Pull requests that update python code

• question

  question

  Further information is requested

• refactor

  refactor

  Refactor / cleanup

• tests

  tests

  Test suite

• wontfix

  wontfix

  This will not be worked on