📋 Roadmap

[macanderson]

The initial public roadmap for Arena, grouped by theme. Each item links a scoped issue.

📦 Distribution & adoption

• Ship arena as an npm package (npx arena) #1 Ship arena as an npm package (npx arena)
• CONTRIBUTING + adapter/task authoring guide #7 CONTRIBUTING + adapter/task authoring guide

🧪 Coverage

• Verify the Gemini adapter against a live gemini-cli #2 Verify the Gemini adapter against a live gemini-cli
• Grow the task suite: more tasks + multi-language (Python/Go/Rust) #3 Grow the task suite: more tasks + multi-language (Python/Go/Rust)
• Pre-registered SWE-bench Verified runner + Docker E2E smoke #6 Pre-registered SWE-bench Verified runner + Docker E2E smoke

📊 Reporting & drift

• Web dashboard for runs, comparisons, and the leaderboard #4 Web dashboard for runs, comparisons, and the leaderboard
• Longitudinal baseline history + drift trend (arena trend) #5 Longitudinal baseline history + drift trend (arena trend)
• HTML report output (arena report --format html) #8 HTML report output

🔒 Integrity

• pricing.json freshness + provenance check #9 pricing.json freshness + provenance check

---

Themes reflect Arena's two jobs: fair head-to-head comparison, and keeping your own agent from drifting. Priorities are a starting point — comment to reshuffle.