Bench: harbor + swe-bench generation mode with runtime hardening (+ a templated dataset card)#17

Draft

Quantumlyy wants to merge 8 commits into

TeichAI:mainfrom

AletheiaResearch:bench-and-verifiable-tasks

Commits on Jul 1, 2026

Add bench mode (harbor + swe-bench) with verifiable seed tasks
Quantumlyy
committed

Commits on Jul 2, 2026

Address Codex review on PR #17 (1 P1 + 4 P2 + 1 P3)
Quantumlyy
committed
Address Codex re-review on PR #17 (round 2: 4 P2 + 1 P3; 1 deferred)
Quantumlyy
committed
Purge harbor prebuilt task images so bench tasks don't leak them
Quantumlyy
committed
Address Codex re-review on PR #17 (round 3: 5 fixed, 1 deferred)
Quantumlyy
committed
bench: per-source swe-bench namespace + a live progress bar
Quantumlyy
committed
bench: fail fast when api.wire_api can't be honored (chat-completions endpoints)
Quantumlyy
committed
Extract shared agent_cfg; bench honors all providers + host-local base_url
Quantumlyy
committed