Skip to content

benchmark: publish the first AgentPack vs no-context E2E report #32

Description

@vishal2612200

Goal

Run and publish the first dated AgentPack vs no-context E2E outcome report.

Suggested files

  • benchmarks/e2e/README.md
  • benchmarks/results/YYYY-MM-DD-e2e-ab.md
  • docs/benchmarking.md if status changes

Acceptance criteria

  • Uses the documented benchmark e2e and benchmark e2e-report workflow.
  • Reports task success, validation result, tool calls, token/time proxy if available, and time-to-first-correct-file where measurable.
  • Keeps file-selection benchmark claims separate from task-success claims.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    benchmarkBenchmark cases, metrics, and evidenceenhancementNew feature or requesthelp wantedExtra attention is needed

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions