Add overview baseline comparison#203
Conversation
|
Event: Validation Product acceptance notes:
Decision: Product acceptance PASS for the #200 user-facing CI regression-comparison slice. Keep this in review/merge consideration; no release action is authorized by this validation. |
Quality Gatekeeper ReviewVerdict: PASS
Notes:
Validated commands:
Decision: PASS. The implementation satisfies #200 with explicit baseline thresholds, deterministic comparison fields, local-only artifacts, and preserved CI/report semantics. Final label state observed: |
|
Event: Validation Decision: Post-merge validation PASS. #200 is closed with status/auto-merged. Follow-up remains #201 for shared authority category classification; #203 only seeds high-authority comparison as nullable until that contract lands. |
Summary
--baselinesupport for--overview -f jsonwith explicit duration, cost, and token delta thresholdsCloses #200
Test plan
go test ./...go build -o /tmp/agenttrace-quality-200 ./cmd/agenttraceAGENTTRACE_BIN=/tmp/agenttrace-quality-200 AGENTTRACE_CI_OUT=/tmp/agenttrace-quality-200-ci scripts/ci/check-output-contract.shAGENTTRACE_BIN=/tmp/agenttrace-quality-200 AGENTTRACE_CI_OUT=/tmp/agenttrace-quality-200-ci scripts/ci/check-deterministic-output.shAGENTTRACE_BIN=/tmp/agenttrace-quality-200 AGENTTRACE_CI_OUT=/tmp/agenttrace-quality-200-ci scripts/ci/check-report-semantics.shAGENTTRACE_BIN=/tmp/agenttrace-quality-200 AGENTTRACE_CI_OUT=/tmp/agenttrace-quality-200-ci scripts/ci/check-docs-commands.shAGENTTRACE_BIN=/tmp/agenttrace-quality-200 AGENTTRACE_CI_OUT=/tmp/agenttrace-quality-200-ci scripts/ci/check-release-surfaces.shAGENTTRACE_BIN=/tmp/agenttrace-quality-200 AGENTTRACE_CI_OUT=/tmp/agenttrace-quality-200-ci scripts/ci/check-pages-artifact.sh site/tmp/agenttrace-quality-200 --doctor || true/tmp/agenttrace-quality-200 --demo --overview -f json --baseline /tmp/agenttrace-quality-200-ci/agenttrace-demo.json | node -e 'const fs=require("fs"); const r=JSON.parse(fs.readFileSync(0,"utf8")); if(!r.baseline_comparison) throw new Error("missing baseline_comparison"); console.log(JSON.stringify({duration_delta_pct:r.baseline_comparison.duration_delta_pct,cost_delta_pct:r.baseline_comparison.cost_delta_pct,token_delta_pct:r.baseline_comparison.token_delta_pct,broader_tool_surface:r.baseline_comparison.broader_tool_surface}))'