Skip to content

chore(eval): cron-detected baseline drift (2026-07-19)#1961

Open
wrsmith108 wants to merge 1 commit into
mainfrom
chore/eval-baseline-cron-20260719T1010
Open

chore(eval): cron-detected baseline drift (2026-07-19)#1961
wrsmith108 wants to merge 1 commit into
mainfrom
chore/eval-baseline-cron-20260719T1010

Conversation

@wrsmith108

Copy link
Copy Markdown
Member

Auto-generated by scripts/eval-baseline-cron.sh in the isolated eval checkout. Review the Retrieval Eval Gate per-category breakdown before merging.

baseline.json sha256: 39c67eab22e3 -> 243bcc33ca36

[skip-impl-check]

Auto-generated by scripts/eval-baseline-cron.sh in the isolated eval checkout.
baseline.json sha256 changed: 39c67eab22e3 -> 243bcc33ca36

CI Retrieval Eval Gate exercises the hybrid threshold against this diff;
review the per-category breakdown in the gate output before merging.

[skip-impl-check]
@wrsmith108 wrsmith108 added the eval-baseline-cron Automated retrieval-eval baseline drift PR (SMI-4764) label Jul 19, 2026
@github-actions

Copy link
Copy Markdown

📊 Retrieval Eval — recall@5 deltas

Overall: 0.6545 → 0.6545 (Δ +0.0000, +0.00%)

Category Prior Current Δ abs Δ %
adr-lookup 0.8333 0.8333 +0.0000 +0.00%
implementation-lookup 0.5833 0.5833 +0.0000 +0.00%
memory-recall 0.9286 0.9286 +0.0000 +0.00%
retro-lookup 0.4000 0.4000 +0.0000 +0.00%
script-header 0.6250 0.6250 +0.0000 +0.00%
skill-discovery 0.4000 0.4000 +0.0000 +0.00%

Repro locally: docker exec skillsmith-dev-1 npm run eval:retrieval --workspace=packages/doc-retrieval-mcp -- --real

Generated by scripts/eval-baseline/render-pr-comment.mjs (SMI-4764 Wave 3).

@github-actions

Copy link
Copy Markdown

E2E Test Results

E2E Test Results - July 19, 2026

Summary

  • Status: ✅ PASSED
  • Total Duration: 0.00s
  • Generated: 2026-07-19T10:31:59.820Z

Test Results

Phase Status Duration
CLI E2E ⏭️ Skipped -
MCP E2E ⏭️ Skipped -

Generated by skillsmith E2E test suite

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

eval-baseline-cron Automated retrieval-eval baseline drift PR (SMI-4764)

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant