Skip to content

frontier-auto: context-doctor gains an optional cache-boundary (prompt-caching) audit - #190

Merged
chrono-meta merged 2 commits into
mainfrom
claude/frontier-auto-2026-07-27
Jul 27, 2026
Merged

frontier-auto: context-doctor gains an optional cache-boundary (prompt-caching) audit#190
chrono-meta merged 2 commits into
mainfrom
claude/frontier-auto-2026-07-27

Conversation

@chrono-meta

Copy link
Copy Markdown
Owner

Summary

Autonomous weekly frontier-auto proposal (no human online). Adds an optional Step 3.5 — Cache-Boundary Audit (prompt caching) to plugins/fh-meta/skills/context-doctor/SKILL.md, with supporting detail in SKILL_detail.md §CacheBoundary.

Signal: 2026-07-27 comment on issue #102 ("Frontier Digest Log") — signal source, item 5 ("Context Engineering as the Dominant Production Discipline"), citing arXiv:2603.09619 and appscale.blog. The digest explicitly proposed: "Concrete improvement candidate: add a cache-boundary audit step to /context-doctor."

What it adds: context-doctor previously only diagnosed context-window footprint (Steps 1–5). Nothing addressed provider-side prompt-cache billing — a distinct cost lever. Step 3.5 adds:

  • A checklist (system-prompt byte-stability, dynamic content placement) for diagnosing cache-hit degradation.
  • The digest's reported decision thresholds (input:output ratio >10:1 favors cache/context engineering; >50:1 prefix caching dominates), explicitly labeled UNCALIBRATED per this repo's own Instrument-Calibration doctrine, since both cited sources returned HTTP 403 to this session's fetch tooling and were not independently re-verified.
  • Wiring into the environment table, explicit/NL triggers, and Done When (so the step isn't orphaned).
  • A cross-reference from Step 5 noting the compression-vs-cache-invalidation tension.

Predicted impact: recorded in tracks/_meta/edit_manifest.yaml (gitignored, local) — sessions with a cache-miss cost symptom on a metered backend now get a diagnosis path that didn't exist before; low-frequency trigger expected since it fires only on a specific cost symptom.

Verification (FH 4-axis gate)

  • Axis 1 (regression_guard.sh --staged): PASS, 0 M-tier / 0 S-tier.
  • Axis 2 (steel-quench-style adversarial review, dispatched to an isolated opus agent): Wave 1 found 1 S-grade + 3 A-grade issues on the first draft (bare/uncalibrated threshold, orphaned step, unsourced mechanism claim, body-bloat convention mismatch). All four fixed inline; Wave 3 re-attack by the same isolated agent converged PASS, zero surviving S/A.
  • Axis 3 (phantom-quench-style claim check, inline): 5/5 numeric + citation claims traced via literal grep hit to the declared local source (the fetched issue comment). The external hop (arXiv/blog originals) is Unreachable (HTTP 403 in this sandbox) and is honestly disclosed as UNCALIBRATED in the doc itself, not silently treated as Phantom.
  • Axis 4: predicted-impact entry recorded in tracks/_meta/edit_manifest.yaml.

Marker: tracks/_meta/.axes_23_passed_claude_frontier-auto-2026-07-27_2026-07-27.marker (gitignored, local — floor-status: at-floor, axis2-model: opus).

Test plan

  • Human review of Step 3.5's placement/wording in plugins/fh-meta/skills/context-doctor/SKILL.md
  • Confirm the UNCALIBRATED framing is acceptable (sources 403'd, not independently re-verified)
  • Re-fetch arXiv:2603.09619 / appscale.blog from an environment with access, if/when convenient, to upgrade the figures from UNCALIBRATED to verified

This PR is opened as a draft per the frontier-auto routine's standing instruction: no auto-merge, human review required before landing.


Generated by Claude Code

claude and others added 2 commits July 27, 2026 00:25
…mpt caching)

Frontier-auto weekly proposal, sourced from the 2026-07-27 frontier-digest
comment on issue #102 (arXiv:2603.09619 / appscale.blog): input:output token
ratio >10:1 favors cache/context engineering over model-level optimization,
>50:1 prefix caching dominates, and cache-boundary control (stable system
prompt, dynamic content at the user-message end) reportedly raised hit rate
~7%->84% in one production case.

Both cited sources returned HTTP 403 to this session's fetch tooling, so the
figures are labeled UNCALIBRATED per CLAUDE.md's Instrument-Calibration rule
and traced only to the digest comment text (phantom-quench: 5/5 local claims
grounded via literal grep hit; external hop Unreachable, not silently
Phantom). steel-quench Wave 1 (opus, isolated) found 1S/3A on the first
draft (bare threshold, orphaned step, unsourced extrapolation, body-bloat);
all four fixed inline and Wave 3 re-attack converged PASS with zero
surviving S/A.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01FaC2wq4rf7zvNPAHkhE3LV
자동 생성 초안은 두 질문을 하나의 'UNCALIBRATED (403)' 으로 뭉쳐놨다:
논문이 실재하나(→ arxiv abs 200, 제목 일치) / 그 수치를 실제로 말하나(→ 원문 미독).

계기가 하마터면 틀린 판정을 낼 뻔했다: 첫 재확인은 arXiv API 를 썼고 대상에 빈 결과를
냈는데 known-real 컨트롤도 빈 결과였다 — 논문이 없는 게 아니라 계기가 죽어 있었다.
abs 페이지로 바꾸니 컨트롤이 살아났고 존재 판정이 VERIFIED 로 뒤집혔다. 함정을
detail 에 주석으로 박았다.

npm 공개 출하 스킬에 미검증 정밀 인용이 실리는 위험 때문에 시작한 확인인데,
결과적으로 인용은 진짜였고 대신 무엇이 검증됐는지의 경계가 정확해졌다.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
@chrono-meta
chrono-meta marked this pull request as ready for review July 27, 2026 16:17
@chrono-meta
chrono-meta merged commit 17b90e1 into main Jul 27, 2026
2 checks passed
@chrono-meta
chrono-meta deleted the claude/frontier-auto-2026-07-27 branch July 27, 2026 16:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants