skill-authoring §3+§7: four maintenance-pass rules from one staleness incident - #82
Merged
F-e-u-e-r merged 1 commit intoJul 26, 2026
Conversation
… incident §3: staleness concentrates in world-fact rules (scope the audit there); an invalidation clause must bind to a surface the work already touches. §7: probe a candidate rule against the bare executor before folding it in; a derived file contradicting reality may be mirroring a wrong source. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What
Four rules, one incident seen from four sides — a maintenance session on a set of rules files where a measured finding went stale, the re-test that fixed it found something unexpected, and the cleanup afterwards found something else again.
§3 (Provenance and decay)
§7 (Maintenance)
3. Probe a candidate rule against the bare executor before folding it in. §6's behavioral probe hunts gaps — what the file fails to cause. This asks the inverse, before the rule exists: run the scenario with no rule and with it. If the bare run already produces the behavior the rule is non-discriminating, and belongs in a reference or nowhere.
4. A derived file contradicting reality has not necessarily drifted — read its source first. If the source carries the identical wrong text, fixing only the derivative gets it re-broken by the next write-back.
Why
The four are causally linked, which is why they ship together rather than as four PRs.
A finding measuring rule-following at two file sizes carried the clause "re-test if either file grows past ~250 lines." Both files reached 297 and 318 and were still cited as current — the clause never fired because nothing read it. That is rule 2.
The re-test that eventually ran added a bare-executor control arm the original design lacked, and found 3 of 8 recently-folded rules were reproduced with no rules file at all. That is rule 3 — the one item here backed by a measurement rather than a shape (n=8, one probe per cell; it detects a large effect, not a small one).
The staleness sweep that followed found all 8 stale instances in the one file carrying model names and CLI behavior, none in the three carrying method. That is rule 1.
And one of those stale lines turned out to be copied faithfully from a source file carrying the same error — so fixing the derived file alone would have been undone by the next write-back. That is rule 4.
Notes
unprobedper the covenant. Private evidence cited as shape per the README covenant's second branch; no code taken..github/checks.pygreen. Unicode sweep clean.🤖 Generated with Claude Code