Skip to content

Conversation

shinpr
Copy link
Owner

@shinpr shinpr commented Oct 10, 2025

Summary

Refine Acceptance Criteria (AC) scoping guidelines to focus on high-ROI test coverage in
LLM/CI/CD environments. This improves autonomous implementation accuracy by clarifying what
should and shouldn't be included in ACs.

Changes

acceptance-test-generator.md (EN/JA)

  • Simplified "Out of Scope" section into 3 clear categories:
    • External Dependencies (test contracts/interfaces instead)
    • Non-Deterministic in CI (performance metrics, load testing)
    • Implementation Details (not user-observable)
  • Removed redundant section: "Security and Performance Requirements Processing"
  • Added Action guideline: How to handle excluded items in ACs

technical-designer.md (EN/JA)

  • Added "AC Scoping for Autonomous Implementation" section:
    • Include (High automation ROI): Business logic, data integrity, user-visible
      functionality, error handling behavior
    • Exclude (Low ROI in LLM/CI/CD): External service connections, performance metrics,
      implementation details, UI layout specifics
    • Principle: AC = User-observable behavior verifiable in isolated CI environment

Version

  • Bumped version from 1.7.13 to 1.7.14

Rationale

  • Focus on observable behavior: ACs should specify what users see/experience, not how
    it's implemented
  • Optimize for CI/CD: Exclude non-deterministic tests that fail in automated
    environments
  • Improve automation ROI: Concentrate testing effort on business logic and data
    integrity
  • Align with LLM capabilities: Match AC scope to what autonomous agents can effectively
    verify

Impact

  • For AC authors: Clearer guidelines on what to include/exclude in acceptance criteria
  • For test generators: Reduced ambiguity when transforming ACs into test cases
  • For autonomous implementation: Better alignment between requirements and verifiable
    outcomes

shinpr and others added 2 commits October 11, 2025 08:48
Refine Acceptance Criteria scoping to focus on high-ROI test coverage in LLM/CI/CD environments.

Changes:
- acceptance-test-generator.md: Simplify "Out of Scope" to 3 clear categories (External Dependencies, Non-Deterministic in CI, Implementation Details)
- technical-designer.md: Add "AC Scoping for Autonomous Implementation" section with Include/Exclude guidelines
- Remove redundant "Security and Performance Requirements Processing" section

Rationale:
- Focus on user-observable behavior verifiable in isolated CI environments
- Exclude items with low automation ROI (external service connections, performance metrics, implementation details)
- Align AC creation with autonomous implementation capabilities

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <[email protected]>
🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <[email protected]>
@shinpr shinpr self-assigned this Oct 10, 2025
@shinpr shinpr merged commit aaf4e6f into main Oct 10, 2025
1 check passed
@shinpr shinpr deleted the test/adjust-test-configuration branch October 10, 2025 23:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant