Skip to content

Commit f8567ab

Browse files
Jason Robertclaude
andcommitted
fix(ci): exclude flaky performance tests from CI
Performance tests use timing-sensitive assertions (e.g., for-each must complete within 1.5x of static parallel) that fail intermittently on shared CI runners. The test file is already marked with @pytest.mark.performance — just add it to the CI exclusion filter alongside real_api tests. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
1 parent 9f96cf6 commit f8567ab

1 file changed

Lines changed: 3 additions & 2 deletions

File tree

.github/workflows/ci.yml

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -110,11 +110,12 @@ jobs:
110110
111111
- name: Run tests with coverage
112112
timeout-minutes: 10
113-
run: uv run pytest --cov=src/conductor --cov-report=xml --cov-report=term-missing -m "not real_api"
113+
run: uv run pytest --cov=src/conductor --cov-report=xml --cov-report=term-missing -m "not real_api and not performance"
114114
env:
115115
# Fake API key for mock tests to prevent accidental real API calls.
116116
# Real API tests (marked with @pytest.mark.real_api) are excluded from CI
117-
# via the '-m "not real_api"' filter and must be run manually with valid key.
117+
# via the marker filter. Performance tests are also excluded as they
118+
# contain timing-sensitive assertions that are flaky on shared CI runners.
118119
# This ensures CI tests are fast, free, and don't leak credentials.
119120
ANTHROPIC_API_KEY: "sk-ant-test-fake-key-for-mocking"
120121

0 commit comments

Comments
 (0)