feat: add deployment URL detection for visual CI testing #91
Ancient23playwright-cli-tests.yml
on: pull_request
Matrix: test
merge-reports
12s
update-baselines
0s
document-patterns
0s
Annotations
4 errors and 8 notices
|
test (1/4)
Process completed with exit code 1.
|
|
[unit-tests] › tests/visual-regression.spec.js:24:5 › Visual Regression Tests › CLI Output Visual Tests › CLI help output visual consistency:
tests/visual-regression.spec.js#L61
1) [unit-tests] › tests/visual-regression.spec.js:24:5 › Visual Regression Tests › CLI Output Visual Tests › CLI help output visual consistency
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(page).toHaveScreenshot(expected)
52137 pixels (ratio 0.06 of all image pixels) are different.
Snapshot: cli-help-output.png
Call log:
- Expect "toHaveScreenshot(cli-help-output.png)" with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 52137 pixels (ratio 0.06 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 52137 pixels (ratio 0.06 of all image pixels) are different.
59 |
60 | // Take screenshot for regression testing
> 61 | await expect(page).toHaveScreenshot('cli-help-output.png', {
| ^
62 | fullPage: true,
63 | animations: 'disabled',
64 | mask: [page.locator('text=/v\\d+\\.\\d+\\.\\d+/')], // Mask version numbers
at /home/runner/work/MultiAgent-Claude/MultiAgent-Claude/tests/visual-regression.spec.js:61:26
|
|
[unit-tests] › tests/visual-regression.spec.js:24:5 › Visual Regression Tests › CLI Output Visual Tests › CLI help output visual consistency:
tests/visual-regression.spec.js#L61
1) [unit-tests] › tests/visual-regression.spec.js:24:5 › Visual Regression Tests › CLI Output Visual Tests › CLI help output visual consistency
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(page).toHaveScreenshot(expected)
52137 pixels (ratio 0.06 of all image pixels) are different.
Snapshot: cli-help-output.png
Call log:
- Expect "toHaveScreenshot(cli-help-output.png)" with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 52137 pixels (ratio 0.06 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 52137 pixels (ratio 0.06 of all image pixels) are different.
59 |
60 | // Take screenshot for regression testing
> 61 | await expect(page).toHaveScreenshot('cli-help-output.png', {
| ^
62 | fullPage: true,
63 | animations: 'disabled',
64 | mask: [page.locator('text=/v\\d+\\.\\d+\\.\\d+/')], // Mask version numbers
at /home/runner/work/MultiAgent-Claude/MultiAgent-Claude/tests/visual-regression.spec.js:61:26
|
|
[unit-tests] › tests/visual-regression.spec.js:24:5 › Visual Regression Tests › CLI Output Visual Tests › CLI help output visual consistency:
tests/visual-regression.spec.js#L61
1) [unit-tests] › tests/visual-regression.spec.js:24:5 › Visual Regression Tests › CLI Output Visual Tests › CLI help output visual consistency
Error: expect(page).toHaveScreenshot(expected)
52137 pixels (ratio 0.06 of all image pixels) are different.
Snapshot: cli-help-output.png
Call log:
- Expect "toHaveScreenshot(cli-help-output.png)" with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 52137 pixels (ratio 0.06 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 52137 pixels (ratio 0.06 of all image pixels) are different.
59 |
60 | // Take screenshot for regression testing
> 61 | await expect(page).toHaveScreenshot('cli-help-output.png', {
| ^
62 | fullPage: true,
63 | animations: 'disabled',
64 | mask: [page.locator('text=/v\\d+\\.\\d+\\.\\d+/')], // Mask version numbers
at /home/runner/work/MultiAgent-Claude/MultiAgent-Claude/tests/visual-regression.spec.js:61:26
|
|
🎭 Playwright Run Summary
3 passed (2.4s)
|
|
🎭 Playwright Run Summary
4 passed (1.5s)
|
|
🎭 Playwright Run Summary
3 passed (2.0s)
|
|
🎭 Playwright Run Summary
4 passed (2.0s)
|
|
🎭 Playwright Run Summary
1 passed (1.5s)
|
|
🎭 Playwright Run Summary
4 passed (3.0s)
|
|
🎭 Playwright Run Summary
1 failed
[unit-tests] › tests/visual-regression.spec.js:24:5 › Visual Regression Tests › CLI Output Visual Tests › CLI help output visual consistency
2 passed (7.3s)
|
|
🎭 Playwright Run Summary
4 passed (1.4s)
|
Artifacts
Produced during runtime
| Name | Size | Digest | |
|---|---|---|---|
|
blob-report-0
Expired
|
2.24 MB |
sha256:474e4f60d5af0fa0ed7beb624f8772cefaf0480d6f3ae49ad8a31e46351f60c0
|
|
|
blob-report-1
Expired
|
24.4 KB |
sha256:415693e118b24543b225d22277ce77a1992854ee3c421b3a19bf3515f0a7ffd9
|
|
|
blob-report-2
Expired
|
24 KB |
sha256:6fdf8bbdae821ee18e85b0829a9479c888a5f5ad1dcc6805bcceef1166b045dc
|
|
|
blob-report-3
Expired
|
21.8 KB |
sha256:8d5a5ab39d6ecdabfce4cf3a541fc2f42d6881871fd9ffe03695bee09d8c9710
|
|
|
playwright-report
Expired
|
174 KB |
sha256:cce5e33cc2f291bbd304ee758c64d35da68420ad9864ac62d80fa5a6d47b15f2
|
|
|
visual-diffs-0
Expired
|
2.21 MB |
sha256:8194f554010f5fd4b8cab3682ad2ca7b911670866eeda24eae13d57844c21475
|
|