feat: add deployment URL detection for visual CI testing #90
Ancient23playwright-cli-tests.yml
on: pull_request
Matrix: test
merge-reports
13s
update-baselines
0s
document-patterns
0s
Annotations
4 errors and 8 notices
|
test (1/4)
Process completed with exit code 1.
|
|
[unit-tests] › tests/visual-regression.spec.js:24:5 › Visual Regression Tests › CLI Output Visual Tests › CLI help output visual consistency:
tests/visual-regression.spec.js#L61
1) [unit-tests] › tests/visual-regression.spec.js:24:5 › Visual Regression Tests › CLI Output Visual Tests › CLI help output visual consistency
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(page).toHaveScreenshot(expected)
Expected an image 1280px by 720px, received 1280px by 761px. 96948 pixels (ratio 0.10 of all image pixels) are different.
Snapshot: cli-help-output.png
Call log:
- Expect "toHaveScreenshot(cli-help-output.png)" with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- Expected an image 1280px by 720px, received 1280px by 761px. 96948 pixels (ratio 0.10 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- Expected an image 1280px by 720px, received 1280px by 761px. 96948 pixels (ratio 0.10 of all image pixels) are different.
59 |
60 | // Take screenshot for regression testing
> 61 | await expect(page).toHaveScreenshot('cli-help-output.png', {
| ^
62 | fullPage: true,
63 | animations: 'disabled',
64 | mask: [page.locator('text=/v\\d+\\.\\d+\\.\\d+/')], // Mask version numbers
at /home/runner/work/MultiAgent-Claude/MultiAgent-Claude/tests/visual-regression.spec.js:61:26
|
|
[unit-tests] › tests/visual-regression.spec.js:24:5 › Visual Regression Tests › CLI Output Visual Tests › CLI help output visual consistency:
tests/visual-regression.spec.js#L61
1) [unit-tests] › tests/visual-regression.spec.js:24:5 › Visual Regression Tests › CLI Output Visual Tests › CLI help output visual consistency
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(page).toHaveScreenshot(expected)
Expected an image 1280px by 720px, received 1280px by 761px. 96948 pixels (ratio 0.10 of all image pixels) are different.
Snapshot: cli-help-output.png
Call log:
- Expect "toHaveScreenshot(cli-help-output.png)" with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- Expected an image 1280px by 720px, received 1280px by 761px. 96948 pixels (ratio 0.10 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- Expected an image 1280px by 720px, received 1280px by 761px. 96948 pixels (ratio 0.10 of all image pixels) are different.
59 |
60 | // Take screenshot for regression testing
> 61 | await expect(page).toHaveScreenshot('cli-help-output.png', {
| ^
62 | fullPage: true,
63 | animations: 'disabled',
64 | mask: [page.locator('text=/v\\d+\\.\\d+\\.\\d+/')], // Mask version numbers
at /home/runner/work/MultiAgent-Claude/MultiAgent-Claude/tests/visual-regression.spec.js:61:26
|
|
[unit-tests] › tests/visual-regression.spec.js:24:5 › Visual Regression Tests › CLI Output Visual Tests › CLI help output visual consistency:
tests/visual-regression.spec.js#L61
1) [unit-tests] › tests/visual-regression.spec.js:24:5 › Visual Regression Tests › CLI Output Visual Tests › CLI help output visual consistency
Error: expect(page).toHaveScreenshot(expected)
Expected an image 1280px by 720px, received 1280px by 761px. 96948 pixels (ratio 0.10 of all image pixels) are different.
Snapshot: cli-help-output.png
Call log:
- Expect "toHaveScreenshot(cli-help-output.png)" with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- Expected an image 1280px by 720px, received 1280px by 761px. 96948 pixels (ratio 0.10 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- Expected an image 1280px by 720px, received 1280px by 761px. 96948 pixels (ratio 0.10 of all image pixels) are different.
59 |
60 | // Take screenshot for regression testing
> 61 | await expect(page).toHaveScreenshot('cli-help-output.png', {
| ^
62 | fullPage: true,
63 | animations: 'disabled',
64 | mask: [page.locator('text=/v\\d+\\.\\d+\\.\\d+/')], // Mask version numbers
at /home/runner/work/MultiAgent-Claude/MultiAgent-Claude/tests/visual-regression.spec.js:61:26
|
|
🎭 Playwright Run Summary
1 failed
[unit-tests] › tests/visual-regression.spec.js:24:5 › Visual Regression Tests › CLI Output Visual Tests › CLI help output visual consistency
2 passed (7.4s)
|
|
🎭 Playwright Run Summary
4 passed (1.4s)
|
|
🎭 Playwright Run Summary
3 passed (1.8s)
|
|
🎭 Playwright Run Summary
4 passed (1.8s)
|
|
🎭 Playwright Run Summary
3 passed (2.6s)
|
|
🎭 Playwright Run Summary
4 passed (1.5s)
|
|
🎭 Playwright Run Summary
1 passed (1.6s)
|
|
🎭 Playwright Run Summary
4 passed (3.1s)
|
Artifacts
Produced during runtime
| Name | Size | Digest | |
|---|---|---|---|
|
blob-report-0
Expired
|
2.17 MB |
sha256:aa636199a6c5466e5029cbc8f3392d919bf7a6ef4f7bf898a019b7835a06d6bb
|
|
|
blob-report-1
Expired
|
24 KB |
sha256:83a807d1d6cfa16eb44293884104693a4af1df77384a59f3d4767f21191d5c90
|
|
|
blob-report-2
Expired
|
24.2 KB |
sha256:6f07ed4009db48ff12596d5eb134ec7b4671dd91d6038efef3b2d6028fd8d721
|
|
|
blob-report-3
Expired
|
22.4 KB |
sha256:9bbd401af93a0dd32fcf21331ea6c014d88cfbf316c8eaf3ec31ecac854f0a15
|
|
|
playwright-report
Expired
|
174 KB |
sha256:a685127a3542366cd59a89218c4e7d1a18c3c2403f236a900af8f6379d090273
|
|
|
visual-diffs-0
Expired
|
2.15 MB |
sha256:20b23a2638305718c75d98689f0b7aeec4e1b565e086077a832b7b205f642e59
|
|