Fix orchestrate command #100
playwright-cli-tests.yml
on: push
Matrix: test
merge-reports
13s
update-baselines
0s
document-patterns
5s
Annotations
4 errors and 8 notices
|
test (1/4)
Process completed with exit code 1.
|
|
[unit-tests] › tests/visual-regression.spec.js:24:5 › Visual Regression Tests › CLI Output Visual Tests › CLI help output visual consistency:
tests/visual-regression.spec.js#L61
1) [unit-tests] › tests/visual-regression.spec.js:24:5 › Visual Regression Tests › CLI Output Visual Tests › CLI help output visual consistency
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(page).toHaveScreenshot(expected)
52137 pixels (ratio 0.06 of all image pixels) are different.
Snapshot: cli-help-output.png
Call log:
- Expect "toHaveScreenshot(cli-help-output.png)" with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 52137 pixels (ratio 0.06 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 52137 pixels (ratio 0.06 of all image pixels) are different.
59 |
60 | // Take screenshot for regression testing
> 61 | await expect(page).toHaveScreenshot('cli-help-output.png', {
| ^
62 | fullPage: true,
63 | animations: 'disabled',
64 | mask: [page.locator('text=/v\\d+\\.\\d+\\.\\d+/')], // Mask version numbers
at /home/runner/work/MultiAgent-Claude/MultiAgent-Claude/tests/visual-regression.spec.js:61:26
|
|
[unit-tests] › tests/visual-regression.spec.js:24:5 › Visual Regression Tests › CLI Output Visual Tests › CLI help output visual consistency:
tests/visual-regression.spec.js#L61
1) [unit-tests] › tests/visual-regression.spec.js:24:5 › Visual Regression Tests › CLI Output Visual Tests › CLI help output visual consistency
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(page).toHaveScreenshot(expected)
52137 pixels (ratio 0.06 of all image pixels) are different.
Snapshot: cli-help-output.png
Call log:
- Expect "toHaveScreenshot(cli-help-output.png)" with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 52137 pixels (ratio 0.06 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 52137 pixels (ratio 0.06 of all image pixels) are different.
59 |
60 | // Take screenshot for regression testing
> 61 | await expect(page).toHaveScreenshot('cli-help-output.png', {
| ^
62 | fullPage: true,
63 | animations: 'disabled',
64 | mask: [page.locator('text=/v\\d+\\.\\d+\\.\\d+/')], // Mask version numbers
at /home/runner/work/MultiAgent-Claude/MultiAgent-Claude/tests/visual-regression.spec.js:61:26
|
|
[unit-tests] › tests/visual-regression.spec.js:24:5 › Visual Regression Tests › CLI Output Visual Tests › CLI help output visual consistency:
tests/visual-regression.spec.js#L61
1) [unit-tests] › tests/visual-regression.spec.js:24:5 › Visual Regression Tests › CLI Output Visual Tests › CLI help output visual consistency
Error: expect(page).toHaveScreenshot(expected)
52137 pixels (ratio 0.06 of all image pixels) are different.
Snapshot: cli-help-output.png
Call log:
- Expect "toHaveScreenshot(cli-help-output.png)" with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 52137 pixels (ratio 0.06 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 52137 pixels (ratio 0.06 of all image pixels) are different.
59 |
60 | // Take screenshot for regression testing
> 61 | await expect(page).toHaveScreenshot('cli-help-output.png', {
| ^
62 | fullPage: true,
63 | animations: 'disabled',
64 | mask: [page.locator('text=/v\\d+\\.\\d+\\.\\d+/')], // Mask version numbers
at /home/runner/work/MultiAgent-Claude/MultiAgent-Claude/tests/visual-regression.spec.js:61:26
|
|
🎭 Playwright Run Summary
3 passed (2.1s)
|
|
🎭 Playwright Run Summary
4 passed (1.2s)
|
|
🎭 Playwright Run Summary
1 failed
[unit-tests] › tests/visual-regression.spec.js:24:5 › Visual Regression Tests › CLI Output Visual Tests › CLI help output visual consistency
2 passed (6.6s)
|
|
🎭 Playwright Run Summary
4 passed (1.0s)
|
|
🎭 Playwright Run Summary
1 passed (1.2s)
|
|
🎭 Playwright Run Summary
4 passed (3.3s)
|
|
🎭 Playwright Run Summary
3 passed (1.5s)
|
|
🎭 Playwright Run Summary
4 passed (1.6s)
|
Artifacts
Produced during runtime
| Name | Size | Digest | |
|---|---|---|---|
|
blob-report-0
Expired
|
2.19 MB |
sha256:02df0ced0de154c982dc82e52f7efd79c881b50c2b532f29e5660f07ae5184be
|
|
|
blob-report-1
Expired
|
3.63 KB |
sha256:facd89f96ec61754ad48515ead182352405bdb9ae87c344f79173ad6282fb58a
|
|
|
blob-report-2
Expired
|
3.69 KB |
sha256:70a4787abdc3f89756dc6de39a843b81222455604c1766a41b19cb210103d137
|
|
|
blob-report-3
Expired
|
2.13 KB |
sha256:cd2fb3f74b93abd122b8f674dee9692e652af16737d90e08ba68e91a5a44a4f5
|
|
|
playwright-report
Expired
|
174 KB |
sha256:6eb729e61d0294ceb19e4720c64701c0d3da06c2e642da2fd16329093d5b8eb5
|
|
|
visual-diffs-0
Expired
|
2.18 MB |
sha256:652d7bd2ede4768cd8470b26be77c8520d64be98eac07d44c17823f5691e4409
|
|