Skip to content

Conversation

@dmarteau
Copy link
Member

@dmarteau dmarteau commented Aug 26, 2025

Tests for Qjazz eager (dev versions)

Tests latest ltr and releases QGIS version with QJazz.

DO NOT MERGE

@dmarteau dmarteau self-assigned this Aug 26, 2025
@dmarteau dmarteau added the tests unit tests and docker configuration for tests label Aug 26, 2025
@github-actions github-actions bot added this to the 3.11.0 milestone Aug 26, 2025
@dmarteau dmarteau changed the title Use QJazz in tests Test Qjazz eager Aug 26, 2025
@dmarteau dmarteau marked this pull request as draft August 26, 2025 10:45
@3liz-bot
Copy link
Contributor

3liz-bot commented Aug 26, 2025

All Playwright tests LEGACY

Summary

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Pending ⏳ Other ❓ Flaky 🍂 Duration ⏱️
308 306 0 2 0 0 2 11m8s

Failed Tests

No failed tests ✨

Flaky Tests

Flaky Tests 🍂 Retries
🍂 Catch GetLegendGraphic requests and timeout on GetLegendGraphic with multi layers 1
🍂 Build permalink, reload and apply one 1

Flaky Rate

Overall Flaky Rate: 0.65%

Test 📝 Attempts 🎯 Pass ✅ Fail ❌ Flaky Rate % 🍂
Catch GetLegendGraphic requests and timeout on GetLegendGraphic with multi layers 2 1 1 50.00
Build permalink, reload and apply one 2 1 1 50.00

Measured over 1 runs.

Github Test Reporter by CTRF 💚


All Playwright tests BLEEDING_EDGE

Summary

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Pending ⏳ Other ❓ Flaky 🍂 Duration ⏱️
308 274 32 2 0 0 1 33m32s

Failed Tests

Failed Tests ❌ Fail Message
❌ Layer point_2154 : create and edit attributes and geometry Test timeout of 30000ms exceeded.
❌ Layer point_3857 : create and edit attributes and geometry Test timeout of 30000ms exceeded.
❌ Layer point_4326 : create and edit attributes and geometry Test timeout of 30000ms exceeded.
❌ Layer line_2154 : create and edit attributes and geometry Test timeout of 30000ms exceeded.
❌ Layer line_3857 : create and edit attributes and geometry Test timeout of 30000ms exceeded.
❌ Layer line_4326 : create and edit attributes and geometry Test timeout of 30000ms exceeded.
❌ Layer polygon_2154 : create and edit attributes and geometry Test timeout of 30000ms exceeded.
❌ Layer polygon_3857 : create and edit attributes and geometry Test timeout of 30000ms exceeded.
❌ Layer polygon_4326 : create and edit attributes and geometry Test timeout of 30000ms exceeded.
❌ EPSG:2154 Test timeout of 30000ms exceeded.
❌ EPSG:3857 Test timeout of 30000ms exceeded.
❌ Catch GetLegendGraphic requests and timeout on GetLegendGraphic with multi layers Error: expect(received).toBeGreaterThanOrEqual(expected)

Expected: >= 2
Received: 0
❌ Catch GetMap requests and GetLegendGraphic requests to check order Error: expect(received).toBeGreaterThanOrEqual(expected)

Expected: >= 2
Received: 0
❌ Base layers list Error: expect(locator).toHaveCount(expected) failed

Locator: locator('lizmap-base-layers select option')
Expected: 12
Received: 10
Timeout: 5000ms

Call log:
- Expect "toHaveCount" with timeout 5000ms
- waiting for locator('lizmap-base-layers select option')
9 × locator resolved to 10 elements
- unexpected value "10"
❌ Load map with dummy API Key Error: expect(received).toBe(expected) // Object.is equality

Expected: 4
Received: 0
❌ Tests the legend toggled layers Error: expect(locator).toBeChecked() failed

Locator: getByLabel('Group as layer')
Expected: checked
Received:
Timeout: 5000ms

Call log:
- Expect "toBeChecked" with timeout 5000ms
- waiting for getByLabel('Group as layer')
❌ Tree initialization of checkboxes on groups Error: expect(locator).not.toBeChecked() failed

Locator: getByLabel('qt')
Expected: not checked
Received:
Timeout: 5000ms

Call log:
- Expect "not toBeChecked" with timeout 5000ms
- waiting for getByLabel('qt')
❌ Group as layer : UI according to permalink parameters Error: expect(locator).toBeChecked() failed

Locator: getByTestId('Group as layer').locator('> div input')
Expected: checked
Received:
Timeout: 5000ms

Call log:
- Expect "toBeChecked" with timeout 5000ms
- waiting for getByTestId('Group as layer').locator('> div input')
❌ Empty string for style : UI according to permalink parameters Error: expect(locator).toBeChecked() failed

Locator: getByTestId('Group as layer').locator('> div input')
Expected: checked
Received:
Timeout: 5000ms

Call log:
- Expect "toBeChecked" with timeout 5000ms
- waiting for getByTestId('Group as layer').locator('> div input')
❌ Groups and layers checked: UI according to permalink parameters Error: expect(locator).not.toBeChecked() failed

Locator: getByTestId('group as layer 1').locator('> div input')
Expected: not checked
Received:
Timeout: 5000ms

Call log:
- Expect "not toBeChecked" with timeout 5000ms
- waiting for getByTestId('group as layer 1').locator('> div input')
❌ Build permalink, reload and apply one Error: expect(locator).not.toBeChecked() failed

Locator: getByTestId('Group as layer').locator('> div input')
Expected: not checked
Received:
Timeout: 5000ms

Call log:
- Expect "not toBeChecked" with timeout 5000ms
- waiting for getByTestId('Group as layer').locator('> div input')
❌ Build permalink and change hash Error: expect(locator).not.toBeChecked() failed

Locator: getByTestId('Group as layer').locator('> div input')
Expected: not checked
Received:
Timeout: 5000ms

Call log:
- Expect "not toBeChecked" with timeout 5000ms
- waiting for getByTestId('Group as layer').locator('> div input')
❌ Hash does not change when changing layers Error: expect(locator).not.toBeChecked() failed

Locator: getByTestId('Group as layer').locator('> div input')
Expected: not checked
Received:
Timeout: 5000ms

Call log:
- Expect "not toBeChecked" with timeout 5000ms
- waiting for getByTestId('Group as layer').locator('> div input')
❌ must display theme3 when active Error: expect(locator).toHaveClass(expected) failed

Locator: locator('lizmap-treeview > ul > li:nth-child(3) > div.expandable')
Expected pattern: /expanded/
Received:
Timeout: 5000ms

Call log:
- Expect "toHaveClass" with timeout 5000ms
- waiting for locator('lizmap-treeview > ul > li:nth-child(3) > div.expandable')
❌ mapTheme parameter Test timeout of 30000ms exceeded.
❌ must display theme1 at startup Error: expect(received).toContain(expected) // indexOf

Expected substring: "|group1,Les%20quartiers,sub-group-1,sub-sub-group--1,sub-sub-group--2|,style1,,,|1,1,1,1,1"
Received string: "#3.730872,43.540386,4.017985,43.679557|group1,Les%20quartiers|,style1|1,1"
❌ layer/group UI Error: expect(received).toBeGreaterThanOrEqual(expected)

Expected: >= 2
Received: 0
❌ layer/group visibility UI Error: expect(received).toBeGreaterThanOrEqual(expected)

Expected: >= 2
Received: 0
❌ displays mutually exclusive group Error: expect(received).toBeGreaterThanOrEqual(expected)

Expected: >= 2
Received: 0
❌ displays "title" defined in Lizmap plugin Error: expect(received).toBeGreaterThanOrEqual(expected)

Expected: >= 2
Received: 0
❌ double clicking Error: expect(received).toBeGreaterThanOrEqual(expected)

Expected: >= 2
Received: 0
❌ "Hide checkboxes for groups" option Test timeout of 30000ms exceeded.

Flaky Tests

Flaky Tests 🍂 Retries
🍂 Default 1

Flaky Rate

Overall Flaky Rate: 0.27%

Test 📝 Attempts 🎯 Pass ✅ Fail ❌ Flaky Rate % 🍂
Default 2 1 1 50.00

Measured over 1 runs.

Github Test Reporter by CTRF 💚

@github-actions
Copy link

The Lizmap project highly values your contribution and would love to see this work merged! Unfortunately this PR has not had any activity in the last 2 months and is being automatically marked as "stale".
If there is no further activity on this pull request, it will be closed in two weeks.

@github-actions github-actions bot added the stale This ticket might be closed soon label Oct 27, 2025
@github-actions github-actions bot removed the stale This ticket might be closed soon label Oct 29, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

tests unit tests and docker configuration for tests

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants