PMM Integration Tests #12
integration-cli-tests.yml
on: workflow_dispatch
CLI
/
...
/
help tests
2m 21s
CLI
/
...
/
pmm-server container
2m 52s
CLI
/
...
/
pmm-client docker
4m 29s
CLI
/
...
/
Generic
4m 2s
CLI
/
...
/
Remove
4m 5s
CLI
/
...
/
Percona Server 5.7
3m 30s
CLI
/
...
/
Percona Server 8.0
3m 53s
CLI
/
...
/
MySQL 8.0
3m 58s
CLI
/
...
/
PD PostgreSQL 13
4m 13s
CLI
/
...
/
PD PostgreSQL 14
3m 33s
CLI
/
...
/
PD PostgreSQL 15
4m 15s
CLI
/
...
/
PSMDB 4.4
8m 18s
CLI
/
...
/
PSMDB 5.x
7m 36s
CLI
/
...
/
PSMDB 6.x
7m 40s
CLI
/
...
/
PSMDB 7.x
7m 48s
CLI
/
...
/
HA Proxy
5m 9s
CLI
/
...
/
PXC 5.7
3m 28s
Annotations
15 errors, 6 warnings, and 16 notices
CLI / Integration / pmm-server container
=================
no tests found.
=================
|
CLI / Integration / pmm-server container
Process completed with exit code 1.
|
CLI / Integration / MySQL 8.0
Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
|
tests/mysql.spec.ts:204:7 › PMM Client CLI tests for MySQL › run pmm-admin add mysql with disable-tablestats-limit=50:
pmm-ui-tests/cli/support/types/output.ts#L22
1) tests/mysql.spec.ts:204:7 › PMM Client CLI tests for MySQL › run pmm-admin add mysql with disable-tablestats-limit=50
Error: "sudo docker exec ms_pmm_8.0 pmm-admin add mysql --query-source=perfschema --disable-tablestats-limit=50 --username=msandbox --*** mysql_limit_remove " expected to exit with 0! Error: "Connection check failed: dial tcp 127.0.0.1:3306: connect: connection refused.
"
Expected: 0
Received: 1
at support/types/output.ts:22
20 | async assertSuccess() {
21 | await test.step(`Verify "${this.command}" command executed successfully`, async () => {
> 22 | expect(this.code, `"${this.command}" expected to exit with 0! Error: "${this.stderr || this.stdout}"`).toEqual(0);
| ^
23 | });
24 | }
25 |
at /home/runner/work/pmm-qa/pmm-qa/pmm-ui-tests/cli/support/types/output.ts:22:110
at Output.assertSuccess (/home/runner/work/pmm-qa/pmm-qa/pmm-ui-tests/cli/support/types/output.ts:21:16)
at /home/runner/work/pmm-qa/pmm-qa/pmm-ui-tests/cli/tests/mysql.spec.ts:208:18
|
tests/mysql.spec.ts:215:7 › PMM Client CLI tests for MySQL › run pmm-admin remove mysql added using disable-tablestats-limit=50:
pmm-ui-tests/cli/support/types/output.ts#L22
2) tests/mysql.spec.ts:215:7 › PMM Client CLI tests for MySQL › run pmm-admin remove mysql added using disable-tablestats-limit=50
Error: "sudo docker exec ms_pmm_8.0 pmm-admin remove mysql mysql_limit_remove" expected to exit with 0! Error: "Service with name "mysql_limit_remove" not found.
"
Expected: 0
Received: 1
at support/types/output.ts:22
20 | async assertSuccess() {
21 | await test.step(`Verify "${this.command}" command executed successfully`, async () => {
> 22 | expect(this.code, `"${this.command}" expected to exit with 0! Error: "${this.stderr || this.stdout}"`).toEqual(0);
| ^
23 | });
24 | }
25 |
at /home/runner/work/pmm-qa/pmm-qa/pmm-ui-tests/cli/support/types/output.ts:22:110
at Output.assertSuccess (/home/runner/work/pmm-qa/pmm-qa/pmm-ui-tests/cli/support/types/output.ts:21:16)
at /home/runner/work/pmm-qa/pmm-qa/pmm-ui-tests/cli/tests/mysql.spec.ts:217:18
|
CLI / Integration / MySQL 8.0
Process completed with exit code 1.
|
CLI / Integration / Generic
Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
|
tests/pmm-server-docker-generic.spec.ts:13:7 › PMM Server CLI tests for Docker Environment Variables › PMM-T224 run docker container with a invalid value for a environment variable DATA_RETENTION=48:
pmm-ui-tests/cli/support/types/output.ts#L22
1) tests/pmm-server-docker-generic.spec.ts:13:7 › PMM Server CLI tests for Docker Environment Variables › PMM-T224 run docker container with a invalid value for a environment variable DATA_RETENTION=48
Error: "docker logs PMM-T224 2>&1 | grep 'Configuration error: environment variable "DATA_RETENTION=48" has invalid duration 48'" expected to exit with 0! Error: ""
Expected: 0
Received: 1
at support/types/output.ts:22
20 | async assertSuccess() {
21 | await test.step(`Verify "${this.command}" command executed successfully`, async () => {
> 22 | expect(this.code, `"${this.command}" expected to exit with 0! Error: "${this.stderr || this.stdout}"`).toEqual(0);
| ^
23 | });
24 | }
25 |
at /home/runner/work/pmm-qa/pmm-qa/pmm-ui-tests/cli/support/types/output.ts:22:110
at Output.assertSuccess (/home/runner/work/pmm-qa/pmm-qa/pmm-ui-tests/cli/support/types/output.ts:21:16)
at /home/runner/work/pmm-qa/pmm-qa/pmm-ui-tests/cli/tests/pmm-server-docker-generic.spec.ts:23:10
|
tests/pmm-server-docker-generic.spec.ts:30:7 › PMM Server CLI tests for Docker Environment Variables › PMM-T225 run docker container with a unexpected environment variable DATA_TENTION=48:
pmm-ui-tests/cli/support/types/output.ts#L22
2) tests/pmm-server-docker-generic.spec.ts:30:7 › PMM Server CLI tests for Docker Environment Variables › PMM-T225 run docker container with a unexpected environment variable DATA_TENTION=48
Error: "docker logs PMM-T225 2>&1 | grep 'Configuration warning: unknown environment variable "DATA_TENTION=48"'" expected to exit with 0! Error: ""
Expected: 0
Received: 1
at support/types/output.ts:22
20 | async assertSuccess() {
21 | await test.step(`Verify "${this.command}" command executed successfully`, async () => {
> 22 | expect(this.code, `"${this.command}" expected to exit with 0! Error: "${this.stderr || this.stdout}"`).toEqual(0);
| ^
23 | });
24 | }
25 |
at /home/runner/work/pmm-qa/pmm-qa/pmm-ui-tests/cli/support/types/output.ts:22:110
at Output.assertSuccess (/home/runner/work/pmm-qa/pmm-qa/pmm-ui-tests/cli/support/types/output.ts:21:16)
at /home/runner/work/pmm-qa/pmm-qa/pmm-ui-tests/cli/tests/pmm-server-docker-generic.spec.ts:36:10
|
tests/pmm-server-docker-generic.spec.ts:44:7 › PMM Server CLI tests for Docker Environment Variables › PMM-T226 run docker container with all valid environment variables not causing any warning or error message:
pmm-ui-tests/cli/support/types/output.ts#L22
3) tests/pmm-server-docker-generic.spec.ts:44:7 › PMM Server CLI tests for Docker Environment Variables › PMM-T226 run docker container with all valid environment variables not causing any warning or error message
Error: "docker ps | grep PMM-T226" expected to exit with 0! Error: ""
Expected: 0
Received: 1
at support/types/output.ts:22
20 | async assertSuccess() {
21 | await test.step(`Verify "${this.command}" command executed successfully`, async () => {
> 22 | expect(this.code, `"${this.command}" expected to exit with 0! Error: "${this.stderr || this.stdout}"`).toEqual(0);
| ^
23 | });
24 | }
25 |
at /home/runner/work/pmm-qa/pmm-qa/pmm-ui-tests/cli/support/types/output.ts:22:110
at Output.assertSuccess (/home/runner/work/pmm-qa/pmm-qa/pmm-ui-tests/cli/support/types/output.ts:21:16)
at /home/runner/work/pmm-qa/pmm-qa/pmm-ui-tests/cli/tests/pmm-server-docker-generic.spec.ts:50:57
|
tests/pmm-server-docker-generic.spec.ts:79:7 › PMM Server CLI tests for Docker Environment Variables › Basic Sanity using Clickhouse shipped with PMM-Server:
pmm-ui-tests/cli/support/types/output.ts#L22
4) tests/pmm-server-docker-generic.spec.ts:79:7 › PMM Server CLI tests for Docker Environment Variables › Basic Sanity using Clickhouse shipped with PMM-Server, Check Connection, Run a Query
Error: "clickhouse-client --database pmm --query "select any(example),sum(num_queries) cnt, max(m_query_time_max) slowest from metrics where period_start>subtractHours(now(),6) group by queryid order by slowest desc limit 10"" expected to exit with 0! Error: "Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::1]:9000). (NETWORK_ERROR)
"
Expected: 0
Received: 210
at support/types/output.ts:22
20 | async assertSuccess() {
21 | await test.step(`Verify "${this.command}" command executed successfully`, async () => {
> 22 | expect(this.code, `"${this.command}" expected to exit with 0! Error: "${this.stderr || this.stdout}"`).toEqual(0);
| ^
23 | });
24 | }
25 |
at /home/runner/work/pmm-qa/pmm-qa/pmm-ui-tests/cli/support/types/output.ts:22:110
at Output.assertSuccess (/home/runner/work/pmm-qa/pmm-qa/pmm-ui-tests/cli/support/types/output.ts:21:16)
at /home/runner/work/pmm-qa/pmm-qa/pmm-ui-tests/cli/tests/pmm-server-docker-generic.spec.ts:86:10
|
CLI / Integration / Generic
Process completed with exit code 1.
|
CLI / Integration / Remove
Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
|
tests/remove.spec.ts:29:7 › PMM Server CLI tests for Docker Environment Variables › PMM-T1286:
pmm-ui-tests/cli/support/types/output.ts#L34
1) tests/remove.spec.ts:29:7 › PMM Server CLI tests for Docker Environment Variables › PMM-T1286, PMM-T1287, PMM-T1288, PMM-T1308 - Verify service removal without specifying service name/service id
Error: Stdout does not contain We could not find a service associated with the local node. Please provide "Service ID" or "Service name"!
Expected substring: "We could not find a service associated with the local node. Please provide \"Service ID\" or \"Service name\""
Received string: ""
at support/types/output.ts:34
32 | async outContains(expectedValue: string) {
33 | await test.step(`Verify command output contains ${expectedValue}`, async () => {
> 34 | expect(this.stdout, `Stdout does not contain ${expectedValue}!`).toContain(expectedValue);
| ^
35 | })
36 | }
37 |
at /home/runner/work/pmm-qa/pmm-qa/pmm-ui-tests/cli/support/types/output.ts:34:72
at Output.outContains (/home/runner/work/pmm-qa/pmm-qa/pmm-ui-tests/cli/support/types/output.ts:33:16)
at /home/runner/work/pmm-qa/pmm-qa/pmm-ui-tests/cli/tests/remove.spec.ts:33:20
|
CLI / Integration / Remove
Process completed with exit code 1.
|
Slow Test:
pmm-ui-tests/cli/tests/postgreSql-pdpgsql.spec.ts#L1
pmm-ui-tests/cli/tests/postgreSql-pdpgsql.spec.ts took 33.6s
|
Slow Test:
pmm-ui-tests/cli/tests/postgreSql-pdpgsql.spec.ts#L1
pmm-ui-tests/cli/tests/postgreSql-pdpgsql.spec.ts took 33.7s
|
Slow Test:
pmm-ui-tests/cli/tests/postgreSql-pdpgsql.spec.ts#L1
pmm-ui-tests/cli/tests/postgreSql-pdpgsql.spec.ts took 33.7s
|
Slow Test:
pmm-ui-tests/cli/tests/perconaMySqlServer.spec.ts#L1
pmm-ui-tests/cli/tests/perconaMySqlServer.spec.ts took 24.2s
|
Slow Test:
pmm-ui-tests/cli/tests/perconaMySqlServer.spec.ts#L1
pmm-ui-tests/cli/tests/perconaMySqlServer.spec.ts took 24.2s
|
Slow Test:
pmm-ui-tests/cli/tests/pmm-server-docker-generic.spec.ts#L1
pmm-ui-tests/cli/tests/pmm-server-docker-generic.spec.ts took 1.5m
|
🎭 Playwright Run Summary
6 passed (1.4s)
|
🎭 Playwright Run Summary
2 skipped
21 passed (34.1s)
|
🎭 Playwright Run Summary
4 passed (614ms)
|
🎭 Playwright Run Summary
2 skipped
21 passed (34.2s)
|
🎭 Playwright Run Summary
2 skipped
21 passed (34.2s)
|
🎭 Playwright Run Summary
7 passed (1.4s)
|
🎭 Playwright Run Summary
7 passed (981ms)
|
🎭 Playwright Run Summary
35 passed (24.8s)
|
🎭 Playwright Run Summary
35 passed (24.7s)
|
🎭 Playwright Run Summary
2 skipped
15 passed (1.7s)
|
🎭 Playwright Run Summary
2 skipped
15 passed (1.7s)
|
🎭 Playwright Run Summary
2 skipped
15 passed (1.6s)
|
🎭 Playwright Run Summary
2 skipped
15 passed (1.6s)
|
🎭 Playwright Run Summary
2 failed
tests/mysql.spec.ts:204:7 › PMM Client CLI tests for MySQL › run pmm-admin add mysql with disable-tablestats-limit=50
tests/mysql.spec.ts:215:7 › PMM Client CLI tests for MySQL › run pmm-admin remove mysql added using disable-tablestats-limit=50
1 skipped
15 passed (3.8s)
|
🎭 Playwright Run Summary
4 failed
tests/pmm-server-docker-generic.spec.ts:13:7 › PMM Server CLI tests for Docker Environment Variables › PMM-T224 run docker container with a invalid value for a environment variable DATA_RETENTION=48
tests/pmm-server-docker-generic.spec.ts:30:7 › PMM Server CLI tests for Docker Environment Variables › PMM-T225 run docker container with a unexpected environment variable DATA_TENTION=48
tests/pmm-server-docker-generic.spec.ts:44:7 › PMM Server CLI tests for Docker Environment Variables › PMM-T226 run docker container with all valid environment variables not causing any warning or error message
tests/pmm-server-docker-generic.spec.ts:79:7 › PMM Server CLI tests for Docker Environment Variables › Basic Sanity using Clickhouse shipped with PMM-Server, Check Connection, Run a Query
1 skipped
7 passed (1.5m)
|
🎭 Playwright Run Summary
1 failed
tests/remove.spec.ts:29:7 › PMM Server CLI tests for Docker Environment Variables › PMM-T1286, PMM-T1287, PMM-T1288, PMM-T1308 - Verify service removal without specifying service name/service id
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
report-
Expired
|
173 KB |
|