Skip to content
Tests

Simplify caching mechanisms for CI and PROD images #116656

Sign in to view logs

Simplify caching mechanisms for CI and PROD images

Simplify caching mechanisms for CI and PROD images #116656

Triggered via pull request December 28, 2024 15:51
@potiukpotiuk
synchronize #45261
potiuk:redesign-image-caching
Status Cancelled
Total duration 15m 2s
Artifacts 19

ci.yml

on: pull_request
Build info
29s
Build info
Matrix: Build CI images / build-ci-images
Basic tests  /  Breeze unit tests
57s
Basic tests / Breeze unit tests
Basic tests  /  React UI tests
33s
Basic tests / React UI tests
Basic tests  /  React WWW tests
47s
Basic tests / React WWW tests
Basic tests  /  Static checks: basic checks only
0s
Basic tests / Static checks: basic checks only
Basic tests  /  Test git clone on Windows
14s
Basic tests / Test git clone on Windows
Basic tests  /  Upgrade checks
0s
Basic tests / Upgrade checks
Basic tests  /  Test Airflow release commands
0s
Basic tests / Test Airflow release commands
Generate constraints  /  Generate constraints 3.9 3.10 3.11 3.12
35s
Generate constraints / Generate constraints 3.9 3.10 3.11 3.12
Matrix: CI image checks / MyPy checks
Matrix: Integration and System Tests / tests-core-integration
Matrix: Integration and System Tests / tests-providers-integration
Matrix: MySQL tests / tests
Matrix: Non-DB tests / tests
Matrix: Postgres tests / tests
Matrix: Sqlite tests / tests
CI image checks  /  Static checks
4m 0s
CI image checks / Static checks
CI image checks  /  Test Python API client
4m 3s
CI image checks / Test Python API client
Integration and System Tests  /  System Tests
1m 33s
Integration and System Tests / System Tests
Matrix: Additional CI image checks / Push Early Image Cache / push-ci-image-cache
Waiting for pending jobs
Matrix: Additional CI image checks / Push Early Image Cache / push-prod-image-cache
Waiting for pending jobs
Matrix: CI image checks / Build documentation
Matrix: Provider packages tests / prepare-install-verify-provider-packages
Matrix: Provider packages tests / providers-compatibility-tests-matrix
Matrix: Helm tests / tests-helm
Matrix: Special tests / ARM Collection test / tests
Matrix: Special tests / Latest Boto test / tests
Matrix: Special tests / Min SQLAlchemy test / tests
Matrix: Special tests / Pendulum2 test / tests
Matrix: Special tests / Quarantined test / tests
Matrix: tests-special / tests-system / tests
Matrix: Task SDK tests / task-sdk-tests
Matrix: Lowest direct dependency providers tests / tests
Helm tests  /  Release Helm
2m 18s
Helm tests / Release Helm
Additional CI image checks  /  Check that image builds quickly
Additional CI image checks / Check that image builds quickly
Build PROD images  /  Build Airflow and provider packages
Build PROD images / Build Airflow and provider packages
CI image checks  /  Publish documentation
0s
CI image checks / Publish documentation
Matrix: Build PROD images / build-prod-images
Waiting for pending jobs
Finalize tests  /  Update constraints
Finalize tests / Update constraints
Finalize tests  /  Summarize warnings
Finalize tests / Summarize warnings
additional-prod-image-tests  /  ...  /  Build Airflow and provider packages
additional-prod-image-tests / prod-image-extra-checks-main / myssql-client-image / Build Airflow and provider packages
additional-prod-image-tests  /  ...  /  Build Airflow and provider packages
additional-prod-image-tests / prod-image-extra-checks-main / pip-image / Build Airflow and provider packages
additional-prod-image-tests  /  ...  /  Build Airflow and provider packages
additional-prod-image-tests / prod-image-extra-checks-release-branch / myssql-client-image / Build Airflow and provider packages
additional-prod-image-tests  /  ...  /  Build Airflow and provider packages
additional-prod-image-tests / prod-image-extra-checks-release-branch / pip-image / Build Airflow and provider packages
Additional PROD image tests  /  Docker-compose quick start with PROD image verifying
Additional PROD image tests / Docker-compose quick start with PROD image verifying
Additional PROD image tests  /  Test examples of PROD image building
Additional PROD image tests / Test examples of PROD image building
Matrix: Kubernetes tests / tests-kubernetes
Waiting for pending jobs
Matrix: Finalize tests / Push Regular AMD Image Cache / push-ci-image-cache
Waiting for pending jobs
Matrix: Finalize tests / Push Regular AMD Image Cache / push-prod-image-cache
Waiting for pending jobs
Matrix: additional-prod-image-tests / prod-image-extra-checks-main / myssql-client-image / build-prod-images
Waiting for pending jobs
Matrix: additional-prod-image-tests / prod-image-extra-checks-main / pip-image / build-prod-images
Waiting for pending jobs
Matrix: additional-prod-image-tests / prod-image-extra-checks-release-branch / myssql-client-image / build-prod-images
Waiting for pending jobs
Matrix: additional-prod-image-tests / prod-image-extra-checks-release-branch / pip-image / build-prod-images
Waiting for pending jobs
Notify Slack on Failure
0s
Notify Slack on Failure
Fit to window
Zoom out
Zoom in

Annotations

144 errors
Generate constraints / Generate constraints 3.9 3.10 3.11 3.12
Process completed with exit code 1.
Helm tests / Unit tests Helm: webserver
Process completed with exit code 1.
Helm tests / Unit tests Helm: security
Process completed with exit code 1.
Sqlite tests / DB-core:Sqlite:3.9
Process completed with exit code 1.
Sqlite tests / DB-core:Sqlite:3.9
Process completed with exit code 123.
Sqlite tests / DB-core:Sqlite:3.12
Process completed with exit code 1.
Sqlite tests / DB-core:Sqlite:3.12
Process completed with exit code 123.
Sqlite tests / DB-core:Sqlite:3.10
Process completed with exit code 1.
Sqlite tests / DB-core:Sqlite:3.10
Process completed with exit code 123.
Sqlite tests / DB-core:Sqlite:3.11
Process completed with exit code 1.
Sqlite tests / DB-core:Sqlite:3.11
Process completed with exit code 123.
CI image checks / MyPy checks (mypy-task-sdk)
Process completed with exit code 1.
CI image checks / MyPy checks (mypy-airflow)
Process completed with exit code 1.
CI image checks / MyPy checks (mypy-providers)
Process completed with exit code 1.
Postgres tests / DB-core:Postgres:16:3.12
Process completed with exit code 1.
Special tests / System test: / System-providers:SystemTest:13:3.9
Process completed with exit code 1.
MySQL tests / DB-core:MySQL:8.4:3.10
Process completed with exit code 1.
CI image checks / MyPy checks (mypy-docs)
Process completed with exit code 1.
Helm tests / Unit tests Helm: airflow_core
Process completed with exit code 1.
Postgres tests / DB-core:Postgres:15:3.11
Process completed with exit code 1.
MySQL tests / DB-core:MySQL:8.0:3.11
Process completed with exit code 1.
Postgres tests / DB-core:Postgres:13:3.9
Process completed with exit code 1.
Postgres tests / DB-core:Postgres:17:3.9
Process completed with exit code 1.
Special tests / System test: / System-core:SystemTest:13:3.9
Process completed with exit code 1.
MySQL tests / DB-core:MySQL:8.4:3.12
Process completed with exit code 1.
Helm tests / Unit tests Helm: airflow_aux
Process completed with exit code 1.
Integration and System Tests / System Tests
Process completed with exit code 1.
Helm tests / Unit tests Helm: other
Process completed with exit code 1.
Integration and System Tests / Integration: providers qdrant
Process completed with exit code 1.
Integration and System Tests / Integration: providers redis
Process completed with exit code 1.
Integration and System Tests / Integration core celery
Process completed with exit code 1.
Integration and System Tests / Integration: providers cassandra
Process completed with exit code 1.
MySQL tests / DB-core:MySQL:8.0:3.9
Process completed with exit code 1.
Integration and System Tests / Integration: providers pinot
Process completed with exit code 1.
Integration and System Tests / Integration: providers ydb
Process completed with exit code 1.
Integration and System Tests / Integration: providers trino
Process completed with exit code 1.
Integration and System Tests / Integration core kerberos
Process completed with exit code 1.
Integration and System Tests / Integration: providers mongo
Process completed with exit code 1.
Postgres tests / DB-core:Postgres:14:3.10
Process completed with exit code 1.
Integration and System Tests / Integration: providers kafka
Process completed with exit code 1.
CI image checks / MyPy checks (mypy-dev)
Process completed with exit code 1.
Integration and System Tests / Integration: providers drill
Process completed with exit code 1.
Provider packages tests / Providers sdist tests
Canceling since a higher priority waiting request for 'ci-45261' exists
Provider packages tests / Providers sdist tests
The operation was canceled.
CI image checks / Build documentation (--docs-only)
Canceling since a higher priority waiting request for 'ci-45261' exists
CI image checks / Build documentation (--docs-only)
The operation was canceled.
Task SDK tests / Task SDK:P3.9 tests
Canceling since a higher priority waiting request for 'ci-45261' exists
Task SDK tests / Task SDK:P3.9 tests
The operation was canceled.
Task SDK tests / Task SDK:P3.11 tests
Canceling since a higher priority waiting request for 'ci-45261' exists
Task SDK tests / Task SDK:P3.11 tests
The operation was canceled.
Provider packages tests / Compat 2.9.3:P3.9 providers test
Canceling since a higher priority waiting request for 'ci-45261' exists
Provider packages tests / Compat 2.9.3:P3.9 providers test
The operation was canceled.
Provider packages tests / Providers wheel tests
Canceling since a higher priority waiting request for 'ci-45261' exists
Provider packages tests / Providers wheel tests
The operation was canceled.
MySQL tests / DB-providers:MySQL:8.4:3.12
Canceling since a higher priority waiting request for 'ci-45261' exists
MySQL tests / DB-providers:MySQL:8.4:3.12
The operation was canceled.
MySQL tests / DB-providers:MySQL:8.0:3.11
Canceling since a higher priority waiting request for 'ci-45261' exists
MySQL tests / DB-providers:MySQL:8.0:3.11
The operation was canceled.
Non-DB tests / Non-DB-providers::3.10
Canceling since a higher priority waiting request for 'ci-45261' exists
Non-DB tests / Non-DB-providers::3.10
The operation was canceled.
Lowest direct dependency providers tests / All-providers:LowestDeps-Postgres:13:3.11
Canceling since a higher priority waiting request for 'ci-45261' exists
Lowest direct dependency providers tests / All-providers:LowestDeps-Postgres:13:3.11
The operation was canceled.
Postgres tests / DB-providers:Postgres:15:3.11
Canceling since a higher priority waiting request for 'ci-45261' exists
Postgres tests / DB-providers:Postgres:15:3.11
The operation was canceled.
Lowest direct dependency providers tests / All-core:LowestDeps-Postgres:13:3.9
Canceling since a higher priority waiting request for 'ci-45261' exists
Lowest direct dependency providers tests / All-core:LowestDeps-Postgres:13:3.9
The operation was canceled.
Lowest direct dependency providers tests / All-providers:LowestDeps-Postgres:13:3.12
Canceling since a higher priority waiting request for 'ci-45261' exists
Lowest direct dependency providers tests / All-providers:LowestDeps-Postgres:13:3.12
The operation was canceled.
MySQL tests / DB-providers:MySQL:8.0:3.9
Canceling since a higher priority waiting request for 'ci-45261' exists
MySQL tests / DB-providers:MySQL:8.0:3.9
The operation was canceled.
Provider packages tests / Compat 2.10.4:P3.9 providers test
Canceling since a higher priority waiting request for 'ci-45261' exists
Provider packages tests / Compat 2.10.4:P3.9 providers test
The operation was canceled.
Lowest direct dependency providers tests / All-providers:LowestDeps-Postgres:13:3.9
Canceling since a higher priority waiting request for 'ci-45261' exists
Lowest direct dependency providers tests / All-providers:LowestDeps-Postgres:13:3.9
The operation was canceled.
Non-DB tests / Non-DB-providers::3.11
Canceling since a higher priority waiting request for 'ci-45261' exists
Non-DB tests / Non-DB-providers::3.11
The operation was canceled.
Non-DB tests / Non-DB-providers::3.12
Canceling since a higher priority waiting request for 'ci-45261' exists
Non-DB tests / Non-DB-providers::3.12
The operation was canceled.
Task SDK tests / Task SDK:P3.12 tests
Canceling since a higher priority waiting request for 'ci-45261' exists
Task SDK tests / Task SDK:P3.12 tests
The operation was canceled.
Lowest direct dependency providers tests / All-core:LowestDeps-Postgres:13:3.11
Canceling since a higher priority waiting request for 'ci-45261' exists
Lowest direct dependency providers tests / All-core:LowestDeps-Postgres:13:3.11
The operation was canceled.
Non-DB tests / Non-DB-providers::3.9
Canceling since a higher priority waiting request for 'ci-45261' exists
Non-DB tests / Non-DB-providers::3.9
The operation was canceled.
CI image checks / Static checks
Canceling since a higher priority waiting request for 'ci-45261' exists
CI image checks / Static checks
The operation was canceled.
CI image checks / Build documentation (--spellcheck-only)
Canceling since a higher priority waiting request for 'ci-45261' exists
CI image checks / Build documentation (--spellcheck-only)
The operation was canceled.
Postgres tests / DB-providers:Postgres:17:3.9
Canceling since a higher priority waiting request for 'ci-45261' exists
Postgres tests / DB-providers:Postgres:17:3.9
The operation was canceled.
Lowest direct dependency providers tests / All-core:LowestDeps-Postgres:13:3.12
Canceling since a higher priority waiting request for 'ci-45261' exists
Lowest direct dependency providers tests / All-core:LowestDeps-Postgres:13:3.12
The operation was canceled.
Lowest direct dependency providers tests / All-providers:LowestDeps-Postgres:13:3.10
Canceling since a higher priority waiting request for 'ci-45261' exists
Lowest direct dependency providers tests / All-providers:LowestDeps-Postgres:13:3.10
The operation was canceled.
Special tests / Latest Boto test / All-core:LatestBoto-Postgres:13:3.9
Canceling since a higher priority waiting request for 'ci-45261' exists
Special tests / Latest Boto test / All-core:LatestBoto-Postgres:13:3.9
The operation was canceled.
Special tests / Pendulum2 test / All-core:Pendulum2-Postgres:13:3.9
Canceling since a higher priority waiting request for 'ci-45261' exists
Special tests / Pendulum2 test / All-core:Pendulum2-Postgres:13:3.9
The operation was canceled.
Task SDK tests / Task SDK:P3.10 tests
Canceling since a higher priority waiting request for 'ci-45261' exists
Task SDK tests / Task SDK:P3.10 tests
The operation was canceled.
Sqlite tests / DB-providers:Sqlite:3.10
Canceling since a higher priority waiting request for 'ci-45261' exists
Sqlite tests / DB-providers:Sqlite:3.10
The operation was canceled.
Special tests / Latest Boto test / All-providers:LatestBoto-Postgres:13:3.9
Canceling since a higher priority waiting request for 'ci-45261' exists
Special tests / Latest Boto test / All-providers:LatestBoto-Postgres:13:3.9
The operation was canceled.
Sqlite tests / DB-providers:Sqlite:3.12
Canceling since a higher priority waiting request for 'ci-45261' exists
Sqlite tests / DB-providers:Sqlite:3.12
The operation was canceled.
Special tests / Pendulum2 test / All-providers:Pendulum2-Postgres:13:3.9
Canceling since a higher priority waiting request for 'ci-45261' exists
Special tests / Pendulum2 test / All-providers:Pendulum2-Postgres:13:3.9
The operation was canceled.
Special tests / ARM Collection test / ARM collection-core:Postgres:13:3.9
Canceling since a higher priority waiting request for 'ci-45261' exists
Special tests / ARM Collection test / ARM collection-providers:Postgres:13:3.9
Canceling since a higher priority waiting request for 'ci-45261' exists
Special tests / ARM Collection test / ARM collection-core:Postgres:13:3.9
The operation was canceled.
Special tests / ARM Collection test / ARM collection-providers:Postgres:13:3.9
The operation was canceled.
Special tests / Quarantined test / Quarantined-core:Postgres:13:3.9
Canceling since a higher priority waiting request for 'ci-45261' exists
Special tests / Quarantined test / Quarantined-core:Postgres:13:3.9
The operation was canceled.
Special tests / Quarantined test / Quarantined-providers:Postgres:13:3.9
Canceling since a higher priority waiting request for 'ci-45261' exists
Special tests / Quarantined test / Quarantined-providers:Postgres:13:3.9
The operation was canceled.
Postgres tests / DB-providers:Postgres:16:3.12
Canceling since a higher priority waiting request for 'ci-45261' exists
Postgres tests / DB-providers:Postgres:16:3.12
The operation was canceled.
Sqlite tests / DB-providers:Sqlite:3.11
Canceling since a higher priority waiting request for 'ci-45261' exists
Sqlite tests / DB-providers:Sqlite:3.11
The operation was canceled.
Postgres tests / DB-providers:Postgres:14:3.10
Canceling since a higher priority waiting request for 'ci-45261' exists
Postgres tests / DB-providers:Postgres:14:3.10
The operation was canceled.
Postgres tests / DB-providers:Postgres:13:3.9
Canceling since a higher priority waiting request for 'ci-45261' exists
Postgres tests / DB-providers:Postgres:13:3.9
The operation was canceled.
Non-DB tests / Non-DB-core::3.11
Canceling since a higher priority waiting request for 'ci-45261' exists
Non-DB tests / Non-DB-core::3.11
The operation was canceled.
MySQL tests / DB-providers:MySQL:8.4:3.10
Canceling since a higher priority waiting request for 'ci-45261' exists
MySQL tests / DB-providers:MySQL:8.4:3.10
The operation was canceled.
Non-DB tests / Non-DB-core::3.12
Canceling since a higher priority waiting request for 'ci-45261' exists
Non-DB tests / Non-DB-core::3.12
The operation was canceled.
Non-DB tests / Non-DB-core::3.9
Canceling since a higher priority waiting request for 'ci-45261' exists
Non-DB tests / Non-DB-core::3.9
The operation was canceled.
Sqlite tests / DB-providers:Sqlite:3.9
Canceling since a higher priority waiting request for 'ci-45261' exists
Sqlite tests / DB-providers:Sqlite:3.9
The operation was canceled.
Lowest direct dependency providers tests / All-core:LowestDeps-Postgres:13:3.10
Canceling since a higher priority waiting request for 'ci-45261' exists
Lowest direct dependency providers tests / All-core:LowestDeps-Postgres:13:3.10
The operation was canceled.
CI image checks / Test Python API client
Canceling since a higher priority waiting request for 'ci-45261' exists
CI image checks / Test Python API client
The operation was canceled.
Non-DB tests / Non-DB-core::3.10
Canceling since a higher priority waiting request for 'ci-45261' exists
Non-DB tests / Non-DB-core::3.10
The operation was canceled.
Special tests / Min SQLAlchemy test / DB-providers:MinSQLAlchemy-Postgres:13:3.9
Canceling since a higher priority waiting request for 'ci-45261' exists
Special tests / Min SQLAlchemy test / DB-providers:MinSQLAlchemy-Postgres:13:3.9
The operation was canceled.
Special tests / Min SQLAlchemy test / DB-core:MinSQLAlchemy-Postgres:13:3.9
Canceling since a higher priority waiting request for 'ci-45261' exists
Special tests / Min SQLAlchemy test / DB-core:MinSQLAlchemy-Postgres:13:3.9
The operation was canceled.

Artifacts

Produced during runtime
Name Size
Helm artifacts
346 KB
ci-image-docker-dump-amd64-3.10-45261_merge
1.2 GB
ci-image-docker-dump-amd64-3.11-45261_merge
1.21 GB
ci-image-docker-dump-amd64-3.12-45261_merge
1.18 GB
ci-image-docker-dump-amd64-3.9-45261_merge
1.2 GB
container-logs-core-System-SystemTest-postgres-13-3.9
1.48 KB
container-logs-integration-core-celery
4.62 KB
container-logs-integration-core-kerberos
4.45 KB
container-logs-integration-providers-cassandra
22.5 KB
container-logs-integration-providers-drill
2.93 KB
container-logs-integration-providers-kafka
2.93 KB
container-logs-integration-providers-mongo
7.38 KB
container-logs-integration-providers-pinot
228 KB
container-logs-integration-providers-qdrant
4.52 KB
container-logs-integration-providers-redis
4.61 KB
container-logs-integration-providers-trino
6.92 KB
container-logs-integration-providers-ydb
3.34 KB
container-logs-providers-System-SystemTest-postgres-13-3.9
1.48 KB
container-logs-system
1.47 KB