Create staging GTFS download configs view

[erikamov]

Description

This PR creates a staging view stg_gtfs_schedule__download_configs, to help test and visualize GTFS download configurations.

[#4379]

Type of change

• Bug fix (non-breaking change which fixes an issue)
• New feature
• Breaking change (fix or feature that would cause existing functionality to not work as expected)
• Documentation

How has this been tested?

Running Locally:

❯ poetry run dbt run -s +models/staging/gtfs/stg_gtfs_schedule__download_configs.sql --target staging
01:06:14  Running with dbt=1.10.1
01:06:15  Registered adapter: bigquery=1.10.0
01:06:21  Found 599 models, 1226 data tests, 14 seeds, 219 sources, 4 exposures, 1075 macros
01:06:21
01:06:21  Concurrency: 8 threads (target='staging')
01:06:21
01:06:24  1 of 1 START sql view model staging.stg_gtfs_schedule__download_configs ........ [RUN]
01:06:26  1 of 1 OK created sql view model staging.stg_gtfs_schedule__download_configs ... [CREATE VIEW (0 processed) in 1.66s]
01:06:26
01:06:26  Finished running 1 view model in 0 hours 0 minutes and 4.91 seconds (4.91s).
01:06:26
01:06:26  Completed successfully
01:06:26
01:06:26  Done. PASS=1 WARN=0 ERROR=0 SKIP=0 NO-OP=0 TOTAL=1

❯ poetry run dbt test -s +models/staging/gtfs/stg_gtfs_schedule__download_configs.sql --target staging
01:06:33  Running with dbt=1.10.1
01:06:34  Registered adapter: bigquery=1.10.0
01:06:35  Found 599 models, 1226 data tests, 14 seeds, 219 sources, 4 exposures, 1075 macros
01:06:35  Nothing to do. Try checking your model configs and model specification args

Post-merge follow-ups

• No action required
• Actions required (specified below)

[github-actions]

Terraform plan in iac/cal-itp-data-infra-staging/composer/us

Plan: 0 to add, 1 to change, 0 to destroy.

Terraform used the selected providers to generate the following execution
plan. Resource actions are indicated with the following symbols:
!~  update in-place

Terraform will perform the following actions:

  # google_composer_environment.calitp-staging-composer will be updated in-place
!~  resource "google_composer_environment" "calitp-staging-composer" {
        id               = "projects/cal-itp-data-infra-staging/locations/us-west2/environments/calitp-staging-composer"
        name             = "calitp-staging-composer"
#        (5 unchanged attributes hidden)

!~      config {
#            (8 unchanged attributes hidden)

!~          software_config {
!~              pypi_packages            = {
+                   "calitp-data-infra"      = "==2025.6.5"
+                   "pydantic"               = ">=1.9,<2.0"
#                    (11 unchanged elements hidden)
                }
#                (6 unchanged attributes hidden)

#                (1 unchanged block hidden)
            }

#            (8 unchanged blocks hidden)
        }

#        (1 unchanged block hidden)
    }

Plan: 0 to add, 1 to change, 0 to destroy.

📝 Plan generated in Plan Terraform for Warehouse and DAG changes #1012

[github-actions]

Terraform plan in iac/cal-itp-data-infra/composer/us

No changes. Your infrastructure matches the configuration.

No changes. Your infrastructure matches the configuration.

Terraform has compared your real infrastructure against your configuration
and found no differences, so no changes are needed.

📝 Plan generated in Plan Terraform for Warehouse and DAG changes #1012

[github-actions]

Terraform plan in iac/cal-itp-data-infra-staging/airflow/us

Plan: 1 to add, 4 to change, 0 to destroy.

Terraform used the selected providers to generate the following execution
plan. Resource actions are indicated with the following symbols:
+   create
!~  update in-place

Terraform will perform the following actions:

  # google_storage_bucket_object.calitp-staging-composer-catalog will be updated in-place
!~  resource "google_storage_bucket_object" "calitp-staging-composer-catalog" {
!~      content             = (sensitive value)
!~      crc32c              = "IXmlHg==" -> (known after apply)
!~      detect_md5hash      = "bSUDdlqbkYvrzOwzoML9OQ==" -> "different hash"
!~      generation          = 1763431094584863 -> (known after apply)
        id                  = "calitp-staging-composer-data/warehouse/target/catalog.json"
!~      md5hash             = "bSUDdlqbkYvrzOwzoML9OQ==" -> (known after apply)
        name                = "data/warehouse/target/catalog.json"
#        (16 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-staging-composer-dags["models/staging/gtfs/_src_gtfs_schedule_external_tables.yml"] will be updated in-place
!~  resource "google_storage_bucket_object" "calitp-staging-composer-dags" {
!~      crc32c              = "JRuXXA==" -> (known after apply)
!~      detect_md5hash      = "Caqsk8kIhrzLrYxkwYo53g==" -> "different hash"
!~      generation          = 1758129838720127 -> (known after apply)
        id                  = "calitp-staging-composer-data/warehouse/models/staging/gtfs/_src_gtfs_schedule_external_tables.yml"
!~      md5hash             = "Caqsk8kIhrzLrYxkwYo53g==" -> (known after apply)
        name                = "data/warehouse/models/staging/gtfs/_src_gtfs_schedule_external_tables.yml"
#        (17 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-staging-composer-dags["models/staging/gtfs/_stg_gtfs.yml"] will be updated in-place
!~  resource "google_storage_bucket_object" "calitp-staging-composer-dags" {
!~      crc32c              = "G4i6cQ==" -> (known after apply)
!~      detect_md5hash      = "ZIoZ9F+deaRCzQBuJSITkA==" -> "different hash"
!~      generation          = 1749663113245609 -> (known after apply)
        id                  = "calitp-staging-composer-data/warehouse/models/staging/gtfs/_stg_gtfs.yml"
!~      md5hash             = "ZIoZ9F+deaRCzQBuJSITkA==" -> (known after apply)
        name                = "data/warehouse/models/staging/gtfs/_stg_gtfs.yml"
#        (17 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-staging-composer-dags["models/staging/gtfs/stg_gtfs_schedule__download_configs.sql"] will be created
+   resource "google_storage_bucket_object" "calitp-staging-composer-dags" {
+       bucket         = "calitp-staging-composer"
+       content        = (sensitive value)
+       content_type   = (known after apply)
+       crc32c         = (known after apply)
+       detect_md5hash = "different hash"
+       generation     = (known after apply)
+       id             = (known after apply)
+       kms_key_name   = (known after apply)
+       md5hash        = (known after apply)
+       md5hexhash     = (known after apply)
+       media_link     = (known after apply)
+       name           = "data/warehouse/models/staging/gtfs/stg_gtfs_schedule__download_configs.sql"
+       output_name    = (known after apply)
+       self_link      = (known after apply)
+       source         = "../../../../warehouse/models/staging/gtfs/stg_gtfs_schedule__download_configs.sql"
+       storage_class  = (known after apply)
    }

  # google_storage_bucket_object.calitp-staging-composer-manifest will be updated in-place
!~  resource "google_storage_bucket_object" "calitp-staging-composer-manifest" {
!~      content             = (sensitive value)
!~      crc32c              = "xB1yog==" -> (known after apply)
!~      detect_md5hash      = "KlwPZogzowe6M4OZTKmaNg==" -> "different hash"
!~      generation          = 1763431095947858 -> (known after apply)
        id                  = "calitp-staging-composer-data/warehouse/target/manifest.json"
!~      md5hash             = "KlwPZogzowe6M4OZTKmaNg==" -> (known after apply)
        name                = "data/warehouse/target/manifest.json"
#        (16 unchanged attributes hidden)
    }

Plan: 1 to add, 4 to change, 0 to destroy.

📝 Plan generated in Plan Terraform for Warehouse and DAG changes #1012

[github-actions]

Terraform plan in iac/cal-itp-data-infra/airflow/us

Plan: 1 to add, 2 to change, 0 to destroy.

Terraform used the selected providers to generate the following execution
plan. Resource actions are indicated with the following symbols:
+   create
!~  update in-place

Terraform will perform the following actions:

  # google_storage_bucket_object.calitp-composer-dags["models/staging/gtfs/_src_gtfs_schedule_external_tables.yml"] will be updated in-place
!~  resource "google_storage_bucket_object" "calitp-composer-dags" {
!~      crc32c              = "JRuXXA==" -> (known after apply)
!~      detect_md5hash      = "Caqsk8kIhrzLrYxkwYo53g==" -> "different hash"
!~      generation          = 1751416666931203 -> (known after apply)
        id                  = "calitp-composer-data/warehouse/models/staging/gtfs/_src_gtfs_schedule_external_tables.yml"
!~      md5hash             = "Caqsk8kIhrzLrYxkwYo53g==" -> (known after apply)
        name                = "data/warehouse/models/staging/gtfs/_src_gtfs_schedule_external_tables.yml"
#        (17 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-composer-dags["models/staging/gtfs/_stg_gtfs.yml"] will be updated in-place
!~  resource "google_storage_bucket_object" "calitp-composer-dags" {
!~      crc32c              = "G4i6cQ==" -> (known after apply)
!~      detect_md5hash      = "ZIoZ9F+deaRCzQBuJSITkA==" -> "different hash"
!~      generation          = 1751416668944451 -> (known after apply)
        id                  = "calitp-composer-data/warehouse/models/staging/gtfs/_stg_gtfs.yml"
!~      md5hash             = "ZIoZ9F+deaRCzQBuJSITkA==" -> (known after apply)
        name                = "data/warehouse/models/staging/gtfs/_stg_gtfs.yml"
#        (17 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-composer-dags["models/staging/gtfs/stg_gtfs_schedule__download_configs.sql"] will be created
+   resource "google_storage_bucket_object" "calitp-composer-dags" {
+       bucket         = "calitp-composer"
+       content        = (sensitive value)
+       content_type   = (known after apply)
+       crc32c         = (known after apply)
+       detect_md5hash = "different hash"
+       generation     = (known after apply)
+       id             = (known after apply)
+       kms_key_name   = (known after apply)
+       md5hash        = (known after apply)
+       md5hexhash     = (known after apply)
+       media_link     = (known after apply)
+       name           = "data/warehouse/models/staging/gtfs/stg_gtfs_schedule__download_configs.sql"
+       output_name    = (known after apply)
+       self_link      = (known after apply)
+       source         = "../../../../warehouse/models/staging/gtfs/stg_gtfs_schedule__download_configs.sql"
+       storage_class  = (known after apply)
    }

Plan: 1 to add, 2 to change, 0 to destroy.

📝 Plan generated in Plan Terraform for Warehouse and DAG changes #1012