[Kernel-Spark] Wire up catalog-managed snapshot management for CCv2

[TimothyW553]

🥞 Stacked PR

Use this link to review incremental changes.

• catalogtableutils-ccv2 [Files changed]
  • stack/ccv2-uc-utils [Files changed]
    • stack/ccv2-uc-wireframe [Files changed]
      • stack/ccv2-uc-impl [Files changed]
        • stack/ccv2-sparktable-factory [Files changed]
    • stack/snapshotmanager-wireframe [Files changed]
      • stack/snapshotmanager-impl [Files changed]
        • stack/sparktable-wiring [Files changed]

---

Which Delta project/connector is this regarding?

• Spark
• Standalone
• Flink
• Kernel
• Other (fill in here)

Description

This PR implements the catalog-managed snapshot management wiring for Coordinated Commits v2 (CCv2), connecting the wireframe components introduced in #5607 to the Unity Catalog infrastructure.

Key changes:

• Wire DeltaSnapshotManagerFactory.fromCatalogTable() to detect UC-managed tables and create CatalogManagedSnapshotManager
• Connect UnityCatalogAdapter to UCCatalogManagedClient for snapshot/commit-range loading
• Add kernelUnityCatalog (compile + test) dependency to kernel-spark module

Architecture

flowchart TD
      Factory[DeltaSnapshotManagerFactory.fromCatalogTable]
      Factory --> UCAdapter[UnityCatalogAdapter.fromCatalog]
      UCAdapter --> Check{Adapter present?}

      Check -->|Yes| CatalogMgr[CatalogManagedSnapshotManager]
      CatalogMgr -.->|delegates to| Adapter[UnityCatalogAdapter]
      Adapter -.->|uses| UCClient[UCCatalogManagedClient]

      Check -->|No| PathMgr[PathBasedSnapshotManager]

Loading

How was this patch tested?

Locally and CI.

Does this PR introduce any user-facing changes?

No.

[TimothyW553]

This is currently UC-specific and will be address in a follow up stack/PR. Although it is UC-specific, generic catalog design is kept in mind.

As we see below, there is no downcasting to UnityCatalogAdapter since getTableId() and getTablePath() are on the ManagedCatalogAdapter interface. Only the discovery call needs generalization when supporting additional catalogs.

[TimothyW553]

getTableId()/getTablePath() are on the generic interface. endpoint/token are not exposed, they're encapsulated inside UCClient, keeping auth details internal to the UC adapter.