[Kernel-Spark] Introduce catalog-managed snapshot management wireframe for CCv2

[TimothyW553]

🥞 Stacked PR

Use this link to review incremental changes.

• catalogtableutils-ccv2 [Files changed]
  • stack/ccv2-uc-utils [Files changed]
    • stack/ccv2-uc-wireframe [Files changed]
      • stack/ccv2-uc-impl [Files changed]
        • stack/ccv2-sparktable-factory [Files changed]
    • stack/snapshotmanager-wireframe [Files changed]
      • stack/snapshotmanager-impl [Files changed]
        • stack/sparktable-wiring [Files changed]

---

Which Delta project/connector is this regarding?

• Spark
• Standalone
• Flink
• Kernel
• Other (fill in here)

Description

This PR is the skeleton for catalog-managed Delta tables in the DSv2 connector backed by Kernel. It introduces the interface hierarchy and factory pattern needed to support both traditional path-based tables and catalog-managed tables (e.g., Unity Catalog with CCv2).

Note: All operations are intentionally stubbed (empty). Functionality will be implemented in the next PR.

Architecture

• orange: previous PR
• green: current PR changes

 graph LR
  subgraph Inputs
    CT[CatalogTable]
    SS[SparkSession]
  end

  subgraph "PR 5605"
    SUCU[SparkUnityCatalogUtils]
    UCCI[UnityCatalogConnectionInfo]
  end

  subgraph "This PR"
    Factory[Factory]
    UCA[UnityCatalogAdapter]
  end

  subgraph "Future PR"
    CMSM[CatalogManagedSnapshotManager]
  end

  subgraph "UC Server"
    UC[Unity Catalog]
  end

  CT --> SUCU
  SS --> SUCU
  SUCU --> UCCI
  UCCI --> Factory
  Factory --> UCA
  UCA --> CMSM
  CMSM --> UC

  style SUCU fill:#FFA500
  style UCCI fill:#FFA500
  style Factory fill:#90EE90
  style UCA fill:#90EE90
  style CMSM fill:#87CEEB

Loading

Key Design Decisions

1. To support different catalog implementations in the future without changing the snapshot manager, we introduce ManagedCatalogAdapter which other catalogs can implement
2. To properly route different snapshot managers and keep it transparent, we use DeltaSnapshotManagerFactory which either goes through:
   • UC-managed tables → CatalogManagedSnapshotManager + UnityCatalogAdapter
   • Path-based tables → PathBasedSnapshotManager (existing already)

How was this patch tested?

Locally and CI.

Does this PR introduce any user-facing changes?

No.

[huan233usc]

Maybe just leave this method to the next PR

[TimothyW553]

Yeah good point, it is not currently used in this PR