Skip to content

Conversation

@TimothyW553
Copy link
Collaborator

@TimothyW553 TimothyW553 commented Nov 17, 2025

🥞 Stacked PR

Use this link to review incremental changes.


Which Delta project/connector is this regarding?

  • Spark
  • Standalone
  • Flink
  • Kernel
  • Other (fill in here)

Description

Introduce UnityCatalogClientFactory to build UCClient instances from spark.sql.catalog.* settings, reusing the Unity Catalog connector semantics established in V1. When a table is flagged as catalog-managed, SparkTable now resolves and carries an optional Unity Catalog client handle for downstream snapshot logic. The factory lazily instantiates UCTokenBasedRestClient, surfacing a clear error if HttpClient dependencies are missing, and comprehensive unit tests cover happy-path construction, configuration validation, and non-UC tables.

How was this patch tested?

build/sbt -DsparkVersion=master "++2.13.16" "sparkV2/testOnly io.delta.kernel.spark.unity.UnityCatalogClientFactoryTest"

Does this PR introduce any user-facing changes?

No.

@TimothyW553 TimothyW553 changed the title uc client factory Setup UC Client Factory Nov 17, 2025
Signed-off-by: TimothyW553 <[email protected]>
Signed-off-by: TimothyW553 <[email protected]>
Signed-off-by: TimothyW553 <[email protected]>
Signed-off-by: TimothyW553 <[email protected]>
Signed-off-by: Timothy Wang <[email protected]>
Signed-off-by: Timothy Wang <[email protected]>
Signed-off-by: Timothy Wang <[email protected]>
Signed-off-by: Timothy Wang <[email protected]>
Signed-off-by: Timothy Wang <[email protected]>
Signed-off-by: Timothy Wang <[email protected]>
Signed-off-by: TimothyW553 <[email protected]>
Signed-off-by: TimothyW553 <[email protected]>
Signed-off-by: TimothyW553 <[email protected]>
rajeshparangi and others added 2 commits November 18, 2025 00:06
#### Which Delta project/connector is this regarding?

- [X] Spark
- [ ] Standalone
- [ ] Flink
- [ ] Kernel
- [ ] Other (fill in here)

## Description

This PR refactors a vacuum code a bit by moving identifying Vacuum type
to earlier in the logic.

## How was this patch tested?

existing tests

## Does this PR introduce _any_ user-facing changes?
No
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants