Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DPE-3196] Add integration test for Apache Iceberg integration #69

Merged
merged 35 commits into from
Feb 1, 2024
Merged

[DPE-3196] Add integration test for Apache Iceberg integration #69

merged 35 commits into from
Feb 1, 2024

Conversation

theoctober19th
Copy link
Member

@theoctober19th theoctober19th commented Jan 29, 2024

This PR adds integration tests to verify integration of Apache Iceberg in Charmed Spark solution.

Jira:
DPE-3196

@theoctober19th theoctober19th changed the title Add integration test for Apache Iceberg integration [DPE-3196] Add integration test for Apache Iceberg integration Jan 29, 2024
@theoctober19th theoctober19th marked this pull request as ready for review January 30, 2024 09:32
@theoctober19th theoctober19th self-assigned this Jan 30, 2024
welpaolo
welpaolo previously approved these changes Jan 31, 2024
Copy link
Collaborator

@welpaolo welpaolo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Really good job here!
Can you please add some comments in both the bash scripts and python script to describe the different steps ?

deusebio
deusebio previously approved these changes Jan 31, 2024
Copy link
Contributor

@deusebio deusebio left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! I don't have any objection and changes seem sensible.

I'd rather merge this PR and after the re-structuring of the tests (PR #68 ) to then make sure things work with restrictred account. Also, it is a bit of a consideration, but I feel that the integration tests files is becoming huge (which is good because we are running more and more tests... :D). But I believe we could improve a bit the current integration tests by creating more maintainable and perimetered files.

@theoctober19th theoctober19th dismissed stale reviews from deusebio and welpaolo via 1da1160 February 1, 2024 10:38
welpaolo
welpaolo previously approved these changes Feb 1, 2024
@deusebio deusebio self-requested a review February 1, 2024 14:51
@deusebio deusebio merged commit 93ca207 into canonical:3.4-22.04/edge Feb 1, 2024
7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants