-
Notifications
You must be signed in to change notification settings - Fork 8
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[DPE-3196] Add integration test for Apache Iceberg integration #69
[DPE-3196] Add integration test for Apache Iceberg integration #69
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Really good job here!
Can you please add some comments in both the bash scripts and python script to describe the different steps ?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM! I don't have any objection and changes seem sensible.
I'd rather merge this PR and after the re-structuring of the tests (PR #68 ) to then make sure things work with restrictred account. Also, it is a bit of a consideration, but I feel that the integration tests files is becoming huge (which is good because we are running more and more tests... :D). But I believe we could improve a bit the current integration tests by creating more maintainable and perimetered files.
1da1160
This PR adds integration tests to verify integration of Apache Iceberg in Charmed Spark solution.
Jira:
DPE-3196