-
Notifications
You must be signed in to change notification settings - Fork 4.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Load CDK Tests: Expand coverage of funky characters #52067
base: master
Are you sure you want to change the base?
Load CDK Tests: Expand coverage of funky characters #52067
Conversation
The latest updates on your projects. Learn more about Vercel for Git ↗︎
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
had a question about the record mapper thing, plus a nit on the comment. Otherwise
@@ -106,6 +106,7 @@ abstract class IntegrationTest( | |||
val actualRecords: List<OutputRecord> = dataDumper.dumpRecords(config, stream) | |||
val expectedRecords: List<OutputRecord> = | |||
canonicalExpectedRecords.map { recordMangler.mapRecord(it, stream.schema) } | |||
val descriptor = recordMangler.mapStreamDescriptor(stream.descriptor) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
why have this on the record mangler, rather than requiring the data dumper to do it transparently?
|
||
@Test | ||
@Disabled( | ||
"Re-enabled for https://github.com/airbytehq/airbyte-internal-issues/issues/11424; TODO: fix glue" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
can you add a link to https://github.com/airbytehq/airbyte-internal-issues/issues/11439 in this comment?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Happily
9abbf7b
to
60d2d64
Compare
DO NOT MERGE UNTIL CI IS WORKING, THIS MAKES A LOT OF CHANGES TO TESTS
What
Expands coverage of
testFunkyCharacters
to includeI also found an issue in the path matching code that fails to properly escape the path matching stuff if the stream name contains legal regex. (This is also an issue with the old CDK.) I went ahead and fixed it
This breaks the recently reenabled test for glue, so I re-disabled it. @edgao I'll leave it to you to decide whether to bother renabling, and whether that means patching or adding parameters to the test.