We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
spark-testing-base/core/src/main/1.3/scala/com/holdenkarau/spark/testing/DataframeGenerator.scala
Line 124 in 79eef40
I was hoping that arbitraryDataFrameWithCustomFields would support custom generators for the elements of an ArrayType column, but it does not seem to.
arbitraryDataFrameWithCustomFields
ArrayType
Is there a problem with changing this line to this:
val elementGenerator = getGenerator(arr.elementType, generators = generators, nullable = arr.containsNull)
I have verified this works in the case of an array of structs, but have not tested other cases yet. I would be happy to open a PR.
The text was updated successfully, but these errors were encountered:
No branches or pull requests
spark-testing-base/core/src/main/1.3/scala/com/holdenkarau/spark/testing/DataframeGenerator.scala
Line 124 in 79eef40
I was hoping that
arbitraryDataFrameWithCustomFields
would support custom generators for the elements of anArrayType
column, but it does not seem to.Is there a problem with changing this line to this:
I have verified this works in the case of an array of structs, but have not tested other cases yet. I would be happy to open a PR.
The text was updated successfully, but these errors were encountered: