Skip to content

v2.1.0

Compare
Choose a tag to compare
@mjakubowski84 mjakubowski84 released this 30 Dec 11:29
· 155 commits to master since this release

Version 2.1.0 brings new features and further improvements to Parquet4s.

Column projection

Available in all modules of Parquet4s: core, akka and fs2. Makes generic reads much more powerful. Allows to use SQL-like DSL to define projection over specific columns. Allows to extract a value from a nested fields and to use aliases. Please refer to the documentation and examples to learn more.

(Experimental) joins and concats

Implementation of ParquetIterable undergoes evolution that eventually will simplify ETL operations on your datasets. It will allow to read partitioned datasets in core module in the future. But now it introduces join and concat operations on datasets. Please refer to the documentation and examples for more information.