Open
Description
This ticket tracks the work to implement Parquet Modular Encryption
See the prior discussion / question here:
Related items
- Support reading parquet with modular encryption #7296
- Use parquet crate for decoding Parquet data into Arrow arrays datafusion-comet#1040
- Update Implementation Status to note that arrow-rs now supports modular encryption (R) parquet-site#107
- Add Parquet Modular decryption (read) support +
encryption
flag #6637 - Support writing Parquet with modular encryption #7327
- Support the AES-GCM-CTR-V1 encryption algorithm for Parquet modular encryption #7258
- Verify footer tags when reading encrypted Parquet files with plaintext footers #7255
- Allow retrieving Parquet decryption keys based on the key metadata #7257
-
Support Parquet key management tools #7256 - Consolidate encryption parquet tests #7280
- Add example for how to read/write encrypted parquet files #7281
- Add decryption support for column index and offset index #7390
- Support writing encrypted Parquet files with plaintext footers #7320
- Include footer key metadata when writing encrypted Parquet with a plaintext footer #7600
- Support multi-threaded writing of Parquet files with modular encryption #7359
- Use a "SecureString" like type to store Parquet encryption keys #7373