You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I'm using serde_arrow for reading and writing Parquet files. Writing succeeds without issues, but when reading, I encounter the following error in some files:
parquet-54.0.0/src/file/serialized_reader.rs:605:21:
attempt to subtract with overflow
stack backtrace:
0: rust_begin_unwind
at /rustc/.../library/std/src/panicking.rs:665:5
1: core::panicking::panic_fmt
at /rustc/.../library/core/src/panicking.rs:76:14
2: core::panicking::panic_const::panic_const_sub_overflow
at /rustc/.../library/core/src/panicking.rs:182:21
3: <parquet::file::serialized_reader::SerializedPageReader<R> as parquet::column::page::PageReader>::get_next_page
at /Users/yui/.cargo/registry/src/.../serialized_reader.rs:605:21
4: parquet::column::reader::GenericColumnReader<R,D,V>::read_new_page
Additional Information:
The error does not occur for all files, only specific ones.
I'm using a Mac machine with Visual Studio Code.
Suspect the issue might be due to file corruption.
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
I'm using serde_arrow for reading and writing Parquet files. Writing succeeds without issues, but when reading, I encounter the following error in some files:
Writing Code:
Error msg
Additional Information:
Questions:
Is this error caused by file corruption?
The file
222-2024-12-30-sleep_feature.zstd.parquet.2.zip
Beta Was this translation helpful? Give feedback.
All reactions