-
Notifications
You must be signed in to change notification settings - Fork 1.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Prevent writing a file with a footer size exceeding the Int max value #2986
Comments
I have the same issue with a corrupted file due to overflow in this field; it was created using the Rust parquet crate, which uses unsigned ints for this field (link). Also, the file is usable with using parquet-cli 1.14.1:
|
Sounds reasonable, let me investigate it. |
Describe the bug, including details regarding any error messages, version, and platform.
The footer size is assumed as an int:
This force casting is not safe. For example, we could write out a file with a size exceeding the Int max value and get a corrupted file:
Component(s)
No response
The text was updated successfully, but these errors were encountered: