Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[FEA] Add config option for the parquet reader input read limit. #9926

Closed
nvdbaranec opened this issue Dec 1, 2023 · 1 comment
Closed

[FEA] Add config option for the parquet reader input read limit. #9926

nvdbaranec opened this issue Dec 1, 2023 · 1 comment
Assignees
@revans2
Labels
feature request New feature or request

Comments

@nvdbaranec
Copy link
Collaborator

We need to make sure the pass_read_limit parameter of the parquet chunked reader is a configurable option for the plugin. The sub-rowgroup PR is not yet merged but the parameter is already exposed in cudf.

https://github.com/rapidsai/cudf/blob/c8074b5176a74630101c78c43c24b66141352b24/cpp/include/cudf/io/parquet.hpp#L466
@nvdbaranec nvdbaranec added feature request New feature or request ? - Needs Triage Need team to review and classify labels Dec 1, 2023
@mattahrens mattahrens removed the ? - Needs Triage Need team to review and classify label Dec 5, 2023
@revans2
Copy link
Collaborator

revans2 commented Feb 5, 2024

This was closed by #9991

@revans2 revans2 closed this as completed Feb 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@revans2 revans2

Labels
feature request New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@revans2 @mattahrens @nvdbaranec