Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[MINOR]: update benefits_from_input_partitioning implementation for projection and repartition #7246

Merged
merged 2 commits into from
Aug 11, 2023
Merged

[MINOR]: update benefits_from_input_partitioning implementation for projection and repartition #7246

merged 2 commits into from
Aug 11, 2023

Conversation

mustafasrepo
Copy link
Contributor

Which issue does this PR close?

Closes #.

Rationale for this change

This PR adds
-Now projection doesn't benefit from parallelism when all of the expressions are either Column or Literal

  • benefits_from_input_partitioning flag is implemented for RepartitionExec (increasing partition is only beneficial for hash partition.)
  • unrelated minor change: preserve_order method is added to the RepartitionExec to inspect preserve_order flag of the, RepartitionExec.

What changes are included in this PR?

Are these changes tested?

Are there any user-facing changes?

@github-actions github-actions bot added core Core DataFusion crate sqllogictest SQL Logic Tests (.slt) labels Aug 9, 2023
Copy link
Contributor

@alamb alamb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me -- thank you @mustafasrepo

@mustafasrepo mustafasrepo merged commit 29b2880 into apache:main Aug 11, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
core Core DataFusion crate sqllogictest SQL Logic Tests (.slt)
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants