Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

minor: make table resolution an independent function ... #5373

Merged
merged 2 commits into from
Feb 24, 2023
Merged

minor: make table resolution an independent function ... #5373

merged 2 commits into from
Feb 24, 2023

Conversation

MichaelScofield
Copy link
Contributor

@MichaelScofield MichaelScofield commented Feb 23, 2023

Which issue does this PR close?

Closes #.

Rationale for this change

... so people can reuse it from outside.

For some reason, we can't directly use statement_to_plan to generate the logical plan. Upon implementing our own, we found that the codes that resolving tables from statement are very useful. Making the table resolution an independent function enables users to resue more codes from DataFusion.

Also there's a small version upgrade of dependency object_store. All places but one are using version "0.5.4".

What changes are included in this PR?

Extract some codes into a function.

Are these changes tested?

yes

Are there any user-facing changes?

no

@github-actions github-actions bot added the core Core DataFusion crate label Feb 23, 2023
Copy link
Member

@waynexia waynexia left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me. I left a comment about style.

&self,
statement: datafusion_sql::parser::Statement,
) -> Result<LogicalPlan> {
statement: &datafusion_sql::parser::Statement,
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is not brought in this patch, but it would be better if we could import and use Statement directly

Copy link
Contributor

@avantgardnerio avantgardnerio left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I like the surgical approach to the git diff - it made it very easy to review.

@avantgardnerio avantgardnerio merged commit 9fd6efa into apache:main Feb 24, 2023
@ursabot
Copy link

ursabot commented Feb 24, 2023

Benchmark runs are scheduled for baseline = 05d8a25 and contender = 9fd6efa. 9fd6efa is a master commit associated with this PR. Results will be available as each benchmark for each run completes.
Conbench compare runs links:
[Skipped ⚠️ Benchmarking of arrow-datafusion-commits is not supported on ec2-t3-xlarge-us-east-2] ec2-t3-xlarge-us-east-2
[Skipped ⚠️ Benchmarking of arrow-datafusion-commits is not supported on test-mac-arm] test-mac-arm
[Skipped ⚠️ Benchmarking of arrow-datafusion-commits is not supported on ursa-i9-9960x] ursa-i9-9960x
[Skipped ⚠️ Benchmarking of arrow-datafusion-commits is not supported on ursa-thinkcentre-m75q] ursa-thinkcentre-m75q
Buildkite builds:
Supported benchmarks:
ec2-t3-xlarge-us-east-2: Supported benchmark langs: Python, R. Runs only benchmarks with cloud = True
test-mac-arm: Supported benchmark langs: C++, Python, R
ursa-i9-9960x: Supported benchmark langs: Python, R, JavaScript
ursa-thinkcentre-m75q: Supported benchmark langs: C++, Java

@MichaelScofield MichaelScofield deleted the fix/upgrade-deps branch February 26, 2023 02:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
core Core DataFusion crate
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants