Update ClickBench benchmarks with DataFusion 45.0.0 (When Published)

[alamb]

Is your feature request related to a problem or challenge?

• Follow on to Update ClickBench benchmarks with DataFusion 44.0.0 #13983
• Requires Release DataFusion 45.0.0 #14008

Describe the solution you'd like

Once DataFusion 45.0.0 is released, It would be great to update ClickBench https://benchmark.clickhouse.com/ with the newest version

ClickBench is a benchmark heavy on filtering and aggregation that we have used as an optimization target for the last several releases.

Describe alternatives you've considered

• Here is the PR that @pmcgleenon made for DataFusion 43.0.0: updated for datafusion release 43.0.0 ClickHouse/ClickBench#251

Additional context

Improvements I know of:

• @Dandandan 's work to improve parquet UTF8 Validation speed: Speed up Parquet utf8 validation arrow-rs#6667

[Dandandan]

Would be nice to get this in as well #13681

[Rachelint]

Would be nice to get this in as well #13681

I added fuzzy tests for it in my local, and found some failed cases for Decimal today ...
I am fixing it, and working for benchmark, I think it can be finished today or tomorrow.

[Dandandan]

Thank you very much @Rachelint

[alamb]

Would be nice to get this in as well #13681

I agree (though I don't think it will help ClickBench as clickbench doesn't have a median aggregate)

Added to release checklist on

• Release DataFusion 45.0.0 #14008

[Rachelint]

#13681 is ready for review

[pmcgleenon]

Here are the initial ClickBench results for datafusion 45.0.0

clickbench-latest 3.html.zip

If it looks reasonable, I can create a ClickBench PR to update the results

[alamb]

If it looks reasonable, I can create a ClickBench PR to update the results

It does look reasonable to me. Thank you @pmcgleenon 🙏

[pmcgleenon]

Makes sense 👍

I've created a PR ClickHouse/ClickBench#304

[pmcgleenon]

FYI the Clickbench PR has been merged and the latest Datafusion 45.0.0 results have been published on the site https://benchmark.clickhouse.com/

[alamb]

FYI the Clickbench PR has been merged and the latest Datafusion 45.0.0 results have been published on the site https://benchmark.clickhouse.com/

Thank you so much @pmcgleenon ❤

[Dandandan]

Nice! Looks we have some more competition now from DuckDB: results

[alamb]

Nice! Looks we have some more competition now from DuckDB:...

• Filed [EPIC] ClickBench Improvements (Vanity Benchmark) #14586 to start up the optimization machine

[alamb]

Filed a ticket for running this on 46

• Update ClickBench benchmarks with DataFusion 46.0.0 (When Published) #14587