Improve performance of join building performance (up to 1.28x speedup) #39067

Job	Run time
build with wasm-pack	3m 56s
Check License Header	2m 33s
Check cargo fmt	38s
linux build test	5m 0s
cargo test (macos-aarch64)	13m 28s
Verify MSRV (Min Supported Rust Version)	9m 8s
Verify Vendored Code	52s
cargo test (amd64)	16m 25s
cargo check no default features	8m 20s
cargo check functions	2m 17s
cargo check datafusion	5m 23s
cargo doc	4m 16s
cargo test doc (amd64)	17m 45s
cargo examples (amd64)	16m 28s
cargo test pyarrow (amd64)	3m 35s
verify benchmark results (amd64)	9m 3s
check Cargo.toml formatting	3m 14s
clippy	5m 54s
check configs.md and ***_functions.md is up-to-date	5m 17s
Run sqllogictest with Postgres runner	5m 31s
	2h 19m 3s

Provide feedback