conbench-apache-arrow / Conbench performance report
failed
Aug 1, 2024 in 0s
Found 1 regression
After merging your PR, Conbench analyzed the 4 benchmarking runs that have been run so far on merge-commit c6be2df.
Benchmarks with performance regressions
There was 1 possible performance regression, according to the lookback z-score method.
Benchmarks with regressions:
- Commit Run on
test-mac-arm
at 2024-07-31 19:31:40Z
All benchmark runs analyzed:
- Commit Run on
ec2-m5-4xlarge-us-east-2
at 2024-07-31 21:05:24Z - Commit Run on
ec2-c6a-4xlarge-us-east-2
at 2024-07-31 19:29:18Z - Commit Run on
arm64-t4g-linux-compute
at 2024-07-31 21:05:22Z - Commit Run on
test-mac-arm
at 2024-07-31 19:31:40Z
Unstable benchmarks with performance regressions
The following benchmark results indicate a possible performance regression, but are known to sometimes produce false positives when applying the lookback z-score analysis.
- Commit Run on
test-mac-arm
at 2024-07-31 19:31:40ZBenchmarkTemporalRounding
(C++) with params=<FloorTemporal, zoned, round_1_month>/4194304/100, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkBenchmarkTemporal
(C++) with params=<Month, zoned>/4194304/0, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkBenchmarkTemporal
(C++) with params=<ISOWeek, zoned>/4194304/0, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkBenchmarkTemporal
(C++) with params=<DayOfYear, zoned>/4194304/0, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkErrorSchemeNoError
(C++) with source=cpp-micro, suite=arrow-type-benchmarkReferenceCompression
(C++) with params=Compression::LZ4, source=cpp-micro, suite=arrow-compression-benchmarkBenchmarkTemporal
(C++) with params=<USWeek, zoned>/4194304/0, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkBitmapReaderSumWithOffset
(C++) with params=32768, source=cpp-micro, suite=arrow-bit-block-counter-benchmarkBenchmarkTemporalRounding
(C++) with params=<CeilTemporal, zoned, round_10_month>/4194304/0, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkErrorSchemeBool
(C++) with source=cpp-micro, suite=arrow-type-benchmarkBenchmarkTemporal
(C++) with params=<DayOfYear, zoned>/4194304/100, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkRecordBatchSortIndicesInt64Narrow
(C++) with params=1048576/100/8, source=cpp-micro, suite=arrow-compute-vector-sort-benchmarkBenchmarkTemporal
(C++) with params=<Day, zoned>/4194304/100, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkTakeStringRandomIndicesWithNulls
(C++) with params=4194304/2, source=cpp-micro, suite=arrow-compute-vector-selection-benchmarkBenchmarkTemporal
(C++) with params=<Quarter, zoned>/4194304/0, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkTakeChunkedChunkedFSBRandomIndicesNoNulls
(C++) with params=4194304/1000/9, source=cpp-micro, suite=arrow-compute-vector-selection-benchmarkCastDoubleToInt32Safe
(C++) with params=4194304/1000, source=cpp-micro, suite=arrow-compute-scalar-cast-benchmarkBenchmarkTemporalRounding
(C++) with params=<CeilTemporal, zoned, round_1_month>/4194304/0, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkBenchmarkTemporal
(C++) with params=<USWeek, zoned>/4194304/100, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkBenchmarkTemporal
(C++) with params=<Quarter, zoned>/4194304/100, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkBenchmarkTemporalRounding
(C++) with params=<CeilTemporal, zoned, round_10_month>/4194304/100, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkCastInt64ToInt32Safe
(C++) with params=4194304/1, source=cpp-micro, suite=arrow-compute-scalar-cast-benchmarkBenchmarkTemporal
(C++) with params=<Month, zoned>/4194304/100, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkBenchmarkTemporal
(C++) with params=<Day, zoned>/4194304/0, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkBenchmarkTemporal
(C++) with params=<USYear, zoned>/4194304/100, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkBenchmarkTemporal
(C++) with params=<ISOYear, zoned>/4194304/100, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkBitmapReaderSumWithOffset
(C++) with params=2, source=cpp-micro, suite=arrow-bit-block-counter-benchmarkTakeStringRandomIndicesNoNulls
(C++) with params=4194304/1000, source=cpp-micro, suite=arrow-compute-vector-selection-benchmarkBenchmarkTemporal
(C++) with params=<ISOWeek, zoned>/4194304/100, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmark
Details
This report was generated using the lookback z-score method with a z-score threshold of 30.0.
Loading