Thanks for your patience. Conbench analyzed the 4 benchmarking runs that have been run so far on PR commit 335a46b.

Benchmarks with performance regressions

There were 23 possible performance regressions, according to the lookback z-score method.

Benchmarks with regressions:

• Pull Request Run on test-mac-arm at 2025-01-24 15:13:21Z

  • BenchmarkTemporal (C++) with params=<Subsecond, non_zoned>/4194304/0, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmark
  • FilterOverhead (C++) with params=selectivity_benchmark/batch_size:100000/null_prob:100/bool_true_prob:50/real_time, source=cpp-micro, suite=arrow-acero-filter-benchmark
  • FilterOverhead (C++) with params=not_null_to_is_true_multipass_benchmark/batch_size:1000000/null_prob:0/bool_true_prob:25/real_time, source=cpp-micro, suite=arrow-acero-filter-benchmark
  • FilterOverhead (C++) with params=not_null_to_is_true_multipass_benchmark/batch_size:10000/null_prob:0/bool_true_prob:25/real_time, source=cpp-micro, suite=arrow-acero-filter-benchmark
  • FilterOverhead (C++) with params=complex_expression/batch_size:1000/null_prob:0/bool_true_prob:50/real_time, source=cpp-micro, suite=arrow-acero-filter-benchmark
  • FilterOverhead (C++) with params=not_null_to_is_true_multipass_benchmark/batch_size:1000000/null_prob:25/bool_true_prob:33/real_time, source=cpp-micro, suite=arrow-acero-filter-benchmark
  • FilterOverhead (C++) with params=selectivity_benchmark/batch_size:10000/null_prob:100/bool_true_prob:50/real_time, source=cpp-micro, suite=arrow-acero-filter-benchmark
  • BM_ByteStreamSplitDecode_Float_Scalar (C++) with params=1024, source=cpp-micro, suite=parquet-encoding-benchmark
  • FilterOverhead (C++) with params=not_null_and_is_true_singlepass_benchmark/batch_size:1000000/null_prob:50/bool_true_prob:50/real_time, source=cpp-micro, suite=arrow-acero-filter-benchmark
  • FilterOverhead (C++) with params=selectivity_benchmark/batch_size:1000000/null_prob:100/bool_true_prob:50/real_time, source=cpp-micro, suite=arrow-acero-filter-benchmark
  • RoundBinaryArrayBenchmark (C++) with params=<RoundBinary, Int32Type, RoundMode::DOWN>/size:4194304/inverse_null_proportion:100, source=cpp-micro, suite=arrow-compute-scalar-round-benchmark
  • FilterOverhead (C++) with params=not_null_to_is_true_multipass_benchmark/batch_size:1000/null_prob:0/bool_true_prob:25/real_time, source=cpp-micro, suite=arrow-acero-filter-benchmark

• Pull Request Run on amd64-c6a-4xlarge-linux at 2025-01-24 14:43:13Z

  • BinaryJoinElementWiseArrayArray (C++) with params=2, source=cpp-micro, suite=arrow-compute-scalar-string-benchmark
  • ArrayArrayKernel (C++) with params=<Subtract, UInt8Type>/size:524288/inverse_null_proportion:100, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmark
  • ArrayArrayKernel (C++) with params=<Subtract, UInt8Type>/size:524288/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmark
  • ArrayScalarKernel (C++) with params=<Add, UInt8Type>/size:524288/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmark
  • ArrayScalarKernel (C++) with params=<Multiply, Int8Type>/size:524288/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmark
  • ArrayScalarKernel (C++) with params=<Add, UInt8Type>/size:524288/inverse_null_proportion:100, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmark
  • ArrayScalarKernel (C++) with params=<Multiply, Int8Type>/size:524288/inverse_null_proportion:100, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmark
  • RoundArrayBenchmark (C++) with params=<Round, FloatType, RoundMode::DOWN>/size:524288/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-round-benchmark
  • BM_CastDispatchBaseline (C++) with source=cpp-micro, suite=arrow-compute-function-benchmark
  • BinaryJoinElementWiseArrayScalar (C++) with params=2, source=cpp-micro, suite=arrow-compute-scalar-string-benchmark

• Pull Request Run on amd64-m5-4xlarge-linux at 2025-01-24 17:11:06Z

  • ShortVectorPushBack (C++) with params=<STATIC_VECTOR(std::shared_ptr)>, source=cpp-micro, suite=arrow-small-vector-benchmark

All benchmark runs analyzed:

• Pull Request Run on test-mac-arm at 2025-01-24 15:13:21Z
• Pull Request Run on arm64-t4g-2xlarge-linux at 2025-01-24 15:04:09Z
• Pull Request Run on amd64-c6a-4xlarge-linux at 2025-01-24 14:43:13Z
• Pull Request Run on amd64-m5-4xlarge-linux at 2025-01-24 17:11:06Z