GH-41755: [C++][ORC] Ensure setting detected ORC version (#41767)
conbench-apache-arrow / Conbench performance report
succeeded
Jun 3, 2024 in 0s
Found 0 regressions
After merging your PR, Conbench analyzed the 6 benchmarking runs that have been run so far on merge-commit ff9921f.
Benchmarks with performance regressions
There were 0 possible performance regressions, according to the lookback z-score method.
All benchmark runs analyzed:
- Commit Run on
arm64-t4g-linux-computeat 2024-05-27 10:28:33Z - Commit Run on
ursa-thinkcentre-m75qat 2024-05-27 09:02:19Z - Commit Run on
test-mac-armat 2024-05-27 09:14:29Z - Commit Run on
ec2-t3-xlarge-us-east-2at 2024-05-27 09:25:24Z - Commit Run on
ec2-m5-4xlarge-us-east-2at 2024-05-27 08:33:06Z - Commit Run on
arm64-m6g-linux-computeat 2024-05-27 08:17:03Z
Unstable benchmarks with performance regressions
The following benchmark results indicate a possible performance regression, but are known to sometimes produce false positives when applying the lookback z-score analysis.
-
Commit Run on
arm64-t4g-linux-computeat 2024-05-27 10:28:33ZReferenceCompression(C++) with params=Compression::LZ4_FRAME, source=cpp-micro, suite=arrow-compression-benchmarkConstructFromEmptyStdVector(C++) with params=<SMALL_VECTOR(std::shared_ptr)>, source=cpp-micro, suite=arrow-small-vector-benchmarkBinaryMathOpAdd256(C++) with source=cpp-micro, suite=arrow-decimal-benchmarkCopyShortVector(C++) with params=<SMALL_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkMoveEmptyVector(C++) with params=<SMALL_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkBM_RleEncoding(C++) with params=65536/16, source=cpp-micro, suite=parquet-column-io-benchmarkMoveShortVector(C++) with params=<SMALL_VECTOR(std::shared_ptr)>, source=cpp-micro, suite=arrow-small-vector-benchmarkBenchmarkBitmapVisitBitsetAnd(C++) with params=131072/2, source=cpp-micro, suite=arrow-bit-util-benchmarkCopyShortVector(C++) with params=<STATIC_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkConstructFromShortStdVector(C++) with params=<STATIC_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkLongVectorPushBack(C++) with params=<SMALL_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkBitmapReaderSum(C++) with params=64, source=cpp-micro, suite=arrow-bit-block-counter-benchmarkMoveEmptyVector(C++) with params=<STATIC_VECTOR(std::shared_ptr)>, source=cpp-micro, suite=arrow-small-vector-benchmarkBinaryBitOp(C++) with source=cpp-micro, suite=arrow-decimal-benchmarkMoveEmptyVector(C++) with params=<STATIC_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkCompressedInputStreamZeroCopyBufferReturnedByCallee(C++) with params=Compression::LZ4_FRAME/num_bytes:1048576/batch_size:65536, source=cpp-micro, suite=arrow-io-compressed-benchmarkShortVectorPushBack(C++) with params=<SMALL_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkLongVectorInsertAtEnd(C++) with params=<SMALL_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkMoveEmptyVector(C++) with params=<STD_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkBM_ReadColumn(C++) with params=<false,BooleanType>/1/20, source=cpp-micro, suite=parquet-arrow-reader-writer-benchmarkMoveEmptyVector(C++) with params=<STD_VECTOR(std::shared_ptr)>, source=cpp-micro, suite=arrow-small-vector-benchmarkMoveEmptyVector(C++) with params=<STATIC_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkCopyEmptyVector(C++) with params=<STD_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkConstructFromEmptyStdVector(C++) with params=<STD_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkBenchmarkTemporal(C++) with params=<IsLeapYear, non_zoned>/1048576/100, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkCopyShortVector(C++) with params=<SMALL_VECTOR(std::shared_ptr)>, source=cpp-micro, suite=arrow-small-vector-benchmarkMoveEmptyVector(C++) with params=<SMALL_VECTOR(std::shared_ptr)>, source=cpp-micro, suite=arrow-small-vector-benchmarkConstructFromShortStdVector(C++) with params=<SMALL_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkConstructFromShortStdVector(C++) with params=<STATIC_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkBitBlockCounterFourWordsSum(C++) with params=32768, source=cpp-micro, suite=arrow-bit-block-counter-benchmarkBinaryMathOpAggregate(C++) with source=cpp-micro, suite=arrow-decimal-benchmarkUnaryOp(C++) with source=cpp-micro, suite=arrow-decimal-benchmarkCopyEmptyVector(C++) with params=<STD_VECTOR(std::shared_ptr)>, source=cpp-micro, suite=arrow-small-vector-benchmarkShortVectorInsertAtEnd(C++) with params=<STATIC_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkMoveShortVector(C++) with params=<STATIC_VECTOR(std::shared_ptr)>, source=cpp-micro, suite=arrow-small-vector-benchmarkShortVectorInsert(C++) with params=<SMALL_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkCopyEmptyVector(C++) with params=<SMALL_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkShortVectorInsertAtEnd(C++) with params=<SMALL_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkBenchmarkTemporal(C++) with params=<Quarter, zoned>/1048576/0, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkUniqueString100bytes(C++) with params=1, source=cpp-micro, suite=arrow-compute-vector-hash-benchmarkCopyEmptyVector(C++) with params=<STATIC_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkUniqueString10bytes(C++) with params=1, source=cpp-micro, suite=arrow-compute-vector-hash-benchmarkFromString(C++) with source=cpp-micro, suite=arrow-decimal-benchmarkConstructFromShortStdVector(C++) with params=<SMALL_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkConstructFromEmptyStdVector(C++) with params=<STD_VECTOR(std::shared_ptr)>, source=cpp-micro, suite=arrow-small-vector-benchmarkCopyShortVector(C++) with params=<STATIC_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkShortVectorInsert(C++) with params=<SMALL_VECTOR(std::shared_ptr)>, source=cpp-micro, suite=arrow-small-vector-benchmarkShortVectorInsert(C++) with params=<SMALL_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkCopyShortVector(C++) with params=<STD_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkBM_RleEncoding(C++) with params=32768/16, source=cpp-micro, suite=parquet-column-io-benchmarkBM_ReadStructColumn(C++) with params=50, source=cpp-micro, suite=parquet-arrow-reader-writer-benchmarkMoveShortVector(C++) with params=<STD_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkBitBlockCounterSumWithOffset(C++) with params=32768, source=cpp-micro, suite=arrow-bit-block-counter-benchmarkConstructFromEmptyStdVector(C++) with params=<STATIC_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkBM_RleEncoding(C++) with params=4096/16, source=cpp-micro, suite=parquet-column-io-benchmarkShortVectorInsert(C++) with params=<STATIC_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkBM_ReadColumn(C++) with params=<true,Int64Type>/-1/0, source=cpp-micro, suite=parquet-arrow-reader-writer-benchmarkUniqueString100bytes(C++) with params=0, source=cpp-micro, suite=arrow-compute-vector-hash-benchmarkConstructFromEmptyStdVector(C++) with params=<STATIC_VECTOR(std::shared_ptr)>, source=cpp-micro, suite=arrow-small-vector-benchmarkReferenceCompression(C++) with params=Compression::SNAPPY, source=cpp-micro, suite=arrow-compression-benchmarkConstructFromEmptyStdVector(C++) with params=<STATIC_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkConstructFromEmptyStdVector(C++) with params=<STD_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkShortVectorPushBack(C++) with params=<SMALL_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkBenchmarkTemporal(C++) with params=<Day, zoned>/1048576/100, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkUniqueUInt8(C++) with params=2, source=cpp-micro, suite=arrow-compute-vector-hash-benchmarkShortVectorPushBack(C++) with params=<STATIC_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkUniqueInt64(C++) with params=4, source=cpp-micro, suite=arrow-compute-vector-hash-benchmarkShortVectorInsertAtEnd(C++) with params=<SMALL_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkBM_PlainDecodingBooleanToBitmap(C++) with params=32768, source=cpp-micro, suite=parquet-encoding-benchmarkCopyShortVector(C++) with params=<SMALL_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkMoveShortVector(C++) with params=<STD_VECTOR(std::shared_ptr)>, source=cpp-micro, suite=arrow-small-vector-benchmarkCopyEmptyVector(C++) with params=<STD_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkBinaryMathOpAdd128(C++) with source=cpp-micro, suite=arrow-decimal-benchmarkConstructFromShortStdVector(C++) with params=<STD_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkCopyEmptyVector(C++) with params=<STATIC_VECTOR(std::shared_ptr)>, source=cpp-micro, suite=arrow-small-vector-benchmarkMoveShortVector(C++) with params=<STD_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkValueCountsDictionaryChunks(C++) with params=4, source=cpp-micro, suite=arrow-compute-vector-hash-benchmarkCopyEmptyVector(C++) with params=<SMALL_VECTOR(std::shared_ptr)>, source=cpp-micro, suite=arrow-small-vector-benchmark
-
Commit Run on
ursa-thinkcentre-m75qat 2024-05-27 09:02:19ZBinaryMathOpDivide256(C++) with source=cpp-micro, suite=arrow-decimal-benchmarkFilterFSLInt64FilterWithNulls(C++) with params=524288/13, source=cpp-micro, suite=arrow-compute-vector-selection-benchmarkTakeFixedSizeBinaryRandomIndicesWithNulls(C++) with params=524288/1/9, source=cpp-micro, suite=arrow-compute-vector-selection-benchmarkBenchmarkTemporalRounding(C++) with params=<RoundTemporal, non_zoned, round_1_week>/524288/0, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkBenchmarkTemporalBinary(C++) with params=<HoursBetween, time32_type>/524288/100, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkBinaryCompareOpConstant(C++) with source=cpp-micro, suite=arrow-decimal-benchmarkInt64Conversion(C++) with source=cpp-micro, suite=arrow-csv-converter-benchmarkBM_ReadInt64Column(C++) with params=<Repetition::OPTIONAL, Compression::LZ4, Encoding::BYTE_STREAM_SPLIT>/65536/1024, source=cpp-micro, suite=parquet-column-io-benchmarkBM_PlainDecodingSpacedDouble(C++) with params=32768/10000, source=cpp-micro, suite=parquet-encoding-benchmark
-
Commit Run on
test-mac-armat 2024-05-27 09:14:29ZRoundDerivativesArrayBenchmark(C++) with params=<Trunc, DoubleType>/size:4194304/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-round-benchmarkArrayScalarKernel(C++) with params=<Add, UInt8Type>/size:4194304/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmark
-
Commit Run on
ec2-t3-xlarge-us-east-2at 2024-05-27 09:25:24ZBinaryBitBlockCounterSumWithOffset(C++) with params=512, source=cpp-micro, suite=arrow-bit-block-counter-benchmarkBinaryBitBlockCounterSum(C++) with params=65536, source=cpp-micro, suite=arrow-bit-block-counter-benchmarkArrayRangeEqualsInt32(C++) with params=32768/0, source=cpp-micro, suite=arrow-compare-benchmarkBM_ByteStreamSplitEncode_FLBA_Generic(C++) with params=<7>/65536, source=cpp-micro, suite=parquet-encoding-benchmarkBM_ByteStreamSplitEncode_Float_Scalar(C++) with params=65536, source=cpp-micro, suite=parquet-encoding-benchmarkDoubleColumnMajorTensorConversionFixture(C++) with params=/ConvertToSparseCSFTensorInt64, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkReadRecordBatch(C++) with params=256/real_time, source=cpp-micro, suite=arrow-ipc-read-write-benchmarkChunkCSVEscapedBlock(C++) with source=cpp-micro, suite=arrow-csv-parser-benchmarkConstructFromEmptyStdVector(C++) with params=<SMALL_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkMaxElementWiseArrayArrayString(C++) with params=32768/1, source=cpp-micro, suite=arrow-compute-scalar-compare-benchmarkBinaryBitmapReaderSumWithOffset(C++) with params=2, source=cpp-micro, suite=arrow-bit-block-counter-benchmarkBinaryBitmapReaderSum(C++) with params=32768, source=cpp-micro, suite=arrow-bit-block-counter-benchmarkChunkedArrayRankInt64Narrow(C++) with params=32768/1/tiebreaker:0, source=cpp-micro, suite=arrow-compute-vector-sort-benchmarkBenchmarkTemporalBinary(C++) with params=<MonthsBetween, non_zoned>/1048576/100, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkFilterFixedSizeBinaryFilterWithNulls(C++) with params=1048576/6/9, source=cpp-micro, suite=arrow-compute-vector-selection-benchmarkBinaryBitBlockCounterSum(C++) with params=32768, source=cpp-micro, suite=arrow-bit-block-counter-benchmarkBenchmarkStrftime(C++) with params=/1048576/0, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkBinaryBitmapReaderSum(C++) with params=65536, source=cpp-micro, suite=arrow-bit-block-counter-benchmarkChunkedArrayRankInt64Wide(C++) with params=32768/10/tiebreaker:3, source=cpp-micro, suite=arrow-compute-vector-sort-benchmarkIntegerParsing(C++) with params=, source=cpp-micro, suite=arrow-value-parsing-benchmarkBinaryBitBlockCounterSumWithOffset(C++) with params=8, source=cpp-micro, suite=arrow-bit-block-counter-benchmarkCoalesceScalarStringBench(C++) with params=2, source=cpp-micro, suite=arrow-compute-scalar-if-else-benchmarkBitRunReaderLinear(C++) with params=0, source=cpp-micro, suite=arrow-bit-util-benchmarkTakeStringRandomIndicesWithNulls(C++) with params=1048576/1, source=cpp-micro, suite=arrow-compute-vector-selection-benchmarkIntegerParsing(C++) with params=, source=cpp-micro, suite=arrow-value-parsing-benchmark
Details
This report was generated using the lookback z-score method with a z-score threshold of 30.0.
Loading