Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Perf] Changes at 7/1/2021 7:08:30 PM #7194

Open
performanceautofiler bot opened this issue Jul 6, 2021 · 13 comments
Open

[Perf] Changes at 7/1/2021 7:08:30 PM #7194

performanceautofiler bot opened this issue Jul 6, 2021 · 13 comments
Labels
Needs Transfer refs/heads/main Regression Windows 10.0.19042 x64

Comments

@performanceautofiler
Copy link

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Text.Json.Tests.Perf_Strings

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
WriteStringsUtf8 - Duration of single invocation 8.42 ms 13.71 ms 1.63 0.06 True
WriteStringsUtf8 - Duration of single invocation 8.42 ms 14.38 ms 1.71 0.03 True
WriteStringsUtf8 - Duration of single invocation 5.12 ms 6.02 ms 1.18 0.36 False
WriteStringsUtf16 - Duration of single invocation 12.68 ms 21.43 ms 1.69 0.02 True
WriteStringsUtf16 - Duration of single invocation 8.50 ms 12.29 ms 1.45 0.18 True
WriteStringsUtf16 - Duration of single invocation 58.19 ms 84.41 ms 1.45 0.00 True
WriteStringsUtf8 - Duration of single invocation 4.58 ms 5.80 ms 1.27 0.08 True
WriteStringsUtf8 - Duration of single invocation 9.56 ms 14.46 ms 1.51 0.08 True
WriteStringsUtf8 - Duration of single invocation 5.01 ms 6.37 ms 1.27 0.24 False
WriteStringsUtf16 - Duration of single invocation 12.08 ms 21.98 ms 1.82 0.04 True
WriteStringsUtf16 - Duration of single invocation 59.47 ms 85.25 ms 1.43 0.00 True
WriteStringsUtf8 - Duration of single invocation 56.33 ms 62.04 ms 1.10 0.01 True
WriteStringsUtf8 - Duration of single invocation 56.74 ms 62.04 ms 1.09 0.01 True
WriteStringsUtf16 - Duration of single invocation 11.42 ms 20.94 ms 1.83 0.03 True
WriteStringsUtf8 - Duration of single invocation 56.34 ms 62.70 ms 1.11 0.01 True
WriteStringsUtf16 - Duration of single invocation 6.70 ms 11.05 ms 1.65 0.04 True
WriteStringsUtf8 - Duration of single invocation 9.12 ms 15.79 ms 1.73 0.07 True
WriteStringsUtf16 - Duration of single invocation 6.96 ms 11.69 ms 1.68 0.05 True
WriteStringsUtf16 - Duration of single invocation 7.29 ms 12.15 ms 1.67 0.08 True
WriteStringsUtf8 - Duration of single invocation 55.94 ms 61.84 ms 1.11 0.00 True
WriteStringsUtf16 - Duration of single invocation 59.11 ms 84.08 ms 1.42 0.00 True
WriteStringsUtf8 - Duration of single invocation 4.19 ms 5.82 ms 1.39 0.20 False
WriteStringsUtf16 - Duration of single invocation 11.20 ms 20.70 ms 1.85 0.03 True
WriteStringsUtf16 - Duration of single invocation 58.06 ms 84.15 ms 1.45 0.00 True

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Text.Json.Tests.Perf_Strings*'

Payloads

Baseline
Compare

Histogram

System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted: False, SkipValidation: True, Escaped: OneEscaped)

System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted: False, SkipValidation: False, Escaped: OneEscaped)

System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted: True, SkipValidation: True, Escaped: NoneEscaped)

System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted: True, SkipValidation: False, Escaped: OneEscaped)

System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted: True, SkipValidation: False, Escaped: NoneEscaped)

System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted: False, SkipValidation: False, Escaped: AllEscaped)

System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted: False, SkipValidation: False, Escaped: NoneEscaped)

System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted: True, SkipValidation: False, Escaped: OneEscaped)

System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted: True, SkipValidation: False, Escaped: NoneEscaped)

System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted: True, SkipValidation: True, Escaped: OneEscaped)

System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted: True, SkipValidation: False, Escaped: AllEscaped)

System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted: False, SkipValidation: False, Escaped: AllEscaped)

System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted: True, SkipValidation: False, Escaped: AllEscaped)

System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted: False, SkipValidation: True, Escaped: OneEscaped)

System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted: True, SkipValidation: True, Escaped: AllEscaped)

System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted: False, SkipValidation: True, Escaped: NoneEscaped)

System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted: True, SkipValidation: True, Escaped: OneEscaped)

System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted: False, SkipValidation: False, Escaped: NoneEscaped)

System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted: True, SkipValidation: True, Escaped: NoneEscaped)

System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted: False, SkipValidation: True, Escaped: AllEscaped)

System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted: True, SkipValidation: True, Escaped: AllEscaped)

System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted: False, SkipValidation: True, Escaped: NoneEscaped)

System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted: False, SkipValidation: False, Escaped: OneEscaped)

System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted: False, SkipValidation: True, Escaped: AllEscaped)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information
Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.MathBenchmarks.Double

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Acos - Duration of single invocation 40.48 μs 43.05 μs 1.06 0.00 True
Sinh - Duration of single invocation 62.63 μs 69.52 μs 1.11 0.00 True
Pow - Duration of single invocation 134.60 μs 150.28 μs 1.12 0.00 True
ScaleB - Duration of single invocation 14.27 μs 16.50 μs 1.16 0.30 False
Max - Duration of single invocation 5.26 μs 18.11 μs 3.44 0.00 True
Log10 - Duration of single invocation 30.28 μs 36.30 μs 1.20 0.01 True
Cosh - Duration of single invocation 59.73 μs 65.27 μs 1.09 0.00 True
Floor - Duration of single invocation 4.77 μs 16.92 μs 3.55 0.00 True
Exp - Duration of single invocation 25.91 μs 31.61 μs 1.22 0.00 True
Sin - Duration of single invocation 28.27 μs 37.21 μs 1.32 0.03 True
Asin - Duration of single invocation 43.31 μs 47.92 μs 1.11 0.01 True
Acosh - Duration of single invocation 92.35 μs 102.46 μs 1.11 0.02 True
Atan2 - Duration of single invocation 92.82 μs 98.39 μs 1.06 0.00 True
Round - Duration of single invocation 4.79 μs 16.91 μs 3.53 0.00 True
FusedMultiplyAdd - Duration of single invocation 4.64 μs 16.72 μs 3.60 0.00 True
Atan - Duration of single invocation 36.99 μs 40.61 μs 1.10 0.00 True
Min - Duration of single invocation 5.58 μs 17.75 μs 3.18 0.00 True
Asinh - Duration of single invocation 113.79 μs 122.69 μs 1.08 0.01 True
ILogB - Duration of single invocation 26.85 μs 29.85 μs 1.11 0.04 False
CopySign - Duration of single invocation 7.51 μs 18.08 μs 2.41 0.00 True
Log - Duration of single invocation 28.57 μs 34.82 μs 1.22 0.01 True
Sqrt - Duration of single invocation 12.53 μs 16.50 μs 1.32 0.00 True
Ceiling - Duration of single invocation 4.79 μs 16.92 μs 3.53 0.00 True
Log2 - Duration of single invocation 43.86 μs 50.11 μs 1.14 0.00 True
Abs - Duration of single invocation 4.17 μs 16.46 μs 3.95 0.00 True
Cos - Duration of single invocation 32.38 μs 39.24 μs 1.21 0.01 True
Tan - Duration of single invocation 37.32 μs 39.40 μs 1.06 0.02 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.MathBenchmarks.Double*'

Payloads

Baseline
Compare

Histogram

System.MathBenchmarks.Double.Acos

System.MathBenchmarks.Double.Sinh

System.MathBenchmarks.Double.Pow

System.MathBenchmarks.Double.ScaleB

System.MathBenchmarks.Double.Max

System.MathBenchmarks.Double.Log10

System.MathBenchmarks.Double.Cosh

System.MathBenchmarks.Double.Floor

System.MathBenchmarks.Double.Exp

System.MathBenchmarks.Double.Sin

System.MathBenchmarks.Double.Asin

System.MathBenchmarks.Double.Acosh

System.MathBenchmarks.Double.Atan2

System.MathBenchmarks.Double.Round

System.MathBenchmarks.Double.FusedMultiplyAdd

System.MathBenchmarks.Double.Atan

System.MathBenchmarks.Double.Min

System.MathBenchmarks.Double.Asinh

System.MathBenchmarks.Double.ILogB

System.MathBenchmarks.Double.CopySign

System.MathBenchmarks.Double.Log

System.MathBenchmarks.Double.Sqrt

System.MathBenchmarks.Double.Ceiling

System.MathBenchmarks.Double.Log2

System.MathBenchmarks.Double.Abs

System.MathBenchmarks.Double.Cos

System.MathBenchmarks.Double.Tan

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare d0a09199f8bf30cb3e3f46654117aeae1f72cd99
Diff Diff

Regressions in Microsoft.Extensions.Primitives.StringSegmentBenchmark

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Trim - Duration of single invocation 21.73 ns 28.39 ns 1.31 0.03 True
TrimEnd - Duration of single invocation 11.05 ns 14.58 ns 1.32 0.02 True
Indexer - Duration of single invocation 8.03 ns 23.85 ns 2.97 0.01 True
TrimStart - Duration of single invocation 9.41 ns 12.14 ns 1.29 0.06 False

graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'Microsoft.Extensions.Primitives.StringSegmentBenchmark*'

Payloads

Baseline
Compare

Histogram

Microsoft.Extensions.Primitives.StringSegmentBenchmark.Trim

Microsoft.Extensions.Primitives.StringSegmentBenchmark.TrimEnd

Microsoft.Extensions.Primitives.StringSegmentBenchmark.Indexer

Microsoft.Extensions.Primitives.StringSegmentBenchmark.TrimStart

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in Benchstone.BenchF.InProd

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Test - Duration of single invocation 1.50 secs 2.15 secs 1.43 0.00 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'Benchstone.BenchF.InProd*'

Payloads

Baseline
Compare

Histogram

Benchstone.BenchF.InProd.Test

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in Benchstone.BenchF.Secant

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Test - Duration of single invocation 179.70 ms 300.63 ms 1.67 0.00 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'Benchstone.BenchF.Secant*'

Payloads

Baseline
Compare

Histogram

Benchstone.BenchF.Secant.Test

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare d0a09199f8bf30cb3e3f46654117aeae1f72cd99
Diff Diff

Regressions in System.Buffers.Tests.RentReturnArrayPoolTests<Object>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
MultipleSerial - Duration of single invocation 216.15 ns 240.36 ns 1.11 0.01 False
SingleParallel - Duration of single invocation 4.80 μs 14.14 μs 2.94 0.04 True
SingleParallel - Duration of single invocation 7.50 μs 14.32 μs 1.91 0.03 True
MultipleSerial - Duration of single invocation 19.16 μs 91.44 μs 4.77 0.00 True
MultipleSerial - Duration of single invocation 19.82 μs 92.05 μs 4.64 0.00 True
SingleSerial - Duration of single invocation 2.69 μs 12.39 μs 4.60 0.00 True
SingleSerial - Duration of single invocation 2.39 μs 11.41 μs 4.78 0.00 True
SingleParallel - Duration of single invocation 6.04 μs 13.69 μs 2.27 0.19 True
ProducerConsumer - Duration of single invocation 1.27 μs 10.29 μs 8.13 0.01 True
ProducerConsumer - Duration of single invocation 1.46 μs 10.54 μs 7.20 0.25 True
MultipleSerial - Duration of single invocation 20.97 μs 93.23 μs 4.45 0.01 True
ProducerConsumer - Duration of single invocation 1.34 μs 10.47 μs 7.79 0.13 True
SingleParallel - Duration of single invocation 7.08 μs 14.44 μs 2.04 0.11 True
SingleSerial - Duration of single invocation 2.71 μs 12.49 μs 4.62 0.00 True
MultipleSerial - Duration of single invocation 21.62 μs 94.00 μs 4.35 0.00 True
ProducerConsumer - Duration of single invocation 1.31 μs 10.43 μs 7.94 0.00 True
SingleSerial - Duration of single invocation 2.36 μs 11.39 μs 4.82 0.00 True

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Buffers.Tests.RentReturnArrayPoolTests&lt;Object&gt;*'

Payloads

Baseline
Compare

Histogram

System.Buffers.Tests.RentReturnArrayPoolTests<Object>.MultipleSerial(RentalSize: 4096, ManipulateArray: False, Async: False, UseSharedPool: False)

System.Buffers.Tests.RentReturnArrayPoolTests<Object>.SingleParallel(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: True)

System.Buffers.Tests.RentReturnArrayPoolTests<Object>.SingleParallel(RentalSize: 4096, ManipulateArray: True, Async: True, UseSharedPool: False)

System.Buffers.Tests.RentReturnArrayPoolTests<Object>.MultipleSerial(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: False)

System.Buffers.Tests.RentReturnArrayPoolTests<Object>.MultipleSerial(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: True)

System.Buffers.Tests.RentReturnArrayPoolTests<Object>.SingleSerial(RentalSize: 4096, ManipulateArray: True, Async: True, UseSharedPool: False)

System.Buffers.Tests.RentReturnArrayPoolTests<Object>.SingleSerial(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: True)

System.Buffers.Tests.RentReturnArrayPoolTests<Object>.SingleParallel(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: False)

System.Buffers.Tests.RentReturnArrayPoolTests<Object>.ProducerConsumer(RentalSize: 4096, ManipulateArray: True, Async: True, UseSharedPool: False)

System.Buffers.Tests.RentReturnArrayPoolTests<Object>.ProducerConsumer(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: True)

System.Buffers.Tests.RentReturnArrayPoolTests<Object>.MultipleSerial(RentalSize: 4096, ManipulateArray: True, Async: True, UseSharedPool: False)

System.Buffers.Tests.RentReturnArrayPoolTests<Object>.ProducerConsumer(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: False)

System.Buffers.Tests.RentReturnArrayPoolTests<Object>.SingleParallel(RentalSize: 4096, ManipulateArray: True, Async: True, UseSharedPool: True)

System.Buffers.Tests.RentReturnArrayPoolTests<Object>.SingleSerial(RentalSize: 4096, ManipulateArray: True, Async: True, UseSharedPool: True)

System.Buffers.Tests.RentReturnArrayPoolTests<Object>.MultipleSerial(RentalSize: 4096, ManipulateArray: True, Async: True, UseSharedPool: True)

System.Buffers.Tests.RentReturnArrayPoolTests<Object>.ProducerConsumer(RentalSize: 4096, ManipulateArray: True, Async: True, UseSharedPool: True)

System.Buffers.Tests.RentReturnArrayPoolTests<Object>.SingleSerial(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: False)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in BenchmarksGame.ReverseComplement_1

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
RunBench - Duration of single invocation 529.94 μs 984.93 μs 1.86 0.10 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'BenchmarksGame.ReverseComplement_1*'

Payloads

Baseline
Compare

Histogram

BenchmarksGame.ReverseComplement_1.RunBench

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
@performanceautofiler
Copy link
Author

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Buffers.Text.Tests.Base64Tests

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Base64EncodeDestinationTooSmall - Duration of single invocation 65.88 ns 72.73 ns 1.10 0.00 True
Base64DecodeDetinationTooSmall - Duration of single invocation 15.86 ns 18.81 ns 1.19 0.04 False
Base64Encode - Duration of single invocation 57.02 ns 65.06 ns 1.14 0.01 False
Base64Decode - Duration of single invocation 15.98 ns 18.79 ns 1.18 0.02 False

graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Buffers.Text.Tests.Base64Tests*'

Payloads

Baseline
Compare

Histogram

System.Buffers.Text.Tests.Base64Tests.Base64EncodeDestinationTooSmall(NumberOfBytes: 1000)

System.Buffers.Text.Tests.Base64Tests.Base64DecodeDetinationTooSmall(NumberOfBytes: 1000)

System.Buffers.Text.Tests.Base64Tests.Base64Encode(NumberOfBytes: 1000)

System.Buffers.Text.Tests.Base64Tests.Base64Decode(NumberOfBytes: 1000)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information
Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in MicroBenchmarks.Serializers.Xml_FromStream<IndexViewModel>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
XmlSerializer_ - Duration of single invocation 99.17 μs 108.38 μs 1.09 0.03 True
DataContractSerializer_ - Duration of single invocation 190.01 μs 254.31 μs 1.34 0.01 True

graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'MicroBenchmarks.Serializers.Xml_FromStream&lt;IndexViewModel&gt;*'

Payloads

Baseline
Compare

Histogram

MicroBenchmarks.Serializers.Xml_FromStream<IndexViewModel>.XmlSerializer_

MicroBenchmarks.Serializers.Xml_FromStream<IndexViewModel>.DataContractSerializer_

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Collections.ContainsFalse<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
ImmutableHashSet - Duration of single invocation 15.77 μs 17.22 μs 1.09 0.28 False
HashSet - Duration of single invocation 2.49 μs 3.02 μs 1.21 0.04 True
Span - Duration of single invocation 46.66 μs 161.07 μs 3.45 0.01 True
LinkedList - Duration of single invocation 301.93 μs 375.99 μs 1.25 0.00 True

graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Collections.ContainsFalse&lt;Int32&gt;*'

Payloads

Baseline
Compare

Histogram

System.Collections.ContainsFalse<Int32>.ImmutableHashSet(Size: 512)

System.Collections.ContainsFalse<Int32>.HashSet(Size: 512)

System.Collections.ContainsFalse<Int32>.Span(Size: 512)

System.Collections.ContainsFalse<Int32>.LinkedList(Size: 512)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Collections.Tests.Perf_PriorityQueue<Guid, Guid>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
HeapSort - Duration of single invocation 5.81 μs 6.38 μs 1.10 0.02 False
HeapSort - Duration of single invocation 133.01 μs 147.60 μs 1.11 0.01 True
K_Max_Elements - Duration of single invocation 253.00 ns 272.57 ns 1.08 0.06 False
Dequeue_And_Enqueue - Duration of single invocation 17.83 μs 19.26 μs 1.08 0.00 False
K_Max_Elements - Duration of single invocation 1.19 μs 1.45 μs 1.21 0.02 True
Enumerate - Duration of single invocation 2.31 μs 2.45 μs 1.06 0.07 False
Dequeue_And_Enqueue - Duration of single invocation 336.93 μs 371.49 μs 1.10 0.00 False
Enumerate - Duration of single invocation 248.74 ns 263.44 ns 1.06 0.06 False
K_Max_Elements - Duration of single invocation 7.97 μs 10.23 μs 1.28 0.01 True

graph
graph
graph
graph
graph
graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Collections.Tests.Perf_PriorityQueue&lt;Guid, Guid&gt;*'

Payloads

Baseline
Compare

Histogram

System.Collections.Tests.Perf_PriorityQueue<Guid, Guid>.HeapSort(Size: 100)

System.Collections.Tests.Perf_PriorityQueue<Guid, Guid>.HeapSort(Size: 1000)

System.Collections.Tests.Perf_PriorityQueue<Guid, Guid>.K_Max_Elements(Size: 10)

System.Collections.Tests.Perf_PriorityQueue<Guid, Guid>.Dequeue_And_Enqueue(Size: 100)

System.Collections.Tests.Perf_PriorityQueue<Guid, Guid>.K_Max_Elements(Size: 100)

System.Collections.Tests.Perf_PriorityQueue<Guid, Guid>.Enumerate(Size: 1000)

System.Collections.Tests.Perf_PriorityQueue<Guid, Guid>.Dequeue_And_Enqueue(Size: 1000)

System.Collections.Tests.Perf_PriorityQueue<Guid, Guid>.Enumerate(Size: 100)

System.Collections.Tests.Perf_PriorityQueue<Guid, Guid>.K_Max_Elements(Size: 1000)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in MicroBenchmarks.Serializers.Json_ToStream<IndexViewModel>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
JsonNet_ - Duration of single invocation 42.25 μs 58.00 μs 1.37 0.01 True
DataContractJsonSerializer_ - Duration of single invocation 105.84 μs 220.81 μs 2.09 0.01 True

graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'MicroBenchmarks.Serializers.Json_ToStream&lt;IndexViewModel&gt;*'

Payloads

Baseline
Compare

Histogram

MicroBenchmarks.Serializers.Json_ToStream<IndexViewModel>.JsonNet_

MicroBenchmarks.Serializers.Json_ToStream<IndexViewModel>.DataContractJsonSerializer_

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in GuardedDevirtualization.TwoClassInterface

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Call - Duration of single invocation 8.20 ns 10.15 ns 1.24 0.01 True
Call - Duration of single invocation 7.78 ns 9.52 ns 1.22 0.03 True
Call - Duration of single invocation 6.79 ns 7.96 ns 1.17 0.03 True
Call - Duration of single invocation 7.44 ns 8.90 ns 1.20 0.01 True
Call - Duration of single invocation 6.55 ns 7.68 ns 1.17 0.04 True
Call - Duration of single invocation 8.08 ns 9.58 ns 1.19 0.01 True
Call - Duration of single invocation 7.93 ns 9.50 ns 1.20 0.03 True

graph
graph
graph
graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'GuardedDevirtualization.TwoClassInterface*'

Payloads

Baseline
Compare

Histogram

GuardedDevirtualization.TwoClassInterface.Call(testInput: pB = 0.50)

GuardedDevirtualization.TwoClassInterface.Call(testInput: pB = 0.30)

GuardedDevirtualization.TwoClassInterface.Call(testInput: pB = 0.20)

GuardedDevirtualization.TwoClassInterface.Call(testInput: pB = 0.70)

GuardedDevirtualization.TwoClassInterface.Call(testInput: pB = 0.80)

GuardedDevirtualization.TwoClassInterface.Call(testInput: pB = 0.60)

GuardedDevirtualization.TwoClassInterface.Call(testInput: pB = 0.40)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in GuardedDevirtualization.ThreeClassVirtual

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Call - Duration of single invocation 6.46 ns 9.12 ns 1.41 0.01 True
Call - Duration of single invocation 6.28 ns 8.46 ns 1.35 0.00 True
Call - Duration of single invocation 7.64 ns 11.18 ns 1.46 0.07 False
Call - Duration of single invocation 6.47 ns 9.12 ns 1.41 0.01 True
Call - Duration of single invocation 6.28 ns 8.45 ns 1.35 0.00 True
Call - Duration of single invocation 6.28 ns 8.46 ns 1.35 0.00 True
Call - Duration of single invocation 6.47 ns 9.12 ns 1.41 0.01 True

graph
graph
graph
graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'GuardedDevirtualization.ThreeClassVirtual*'

Payloads

Baseline
Compare

Histogram

GuardedDevirtualization.ThreeClassVirtual.Call(testInput: pB=0.00 pD=0.33)

GuardedDevirtualization.ThreeClassVirtual.Call(testInput: pB=0.67 pD=0.33)

GuardedDevirtualization.ThreeClassVirtual.Call(testInput: pB=0.33 pD=0.33)

GuardedDevirtualization.ThreeClassVirtual.Call(testInput: pB=0.33 pD=0.00)

GuardedDevirtualization.ThreeClassVirtual.Call(testInput: pB=0.67 pD=0.00)

GuardedDevirtualization.ThreeClassVirtual.Call(testInput: pB=0.00 pD=0.67)

GuardedDevirtualization.ThreeClassVirtual.Call(testInput: pB=0.33 pD=0.67)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in Benchstone.BenchI.NDhrystone

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Test - Duration of single invocation 364.76 ms 598.78 ms 1.64 0.09 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'Benchstone.BenchI.NDhrystone*'

Payloads

Baseline
Compare

Histogram

Benchstone.BenchI.NDhrystone.Test

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Text.Json.Serialization.Tests.ReadJson<MyEventsListerViewModel>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
DeserializeFromStream - Duration of single invocation 460.55 μs 526.83 μs 1.14 0.04 False
DeserializeFromString - Duration of single invocation 402.30 μs 454.57 μs 1.13 0.05 False
DeserializeFromUtf8Bytes - Duration of single invocation 383.38 μs 476.12 μs 1.24 0.05 False

graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Text.Json.Serialization.Tests.ReadJson&lt;MyEventsListerViewModel&gt;*'

Payloads

Baseline
Compare

Histogram

System.Text.Json.Serialization.Tests.ReadJson<MyEventsListerViewModel>.DeserializeFromStream

System.Text.Json.Serialization.Tests.ReadJson<MyEventsListerViewModel>.DeserializeFromString

System.Text.Json.Serialization.Tests.ReadJson<MyEventsListerViewModel>.DeserializeFromUtf8Bytes

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in SciMark2.kernel

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
benchSOR - Duration of single invocation 998.06 ms 1.06 secs 1.06 0.00 True
benchFFT - Duration of single invocation 586.08 ms 1.91 secs 3.26 0.00 True
benchmarkLU - Duration of single invocation 611.30 ms 2.05 secs 3.35 0.03 True
benchSparseMult - Duration of single invocation 536.19 ms 1.51 secs 2.82 0.01 True
benchMonteCarlo - Duration of single invocation 690.23 ms 804.50 ms 1.17 0.01 True

graph
graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'SciMark2.kernel*'

Payloads

Baseline
Compare

Histogram

SciMark2.kernel.benchSOR

SciMark2.kernel.benchFFT

SciMark2.kernel.benchmarkLU

SciMark2.kernel.benchSparseMult

SciMark2.kernel.benchMonteCarlo

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline e363f9acfa1811904eaf9ce017120b8385a58443
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Text.Json.Serialization.Tests.ReadJson<Location>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
DeserializeFromString - Duration of single invocation 1.77 μs 1.91 μs 1.08 0.05 False

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Text.Json.Serialization.Tests.ReadJson&lt;Location&gt;*'

Payloads

Baseline
Compare

Histogram

System.Text.Json.Serialization.Tests.ReadJson<Location>.DeserializeFromString

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare d0a09199f8bf30cb3e3f46654117aeae1f72cd99
Diff Diff

Regressions in Microsoft.Extensions.Logging.ScopesOverheadBenchmark

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
FilteredByLevel - Duration of single invocation 7.25 ns 10.27 ns 1.42 0.06 False
FilteredByLevel - Duration of single invocation 7.52 ns 10.56 ns 1.40 0.05 False
FilteredByLevel - Duration of single invocation 7.42 ns 10.47 ns 1.41 0.04 False
FilteredByLevel - Duration of single invocation 7.52 ns 9.99 ns 1.33 0.06 False

graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'Microsoft.Extensions.Logging.ScopesOverheadBenchmark*'

Payloads

Baseline
Compare

Histogram

Microsoft.Extensions.Logging.ScopesOverheadBenchmark.FilteredByLevel(HasISupportLoggingScopeLogger: True, CaptureScopes: False)

Microsoft.Extensions.Logging.ScopesOverheadBenchmark.FilteredByLevel(HasISupportLoggingScopeLogger: True, CaptureScopes: True)

Microsoft.Extensions.Logging.ScopesOverheadBenchmark.FilteredByLevel(HasISupportLoggingScopeLogger: False, CaptureScopes: True)

Microsoft.Extensions.Logging.ScopesOverheadBenchmark.FilteredByLevel(HasISupportLoggingScopeLogger: False, CaptureScopes: False)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in MicroBenchmarks.Serializers.Xml_FromStream<ClassImplementingIXmlSerialiable>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
DataContractSerializer_ - Duration of single invocation 2.41 μs 2.63 μs 1.09 0.00 True
XmlSerializer_ - Duration of single invocation 2.73 μs 2.90 μs 1.06 0.00 False

graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'MicroBenchmarks.Serializers.Xml_FromStream&lt;ClassImplementingIXmlSerialiable&gt;*'

Payloads

Baseline
Compare

Histogram

MicroBenchmarks.Serializers.Xml_FromStream<ClassImplementingIXmlSerialiable>.DataContractSerializer_

MicroBenchmarks.Serializers.Xml_FromStream<ClassImplementingIXmlSerialiable>.XmlSerializer_

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in Burgers

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Test3 - Duration of single invocation 84.25 ms 323.48 ms 3.84 0.04 True
Test0 - Duration of single invocation 173.97 ms 265.86 ms 1.53 0.00 True
Test2 - Duration of single invocation 145.64 ms 276.84 ms 1.90 0.01 True
Test1 - Duration of single invocation 145.98 ms 263.49 ms 1.80 0.01 True

graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'Burgers*'

Payloads

Baseline
Compare

Histogram

Burgers.Test3

Burgers.Test0

Burgers.Test2

Burgers.Test1

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler
Copy link
Author

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Collections.CreateAddAndRemove<String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Queue - Duration of single invocation 5.11 μs 5.54 μs 1.08 0.43 False

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Collections.CreateAddAndRemove&lt;String&gt;*'

Payloads

Baseline
Compare

Histogram

System.Collections.CreateAddAndRemove<String>.Queue(Size: 512)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information
Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in BenchmarksGame.BinaryTrees_6

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
RunBench - Duration of single invocation 483.80 ms 649.04 ms 1.34 0.01 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'BenchmarksGame.BinaryTrees_6*'

Payloads

Baseline
Compare

Histogram

BenchmarksGame.BinaryTrees_6.RunBench

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in Benchstone.BenchI.BenchE

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Test - Duration of single invocation 323.85 ms 1.35 secs 4.16 0.06 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'Benchstone.BenchI.BenchE*'

Payloads

Baseline
Compare

Histogram

Benchstone.BenchI.BenchE.Test

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in MicroBenchmarks.Serializers.Json_FromString<CollectionsOfPrimitives>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
JsonNet_ - Duration of single invocation 675.94 μs 728.87 μs 1.08 0.05 False

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'MicroBenchmarks.Serializers.Json_FromString&lt;CollectionsOfPrimitives&gt;*'

Payloads

Baseline
Compare

Histogram

MicroBenchmarks.Serializers.Json_FromString<CollectionsOfPrimitives>.JsonNet_

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in Benchstone.BenchF.Bisect

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Test - Duration of single invocation 300.86 ms 527.09 ms 1.75 0.00 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'Benchstone.BenchF.Bisect*'

Payloads

Baseline
Compare

Histogram

Benchstone.BenchF.Bisect.Test

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare d0a09199f8bf30cb3e3f46654117aeae1f72cd99
Diff Diff

Regressions in MicroBenchmarks.Serializers.Json_FromString<IndexViewModel>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
JsonNet_ - Duration of single invocation 82.49 μs 100.92 μs 1.22 0.03 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'MicroBenchmarks.Serializers.Json_FromString&lt;IndexViewModel&gt;*'

Payloads

Baseline
Compare

Histogram

MicroBenchmarks.Serializers.Json_FromString<IndexViewModel>.JsonNet_

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in Benchstone.BenchF.SqMtx

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Test - Duration of single invocation 631.28 ms 768.82 ms 1.22 0.00 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'Benchstone.BenchF.SqMtx*'

Payloads

Baseline
Compare

Histogram

Benchstone.BenchF.SqMtx.Test

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in Benchstone.BenchF.Lorenz

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Test - Duration of single invocation 247.58 ms 372.43 ms 1.50 0.00 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'Benchstone.BenchF.Lorenz*'

Payloads

Baseline
Compare

Histogram

Benchstone.BenchF.Lorenz.Test

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Xml.Linq.Perf_XElement

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
GetElementWithNamespace - Duration of single invocation 90.92 ns 99.84 ns 1.10 0.09 False

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Xml.Linq.Perf_XElement*'

Payloads

Baseline
Compare

Histogram

System.Xml.Linq.Perf_XElement.GetElementWithNamespace

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in HardwareIntrinsics.RayTracer.SoA

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Render - Duration of single invocation 6.17 ms 7.95 ms 1.29 0.09 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'HardwareIntrinsics.RayTracer.SoA*'

Payloads

Baseline
Compare

Histogram

HardwareIntrinsics.RayTracer.SoA.Render

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in Benchstone.BenchI.QuickSort

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Test - Duration of single invocation 9.00 μs 12.44 μs 1.38 0.05 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'Benchstone.BenchI.QuickSort*'

Payloads

Baseline
Compare

Histogram

Benchstone.BenchI.QuickSort.Test

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in BenchmarksGame.PiDigits_3

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
RunBench - Duration of single invocation 600.15 ms 1.57 secs 2.61 0.00 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'BenchmarksGame.PiDigits_3*'

Payloads

Baseline
Compare

Histogram

BenchmarksGame.PiDigits_3.RunBench(n: 3000, expected: "8649423196\t:3000")

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in BenchmarksGame.FannkuchRedux_5

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
RunBench - Duration of single invocation 16.26 ms 18.17 ms 1.12 0.02 False

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'BenchmarksGame.FannkuchRedux_5*'

Payloads

Baseline
Compare

Histogram

BenchmarksGame.FannkuchRedux_5.RunBench(n: 10, expectedSum: 38)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in BenchmarksGame.Fasta_1

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
RunBench - Duration of single invocation 257.01 μs 374.83 μs 1.46 0.00 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'BenchmarksGame.Fasta_1*'

Payloads

Baseline
Compare

Histogram

BenchmarksGame.Fasta_1.RunBench

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in FractalPerf.Launch

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Test - Duration of single invocation 134.52 ms 259.44 ms 1.93 0.00 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'FractalPerf.Launch*'

Payloads

Baseline
Compare

Histogram

FractalPerf.Launch.Test

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Collections.ContainsFalse<String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
LinkedList - Duration of single invocation 1.25 ms 1.35 ms 1.08 0.00 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Collections.ContainsFalse&lt;String&gt;*'

Payloads

Baseline
Compare

Histogram

System.Collections.ContainsFalse<String>.LinkedList(Size: 512)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in Benchstone.BenchF.Romber

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Test - Duration of single invocation 133.58 ms 168.23 ms 1.26 0.00 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'Benchstone.BenchF.Romber*'

Payloads

Baseline
Compare

Histogram

Benchstone.BenchF.Romber.Test

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in Benchstone.BenchI.BubbleSort2

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Test - Duration of single invocation 27.68 ms 70.55 ms 2.55 0.13 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'Benchstone.BenchI.BubbleSort2*'

Payloads

Baseline
Compare

Histogram

Benchstone.BenchI.BubbleSort2.Test

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in Benchstone.BenchI.Array1

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Test - Duration of single invocation 6.35 ms 8.92 ms 1.41 0.00 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'Benchstone.BenchI.Array1*'

Payloads

Baseline
Compare

Histogram

Benchstone.BenchI.Array1.Test

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in Benchstone.BenchF.Simpsn

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Test - Duration of single invocation 120.25 ms 155.24 ms 1.29 0.00 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'Benchstone.BenchF.Simpsn*'

Payloads

Baseline
Compare

Histogram

Benchstone.BenchF.Simpsn.Test

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in MicroBenchmarks.Serializers.Json_FromString<MyEventsListerViewModel>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
JsonNet_ - Duration of single invocation 957.06 μs 1.03 ms 1.07 0.02 False

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'MicroBenchmarks.Serializers.Json_FromString&lt;MyEventsListerViewModel&gt;*'

Payloads

Baseline
Compare

Histogram

MicroBenchmarks.Serializers.Json_FromString<MyEventsListerViewModel>.JsonNet_

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare d0a09199f8bf30cb3e3f46654117aeae1f72cd99
Diff Diff

Regressions in System.Collections.ContainsKeyTrue<String, String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
ConcurrentDictionary - Duration of single invocation 18.06 μs 19.50 μs 1.08 0.01 False

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Collections.ContainsKeyTrue&lt;String, String&gt;*'

Payloads

Baseline
Compare

Histogram

System.Collections.ContainsKeyTrue<String, String>.ConcurrentDictionary(Size: 512)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler
Copy link
Author

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Text.Json.Tests.Perf_Basic

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
WriteBasicUtf16 - Duration of single invocation 797.23 ns 928.08 ns 1.16 0.03 True
WriteBasicUtf16 - Duration of single invocation 1.00 μs 1.15 μs 1.15 0.06 False
WriteBasicUtf16 - Duration of single invocation 1.49 ms 1.65 ms 1.10 0.03 False
WriteBasicUtf16 - Duration of single invocation 1.00 μs 1.20 μs 1.19 0.05 False
WriteBasicUtf8 - Duration of single invocation 1.48 ms 1.65 ms 1.12 0.02 False
WriteBasicUtf16 - Duration of single invocation 2.31 ms 2.54 ms 1.10 0.01 False
WriteBasicUtf8 - Duration of single invocation 2.15 ms 2.44 ms 1.13 0.01 False
WriteBasicUtf16 - Duration of single invocation 2.16 ms 2.40 ms 1.11 0.01 False
WriteBasicUtf8 - Duration of single invocation 887.64 ns 1.03 μs 1.16 0.04 False
WriteBasicUtf8 - Duration of single invocation 788.99 ns 862.37 ns 1.09 0.06 False
WriteBasicUtf8 - Duration of single invocation 2.30 ms 2.54 ms 1.11 0.02 False
WriteBasicUtf8 - Duration of single invocation 704.62 ns 823.44 ns 1.17 0.06 False
WriteBasicUtf8 - Duration of single invocation 920.64 ns 1.08 μs 1.17 0.07 False
WriteBasicUtf16 - Duration of single invocation 877.31 ns 976.58 ns 1.11 0.03 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Text.Json.Tests.Perf_Basic*'

Payloads

Baseline
Compare

Histogram

System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted: False, SkipValidation: True, DataSize: 10)

System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted: True, SkipValidation: True, DataSize: 10)

System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted: False, SkipValidation: True, DataSize: 100000)

System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted: True, SkipValidation: False, DataSize: 10)

System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted: False, SkipValidation: True, DataSize: 100000)

System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted: True, SkipValidation: False, DataSize: 100000)

System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted: True, SkipValidation: True, DataSize: 100000)

System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted: True, SkipValidation: True, DataSize: 100000)

System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted: True, SkipValidation: True, DataSize: 10)

System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted: False, SkipValidation: False, DataSize: 10)

System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted: True, SkipValidation: False, DataSize: 100000)

System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted: False, SkipValidation: True, DataSize: 10)

System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted: True, SkipValidation: False, DataSize: 10)

System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted: False, SkipValidation: False, DataSize: 10)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information
Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Collections.IndexerSetReverse<String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Array - Duration of single invocation 258.55 ns 1.29 μs 4.98 0.00 True
Span - Duration of single invocation 256.87 ns 1.52 μs 5.92 0.03 True
List - Duration of single invocation 996.54 ns 1.91 μs 1.91 0.01 True

graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Collections.IndexerSetReverse&lt;String&gt;*'

Payloads

Baseline
Compare

Histogram

System.Collections.IndexerSetReverse<String>.Array(Size: 512)

System.Collections.IndexerSetReverse<String>.Span(Size: 512)

System.Collections.IndexerSetReverse<String>.List(Size: 512)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Collections.TryAddGiventSize<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
ConcurrentDictionary - Duration of single invocation 21.02 μs 23.53 μs 1.12 0.01 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Collections.TryAddGiventSize&lt;Int32&gt;*'

Payloads

Baseline
Compare

Histogram

System.Collections.TryAddGiventSize<Int32>.ConcurrentDictionary(Count: 512)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Text.Json.Serialization.Tests.ReadMissingAndCaseInsensitive<Location>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Baseline - Duration of single invocation 1.77 μs 1.87 μs 1.06 0.05 False
CaseInsensitiveNotMatching - Duration of single invocation 1.73 μs 1.90 μs 1.10 0.03 False
MissingProperties - Duration of single invocation 1.09 μs 1.20 μs 1.11 0.06 False

graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Text.Json.Serialization.Tests.ReadMissingAndCaseInsensitive&lt;Location&gt;*'

Payloads

Baseline
Compare

Histogram

System.Text.Json.Serialization.Tests.ReadMissingAndCaseInsensitive<Location>.Baseline

System.Text.Json.Serialization.Tests.ReadMissingAndCaseInsensitive<Location>.CaseInsensitiveNotMatching

System.Text.Json.Serialization.Tests.ReadMissingAndCaseInsensitive<Location>.MissingProperties

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Tests.Perf_Uri

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
DnsSafeHost - Duration of single invocation 374.41 ns 416.85 ns 1.11 0.08 False

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Tests.Perf_Uri*'

Payloads

Baseline
Compare

Histogram

System.Tests.Perf_Uri.DnsSafeHost

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline e363f9acfa1811904eaf9ce017120b8385a58443
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Collections.Concurrent.IsEmpty<String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Dictionary - Duration of single invocation 184.09 ns 236.27 ns 1.28 0.00 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Collections.Concurrent.IsEmpty&lt;String&gt;*'

Payloads

Baseline
Compare

Histogram

System.Collections.Concurrent.IsEmpty<String>.Dictionary(Size: 0)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Tests.Perf_Single

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
IsNaN - Duration of single invocation 835.26 μs 3.32 ms 3.98 0.00 True
IsNaN - Duration of single invocation 835.93 μs 3.34 ms 3.99 0.00 True

graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Tests.Perf_Single*'

Payloads

Baseline
Compare

Histogram

System.Tests.Perf_Single.IsNaN(value: 0)

System.Tests.Perf_Single.IsNaN(value: NaN)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in Benchstone.BenchF.Whetsto

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Test - Duration of single invocation 560.44 ms 601.91 ms 1.07 0.00 False

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'Benchstone.BenchF.Whetsto*'

Payloads

Baseline
Compare

Histogram

Benchstone.BenchF.Whetsto.Test

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Collections.TryAddDefaultSize<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
ConcurrentDictionary - Duration of single invocation 31.80 μs 36.79 μs 1.16 0.01 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Collections.TryAddDefaultSize&lt;Int32&gt;*'

Payloads

Baseline
Compare

Histogram

System.Collections.TryAddDefaultSize<Int32>.ConcurrentDictionary(Count: 512)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in Benchstone.BenchI.TreeInsert

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Test - Duration of single invocation 50.29 μs 84.15 μs 1.67 0.01 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'Benchstone.BenchI.TreeInsert*'

Payloads

Baseline
Compare

Histogram

Benchstone.BenchI.TreeInsert.Test

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in Span.Sorting

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
BubbleSortSpan - Duration of single invocation 191.55 μs 367.96 μs 1.92 0.07 True
BubbleSortArray - Duration of single invocation 188.22 μs 372.13 μs 1.98 0.09 False
QuickSortSpan - Duration of single invocation 9.43 μs 17.05 μs 1.81 0.07 True
QuickSortArray - Duration of single invocation 8.71 μs 15.18 μs 1.74 0.03 True

graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'Span.Sorting*'

Payloads

Baseline
Compare

Histogram

Span.Sorting.BubbleSortSpan(Size: 512)

Span.Sorting.BubbleSortArray(Size: 512)

Span.Sorting.QuickSortSpan(Size: 512)

Span.Sorting.QuickSortArray(Size: 512)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare d0a09199f8bf30cb3e3f46654117aeae1f72cd99
Diff Diff

Regressions in System.Collections.IterateFor<String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Span - Duration of single invocation 296.91 ns 1.30 μs 4.37 0.04 True
ImmutableArray - Duration of single invocation 152.04 ns 1.37 μs 9.04 0.00 True
ReadOnlySpan - Duration of single invocation 293.79 ns 1.31 μs 4.46 0.04 True
Array - Duration of single invocation 149.41 ns 1.28 μs 8.56 0.00 True
List - Duration of single invocation 290.21 ns 1.48 μs 5.11 0.00 True

graph
graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Collections.IterateFor&lt;String&gt;*'

Payloads

Baseline
Compare

Histogram

System.Collections.IterateFor<String>.Span(Size: 512)

System.Collections.IterateFor<String>.ImmutableArray(Size: 512)

System.Collections.IterateFor<String>.ReadOnlySpan(Size: 512)

System.Collections.IterateFor<String>.Array(Size: 512)

System.Collections.IterateFor<String>.List(Size: 512)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Text.Json.Document.Tests.Perf_ParseThenWrite

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
ParseThenWrite - Duration of single invocation 6.85 μs 7.66 μs 1.12 0.08 False
ParseThenWrite - Duration of single invocation 6.22 μs 6.90 μs 1.11 0.09 False
ParseThenWrite - Duration of single invocation 24.09 μs 27.62 μs 1.15 0.01 False
ParseThenWrite - Duration of single invocation 3.27 μs 3.58 μs 1.10 0.01 False
ParseThenWrite - Duration of single invocation 17.19 μs 18.39 μs 1.07 0.02 False
ParseThenWrite - Duration of single invocation 20.13 μs 21.66 μs 1.08 0.04 False
ParseThenWrite - Duration of single invocation 8.27 μs 9.29 μs 1.12 0.09 False
ParseThenWrite - Duration of single invocation 24.29 μs 28.13 μs 1.16 0.01 False
ParseThenWrite - Duration of single invocation 2.18 ms 2.41 ms 1.11 0.02 False
ParseThenWrite - Duration of single invocation 2.54 ms 2.85 ms 1.12 0.01 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Text.Json.Document.Tests.Perf_ParseThenWrite*'

Payloads

Baseline
Compare

Histogram

System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: False, TestCase: LotsOfNumbers)

System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: True, TestCase: LotsOfStrings)

System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: True, TestCase: DeepTree)

System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: True, TestCase: Json400B)

System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: False, TestCase: DeepTree)

System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: False, TestCase: Json4KB)

System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: True, TestCase: LotsOfNumbers)

System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: True, TestCase: Json4KB)

System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: False, TestCase: Json400KB)

System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: True, TestCase: Json400KB)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Memory.Span<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
IndexOfAnyThreeValues - Duration of single invocation 113.94 ns 443.47 ns 3.89 0.03 True
IndexOfAnyFourValues - Duration of single invocation 436.73 ns 1.67 μs 3.83 0.04 True
LastIndexOfAnyValues - Duration of single invocation 87.54 ns 330.23 ns 3.77 0.00 True
Fill - Duration of single invocation 35.02 ns 53.94 ns 1.54 0.06 False
IndexOfAnyTwoValues - Duration of single invocation 82.22 ns 336.09 ns 4.09 0.00 True
SequenceCompareTo - Duration of single invocation 580.23 ns 875.46 ns 1.51 0.00 True

graph
graph
graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Memory.Span&lt;Int32&gt;*'

Payloads

Baseline
Compare

Histogram

System.Memory.Span<Int32>.IndexOfAnyThreeValues(Size: 512)

System.Memory.Span<Int32>.IndexOfAnyFourValues(Size: 512)

System.Memory.Span<Int32>.LastIndexOfAnyValues(Size: 512)

System.Memory.Span<Int32>.Fill(Size: 512)

System.Memory.Span<Int32>.IndexOfAnyTwoValues(Size: 512)

System.Memory.Span<Int32>.SequenceCompareTo(Size: 512)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler
Copy link
Author

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in Benchstone.BenchF.Trap

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Test - Duration of single invocation 115.14 ms 151.93 ms 1.32 0.00 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'Benchstone.BenchF.Trap*'

Payloads

Baseline
Compare

Histogram

Benchstone.BenchF.Trap.Test

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information
Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in Benchstone.BenchI.Pi

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Test - Duration of single invocation 4.86 ms 8.08 ms 1.66 0.00 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'Benchstone.BenchI.Pi*'

Payloads

Baseline
Compare

Histogram

Benchstone.BenchI.Pi.Test

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in MicroBenchmarks.Serializers.Json_ToStream<Location>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
DataContractJsonSerializer_ - Duration of single invocation 3.17 μs 3.37 μs 1.06 0.02 False

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'MicroBenchmarks.Serializers.Json_ToStream&lt;Location&gt;*'

Payloads

Baseline
Compare

Histogram

MicroBenchmarks.Serializers.Json_ToStream<Location>.DataContractJsonSerializer_

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in Benchstone.BenchI.AddArray

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Test - Duration of single invocation 15.60 μs 55.47 μs 3.56 0.03 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'Benchstone.BenchI.AddArray*'

Payloads

Baseline
Compare

Histogram

Benchstone.BenchI.AddArray.Test

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in Benchstone.BenchF.LLoops

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Test - Duration of single invocation 587.44 ms 1.05 secs 1.79 0.14 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'Benchstone.BenchF.LLoops*'

Payloads

Baseline
Compare

Histogram

Benchstone.BenchF.LLoops.Test

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in BenchmarksGame.Fasta_2

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
RunBench - Duration of single invocation 466.60 μs 493.47 μs 1.06 0.00 False

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'BenchmarksGame.Fasta_2*'

Payloads

Baseline
Compare

Histogram

BenchmarksGame.Fasta_2.RunBench

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare d0a09199f8bf30cb3e3f46654117aeae1f72cd99
Diff Diff

Regressions in BenchmarksGame.FannkuchRedux_2

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
RunBench - Duration of single invocation 159.01 ms 276.34 ms 1.74 0.00 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'BenchmarksGame.FannkuchRedux_2*'

Payloads

Baseline
Compare

Histogram

BenchmarksGame.FannkuchRedux_2.RunBench(n: 10, expectedSum: 73196)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in BenchmarksGame.NBody_3

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
RunBench - Duration of single invocation 444.83 ms 1.01 secs 2.28 0.00 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'BenchmarksGame.NBody_3*'

Payloads

Baseline
Compare

Histogram

BenchmarksGame.NBody_3.RunBench

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in MicroBenchmarks.Serializers.Xml_ToStream<Location>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
DataContractSerializer_ - Duration of single invocation 2.18 μs 3.22 μs 1.48 0.03 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'MicroBenchmarks.Serializers.Xml_ToStream&lt;Location&gt;*'

Payloads

Baseline
Compare

Histogram

MicroBenchmarks.Serializers.Xml_ToStream<Location>.DataContractSerializer_

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in Benchstone.BenchI.AddArray2

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Test - Duration of single invocation 13.03 ms 18.24 ms 1.40 0.24 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'Benchstone.BenchI.AddArray2*'

Payloads

Baseline
Compare

Histogram

Benchstone.BenchI.AddArray2.Test

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in PerfLabTests.DelegatePerf

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
DelegateInvoke - Duration of single invocation 389.91 μs 445.80 μs 1.14 0.04 False

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'PerfLabTests.DelegatePerf*'

Payloads

Baseline
Compare

Histogram

PerfLabTests.DelegatePerf.DelegateInvoke

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in MicroBenchmarks.Serializers.Xml_ToStream<IndexViewModel>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
DataContractSerializer_ - Duration of single invocation 77.58 μs 118.02 μs 1.52 0.03 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'MicroBenchmarks.Serializers.Xml_ToStream&lt;IndexViewModel&gt;*'

Payloads

Baseline
Compare

Histogram

MicroBenchmarks.Serializers.Xml_ToStream<IndexViewModel>.DataContractSerializer_

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline e363f9acfa1811904eaf9ce017120b8385a58443
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in Benchstone.BenchI.IniArray

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Test - Duration of single invocation 50.61 ms 168.62 ms 3.33 0.15 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'Benchstone.BenchI.IniArray*'

Payloads

Baseline
Compare

Histogram

Benchstone.BenchI.IniArray.Test

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Threading.Channels.Tests.UnboundedChannelPerfTests

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
WriteAsyncThenReadAsync - Duration of single invocation 58.31 ns 65.47 ns 1.12 0.07 False
TryWriteThenTryRead - Duration of single invocation 25.71 ns 27.92 ns 1.09 0.14 False

graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Threading.Channels.Tests.UnboundedChannelPerfTests*'

Payloads

Baseline
Compare

Histogram

System.Threading.Channels.Tests.UnboundedChannelPerfTests.WriteAsyncThenReadAsync

System.Threading.Channels.Tests.UnboundedChannelPerfTests.TryWriteThenTryRead

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in MicroBenchmarks.Serializers.Xml_ToStream<SimpleStructWithProperties>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
DataContractSerializer_ - Duration of single invocation 1.05 μs 1.29 μs 1.23 0.02 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'MicroBenchmarks.Serializers.Xml_ToStream&lt;SimpleStructWithProperties&gt;*'

Payloads

Baseline
Compare

Histogram

MicroBenchmarks.Serializers.Xml_ToStream<SimpleStructWithProperties>.DataContractSerializer_

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in MicroBenchmarks.Serializers.Json_FromStream<IndexViewModel>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
DataContractJsonSerializer_ - Duration of single invocation 387.65 μs 428.30 μs 1.10 0.01 False
JsonNet_ - Duration of single invocation 86.30 μs 105.00 μs 1.22 0.02 True

graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'MicroBenchmarks.Serializers.Json_FromStream&lt;IndexViewModel&gt;*'

Payloads

Baseline
Compare

Histogram

MicroBenchmarks.Serializers.Json_FromStream<IndexViewModel>.DataContractJsonSerializer_

MicroBenchmarks.Serializers.Json_FromStream<IndexViewModel>.JsonNet_

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in Benchstone.BenchI.EightQueens

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Test - Duration of single invocation 2.26 μs 3.10 μs 1.37 0.06 False

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'Benchstone.BenchI.EightQueens*'

Payloads

Baseline
Compare

Histogram

Benchstone.BenchI.EightQueens.Test

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Collections.CtorDefaultSize<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
ConcurrentQueue - Duration of single invocation 95.00 ns 172.49 ns 1.82 0.05 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Collections.CtorDefaultSize&lt;Int32&gt;*'

Payloads

Baseline
Compare

Histogram

System.Collections.CtorDefaultSize<Int32>.ConcurrentQueue

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in BenchmarksGame.FannkuchRedux_9

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
RunBench - Duration of single invocation 161.90 ms 178.79 ms 1.10 0.00 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'BenchmarksGame.FannkuchRedux_9*'

Payloads

Baseline
Compare

Histogram

BenchmarksGame.FannkuchRedux_9.RunBench(n: 11, expectedSum: 556355)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in Benchstone.BenchI.BubbleSort

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Test - Duration of single invocation 14.88 μs 28.52 μs 1.92 0.06 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'Benchstone.BenchI.BubbleSort*'

Payloads

Baseline
Compare

Histogram

Benchstone.BenchI.BubbleSort.Test

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in MicroBenchmarks.Serializers.Xml_ToStream<MyEventsListerViewModel>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
DataContractSerializer_ - Duration of single invocation 890.54 μs 1.13 ms 1.27 0.01 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'MicroBenchmarks.Serializers.Xml_ToStream&lt;MyEventsListerViewModel&gt;*'

Payloads

Baseline
Compare

Histogram

MicroBenchmarks.Serializers.Xml_ToStream<MyEventsListerViewModel>.DataContractSerializer_

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Text.Json.Serialization.Tests.ReadJson<LoginViewModel>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
DeserializeFromUtf8Bytes - Duration of single invocation 621.47 ns 654.17 ns 1.05 0.08 False

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Text.Json.Serialization.Tests.ReadJson&lt;LoginViewModel&gt;*'

Payloads

Baseline
Compare

Histogram

System.Text.Json.Serialization.Tests.ReadJson<LoginViewModel>.DeserializeFromUtf8Bytes

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Security.Cryptography.Tests.Perf_Rfc2898DeriveBytes

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
DeriveBytes - Duration of single invocation 2.04 ms 2.27 ms 1.11 0.02 False

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Security.Cryptography.Tests.Perf_Rfc2898DeriveBytes*'

Payloads

Baseline
Compare

Histogram

System.Security.Cryptography.Tests.Perf_Rfc2898DeriveBytes.DeriveBytes

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare d0a09199f8bf30cb3e3f46654117aeae1f72cd99
Diff Diff

Regressions in Benchstone.BenchF.NewtR

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Test - Duration of single invocation 245.14 ms 319.17 ms 1.30 0.05 False

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'Benchstone.BenchF.NewtR*'

Payloads

Baseline
Compare

Histogram

Benchstone.BenchF.NewtR.Test

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler
Copy link
Author

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Collections.CtorFromCollection<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
SortedDictionary - Duration of single invocation 74.02 μs 77.97 μs 1.05 0.00 False
SortedList - Duration of single invocation 8.88 μs 16.06 μs 1.81 0.02 True
ConcurrentDictionary - Duration of single invocation 49.59 μs 58.42 μs 1.18 0.01 True
Dictionary - Duration of single invocation 3.03 μs 3.55 μs 1.17 0.56 False
ImmutableSortedDictionary - Duration of single invocation 90.82 μs 95.71 μs 1.05 0.01 False
ConcurrentQueue - Duration of single invocation 5.12 μs 6.92 μs 1.35 0.15 True

graph
graph
graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Collections.CtorFromCollection&lt;Int32&gt;*'

Payloads

Baseline
Compare

Histogram

System.Collections.CtorFromCollection<Int32>.SortedDictionary(Size: 512)

System.Collections.CtorFromCollection<Int32>.SortedList(Size: 512)

System.Collections.CtorFromCollection<Int32>.ConcurrentDictionary(Size: 512)

System.Collections.CtorFromCollection<Int32>.Dictionary(Size: 512)

System.Collections.CtorFromCollection<Int32>.ImmutableSortedDictionary(Size: 512)

System.Collections.CtorFromCollection<Int32>.ConcurrentQueue(Size: 512)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information
Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in Benchstone.BenchF.MatInv4

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Test - Duration of single invocation 2.51 ms 3.48 ms 1.39 0.57 False

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'Benchstone.BenchF.MatInv4*'

Payloads

Baseline
Compare

Histogram

Benchstone.BenchF.MatInv4.Test

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Collections.Concurrent.IsEmpty<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Dictionary - Duration of single invocation 181.66 ns 235.65 ns 1.30 0.01 True
Queue - Duration of single invocation 5.42 ns 8.11 ns 1.50 0.06 True
Queue - Duration of single invocation 4.95 ns 6.63 ns 1.34 0.12 True
Dictionary - Duration of single invocation 2.80 ns 4.27 ns 1.52 0.30 False

graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Collections.Concurrent.IsEmpty&lt;Int32&gt;*'

Payloads

Baseline
Compare

Histogram

System.Collections.Concurrent.IsEmpty<Int32>.Dictionary(Size: 0)

System.Collections.Concurrent.IsEmpty<Int32>.Queue(Size: 0)

System.Collections.Concurrent.IsEmpty<Int32>.Queue(Size: 512)

System.Collections.Concurrent.IsEmpty<Int32>.Dictionary(Size: 512)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Tests.Perf_HashCode

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Combine_8 - Duration of single invocation 103.01 μs 122.48 μs 1.19 0.00 True
Combine_4 - Duration of single invocation 78.18 μs 98.34 μs 1.26 0.00 True
Combine_6 - Duration of single invocation 105.79 μs 123.71 μs 1.17 0.00 True
Combine_7 - Duration of single invocation 116.93 μs 137.85 μs 1.18 0.00 True
Combine_5 - Duration of single invocation 90.46 μs 111.02 μs 1.23 0.00 True
Combine_3 - Duration of single invocation 86.33 μs 105.82 μs 1.23 0.00 True
Combine_2 - Duration of single invocation 72.38 μs 91.88 μs 1.27 0.00 True
Combine_1 - Duration of single invocation 58.49 μs 77.96 μs 1.33 0.00 True

graph
graph
graph
graph
graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Tests.Perf_HashCode*'

Payloads

Baseline
Compare

Histogram

System.Tests.Perf_HashCode.Combine_8

System.Tests.Perf_HashCode.Combine_4

System.Tests.Perf_HashCode.Combine_6

System.Tests.Perf_HashCode.Combine_7

System.Tests.Perf_HashCode.Combine_5

System.Tests.Perf_HashCode.Combine_3

System.Tests.Perf_HashCode.Combine_2

System.Tests.Perf_HashCode.Combine_1

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in BenchmarksGame.BinaryTrees_5

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
RunBench - Duration of single invocation 100.18 ms 147.65 ms 1.47 0.01 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'BenchmarksGame.BinaryTrees_5*'

Payloads

Baseline
Compare

Histogram

BenchmarksGame.BinaryTrees_5.RunBench

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Collections.ContainsTrue<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Span - Duration of single invocation 43.99 μs 83.32 μs 1.89 0.02 True
SortedSet - Duration of single invocation 25.06 μs 30.28 μs 1.21 0.05 False
HashSet - Duration of single invocation 2.88 μs 3.44 μs 1.19 0.06 True
ImmutableHashSet - Duration of single invocation 17.47 μs 20.33 μs 1.16 0.27 False
LinkedList - Duration of single invocation 152.01 μs 191.84 μs 1.26 0.00 True

graph
graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Collections.ContainsTrue&lt;Int32&gt;*'

Payloads

Baseline
Compare

Histogram

System.Collections.ContainsTrue<Int32>.Span(Size: 512)

System.Collections.ContainsTrue<Int32>.SortedSet(Size: 512)

System.Collections.ContainsTrue<Int32>.HashSet(Size: 512)

System.Collections.ContainsTrue<Int32>.ImmutableHashSet(Size: 512)

System.Collections.ContainsTrue<Int32>.LinkedList(Size: 512)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Collections.IndexerSet<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Array - Duration of single invocation 199.22 ns 1.29 μs 6.47 0.00 True
IList - Duration of single invocation 2.00 μs 2.29 μs 1.14 0.07 False
Dictionary - Duration of single invocation 3.77 μs 5.13 μs 1.36 0.02 True
Span - Duration of single invocation 188.93 ns 1.80 μs 9.51 0.00 True
List - Duration of single invocation 994.30 ns 1.49 μs 1.50 0.00 True

graph
graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Collections.IndexerSet&lt;Int32&gt;*'

Payloads

Baseline
Compare

Histogram

System.Collections.IndexerSet<Int32>.Array(Size: 512)

System.Collections.IndexerSet<Int32>.IList(Size: 512)

System.Collections.IndexerSet<Int32>.Dictionary(Size: 512)

System.Collections.IndexerSet<Int32>.Span(Size: 512)

System.Collections.IndexerSet<Int32>.List(Size: 512)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Buffers.Text.Tests.Base64EncodeDecodeInPlaceTests

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Base64EncodeInPlace - Duration of single invocation 149.94 ms 296.71 ms 1.98 0.00 True
Base64DecodeInPlace - Duration of single invocation 149.19 ms 326.40 ms 2.19 0.01 True

graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Buffers.Text.Tests.Base64EncodeDecodeInPlaceTests*'

Payloads

Baseline
Compare

Histogram

System.Buffers.Text.Tests.Base64EncodeDecodeInPlaceTests.Base64EncodeInPlace(NumberOfBytes: 200000000)

System.Buffers.Text.Tests.Base64EncodeDecodeInPlaceTests.Base64DecodeInPlace(NumberOfBytes: 200000000)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Collections.CreateAddAndClear<String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Span - Duration of single invocation 1.80 μs 2.32 μs 1.29 0.38 False
Array - Duration of single invocation 2.15 μs 2.32 μs 1.08 0.33 False

graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Collections.CreateAddAndClear&lt;String&gt;*'

Payloads

Baseline
Compare

Histogram

System.Collections.CreateAddAndClear<String>.Span(Size: 512)

System.Collections.CreateAddAndClear<String>.Array(Size: 512)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in MicroBenchmarks.Serializers.Xml_FromStream<Location>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
DataContractSerializer_ - Duration of single invocation 7.55 μs 8.76 μs 1.16 0.02 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'MicroBenchmarks.Serializers.Xml_FromStream&lt;Location&gt;*'

Payloads

Baseline
Compare

Histogram

MicroBenchmarks.Serializers.Xml_FromStream<Location>.DataContractSerializer_

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in Benchstone.BenchF.Regula

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Test - Duration of single invocation 220.06 ms 397.02 ms 1.80 0.01 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'Benchstone.BenchF.Regula*'

Payloads

Baseline
Compare

Histogram

Benchstone.BenchF.Regula.Test

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Text.Json.Tests.Perf_Deep

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
WriteDeepUtf16 - Duration of single invocation 4.61 ms 5.13 ms 1.11 0.14 False
WriteDeepUtf8 - Duration of single invocation 4.64 ms 5.24 ms 1.13 0.30 False
WriteDeepUtf16 - Duration of single invocation 4.82 ms 5.46 ms 1.13 0.23 False
WriteDeepUtf8 - Duration of single invocation 4.30 ms 5.21 ms 1.21 0.05 False

graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Text.Json.Tests.Perf_Deep*'

Payloads

Baseline
Compare

Histogram

System.Text.Json.Tests.Perf_Deep.WriteDeepUtf16(Formatted: False, SkipValidation: True)

System.Text.Json.Tests.Perf_Deep.WriteDeepUtf8(Formatted: False, SkipValidation: False)

System.Text.Json.Tests.Perf_Deep.WriteDeepUtf16(Formatted: False, SkipValidation: False)

System.Text.Json.Tests.Perf_Deep.WriteDeepUtf8(Formatted: False, SkipValidation: True)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in JetStream.TimeSeriesSegmentation

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
MaximizeSchwarzCriterion - Duration of single invocation 81.85 ms 108.44 ms 1.32 0.04 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'JetStream.TimeSeriesSegmentation*'

Payloads

Baseline
Compare

Histogram

JetStream.TimeSeriesSegmentation.MaximizeSchwarzCriterion

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in GuardedDevirtualization.TwoClassVirtual

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Call - Duration of single invocation 4.57 ns 6.28 ns 1.38 0.03 True
Call - Duration of single invocation 6.09 ns 8.32 ns 1.37 0.00 True
Call - Duration of single invocation 4.05 ns 5.60 ns 1.38 0.05 False
Call - Duration of single invocation 6.74 ns 9.27 ns 1.38 0.01 True
Call - Duration of single invocation 5.90 ns 8.12 ns 1.37 0.01 True
Call - Duration of single invocation 6.48 ns 8.89 ns 1.37 0.01 True
Call - Duration of single invocation 5.54 ns 7.60 ns 1.37 0.00 True
Call - Duration of single invocation 6.68 ns 9.20 ns 1.38 0.01 True
Call - Duration of single invocation 6.49 ns 8.95 ns 1.38 0.01 True

graph
graph
graph
graph
graph
graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'GuardedDevirtualization.TwoClassVirtual*'

Payloads

Baseline
Compare

Histogram

GuardedDevirtualization.TwoClassVirtual.Call(testInput: pB = 0.10)

GuardedDevirtualization.TwoClassVirtual.Call(testInput: pB = 0.70)

GuardedDevirtualization.TwoClassVirtual.Call(testInput: pB = 0.90)

GuardedDevirtualization.TwoClassVirtual.Call(testInput: pB = 0.40)

GuardedDevirtualization.TwoClassVirtual.Call(testInput: pB = 0.20)

GuardedDevirtualization.TwoClassVirtual.Call(testInput: pB = 0.60)

GuardedDevirtualization.TwoClassVirtual.Call(testInput: pB = 0.80)

GuardedDevirtualization.TwoClassVirtual.Call(testInput: pB = 0.50)

GuardedDevirtualization.TwoClassVirtual.Call(testInput: pB = 0.30)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in Benchstone.BenchF.InvMt

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Test - Duration of single invocation 1.88 ms 3.86 ms 2.05 0.00 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'Benchstone.BenchF.InvMt*'

Payloads

Baseline
Compare

Histogram

Benchstone.BenchF.InvMt.Test

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Collections.ContainsKeyFalse<String, String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
ConcurrentDictionary - Duration of single invocation 14.06 μs 15.56 μs 1.11 0.00 True
ImmutableDictionary - Duration of single invocation 20.71 μs 24.29 μs 1.17 0.12 False

graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Collections.ContainsKeyFalse&lt;String, String&gt;*'

Payloads

Baseline
Compare

Histogram

System.Collections.ContainsKeyFalse<String, String>.ConcurrentDictionary(Size: 512)

System.Collections.ContainsKeyFalse<String, String>.ImmutableDictionary(Size: 512)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler
Copy link
Author

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Text.Json.Tests.Perf_Segment

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
ReadMultiSegmentSequence - Duration of single invocation 119.61 μs 132.63 μs 1.11 0.05 False
ReadMultiSegmentSequence - Duration of single invocation 119.81 μs 136.46 μs 1.14 0.04 False
ReadSingleSegmentSequence - Duration of single invocation 1.13 ms 1.32 ms 1.17 0.04 False
ReadMultiSegmentSequenceUsingSpan - Duration of single invocation 108.61 μs 133.01 μs 1.22 0.06 False
ReadSingleSegmentSequenceByN - Duration of single invocation 1.13 ms 1.28 ms 1.13 0.07 False
ReadSingleSegmentSequenceByN - Duration of single invocation 108.77 μs 121.65 μs 1.12 0.05 False
ReadSingleSegmentSequenceByN - Duration of single invocation 109.78 μs 122.38 μs 1.11 0.06 False
ReadSingleSegmentSequenceByN - Duration of single invocation 1.09 ms 1.25 ms 1.15 0.06 False
ReadMultiSegmentSequence - Duration of single invocation 10.10 μs 12.11 μs 1.20 0.06 False
ReadMultiSegmentSequence - Duration of single invocation 1.17 ms 1.37 ms 1.18 0.04 False
ReadMultiSegmentSequence - Duration of single invocation 1.15 ms 1.38 ms 1.19 0.05 False
ReadMultiSegmentSequenceUsingSpan - Duration of single invocation 1.11 ms 1.37 ms 1.24 0.05 False
ReadMultiSegmentSequenceUsingSpan - Duration of single invocation 10.05 μs 12.45 μs 1.24 0.08 False
ReadMultiSegmentSequenceUsingSpan - Duration of single invocation 109.12 μs 134.13 μs 1.23 0.06 False
ReadMultiSegmentSequenceUsingSpan - Duration of single invocation 10.12 μs 12.37 μs 1.22 0.05 False
ReadSingleSegmentSequenceByN - Duration of single invocation 10.38 μs 11.35 μs 1.09 0.07 False
ReadSingleSegmentSequence - Duration of single invocation 111.11 μs 127.82 μs 1.15 0.04 False
ReadSingleSegmentSequence - Duration of single invocation 10.42 μs 11.71 μs 1.12 0.06 False
ReadMultiSegmentSequenceUsingSpan - Duration of single invocation 1.13 ms 1.35 ms 1.20 0.06 False
ReadSingleSegmentSequenceByN - Duration of single invocation 10.05 μs 11.13 μs 1.11 0.07 False
ReadMultiSegmentSequence - Duration of single invocation 10.90 μs 13.32 μs 1.22 0.04 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Text.Json.Tests.Perf_Segment*'

Payloads

Baseline
Compare

Histogram

System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequence(segmentSize: 4096, TestCase: Json40KB)

System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequence(segmentSize: 8192, TestCase: Json40KB)

System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequence(TestCase: Json400KB)

System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequenceUsingSpan(segmentSize: 8192, TestCase: Json40KB)

System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequenceByN(numberOfBytes: 4096, TestCase: Json400KB)

System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequenceByN(numberOfBytes: 8192, TestCase: Json40KB)

System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequenceByN(numberOfBytes: 4096, TestCase: Json40KB)

System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequenceByN(numberOfBytes: 8192, TestCase: Json400KB)

System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequence(segmentSize: 8192, TestCase: Json4KB)

System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequence(segmentSize: 4096, TestCase: Json400KB)

System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequence(segmentSize: 8192, TestCase: Json400KB)

System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequenceUsingSpan(segmentSize: 4096, TestCase: Json400KB)

System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequenceUsingSpan(segmentSize: 4096, TestCase: Json4KB)

System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequenceUsingSpan(segmentSize: 4096, TestCase: Json40KB)

System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequenceUsingSpan(segmentSize: 8192, TestCase: Json4KB)

System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequenceByN(numberOfBytes: 4096, TestCase: Json4KB)

System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequence(TestCase: Json40KB)

System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequence(TestCase: Json4KB)

System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequenceUsingSpan(segmentSize: 8192, TestCase: Json400KB)

System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequenceByN(numberOfBytes: 8192, TestCase: Json4KB)

System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequence(segmentSize: 4096, TestCase: Json4KB)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information
Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Numerics.Tests.Perf_BitOperations

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Log2_uint - Duration of single invocation 683.86 ns 2.21 μs 3.24 0.00 True
LeadingZeroCount_ulong - Duration of single invocation 636.12 ns 2.22 μs 3.49 0.00 True
TrailingZeroCount_uint - Duration of single invocation 640.84 ns 2.23 μs 3.48 0.00 True
TrailingZeroCount_ulong - Duration of single invocation 641.51 ns 2.23 μs 3.47 0.00 True
PopCount_uint - Duration of single invocation 636.24 ns 2.22 μs 3.49 0.00 True
Log2_ulong - Duration of single invocation 684.16 ns 2.21 μs 3.23 0.00 True
PopCount_ulong - Duration of single invocation 636.19 ns 2.22 μs 3.50 0.00 True
LeadingZeroCount_uint - Duration of single invocation 640.24 ns 2.22 μs 3.47 0.00 True

graph
graph
graph
graph
graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Numerics.Tests.Perf_BitOperations*'

Payloads

Baseline
Compare

Histogram

System.Numerics.Tests.Perf_BitOperations.Log2_uint

System.Numerics.Tests.Perf_BitOperations.LeadingZeroCount_ulong

System.Numerics.Tests.Perf_BitOperations.TrailingZeroCount_uint

System.Numerics.Tests.Perf_BitOperations.TrailingZeroCount_ulong

System.Numerics.Tests.Perf_BitOperations.PopCount_uint

System.Numerics.Tests.Perf_BitOperations.Log2_ulong

System.Numerics.Tests.Perf_BitOperations.PopCount_ulong

System.Numerics.Tests.Perf_BitOperations.LeadingZeroCount_uint

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline e363f9acfa1811904eaf9ce017120b8385a58443
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Text.Tests.Perf_StringBuilder

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Append_Char_Capacity - Duration of single invocation 299.36 ns 554.24 ns 1.85 0.03 True
Append_Char_Capacity - Duration of single invocation 278.42 μs 378.85 μs 1.36 0.16 False
Append_Char - Duration of single invocation 339.64 ns 420.38 ns 1.24 0.05 False
ctor_capacity - Duration of single invocation 3.50 μs 3.78 μs 1.08 0.02 False

graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Text.Tests.Perf_StringBuilder*'

Payloads

Baseline
Compare

Histogram

System.Text.Tests.Perf_StringBuilder.Append_Char_Capacity(length: 100)

System.Text.Tests.Perf_StringBuilder.Append_Char_Capacity(length: 100000)

System.Text.Tests.Perf_StringBuilder.Append_Char(length: 100)

System.Text.Tests.Perf_StringBuilder.ctor_capacity(length: 100000)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in PerfLabTests.LowLevelPerf

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
StaticIntPlus - Duration of single invocation 194.95 μs 222.75 μs 1.14 0.00 True
TypeReflectionArrayGetType - Duration of single invocation 167.07 μs 250.22 μs 1.50 0.10 False
ObjectStringIsString - Duration of single invocation 80.46 μs 90.16 μs 1.12 0.00 False
GenericClassGenericStaticField - Duration of single invocation 27.87 μs 226.78 μs 8.14 0.00 True
GenericClassWithSTringGenericInstanceMethod - Duration of single invocation 194.96 μs 230.24 μs 1.18 0.09 False
InstanceDelegate - Duration of single invocation 223.12 μs 244.05 μs 1.09 0.01 True
TypeReflectionObjectGetType - Duration of single invocation 167.19 μs 246.52 μs 1.47 0.10 False
ForeachOverList100Elements - Duration of single invocation 11.81 ms 20.63 ms 1.75 0.06 False
GenericClassWithIntGenericInstanceField - Duration of single invocation 34.82 μs 232.12 μs 6.67 0.05 True

graph
graph
graph
graph
graph
graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'PerfLabTests.LowLevelPerf*'

Payloads

Baseline
Compare

Histogram

PerfLabTests.LowLevelPerf.StaticIntPlus

PerfLabTests.LowLevelPerf.TypeReflectionArrayGetType

PerfLabTests.LowLevelPerf.ObjectStringIsString

PerfLabTests.LowLevelPerf.GenericClassGenericStaticField

PerfLabTests.LowLevelPerf.GenericClassWithSTringGenericInstanceMethod

PerfLabTests.LowLevelPerf.InstanceDelegate

PerfLabTests.LowLevelPerf.TypeReflectionObjectGetType

PerfLabTests.LowLevelPerf.ForeachOverList100Elements

PerfLabTests.LowLevelPerf.GenericClassWithIntGenericInstanceField

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in Benchstone.BenchI.XposMatrix

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Test - Duration of single invocation 15.09 μs 30.31 μs 2.01 0.10 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'Benchstone.BenchI.XposMatrix*'

Payloads

Baseline
Compare

Histogram

Benchstone.BenchI.XposMatrix.Test

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Collections.Tests.Perf_BitArray

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
BitArrayOr - Duration of single invocation 10.21 ns 37.57 ns 3.68 0.12 True
BitArrayByteArrayCtor - Duration of single invocation 10.58 ns 11.60 ns 1.10 0.13 False
BitArrayOr - Duration of single invocation 2.51 ns 4.01 ns 1.60 0.08 True
BitArraySet - Duration of single invocation 6.13 ns 8.97 ns 1.46 0.01 True
BitArraySetLengthShrink - Duration of single invocation 13.62 ns 15.56 ns 1.14 0.07 False
BitArrayGet - Duration of single invocation 3.73 μs 10.28 μs 2.76 0.00 True
BitArrayLeftShift - Duration of single invocation 4.18 ns 6.39 ns 1.53 0.20 False
BitArrayLeftShift - Duration of single invocation 246.59 ns 262.18 ns 1.06 0.02 False
BitArrayCopyToByteArray - Duration of single invocation 99.25 ns 369.08 ns 3.72 0.03 True
BitArrayCopyToBoolArray - Duration of single invocation 14.19 ns 22.02 ns 1.55 0.47 False
BitArrayAnd - Duration of single invocation 2.53 ns 4.11 ns 1.63 0.09 True
BitArrayLengthValueCtor - Duration of single invocation 13.38 ns 14.87 ns 1.11 0.14 False
BitArrayCopyToIntArray - Duration of single invocation 15.90 ns 19.03 ns 1.20 0.06 False
BitArrayBoolArrayCtor - Duration of single invocation 12.62 ns 15.58 ns 1.23 0.14 False
BitArrayCopyToByteArray - Duration of single invocation 8.91 ns 17.94 ns 2.01 0.28 False
BitArrayCopyToBoolArray - Duration of single invocation 138.72 ns 437.87 ns 3.16 0.05 True
BitArrayBoolArrayCtor - Duration of single invocation 42.94 ns 65.22 ns 1.52 0.04 True
BitArrayAnd - Duration of single invocation 10.20 ns 37.95 ns 3.72 0.13 True
BitArrayRightShift - Duration of single invocation 5.44 ns 7.02 ns 1.29 0.06 False
BitArrayGet - Duration of single invocation 28.99 ns 70.55 ns 2.43 0.01 True
BitArraySetLengthShrink - Duration of single invocation 144.81 ns 239.42 ns 1.65 0.03 True
BitArrayRightShift - Duration of single invocation 248.41 ns 376.20 ns 1.51 0.00 True
BitArrayCopyToIntArray - Duration of single invocation 8.64 ns 10.21 ns 1.18 0.07 False
BitArrayXor - Duration of single invocation 2.51 ns 4.31 ns 1.72 0.12 True
BitArraySet - Duration of single invocation 995.88 ns 1.54 μs 1.55 0.00 True
BitArrayNot - Duration of single invocation 8.00 ns 23.23 ns 2.90 0.16 True
BitArrayByteArrayCtor - Duration of single invocation 140.93 ns 288.98 ns 2.05 0.04 True
BitArrayXor - Duration of single invocation 12.86 ns 37.78 ns 2.94 0.17 True
BitArraySetLengthGrow - Duration of single invocation 213.34 ns 338.01 ns 1.58 0.04 True
BitArraySetAll - Duration of single invocation 8.15 ns 19.69 ns 2.42 0.05 True

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Collections.Tests.Perf_BitArray*'

Payloads

Baseline
Compare

Histogram

System.Collections.Tests.Perf_BitArray.BitArrayOr(Size: 512)

System.Collections.Tests.Perf_BitArray.BitArrayByteArrayCtor(Size: 4)

System.Collections.Tests.Perf_BitArray.BitArrayOr(Size: 4)

System.Collections.Tests.Perf_BitArray.BitArraySet(Size: 4)

System.Collections.Tests.Perf_BitArray.BitArraySetLengthShrink(Size: 4)

System.Collections.Tests.Perf_BitArray.BitArrayGet(Size: 512)

System.Collections.Tests.Perf_BitArray.BitArrayLeftShift(Size: 4)

System.Collections.Tests.Perf_BitArray.BitArrayLeftShift(Size: 512)

System.Collections.Tests.Perf_BitArray.BitArrayCopyToByteArray(Size: 512)

System.Collections.Tests.Perf_BitArray.BitArrayCopyToBoolArray(Size: 4)

System.Collections.Tests.Perf_BitArray.BitArrayAnd(Size: 4)

System.Collections.Tests.Perf_BitArray.BitArrayLengthValueCtor(Size: 4)

System.Collections.Tests.Perf_BitArray.BitArrayCopyToIntArray(Size: 512)

System.Collections.Tests.Perf_BitArray.BitArrayBoolArrayCtor(Size: 4)

System.Collections.Tests.Perf_BitArray.BitArrayCopyToByteArray(Size: 4)

System.Collections.Tests.Perf_BitArray.BitArrayCopyToBoolArray(Size: 512)

System.Collections.Tests.Perf_BitArray.BitArrayBoolArrayCtor(Size: 512)

System.Collections.Tests.Perf_BitArray.BitArrayAnd(Size: 512)

System.Collections.Tests.Perf_BitArray.BitArrayRightShift(Size: 4)

System.Collections.Tests.Perf_BitArray.BitArrayGet(Size: 4)

System.Collections.Tests.Perf_BitArray.BitArraySetLengthShrink(Size: 512)

System.Collections.Tests.Perf_BitArray.BitArrayRightShift(Size: 512)

System.Collections.Tests.Perf_BitArray.BitArrayCopyToIntArray(Size: 4)

System.Collections.Tests.Perf_BitArray.BitArrayXor(Size: 4)

System.Collections.Tests.Perf_BitArray.BitArraySet(Size: 512)

System.Collections.Tests.Perf_BitArray.BitArrayNot(Size: 512)

System.Collections.Tests.Perf_BitArray.BitArrayByteArrayCtor(Size: 512)

System.Collections.Tests.Perf_BitArray.BitArrayXor(Size: 512)

System.Collections.Tests.Perf_BitArray.BitArraySetLengthGrow(Size: 512)

System.Collections.Tests.Perf_BitArray.BitArraySetAll(Size: 512)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler
Copy link
Author

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Text.Json.Tests.Perf_Reader

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
ReadSingleSpanSequenceEmptyLoop - Duration of single invocation 9.26 μs 12.55 μs 1.36 0.07 False
ReadMultiSpanSequenceEmptyLoop - Duration of single invocation 7.08 μs 8.40 μs 1.19 0.02 False
ReadReturnBytes - Duration of single invocation 10.79 μs 13.77 μs 1.28 0.05 False
ReadSpanEmptyLoop - Duration of single invocation 4.28 μs 4.75 μs 1.11 0.04 False
ReadReturnBytes - Duration of single invocation 1.29 μs 1.64 μs 1.27 0.05 False
ReadReturnBytes - Duration of single invocation 158.60 ns 178.13 ns 1.12 0.06 False
ReadReturnBytes - Duration of single invocation 17.33 μs 20.93 μs 1.21 0.07 False
ReadMultiSpanSequenceEmptyLoop - Duration of single invocation 1.74 μs 1.93 μs 1.11 0.07 False
ReadSingleSpanSequenceEmptyLoop - Duration of single invocation 2.46 μs 2.92 μs 1.19 0.14 False
ReadMultiSpanSequenceEmptyLoop - Duration of single invocation 10.47 μs 12.80 μs 1.22 0.08 False
ReadReturnBytes - Duration of single invocation 12.34 μs 14.90 μs 1.21 0.05 False
ReadReturnBytes - Duration of single invocation 7.71 μs 9.11 μs 1.18 0.03 False
ReadSingleSpanSequenceEmptyLoop - Duration of single invocation 1.57 μs 1.81 μs 1.15 0.08 False
ReadSingleSpanSequenceEmptyLoop - Duration of single invocation 9.45 μs 11.51 μs 1.22 0.06 False
ReadMultiSpanSequenceEmptyLoop - Duration of single invocation 1.06 μs 1.26 μs 1.18 0.04 False
ReadReturnBytes - Duration of single invocation 10.36 μs 13.71 μs 1.32 0.07 False
ReadSingleSpanSequenceEmptyLoop - Duration of single invocation 4.40 μs 4.95 μs 1.13 0.04 False
ReadMultiSpanSequenceEmptyLoop - Duration of single invocation 2.65 μs 3.23 μs 1.22 0.10 False
ReadSingleSpanSequenceEmptyLoop - Duration of single invocation 887.66 ns 1.10 μs 1.24 0.04 False
ReadMultiSpanSequenceEmptyLoop - Duration of single invocation 4.78 μs 5.50 μs 1.15 0.16 False
ReadSpanEmptyLoop - Duration of single invocation 2.57 μs 2.94 μs 1.15 0.14 False
ReadSingleSpanSequenceEmptyLoop - Duration of single invocation 3.92 μs 4.40 μs 1.12 0.11 False
ReadReturnBytes - Duration of single invocation 88.09 μs 101.99 μs 1.16 0.01 True
ReadReturnBytes - Duration of single invocation 5.23 μs 5.69 μs 1.09 0.02 False
ReadReturnBytes - Duration of single invocation 116.83 μs 148.54 μs 1.27 0.05 False
ReadSpanEmptyLoop - Duration of single invocation 1.20 μs 1.39 μs 1.16 0.07 False
ReadReturnBytes - Duration of single invocation 2.92 μs 3.57 μs 1.22 0.12 False
ReadMultiSpanSequenceEmptyLoop - Duration of single invocation 75.36 μs 92.14 μs 1.22 0.02 True
ReadMultiSpanSequenceEmptyLoop - Duration of single invocation 1.39 μs 1.63 μs 1.17 0.05 False
ReadSingleSpanSequenceEmptyLoop - Duration of single invocation 100.39 μs 127.62 μs 1.27 0.05 False
ReadSingleSpanSequenceEmptyLoop - Duration of single invocation 71.28 μs 86.87 μs 1.22 0.03 True
ReadReturnBytes - Duration of single invocation 133.64 ns 144.14 ns 1.08 0.08 False
ReadMultiSpanSequenceEmptyLoop - Duration of single invocation 113.28 μs 139.50 μs 1.23 0.04 False
ReadSpanEmptyLoop - Duration of single invocation 16.11 μs 17.90 μs 1.11 0.09 False
ReadSingleSpanSequenceEmptyLoop - Duration of single invocation 14.85 μs 18.09 μs 1.22 0.06 False
ReadReturnBytes - Duration of single invocation 3.47 μs 4.03 μs 1.16 0.09 False
ReadMultiSpanSequenceEmptyLoop - Duration of single invocation 10.54 μs 13.37 μs 1.27 0.06 False
ReadSpanEmptyLoop - Duration of single invocation 108.47 μs 122.23 μs 1.13 0.08 False
ReadMultiSpanSequenceEmptyLoop - Duration of single invocation 17.57 μs 20.19 μs 1.15 0.08 False
ReadSingleSpanSequenceEmptyLoop - Duration of single invocation 10.02 μs 11.28 μs 1.13 0.06 False
ReadMultiSpanSequenceEmptyLoop - Duration of single invocation 211.70 ns 232.88 ns 1.10 0.04 False
ReadSpanEmptyLoop - Duration of single invocation 123.12 ns 152.91 ns 1.24 0.07 False
ReadReturnBytes - Duration of single invocation 4.57 μs 5.17 μs 1.13 0.06 False
ReadSpanEmptyLoop - Duration of single invocation 818.80 ns 1.07 μs 1.31 0.03 True
ReadSpanEmptyLoop - Duration of single invocation 10.12 μs 11.10 μs 1.10 0.07 False
ReadMultiSpanSequenceEmptyLoop - Duration of single invocation 11.01 μs 12.43 μs 1.13 0.03 False
ReadSingleSpanSequenceEmptyLoop - Duration of single invocation 1.16 μs 1.37 μs 1.18 0.04 False
ReadSpanEmptyLoop - Duration of single invocation 10.50 μs 12.26 μs 1.17 0.08 False
ReadSpanEmptyLoop - Duration of single invocation 9.91 μs 10.94 μs 1.10 0.07 False
ReadSpanEmptyLoop - Duration of single invocation 6.02 μs 7.62 μs 1.26 0.10 False
ReadSingleSpanSequenceEmptyLoop - Duration of single invocation 6.09 μs 7.83 μs 1.29 0.03 True
ReadReturnBytes - Duration of single invocation 1.04 μs 1.31 μs 1.27 0.05 True
ReadSpanEmptyLoop - Duration of single invocation 72.79 μs 84.97 μs 1.17 0.06 True

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Text.Json.Tests.Perf_Reader*'

Payloads

Baseline
Compare

Histogram

System.Text.Json.Tests.Perf_Reader.ReadSingleSpanSequenceEmptyLoop(IsDataCompact: False, TestCase: DeepTree)

System.Text.Json.Tests.Perf_Reader.ReadMultiSpanSequenceEmptyLoop(IsDataCompact: True, TestCase: Json4KB)

System.Text.Json.Tests.Perf_Reader.ReadReturnBytes(IsDataCompact: False, TestCase: Json4KB)

System.Text.Json.Tests.Perf_Reader.ReadSpanEmptyLoop(IsDataCompact: True, TestCase: DeepTree)

System.Text.Json.Tests.Perf_Reader.ReadReturnBytes(IsDataCompact: False, TestCase: Json400B)

System.Text.Json.Tests.Perf_Reader.ReadReturnBytes(IsDataCompact: False, TestCase: HelloWorld)

System.Text.Json.Tests.Perf_Reader.ReadReturnBytes(IsDataCompact: False, TestCase: BroadTree)

System.Text.Json.Tests.Perf_Reader.ReadMultiSpanSequenceEmptyLoop(IsDataCompact: True, TestCase: LotsOfStrings)

System.Text.Json.Tests.Perf_Reader.ReadSingleSpanSequenceEmptyLoop(IsDataCompact: False, TestCase: LotsOfStrings)

System.Text.Json.Tests.Perf_Reader.ReadMultiSpanSequenceEmptyLoop(IsDataCompact: False, TestCase: DeepTree)

System.Text.Json.Tests.Perf_Reader.ReadReturnBytes(IsDataCompact: True, TestCase: BroadTree)

System.Text.Json.Tests.Perf_Reader.ReadReturnBytes(IsDataCompact: True, TestCase: Json4KB)

System.Text.Json.Tests.Perf_Reader.ReadSingleSpanSequenceEmptyLoop(IsDataCompact: True, TestCase: LotsOfStrings)

System.Text.Json.Tests.Perf_Reader.ReadSingleSpanSequenceEmptyLoop(IsDataCompact: False, TestCase: Json4KB)

System.Text.Json.Tests.Perf_Reader.ReadMultiSpanSequenceEmptyLoop(IsDataCompact: True, TestCase: Json400B)

System.Text.Json.Tests.Perf_Reader.ReadReturnBytes(IsDataCompact: False, TestCase: DeepTree)

System.Text.Json.Tests.Perf_Reader.ReadSingleSpanSequenceEmptyLoop(IsDataCompact: True, TestCase: DeepTree)

System.Text.Json.Tests.Perf_Reader.ReadMultiSpanSequenceEmptyLoop(IsDataCompact: False, TestCase: LotsOfStrings)

System.Text.Json.Tests.Perf_Reader.ReadSingleSpanSequenceEmptyLoop(IsDataCompact: True, TestCase: Json400B)

System.Text.Json.Tests.Perf_Reader.ReadMultiSpanSequenceEmptyLoop(IsDataCompact: True, TestCase: DeepTree)

System.Text.Json.Tests.Perf_Reader.ReadSpanEmptyLoop(IsDataCompact: False, TestCase: LotsOfStrings)

System.Text.Json.Tests.Perf_Reader.ReadSingleSpanSequenceEmptyLoop(IsDataCompact: False, TestCase: LotsOfNumbers)

System.Text.Json.Tests.Perf_Reader.ReadReturnBytes(IsDataCompact: True, TestCase: Json40KB)

System.Text.Json.Tests.Perf_Reader.ReadReturnBytes(IsDataCompact: True, TestCase: DeepTree)

System.Text.Json.Tests.Perf_Reader.ReadReturnBytes(IsDataCompact: False, TestCase: Json40KB)

System.Text.Json.Tests.Perf_Reader.ReadSpanEmptyLoop(IsDataCompact: False, TestCase: Json400B)

System.Text.Json.Tests.Perf_Reader.ReadReturnBytes(IsDataCompact: False, TestCase: LotsOfStrings)

System.Text.Json.Tests.Perf_Reader.ReadMultiSpanSequenceEmptyLoop(IsDataCompact: True, TestCase: Json40KB)

System.Text.Json.Tests.Perf_Reader.ReadMultiSpanSequenceEmptyLoop(IsDataCompact: False, TestCase: Json400B)

System.Text.Json.Tests.Perf_Reader.ReadSingleSpanSequenceEmptyLoop(IsDataCompact: False, TestCase: Json40KB)

System.Text.Json.Tests.Perf_Reader.ReadSingleSpanSequenceEmptyLoop(IsDataCompact: True, TestCase: Json40KB)

System.Text.Json.Tests.Perf_Reader.ReadReturnBytes(IsDataCompact: True, TestCase: HelloWorld)

System.Text.Json.Tests.Perf_Reader.ReadMultiSpanSequenceEmptyLoop(IsDataCompact: False, TestCase: Json40KB)

System.Text.Json.Tests.Perf_Reader.ReadSpanEmptyLoop(IsDataCompact: False, TestCase: BroadTree)

System.Text.Json.Tests.Perf_Reader.ReadSingleSpanSequenceEmptyLoop(IsDataCompact: False, TestCase: BroadTree)

System.Text.Json.Tests.Perf_Reader.ReadReturnBytes(IsDataCompact: True, TestCase: LotsOfNumbers)

System.Text.Json.Tests.Perf_Reader.ReadMultiSpanSequenceEmptyLoop(IsDataCompact: False, TestCase: Json4KB)

System.Text.Json.Tests.Perf_Reader.ReadSpanEmptyLoop(IsDataCompact: False, TestCase: Json40KB)

System.Text.Json.Tests.Perf_Reader.ReadMultiSpanSequenceEmptyLoop(IsDataCompact: False, TestCase: BroadTree)

System.Text.Json.Tests.Perf_Reader.ReadSingleSpanSequenceEmptyLoop(IsDataCompact: True, TestCase: BroadTree)

System.Text.Json.Tests.Perf_Reader.ReadMultiSpanSequenceEmptyLoop(IsDataCompact: True, TestCase: HelloWorld)

System.Text.Json.Tests.Perf_Reader.ReadSpanEmptyLoop(IsDataCompact: False, TestCase: HelloWorld)

System.Text.Json.Tests.Perf_Reader.ReadReturnBytes(IsDataCompact: False, TestCase: LotsOfNumbers)

System.Text.Json.Tests.Perf_Reader.ReadSpanEmptyLoop(IsDataCompact: True, TestCase: Json400B)

System.Text.Json.Tests.Perf_Reader.ReadSpanEmptyLoop(IsDataCompact: False, TestCase: Json4KB)

System.Text.Json.Tests.Perf_Reader.ReadMultiSpanSequenceEmptyLoop(IsDataCompact: True, TestCase: BroadTree)

System.Text.Json.Tests.Perf_Reader.ReadSingleSpanSequenceEmptyLoop(IsDataCompact: False, TestCase: Json400B)

System.Text.Json.Tests.Perf_Reader.ReadSpanEmptyLoop(IsDataCompact: False, TestCase: DeepTree)

System.Text.Json.Tests.Perf_Reader.ReadSpanEmptyLoop(IsDataCompact: True, TestCase: BroadTree)

System.Text.Json.Tests.Perf_Reader.ReadSpanEmptyLoop(IsDataCompact: True, TestCase: Json4KB)

System.Text.Json.Tests.Perf_Reader.ReadSingleSpanSequenceEmptyLoop(IsDataCompact: True, TestCase: Json4KB)

System.Text.Json.Tests.Perf_Reader.ReadReturnBytes(IsDataCompact: True, TestCase: Json400B)

System.Text.Json.Tests.Perf_Reader.ReadSpanEmptyLoop(IsDataCompact: True, TestCase: Json40KB)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information
Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Tests.Perf_Double

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
IsNaN - Duration of single invocation 835.77 μs 3.32 ms 3.98 0.00 True
IsNaN - Duration of single invocation 835.52 μs 3.33 ms 3.98 0.01 False

graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Tests.Perf_Double*'

Payloads

Baseline
Compare

Histogram

System.Tests.Perf_Double.IsNaN(value: 0)

System.Tests.Perf_Double.IsNaN(value: NaN)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Tests.Perf_UInt64

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Parse - Duration of single invocation 26.82 ns 28.27 ns 1.05 0.02 False

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Tests.Perf_UInt64*'

Payloads

Baseline
Compare

Histogram

System.Tests.Perf_UInt64.Parse(value: "18446744073709551615")

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.MathBenchmarks.Single

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Min - Duration of single invocation 5.40 μs 17.06 μs 3.16 0.01 True
Tan - Duration of single invocation 24.38 μs 28.85 μs 1.18 0.00 True
Acos - Duration of single invocation 35.17 μs 37.86 μs 1.08 0.00 True
Floor - Duration of single invocation 4.77 μs 16.57 μs 3.48 0.00 True
Sin - Duration of single invocation 29.24 μs 33.51 μs 1.15 0.00 True
Abs - Duration of single invocation 4.17 μs 16.38 μs 3.93 0.00 True
Cosh - Duration of single invocation 51.25 μs 60.35 μs 1.18 0.00 True
Asinh - Duration of single invocation 88.65 μs 97.15 μs 1.10 0.00 True
Ceiling - Duration of single invocation 4.79 μs 16.59 μs 3.46 0.00 True
Log - Duration of single invocation 23.68 μs 29.37 μs 1.24 0.00 True
Cos - Duration of single invocation 29.38 μs 34.55 μs 1.18 0.00 True
Max - Duration of single invocation 5.57 μs 17.18 μs 3.08 0.00 True
Atan - Duration of single invocation 27.44 μs 31.42 μs 1.14 0.03 False
Sinh - Duration of single invocation 52.84 μs 61.56 μs 1.17 0.00 True
Sqrt - Duration of single invocation 7.66 μs 17.71 μs 2.31 0.00 True
Exp - Duration of single invocation 19.50 μs 23.99 μs 1.23 0.00 True
CopySign - Duration of single invocation 7.51 μs 18.09 μs 2.41 0.00 True
Log2 - Duration of single invocation 121.35 μs 128.57 μs 1.06 0.00 True
Pow - Duration of single invocation 51.07 μs 60.74 μs 1.19 0.00 True
ScaleB - Duration of single invocation 13.97 μs 15.67 μs 1.12 0.13 False
FusedMultiplyAdd - Duration of single invocation 4.64 μs 16.70 μs 3.60 0.00 True
ILogB - Duration of single invocation 27.19 μs 30.43 μs 1.12 0.00 True
Log10 - Duration of single invocation 24.30 μs 29.99 μs 1.23 0.02 True
Round - Duration of single invocation 4.79 μs 16.57 μs 3.46 0.00 True
Tanh - Duration of single invocation 34.09 μs 38.14 μs 1.12 0.00 True
Asin - Duration of single invocation 37.28 μs 39.49 μs 1.06 0.07 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.MathBenchmarks.Single*'

Payloads

Baseline
Compare

Histogram

System.MathBenchmarks.Single.Min

System.MathBenchmarks.Single.Tan

System.MathBenchmarks.Single.Acos

System.MathBenchmarks.Single.Floor

System.MathBenchmarks.Single.Sin

System.MathBenchmarks.Single.Abs

System.MathBenchmarks.Single.Cosh

System.MathBenchmarks.Single.Asinh

System.MathBenchmarks.Single.Ceiling

System.MathBenchmarks.Single.Log

System.MathBenchmarks.Single.Cos

System.MathBenchmarks.Single.Max

System.MathBenchmarks.Single.Atan

System.MathBenchmarks.Single.Sinh

System.MathBenchmarks.Single.Sqrt

System.MathBenchmarks.Single.Exp

System.MathBenchmarks.Single.CopySign

System.MathBenchmarks.Single.Log2

System.MathBenchmarks.Single.Pow

System.MathBenchmarks.Single.ScaleB

System.MathBenchmarks.Single.FusedMultiplyAdd

System.MathBenchmarks.Single.ILogB

System.MathBenchmarks.Single.Log10

System.MathBenchmarks.Single.Round

System.MathBenchmarks.Single.Tanh

System.MathBenchmarks.Single.Asin

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Text.Json.Document.Tests.Perf_DocumentParse

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Parse - Duration of single invocation 6.14 ms 10.46 ms 1.70 0.01 True
Parse - Duration of single invocation 1.80 μs 2.02 μs 1.12 0.03 False
Parse - Duration of single invocation 1.26 ms 1.39 ms 1.10 0.01 True
Parse - Duration of single invocation 6.39 ms 10.93 ms 1.71 0.00 True
Parse - Duration of single invocation 1.58 μs 1.80 μs 1.14 0.03 False
Parse - Duration of single invocation 1.47 ms 1.77 ms 1.21 0.05 False

graph
graph
graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Text.Json.Document.Tests.Perf_DocumentParse*'

Payloads

Baseline
Compare

Histogram

System.Text.Json.Document.Tests.Perf_DocumentParse.Parse(IsDataIndented: False, TestRandomAccess: True, TestCase: Json400KB)

System.Text.Json.Document.Tests.Perf_DocumentParse.Parse(IsDataIndented: True, TestRandomAccess: False, TestCase: Json400B)

System.Text.Json.Document.Tests.Perf_DocumentParse.Parse(IsDataIndented: False, TestRandomAccess: False, TestCase: Json400KB)

System.Text.Json.Document.Tests.Perf_DocumentParse.Parse(IsDataIndented: True, TestRandomAccess: True, TestCase: Json400KB)

System.Text.Json.Document.Tests.Perf_DocumentParse.Parse(IsDataIndented: False, TestRandomAccess: False, TestCase: Json400B)

System.Text.Json.Document.Tests.Perf_DocumentParse.Parse(IsDataIndented: True, TestRandomAccess: False, TestCase: Json400KB)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler
Copy link
Author

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Text.Encodings.Web.Tests.Perf_Encoders

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
EncodeUtf8 - Duration of single invocation 73.06 ns 177.05 ns 2.42 0.03 True
EncodeUtf16 - Duration of single invocation 31.31 ns 56.35 ns 1.80 0.07 True
EncodeUtf16 - Duration of single invocation 34.72 ns 57.15 ns 1.65 0.05 False
EncodeUtf8 - Duration of single invocation 14.70 ns 27.18 ns 1.85 0.08 True
EncodeUtf8 - Duration of single invocation 66.78 ns 184.52 ns 2.76 0.02 True
EncodeUtf8 - Duration of single invocation 40.48 ns 131.06 ns 3.24 0.01 True
EncodeUtf16 - Duration of single invocation 77.81 ns 200.15 ns 2.57 0.02 True
EncodeUtf16 - Duration of single invocation 60.08 ns 172.32 ns 2.87 0.02 True
EncodeUtf8 - Duration of single invocation 57.39 ns 158.16 ns 2.76 0.03 True
EncodeUtf16 - Duration of single invocation 16.07 ns 28.18 ns 1.75 0.14 True
EncodeUtf8 - Duration of single invocation 14.64 ns 27.98 ns 1.91 0.05 True
EncodeUtf8 - Duration of single invocation 30.70 ns 52.66 ns 1.72 0.07 True
EncodeUtf16 - Duration of single invocation 15.63 ns 28.30 ns 1.81 0.07 True
EncodeUtf16 - Duration of single invocation 54.42 ns 157.75 ns 2.90 0.01 True
EncodeUtf16 - Duration of single invocation 92.93 ns 252.16 ns 2.71 0.01 True
EncodeUtf8 - Duration of single invocation 44.42 ns 66.68 ns 1.50 0.08 True
EncodeUtf16 - Duration of single invocation 80.94 ns 197.76 ns 2.44 0.05 True
EncodeUtf8 - Duration of single invocation 39.86 ns 79.85 ns 2.00 0.05 True
EncodeUtf8 - Duration of single invocation 42.79 ns 137.07 ns 3.20 0.01 True
EncodeUtf8 - Duration of single invocation 52.36 ns 120.50 ns 2.30 0.05 True
EncodeUtf16 - Duration of single invocation 54.46 ns 126.43 ns 2.32 0.02 True
EncodeUtf16 - Duration of single invocation 102.29 ns 268.58 ns 2.63 0.01 True
EncodeUtf16 - Duration of single invocation 49.84 ns 120.60 ns 2.42 0.02 True
EncodeUtf8 - Duration of single invocation 79.63 ns 223.79 ns 2.81 0.04 True

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Text.Encodings.Web.Tests.Perf_Encoders*'

Payloads

Baseline
Compare

Histogram

System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: Url,©2020,512)

System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments: UnsafeRelaxed,hello "there",16)

System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments: Url,©2020,16)

System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: UnsafeRelaxed,no <escaping /> required,16)

System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: JavaScript,&Hello+<World>!,512)

System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: JavaScript,no escaping required,512)

System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments: UnsafeRelaxed,hello "there",512)

System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments: JavaScript,no escaping required,512)

System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: UnsafeRelaxed,hello "there",512)

System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments: JavaScript,no escaping required,16)

System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: JavaScript,no escaping required,16)

System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: UnsafeRelaxed,hello "there",16)

System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments: UnsafeRelaxed,no <escaping /> required,16)

System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments: UnsafeRelaxed,no <escaping /> required,512)

System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments: JavaScript,&Hello+<World>!,512)

System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: Url,©2020,16)

System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments: Url,©2020,512)

System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: JavaScript,&Hello+<World>!,16)

System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: UnsafeRelaxed,no <escaping /> required,512)

System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: Url,&lorem ipsum=dolor sit amet,16)

System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments: Url,&lorem ipsum=dolor sit amet,16)

System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments: Url,&lorem ipsum=dolor sit amet,512)

System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments: JavaScript,&Hello+<World>!,16)

System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: Url,&lorem ipsum=dolor sit amet,512)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information
Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Text.Json.Serialization.Tests.WriteJson<HashSet<String>>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
SerializeToUtf8Bytes - Duration of single invocation 8.24 μs 9.41 μs 1.14 0.07 False
SerializeToString - Duration of single invocation 8.61 μs 9.58 μs 1.11 0.11 False
SerializeToStream - Duration of single invocation 8.08 μs 10.28 μs 1.27 0.09 True
SerializeObjectProperty - Duration of single invocation 8.68 μs 10.04 μs 1.16 0.12 False

graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Text.Json.Serialization.Tests.WriteJson&lt;HashSet&lt;String&gt;&gt;*'

Payloads

Baseline
Compare

Histogram

System.Text.Json.Serialization.Tests.WriteJson<HashSet<String>>.SerializeToUtf8Bytes

System.Text.Json.Serialization.Tests.WriteJson<HashSet<String>>.SerializeToString

System.Text.Json.Serialization.Tests.WriteJson<HashSet<String>>.SerializeToStream

System.Text.Json.Serialization.Tests.WriteJson<HashSet<String>>.SerializeObjectProperty

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Memory.Span<Char>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Reverse - Duration of single invocation 294.69 ns 447.82 ns 1.52 0.01 True
LastIndexOfAnyValues - Duration of single invocation 110.02 ns 330.92 ns 3.01 0.00 True
BinarySearch - Duration of single invocation 10.71 ns 34.60 ns 3.23 0.11 True
LastIndexOfValue - Duration of single invocation 15.15 ns 16.49 ns 1.09 0.07 False
Fill - Duration of single invocation 17.48 ns 26.34 ns 1.51 0.15 False
IndexOfAnyThreeValues - Duration of single invocation 13.02 ns 18.77 ns 1.44 0.05 False

graph
graph
graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Memory.Span&lt;Char&gt;*'

Payloads

Baseline
Compare

Histogram

System.Memory.Span<Char>.Reverse(Size: 512)

System.Memory.Span<Char>.LastIndexOfAnyValues(Size: 512)

System.Memory.Span<Char>.BinarySearch(Size: 512)

System.Memory.Span<Char>.LastIndexOfValue(Size: 512)

System.Memory.Span<Char>.Fill(Size: 512)

System.Memory.Span<Char>.IndexOfAnyThreeValues(Size: 512)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in PerfLabTests.CastingPerf2.CastingPerf

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
ScalarValueTypeObj - Duration of single invocation 334.31 μs 1.20 ms 3.58 0.01 True
IntObj - Duration of single invocation 112.78 μs 472.93 μs 4.19 0.04 True

graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'PerfLabTests.CastingPerf2.CastingPerf*'

Payloads

Baseline
Compare

Histogram

PerfLabTests.CastingPerf2.CastingPerf.ScalarValueTypeObj

PerfLabTests.CastingPerf2.CastingPerf.IntObj

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline e363f9acfa1811904eaf9ce017120b8385a58443
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Text.Json.Document.Tests.Perf_EnumerateObject

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Parse - Duration of single invocation 30.22 μs 38.57 μs 1.28 0.15 False
PropertyIndexer - Duration of single invocation 2.61 μs 2.82 μs 1.08 0.00 True
PropertyIndexer - Duration of single invocation 2.60 μs 2.82 μs 1.08 0.00 True
Parse - Duration of single invocation 1.18 ms 1.26 ms 1.07 0.01 False
Parse - Duration of single invocation 24.26 μs 29.89 μs 1.23 0.09 True

graph
graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Text.Json.Document.Tests.Perf_EnumerateObject*'

Payloads

Baseline
Compare

Histogram

System.Text.Json.Document.Tests.Perf_EnumerateObject.Parse(TestCase: NumericProperties)

System.Text.Json.Document.Tests.Perf_EnumerateObject.PropertyIndexer(TestCase: NumericProperties)

System.Text.Json.Document.Tests.Perf_EnumerateObject.PropertyIndexer(TestCase: StringProperties)

System.Text.Json.Document.Tests.Perf_EnumerateObject.Parse(TestCase: ObjectProperties)

System.Text.Json.Document.Tests.Perf_EnumerateObject.Parse(TestCase: StringProperties)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Text.Json.Serialization.Tests.WriteJson<ImmutableSortedDictionary<String, String>>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
SerializeToString - Duration of single invocation 23.86 μs 26.56 μs 1.11 0.11 False
SerializeToUtf8Bytes - Duration of single invocation 23.07 μs 25.44 μs 1.10 0.09 False
SerializeToStream - Duration of single invocation 22.85 μs 25.44 μs 1.11 0.08 False
SerializeObjectProperty - Duration of single invocation 25.00 μs 27.18 μs 1.09 0.09 False

graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Text.Json.Serialization.Tests.WriteJson&lt;ImmutableSortedDictionary&lt;String, String&gt;&gt;*'

Payloads

Baseline
Compare

Histogram

System.Text.Json.Serialization.Tests.WriteJson<ImmutableSortedDictionary<String, String>>.SerializeToString

System.Text.Json.Serialization.Tests.WriteJson<ImmutableSortedDictionary<String, String>>.SerializeToUtf8Bytes

System.Text.Json.Serialization.Tests.WriteJson<ImmutableSortedDictionary<String, String>>.SerializeToStream

System.Text.Json.Serialization.Tests.WriteJson<ImmutableSortedDictionary<String, String>>.SerializeObjectProperty

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare d0a09199f8bf30cb3e3f46654117aeae1f72cd99
Diff Diff

Regressions in System.Text.Json.Tests.Utf8JsonReaderCommentsTests

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Utf8JsonReaderCommentParsing - Duration of single invocation 13.77 μs 14.77 μs 1.07 0.02 False
Utf8JsonReaderCommentParsing - Duration of single invocation 14.31 μs 15.55 μs 1.09 0.02 False
Utf8JsonReaderCommentParsing - Duration of single invocation 8.54 μs 35.52 μs 4.16 0.02 True
Utf8JsonReaderCommentParsing - Duration of single invocation 8.41 μs 35.47 μs 4.22 0.04 True

graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Text.Json.Tests.Utf8JsonReaderCommentsTests*'

Payloads

Baseline
Compare

Histogram

System.Text.Json.Tests.Utf8JsonReaderCommentsTests.Utf8JsonReaderCommentParsing(CommentHandling: Skip, SegmentSize: 100, TestCase: LongMultiLine)

System.Text.Json.Tests.Utf8JsonReaderCommentsTests.Utf8JsonReaderCommentParsing(CommentHandling: Allow, SegmentSize: 100, TestCase: LongMultiLine)

System.Text.Json.Tests.Utf8JsonReaderCommentsTests.Utf8JsonReaderCommentParsing(CommentHandling: Skip, SegmentSize: 0, TestCase: LongMultiLine)

System.Text.Json.Tests.Utf8JsonReaderCommentsTests.Utf8JsonReaderCommentParsing(CommentHandling: Allow, SegmentSize: 0, TestCase: LongMultiLine)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Collections.Concurrent.Count<String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Bag - Duration of single invocation 27.92 ns 29.47 ns 1.06 0.01 False
Stack - Duration of single invocation 578.38 ns 1.11 μs 1.93 0.00 True

graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Collections.Concurrent.Count&lt;String&gt;*'

Payloads

Baseline
Compare

Histogram

System.Collections.Concurrent.Count<String>.Bag(Size: 512)

System.Collections.Concurrent.Count<String>.Stack(Size: 512)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler
Copy link
Author

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in Benchstone.BenchF.DMath

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Test - Duration of single invocation 697.39 ms 1.77 secs 2.54 0.03 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'Benchstone.BenchF.DMath*'

Payloads

Baseline
Compare

Histogram

Benchstone.BenchF.DMath.Test

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information
Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in SeekUnroll

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Test - Duration of single invocation 1.11 secs 2.40 secs 2.16 0.00 True
Test - Duration of single invocation 1.12 secs 2.39 secs 2.13 0.00 True
Test - Duration of single invocation 1.63 secs 2.56 secs 1.57 0.01 True
Test - Duration of single invocation 1.29 secs 2.33 secs 1.81 0.01 True
Test - Duration of single invocation 1.99 secs 2.59 secs 1.30 0.00 True

graph
graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'SeekUnroll*'

Payloads

Baseline
Compare

Histogram

SeekUnroll.Test(boxedIndex: 1)

SeekUnroll.Test(boxedIndex: 3)

SeekUnroll.Test(boxedIndex: 19)

SeekUnroll.Test(boxedIndex: 11)

SeekUnroll.Test(boxedIndex: 27)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Collections.TryGetValueFalse<String, String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
ConcurrentDictionary - Duration of single invocation 14.10 μs 14.89 μs 1.06 0.01 True
ImmutableDictionary - Duration of single invocation 20.32 μs 24.95 μs 1.23 0.11 False

graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Collections.TryGetValueFalse&lt;String, String&gt;*'

Payloads

Baseline
Compare

Histogram

System.Collections.TryGetValueFalse<String, String>.ConcurrentDictionary(Size: 512)

System.Collections.TryGetValueFalse<String, String>.ImmutableDictionary(Size: 512)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in Benchstone.BenchI.HeapSort

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Test - Duration of single invocation 264.64 μs 503.54 μs 1.90 0.01 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'Benchstone.BenchI.HeapSort*'

Payloads

Baseline
Compare

Histogram

Benchstone.BenchI.HeapSort.Test

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Collections.Tests.Add_Remove_SteadyState<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
ConcurrentQueue - Duration of single invocation 11.81 ns 13.74 ns 1.16 0.02 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Collections.Tests.Add_Remove_SteadyState&lt;Int32&gt;*'

Payloads

Baseline
Compare

Histogram

System.Collections.Tests.Add_Remove_SteadyState<Int32>.ConcurrentQueue(Count: 512)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Text.Json.Tests.Perf_Depth

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
ReadSpanEmptyLoop - Duration of single invocation 32.75 μs 36.11 μs 1.10 0.02 False
ReadSpanEmptyLoop - Duration of single invocation 107.78 ns 129.28 ns 1.20 0.11 False
ReadSpanEmptyLoop - Duration of single invocation 3.70 μs 4.14 μs 1.12 0.06 False

graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Text.Json.Tests.Perf_Depth*'

Payloads

Baseline
Compare

Histogram

System.Text.Json.Tests.Perf_Depth.ReadSpanEmptyLoop(Depth: 512)

System.Text.Json.Tests.Perf_Depth.ReadSpanEmptyLoop(Depth: 1)

System.Text.Json.Tests.Perf_Depth.ReadSpanEmptyLoop(Depth: 65)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in BilinearTest

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Interpol_Scalar - Duration of single invocation 7.47 μs 16.20 μs 2.17 0.01 True
Interpol_Vector - Duration of single invocation 10.40 μs 16.47 μs 1.58 0.49 False
Interpol_AVX - Duration of single invocation 3.91 μs 8.56 μs 2.19 0.02 True

graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'BilinearTest*'

Payloads

Baseline
Compare

Histogram

BilinearTest.Interpol_Scalar

BilinearTest.Interpol_Vector

BilinearTest.Interpol_AVX

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Collections.IndexerSet<String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Array - Duration of single invocation 195.98 ns 1.29 μs 6.56 0.00 True
Span - Duration of single invocation 298.35 ns 1.70 μs 5.70 0.05 True
List - Duration of single invocation 1.04 μs 1.50 μs 1.45 0.01 True

graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Collections.IndexerSet&lt;String&gt;*'

Payloads

Baseline
Compare

Histogram

System.Collections.IndexerSet<String>.Array(Size: 512)

System.Collections.IndexerSet<String>.Span(Size: 512)

System.Collections.IndexerSet<String>.List(Size: 512)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Collections.IndexerSetReverse<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
List - Duration of single invocation 998.85 ns 1.86 μs 1.86 0.00 True
Span - Duration of single invocation 256.56 ns 1.42 μs 5.53 0.01 True
IList - Duration of single invocation 1.22 μs 1.39 μs 1.14 0.05 False
Array - Duration of single invocation 258.60 ns 1.29 μs 4.98 0.00 True

graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Collections.IndexerSetReverse&lt;Int32&gt;*'

Payloads

Baseline
Compare

Histogram

System.Collections.IndexerSetReverse<Int32>.List(Size: 512)

System.Collections.IndexerSetReverse<Int32>.Span(Size: 512)

System.Collections.IndexerSetReverse<Int32>.IList(Size: 512)

System.Collections.IndexerSetReverse<Int32>.Array(Size: 512)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in BenchmarksGame.Mandelbrot_2

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Bench - Duration of single invocation 1.10 secs 2.83 secs 2.56 0.00 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'BenchmarksGame.Mandelbrot_2*'

Payloads

Baseline
Compare

Histogram

BenchmarksGame.Mandelbrot_2.Bench(width: 4000, checksum: "C7-E6-66-43-66-73-F8-A8-D3-B4-D7-97-2F-FC-A1-D3")

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline e363f9acfa1811904eaf9ce017120b8385a58443
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Buffers.Tests.ReadOnlySequenceTests<Char>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
IterateGetPositionArray - Duration of single invocation 18.13 ns 26.71 ns 1.47 0.02 True
IterateGetPositionTenSegments - Duration of single invocation 83.07 ns 90.77 ns 1.09 0.06 False
IterateGetPositionSingleSegment - Duration of single invocation 26.54 ns 39.80 ns 1.50 0.03 True
IterateTryGetSingleSegment - Duration of single invocation 15.09 ns 17.39 ns 1.15 0.02 False

graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Buffers.Tests.ReadOnlySequenceTests&lt;Char&gt;*'

Payloads

Baseline
Compare

Histogram

System.Buffers.Tests.ReadOnlySequenceTests<Char>.IterateGetPositionArray

System.Buffers.Tests.ReadOnlySequenceTests<Char>.IterateGetPositionTenSegments

System.Buffers.Tests.ReadOnlySequenceTests<Char>.IterateGetPositionSingleSegment

System.Buffers.Tests.ReadOnlySequenceTests<Char>.IterateTryGetSingleSegment

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in Benchstone.BenchI.Permutate

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Test - Duration of single invocation 574.05 ms 653.01 ms 1.14 0.07 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'Benchstone.BenchI.Permutate*'

Payloads

Baseline
Compare

Histogram

Benchstone.BenchI.Permutate.Test

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in Benchstone.BenchI.CSieve

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Test - Duration of single invocation 4.41 ms 24.97 ms 5.66 0.25 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'Benchstone.BenchI.CSieve*'

Payloads

Baseline
Compare

Histogram

Benchstone.BenchI.CSieve.Test

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Text.Json.Serialization.Tests.ReadJson<Dictionary<String, String>>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
DeserializeFromString - Duration of single invocation 24.28 μs 27.42 μs 1.13 0.03 False
DeserializeFromUtf8Bytes - Duration of single invocation 24.65 μs 27.06 μs 1.10 0.05 False

graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Text.Json.Serialization.Tests.ReadJson&lt;Dictionary&lt;String, String&gt;&gt;*'

Payloads

Baseline
Compare

Histogram

System.Text.Json.Serialization.Tests.ReadJson<Dictionary<String, String>>.DeserializeFromString

System.Text.Json.Serialization.Tests.ReadJson<Dictionary<String, String>>.DeserializeFromUtf8Bytes

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in MicroBenchmarks.Serializers.Xml_ToStream<LoginViewModel>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
DataContractSerializer_ - Duration of single invocation 1.26 μs 1.76 μs 1.40 0.01 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'MicroBenchmarks.Serializers.Xml_ToStream&lt;LoginViewModel&gt;*'

Payloads

Baseline
Compare

Histogram

MicroBenchmarks.Serializers.Xml_ToStream<LoginViewModel>.DataContractSerializer_

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in Benchstone.BenchF.FFT

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Test - Duration of single invocation 155.77 ms 225.86 ms 1.45 0.01 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'Benchstone.BenchF.FFT*'

Payloads

Baseline
Compare

Histogram

Benchstone.BenchF.FFT.Test

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in Benchstone.BenchI.Puzzle

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Test - Duration of single invocation 456.44 ms 950.05 ms 2.08 0.04 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'Benchstone.BenchI.Puzzle*'

Payloads

Baseline
Compare

Histogram

Benchstone.BenchI.Puzzle.Test

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Collections.TryGetValueTrue<Int32, Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
SortedDictionary - Duration of single invocation 53.14 μs 58.89 μs 1.11 0.01 False
ConcurrentDictionary - Duration of single invocation 3.34 μs 4.04 μs 1.21 0.00 True
Dictionary - Duration of single invocation 2.95 μs 3.48 μs 1.18 0.01 True

graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Collections.TryGetValueTrue&lt;Int32, Int32&gt;*'

Payloads

Baseline
Compare

Histogram

System.Collections.TryGetValueTrue<Int32, Int32>.SortedDictionary(Size: 512)

System.Collections.TryGetValueTrue<Int32, Int32>.ConcurrentDictionary(Size: 512)

System.Collections.TryGetValueTrue<Int32, Int32>.Dictionary(Size: 512)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Net.Primitives.Tests.IPAddressPerformanceTests

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Ctor_Span - Duration of single invocation 18.13 ns 31.49 ns 1.74 0.15 True
Ctor_Bytes - Duration of single invocation 17.96 ns 36.86 ns 2.05 0.13 True

graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Net.Primitives.Tests.IPAddressPerformanceTests*'

Payloads

Baseline
Compare

Histogram

System.Net.Primitives.Tests.IPAddressPerformanceTests.Ctor_Span(address: [16, 32, 48, 64, 80, ...])

System.Net.Primitives.Tests.IPAddressPerformanceTests.Ctor_Bytes(address: [16, 32, 48, 64, 80, ...])

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in BenchmarksGame.KNucleotide_1

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
RunBench - Duration of single invocation 226.62 ms 350.76 ms 1.55 0.00 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'BenchmarksGame.KNucleotide_1*'

Payloads

Baseline
Compare

Histogram

BenchmarksGame.KNucleotide_1.RunBench

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler
Copy link
Author

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Collections.Tests.DictionarySequentialKeys

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
ContainsValue_3k_Int_Int - Duration of single invocation 4.36 ns 5.36 ns 1.23 0.09 True
TryGetValue_17_Int_32ByteValue - Duration of single invocation 5.41 ns 7.49 ns 1.38 0.01 True
ContainsKey_17_Int_32ByteRefsValue - Duration of single invocation 4.92 ns 7.18 ns 1.46 0.02 False
ContainsKey_3k_Int_32ByteRefsValue - Duration of single invocation 4.75 ns 7.20 ns 1.52 0.07 True
ContainsKey_17_Int_32ByteValue - Duration of single invocation 4.65 ns 6.67 ns 1.43 0.01 True
TryGetValue_3k_Int_32ByteValue - Duration of single invocation 5.05 ns 7.04 ns 1.40 0.01 True
ContainsKey_3k_Int_32ByteValue - Duration of single invocation 4.69 ns 6.66 ns 1.42 0.06 True
TryGetValue_17_Int_Int - Duration of single invocation 4.87 ns 6.06 ns 1.24 0.03 True
TryGetValue_3k_Int_32ByteRefsValue - Duration of single invocation 5.11 ns 7.54 ns 1.48 0.01 True
TryGetValue_17_Int_32ByteRefsValue - Duration of single invocation 5.52 ns 7.92 ns 1.43 0.01 True
TryGetValue_3k_Int_Int - Duration of single invocation 4.53 ns 5.58 ns 1.23 0.07 True

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Collections.Tests.DictionarySequentialKeys*'

Payloads

Baseline
Compare

Histogram

System.Collections.Tests.DictionarySequentialKeys.ContainsValue_3k_Int_Int

System.Collections.Tests.DictionarySequentialKeys.TryGetValue_17_Int_32ByteValue

System.Collections.Tests.DictionarySequentialKeys.ContainsKey_17_Int_32ByteRefsValue

System.Collections.Tests.DictionarySequentialKeys.ContainsKey_3k_Int_32ByteRefsValue

System.Collections.Tests.DictionarySequentialKeys.ContainsKey_17_Int_32ByteValue

System.Collections.Tests.DictionarySequentialKeys.TryGetValue_3k_Int_32ByteValue

System.Collections.Tests.DictionarySequentialKeys.ContainsKey_3k_Int_32ByteValue

System.Collections.Tests.DictionarySequentialKeys.TryGetValue_17_Int_Int

System.Collections.Tests.DictionarySequentialKeys.TryGetValue_3k_Int_32ByteRefsValue

System.Collections.Tests.DictionarySequentialKeys.TryGetValue_17_Int_32ByteRefsValue

System.Collections.Tests.DictionarySequentialKeys.TryGetValue_3k_Int_Int

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information
Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Text.Json.Serialization.Tests.WriteJson<ImmutableDictionary<String, String>>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
SerializeToUtf8Bytes - Duration of single invocation 30.75 μs 34.50 μs 1.12 0.06 False
SerializeObjectProperty - Duration of single invocation 32.42 μs 36.36 μs 1.12 0.09 False
SerializeToStream - Duration of single invocation 31.43 μs 33.74 μs 1.07 0.09 False
SerializeToString - Duration of single invocation 30.55 μs 35.13 μs 1.15 0.12 False

graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Text.Json.Serialization.Tests.WriteJson&lt;ImmutableDictionary&lt;String, String&gt;&gt;*'

Payloads

Baseline
Compare

Histogram

System.Text.Json.Serialization.Tests.WriteJson<ImmutableDictionary<String, String>>.SerializeToUtf8Bytes

System.Text.Json.Serialization.Tests.WriteJson<ImmutableDictionary<String, String>>.SerializeObjectProperty

System.Text.Json.Serialization.Tests.WriteJson<ImmutableDictionary<String, String>>.SerializeToStream

System.Text.Json.Serialization.Tests.WriteJson<ImmutableDictionary<String, String>>.SerializeToString

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Tests.Perf_String

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
IndexerCheckPathLength - Duration of single invocation 146.44 ns 190.05 ns 1.30 0.05 False
Split - Duration of single invocation 20.73 ns 22.54 ns 1.09 0.04 False
IndexerCheckLengthHoisting - Duration of single invocation 30.06 ns 150.17 ns 4.99 0.05 True
Replace_Char - Duration of single invocation 24.67 ns 36.39 ns 1.47 0.13 True
Split - Duration of single invocation 20.73 ns 22.79 ns 1.10 0.05 False
IndexerCheckBoundCheckHoist - Duration of single invocation 41.51 ns 166.39 ns 4.01 0.09 True

graph
graph
graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Tests.Perf_String*'

Payloads

Baseline
Compare

Histogram

System.Tests.Perf_String.IndexerCheckPathLength

System.Tests.Perf_String.Split(s: "ABCDEFGHIJKLMNOPQRSTUVWXYZ", arr: [' '], options: None)

System.Tests.Perf_String.IndexerCheckLengthHoisting

System.Tests.Perf_String.Replace_Char(text: "This is a very nice sentence", oldChar: 'i', newChar: 'I')

System.Tests.Perf_String.Split(s: "ABCDEFGHIJKLMNOPQRSTUVWXYZ", arr: [' '], options: RemoveEmptyEntries)

System.Tests.Perf_String.IndexerCheckBoundCheckHoist

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare d0a09199f8bf30cb3e3f46654117aeae1f72cd99
Diff Diff

Regressions in ByteMark

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
BenchEmFloatClass - Duration of single invocation 778.29 ms 1.24 secs 1.59 0.00 True
BenchLUDecomp - Duration of single invocation 876.02 ms 3.07 secs 3.50 0.02 False
BenchNeural - Duration of single invocation 751.81 ms 949.87 ms 1.26 0.03 True
BenchAssignJagged - Duration of single invocation 919.00 ms 2.36 secs 2.57 0.07 True
BenchNeuralJagged - Duration of single invocation 800.89 ms 1.21 secs 1.51 0.04 True
BenchNumericSortJagged - Duration of single invocation 1.18 secs 2.15 secs 1.82 0.02 True
BenchNumericSortRectangular - Duration of single invocation 1.32 secs 2.30 secs 1.74 0.05 True
BenchIDEAEncryption - Duration of single invocation 915.81 ms 1.28 secs 1.39 0.00 True
BenchAssignRectangular - Duration of single invocation 1.27 secs 2.57 secs 2.03 0.03 True
BenchEmFloat - Duration of single invocation 3.85 secs 6.20 secs 1.61 0.00 True

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'ByteMark*'

Payloads

Baseline
Compare

Histogram

ByteMark.BenchEmFloatClass

ByteMark.BenchLUDecomp

ByteMark.BenchNeural

ByteMark.BenchAssignJagged

ByteMark.BenchNeuralJagged

ByteMark.BenchNumericSortJagged

ByteMark.BenchNumericSortRectangular

ByteMark.BenchIDEAEncryption

ByteMark.BenchAssignRectangular

ByteMark.BenchEmFloat

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Text.Json.Reader.Tests.Perf_Base64

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
ReadBase64EncodedByteArray_HeavyEscaping - Duration of single invocation 106.86 ns 197.50 ns 1.85 0.27 True
ReadBase64EncodedByteArray_NoEscaping - Duration of single invocation 338.96 ns 459.99 ns 1.36 0.08 True
ReadBase64EncodedByteArray_NoEscaping - Duration of single invocation 110.84 ns 197.14 ns 1.78 0.28 False
ReadBase64EncodedByteArray_HeavyEscaping - Duration of single invocation 337.13 ns 554.32 ns 1.64 0.09 True

graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Text.Json.Reader.Tests.Perf_Base64*'

Payloads

Baseline
Compare

Histogram

System.Text.Json.Reader.Tests.Perf_Base64.ReadBase64EncodedByteArray_HeavyEscaping(NumberOfBytes: 100)

System.Text.Json.Reader.Tests.Perf_Base64.ReadBase64EncodedByteArray_NoEscaping(NumberOfBytes: 1000)

System.Text.Json.Reader.Tests.Perf_Base64.ReadBase64EncodedByteArray_NoEscaping(NumberOfBytes: 100)

System.Text.Json.Reader.Tests.Perf_Base64.ReadBase64EncodedByteArray_HeavyEscaping(NumberOfBytes: 1000)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Collections.IterateForEach<String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
ImmutableArray - Duration of single invocation 692.40 ns 762.01 ns 1.10 0.00 True
ReadOnlySpan - Duration of single invocation 152.57 ns 1.35 μs 8.84 0.01 True
Span - Duration of single invocation 157.04 ns 1.35 μs 8.63 0.00 True
Array - Duration of single invocation 149.46 ns 1.28 μs 8.58 0.00 True
ConcurrentDictionary - Duration of single invocation 20.02 μs 23.46 μs 1.17 0.33 False

graph
graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Collections.IterateForEach&lt;String&gt;*'

Payloads

Baseline
Compare

Histogram

System.Collections.IterateForEach<String>.ImmutableArray(Size: 512)

System.Collections.IterateForEach<String>.ReadOnlySpan(Size: 512)

System.Collections.IterateForEach<String>.Span(Size: 512)

System.Collections.IterateForEach<String>.Array(Size: 512)

System.Collections.IterateForEach<String>.ConcurrentDictionary(Size: 512)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Buffers.Tests.RentReturnArrayPoolTests<Byte>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
ProducerConsumer - Duration of single invocation 1.36 μs 4.27 μs 3.14 0.16 True
ProducerConsumer - Duration of single invocation 1.35 μs 4.26 μs 3.16 0.02 True
MultipleSerial - Duration of single invocation 10.26 μs 33.35 μs 3.25 0.04 True
SingleSerial - Duration of single invocation 1.52 μs 4.67 μs 3.08 0.06 True
SingleSerial - Duration of single invocation 1.52 μs 4.67 μs 3.08 0.01 True
SingleSerial - Duration of single invocation 1.26 μs 4.16 μs 3.31 0.00 True
SingleParallel - Duration of single invocation 4.91 μs 10.30 μs 2.10 0.04 True
MultipleSerial - Duration of single invocation 10.34 μs 33.58 μs 3.25 0.00 True
ProducerConsumer - Duration of single invocation 1.51 μs 4.49 μs 2.97 0.22 True
MultipleSerial - Duration of single invocation 212.57 ns 236.00 ns 1.11 0.00 False
ProducerConsumer - Duration of single invocation 1.25 μs 4.17 μs 3.35 0.01 True
MultipleSerial - Duration of single invocation 11.43 μs 35.37 μs 3.09 0.00 True
SingleParallel - Duration of single invocation 3.77 μs 9.82 μs 2.61 0.01 True
SingleSerial - Duration of single invocation 25.58 ns 27.50 ns 1.07 0.05 False
SingleSerial - Duration of single invocation 1.26 μs 4.16 μs 3.31 0.00 True
SingleParallel - Duration of single invocation 2.47 μs 8.35 μs 3.38 0.01 True
SingleParallel - Duration of single invocation 5.86 μs 10.38 μs 1.77 0.15 True
MultipleSerial - Duration of single invocation 11.18 μs 35.03 μs 3.13 0.00 True

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Buffers.Tests.RentReturnArrayPoolTests&lt;Byte&gt;*'

Payloads

Baseline
Compare

Histogram

System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.ProducerConsumer(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: False)

System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.ProducerConsumer(RentalSize: 4096, ManipulateArray: True, Async: True, UseSharedPool: True)

System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.MultipleSerial(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: False)

System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleSerial(RentalSize: 4096, ManipulateArray: True, Async: True, UseSharedPool: True)

System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleSerial(RentalSize: 4096, ManipulateArray: True, Async: True, UseSharedPool: False)

System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleSerial(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: False)

System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleParallel(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: False)

System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.MultipleSerial(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: True)

System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.ProducerConsumer(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: True)

System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.MultipleSerial(RentalSize: 4096, ManipulateArray: False, Async: False, UseSharedPool: False)

System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.ProducerConsumer(RentalSize: 4096, ManipulateArray: True, Async: True, UseSharedPool: False)

System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.MultipleSerial(RentalSize: 4096, ManipulateArray: True, Async: True, UseSharedPool: True)

System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleParallel(RentalSize: 4096, ManipulateArray: True, Async: True, UseSharedPool: True)

System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleSerial(RentalSize: 4096, ManipulateArray: False, Async: False, UseSharedPool: True)

System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleSerial(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: True)

System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleParallel(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: True)

System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleParallel(RentalSize: 4096, ManipulateArray: True, Async: True, UseSharedPool: False)

System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.MultipleSerial(RentalSize: 4096, ManipulateArray: True, Async: True, UseSharedPool: False)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in Benchstone.BenchI.LogicArray

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Test - Duration of single invocation 287.57 ms 646.02 ms 2.25 0.00 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'Benchstone.BenchI.LogicArray*'

Payloads

Baseline
Compare

Histogram

Benchstone.BenchI.LogicArray.Test

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Collections.CreateAddAndRemove<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Stack - Duration of single invocation 2.77 μs 3.13 μs 1.13 0.05 False
Dictionary - Duration of single invocation 11.22 μs 13.13 μs 1.17 0.16 False
HashSet - Duration of single invocation 10.32 μs 12.24 μs 1.19 0.06 True
SortedDictionary - Duration of single invocation 162.31 μs 172.35 μs 1.06 0.00 False
List - Duration of single invocation 14.97 μs 18.27 μs 1.22 0.06 False

graph
graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Collections.CreateAddAndRemove&lt;Int32&gt;*'

Payloads

Baseline
Compare

Histogram

System.Collections.CreateAddAndRemove<Int32>.Stack(Size: 512)

System.Collections.CreateAddAndRemove<Int32>.Dictionary(Size: 512)

System.Collections.CreateAddAndRemove<Int32>.HashSet(Size: 512)

System.Collections.CreateAddAndRemove<Int32>.SortedDictionary(Size: 512)

System.Collections.CreateAddAndRemove<Int32>.List(Size: 512)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Collections.AddGivenSize<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
List - Duration of single invocation 1.13 μs 2.25 μs 1.99 0.03 True
ICollection - Duration of single invocation 1.65 μs 2.29 μs 1.39 0.09 True
Stack - Duration of single invocation 1.38 μs 3.74 μs 2.71 0.06 True
Queue - Duration of single invocation 2.05 μs 2.50 μs 1.22 0.47 False
ConcurrentDictionary - Duration of single invocation 20.98 μs 24.01 μs 1.14 0.01 True

graph
graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Collections.AddGivenSize&lt;Int32&gt;*'

Payloads

Baseline
Compare

Histogram

System.Collections.AddGivenSize<Int32>.List(Size: 512)

System.Collections.AddGivenSize<Int32>.ICollection(Size: 512)

System.Collections.AddGivenSize<Int32>.Stack(Size: 512)

System.Collections.AddGivenSize<Int32>.Queue(Size: 512)

System.Collections.AddGivenSize<Int32>.ConcurrentDictionary(Size: 512)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler
Copy link
Author

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Numerics.Tests.Perf_VectorConvert

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Convert_long_double - Duration of single invocation 1.93 μs 3.28 μs 1.70 0.03 True
Widen_int - Duration of single invocation 1.12 μs 3.22 μs 2.88 0.02 True
Convert_uint_float - Duration of single invocation 1.40 μs 2.79 μs 2.00 0.02 True
Narrow_ulong - Duration of single invocation 1.32 μs 2.79 μs 2.11 0.03 True
Narrow_short - Duration of single invocation 1.76 μs 2.89 μs 1.64 0.02 True
Narrow_long - Duration of single invocation 1.32 μs 3.17 μs 2.41 0.03 True
Widen_uint - Duration of single invocation 1.03 μs 3.20 μs 3.12 0.02 True
Widen_ushort - Duration of single invocation 1.03 μs 2.79 μs 2.71 0.03 True
Narrow_ushort - Duration of single invocation 1.76 μs 2.84 μs 1.61 0.02 True
Narrow_uint - Duration of single invocation 1.76 μs 3.19 μs 1.81 0.03 True
Widen_byte - Duration of single invocation 1.03 μs 2.78 μs 2.70 0.01 True
Narrow_double - Duration of single invocation 906.44 ns 2.84 μs 3.13 0.03 True
Convert_double_long - Duration of single invocation 1.96 μs 2.85 μs 1.45 0.02 True
Narrow_int - Duration of single invocation 1.77 μs 2.88 μs 1.63 0.02 True
Convert_int_float - Duration of single invocation 352.04 ns 2.90 μs 8.24 0.03 True
Convert_double_ulong - Duration of single invocation 11.99 μs 14.85 μs 1.24 0.29 False
Convert_ulong_double - Duration of single invocation 1.95 μs 2.82 μs 1.44 0.02 True
Widen_sbyte - Duration of single invocation 1.11 μs 2.79 μs 2.50 0.03 True
Widen_short - Duration of single invocation 1.12 μs 2.79 μs 2.50 0.01 True
Convert_float_uint - Duration of single invocation 13.18 μs 18.15 μs 1.38 0.08 True
Convert_float_int - Duration of single invocation 365.20 ns 2.93 μs 8.02 0.04 True
Widen_float - Duration of single invocation 866.70 ns 3.05 μs 3.52 0.02 True

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Numerics.Tests.Perf_VectorConvert*'

Payloads

Baseline
Compare

Histogram

System.Numerics.Tests.Perf_VectorConvert.Convert_long_double

System.Numerics.Tests.Perf_VectorConvert.Widen_int

System.Numerics.Tests.Perf_VectorConvert.Convert_uint_float

System.Numerics.Tests.Perf_VectorConvert.Narrow_ulong

System.Numerics.Tests.Perf_VectorConvert.Narrow_short

System.Numerics.Tests.Perf_VectorConvert.Narrow_long

System.Numerics.Tests.Perf_VectorConvert.Widen_uint

System.Numerics.Tests.Perf_VectorConvert.Widen_ushort

System.Numerics.Tests.Perf_VectorConvert.Narrow_ushort

System.Numerics.Tests.Perf_VectorConvert.Narrow_uint

System.Numerics.Tests.Perf_VectorConvert.Widen_byte

System.Numerics.Tests.Perf_VectorConvert.Narrow_double

System.Numerics.Tests.Perf_VectorConvert.Convert_double_long

System.Numerics.Tests.Perf_VectorConvert.Narrow_int

System.Numerics.Tests.Perf_VectorConvert.Convert_int_float

System.Numerics.Tests.Perf_VectorConvert.Convert_double_ulong

System.Numerics.Tests.Perf_VectorConvert.Convert_ulong_double

System.Numerics.Tests.Perf_VectorConvert.Widen_sbyte

System.Numerics.Tests.Perf_VectorConvert.Widen_short

System.Numerics.Tests.Perf_VectorConvert.Convert_float_uint

System.Numerics.Tests.Perf_VectorConvert.Convert_float_int

System.Numerics.Tests.Perf_VectorConvert.Widen_float

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information
Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Collections.IterateForEach<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
List - Duration of single invocation 578.36 ns 1.01 μs 1.75 0.04 False
ImmutableStack - Duration of single invocation 1.73 μs 2.20 μs 1.28 0.25 False
ConcurrentDictionary - Duration of single invocation 16.07 μs 19.09 μs 1.19 0.04 False
ReadOnlySpan - Duration of single invocation 149.82 ns 1.35 μs 8.99 0.00 True
Span - Duration of single invocation 149.74 ns 1.35 μs 9.00 0.00 True
ConcurrentBag - Duration of single invocation 2.45 μs 3.55 μs 1.45 0.04 True
ImmutableArray - Duration of single invocation 150.08 ns 800.34 ns 5.33 0.00 True
Array - Duration of single invocation 149.58 ns 510.06 ns 3.41 0.00 True
ConcurrentQueue - Duration of single invocation 3.91 μs 4.57 μs 1.17 0.08 False
Dictionary - Duration of single invocation 1.43 μs 4.73 μs 3.31 0.01 True
HashSet - Duration of single invocation 1.26 μs 1.46 μs 1.15 0.00 True

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Collections.IterateForEach&lt;Int32&gt;*'

Payloads

Baseline
Compare

Histogram

System.Collections.IterateForEach<Int32>.List(Size: 512)

System.Collections.IterateForEach<Int32>.ImmutableStack(Size: 512)

System.Collections.IterateForEach<Int32>.ConcurrentDictionary(Size: 512)

System.Collections.IterateForEach<Int32>.ReadOnlySpan(Size: 512)

System.Collections.IterateForEach<Int32>.Span(Size: 512)

System.Collections.IterateForEach<Int32>.ConcurrentBag(Size: 512)

System.Collections.IterateForEach<Int32>.ImmutableArray(Size: 512)

System.Collections.IterateForEach<Int32>.Array(Size: 512)

System.Collections.IterateForEach<Int32>.ConcurrentQueue(Size: 512)

System.Collections.IterateForEach<Int32>.Dictionary(Size: 512)

System.Collections.IterateForEach<Int32>.HashSet(Size: 512)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in Span.IndexerBench

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Indexer6 - Duration of single invocation 590.07 ns 2.56 μs 4.34 0.00 True
Indexer4 - Duration of single invocation 6.34 μs 25.60 μs 4.04 0.00 True
WriteViaIndexer1 - Duration of single invocation 1.96 μs 2.83 μs 1.45 0.00 True
Fixed1 - Duration of single invocation 638.83 ns 2.60 μs 4.07 0.00 True
Fixed2 - Duration of single invocation 638.92 ns 2.60 μs 4.08 0.00 True
Indexer1 - Duration of single invocation 644.54 ns 2.61 μs 4.04 0.05 True
Indexer5 - Duration of single invocation 643.70 ns 2.56 μs 3.98 0.00 True
SameIndex2 - Duration of single invocation 866.20 ns 3.31 μs 3.82 0.00 True
ReadOnlyIndexer2 - Duration of single invocation 657.01 ns 2.55 μs 3.88 0.05 True
KnownSizeCtor - Duration of single invocation 644.46 ns 2.56 μs 3.97 0.00 True
KnownSizeArray - Duration of single invocation 644.72 ns 2.55 μs 3.96 0.05 True
CoveredIndex2 - Duration of single invocation 848.11 ns 2.57 μs 3.03 0.00 True
Ref - Duration of single invocation 643.50 ns 2.60 μs 4.04 0.04 True
CoveredIndex1 - Duration of single invocation 1.12 μs 2.62 μs 2.35 0.00 True
KnownSizeCtor2 - Duration of single invocation 618.55 ns 2.69 μs 4.35 0.00 True
CoveredIndex3 - Duration of single invocation 963.14 ns 2.96 μs 3.07 0.00 True
Indexer3 - Duration of single invocation 644.78 ns 2.56 μs 3.97 0.05 True
WriteViaIndexer2 - Duration of single invocation 732.66 ns 2.62 μs 3.58 0.00 True
Indexer2 - Duration of single invocation 644.87 ns 2.55 μs 3.95 0.05 True
ReadOnlyIndexer1 - Duration of single invocation 657.21 ns 2.61 μs 3.96 0.06 True
SameIndex1 - Duration of single invocation 630.53 ns 2.57 μs 4.08 0.06 True

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'Span.IndexerBench*'

Payloads

Baseline
Compare

Histogram

Span.IndexerBench.Indexer6(length: 1024)

Span.IndexerBench.Indexer4(length: 1024)

Span.IndexerBench.WriteViaIndexer1(length: 1024)

Span.IndexerBench.Fixed1(length: 1024)

Span.IndexerBench.Fixed2(length: 1024)

Span.IndexerBench.Indexer1(length: 1024)

Span.IndexerBench.Indexer5(length: 1024)

Span.IndexerBench.SameIndex2(length: 1024)

Span.IndexerBench.ReadOnlyIndexer2(length: 1024)

Span.IndexerBench.KnownSizeCtor(length: 1024)

Span.IndexerBench.KnownSizeArray(length: 1024)

Span.IndexerBench.CoveredIndex2(length: 1024)

Span.IndexerBench.Ref(length: 1024)

Span.IndexerBench.CoveredIndex1(length: 1024)

Span.IndexerBench.KnownSizeCtor2(length: 1024)

Span.IndexerBench.CoveredIndex3(length: 1024)

Span.IndexerBench.Indexer3(length: 1024)

Span.IndexerBench.WriteViaIndexer2(length: 1024)

Span.IndexerBench.Indexer2(length: 1024)

Span.IndexerBench.ReadOnlyIndexer1(length: 1024)

Span.IndexerBench.SameIndex1(length: 1024)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Text.Json.Serialization.Tests.WriteJson<Hashtable>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
SerializeToString - Duration of single invocation 18.26 μs 21.46 μs 1.18 0.09 False
SerializeToStream - Duration of single invocation 17.92 μs 20.24 μs 1.13 0.10 False
SerializeObjectProperty - Duration of single invocation 17.68 μs 21.62 μs 1.22 0.07 False
SerializeToUtf8Bytes - Duration of single invocation 16.89 μs 20.43 μs 1.21 0.11 False

graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Text.Json.Serialization.Tests.WriteJson&lt;Hashtable&gt;*'

Payloads

Baseline
Compare

Histogram

System.Text.Json.Serialization.Tests.WriteJson<Hashtable>.SerializeToString

System.Text.Json.Serialization.Tests.WriteJson<Hashtable>.SerializeToStream

System.Text.Json.Serialization.Tests.WriteJson<Hashtable>.SerializeObjectProperty

System.Text.Json.Serialization.Tests.WriteJson<Hashtable>.SerializeToUtf8Bytes

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Collections.Sort<BigStruct>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Array_Comparison - Duration of single invocation 29.28 μs 32.08 μs 1.10 0.01 False
Array - Duration of single invocation 9.08 μs 13.23 μs 1.46 0.42 False
Array_ComparerClass - Duration of single invocation 28.35 μs 31.87 μs 1.12 0.01 False
Array_ComparerStruct - Duration of single invocation 35.93 μs 38.27 μs 1.07 0.01 False
List - Duration of single invocation 8.66 μs 12.86 μs 1.48 0.22 True

graph
graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Collections.Sort&lt;BigStruct&gt;*'

Payloads

Baseline
Compare

Histogram

System.Collections.Sort<BigStruct>.Array_Comparison(Size: 512)

System.Collections.Sort<BigStruct>.Array(Size: 512)

System.Collections.Sort<BigStruct>.Array_ComparerClass(Size: 512)

System.Collections.Sort<BigStruct>.Array_ComparerStruct(Size: 512)

System.Collections.Sort<BigStruct>.List(Size: 512)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Linq.Tests.Perf_Enumerable

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
SelectToList - Duration of single invocation 486.82 ns 549.63 ns 1.13 0.25 False
WhereSingleOrDefault_LastElementMatches - Duration of single invocation 245.35 ns 485.28 ns 1.98 0.08 True
Where - Duration of single invocation 1.04 μs 1.10 μs 1.06 0.06 False
AnyWithPredicate_LastElementMatches - Duration of single invocation 828.84 ns 942.52 ns 1.14 0.23 False
SelectToList - Duration of single invocation 311.20 ns 476.08 ns 1.53 0.05 True
OrderByThenBy - Duration of single invocation 4.55 μs 4.88 μs 1.07 0.00 False
Distinct - Duration of single invocation 2.12 μs 2.38 μs 1.12 0.03 True
WhereFirst_LastElementMatches - Duration of single invocation 249.16 ns 486.15 ns 1.95 0.11 True
WhereSingle_LastElementMatches - Duration of single invocation 243.73 ns 483.79 ns 1.98 0.03 True
SelectToArray - Duration of single invocation 222.34 ns 480.12 ns 2.16 0.16 False
OrderByDescending - Duration of single invocation 5.45 μs 5.96 μs 1.09 0.00 False
Where - Duration of single invocation 676.43 ns 754.54 ns 1.12 0.00 True
Count - Duration of single invocation 254.19 ns 284.16 ns 1.12 0.15 False
WhereAny_LastElementMatches - Duration of single invocation 245.37 ns 481.12 ns 1.96 0.06 True
SelectToArray - Duration of single invocation 258.50 ns 321.03 ns 1.24 0.12 True
OrderBy - Duration of single invocation 4.17 μs 4.58 μs 1.10 0.00 False
WhereSelect - Duration of single invocation 843.48 ns 909.07 ns 1.08 0.02 False
SelectToList - Duration of single invocation 320.17 ns 514.49 ns 1.61 0.03 True
Intersect - Duration of single invocation 3.34 μs 3.63 μs 1.09 0.01 True
FirstWithPredicate_LastElementMatches - Duration of single invocation 3.74 μs 4.05 μs 1.08 0.01 False
SelectToArray - Duration of single invocation 249.44 ns 415.51 ns 1.67 0.06 True
Except - Duration of single invocation 2.68 μs 2.93 μs 1.09 0.06 False
SelectToList - Duration of single invocation 893.99 ns 961.91 ns 1.08 0.19 False
SelectToArray - Duration of single invocation 396.96 ns 506.08 ns 1.27 0.18 False
ToDictionary - Duration of single invocation 964.35 ns 1.04 μs 1.08 0.08 False
ToDictionary - Duration of single invocation 1.97 μs 2.10 μs 1.07 0.01 True
AnyWithPredicate_LastElementMatches - Duration of single invocation 3.74 μs 4.15 μs 1.11 0.00 False
SelectToList - Duration of single invocation 287.53 ns 428.19 ns 1.49 0.14 True
WhereLast_LastElementMatches - Duration of single invocation 274.63 ns 487.17 ns 1.77 0.05 True
AnyWithPredicate_LastElementMatches - Duration of single invocation 577.49 ns 676.71 ns 1.17 0.18 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Linq.Tests.Perf_Enumerable*'

Payloads

Baseline
Compare

Histogram

System.Linq.Tests.Perf_Enumerable.SelectToList(input: IList)

System.Linq.Tests.Perf_Enumerable.WhereSingleOrDefault_LastElementMatches(input: Array)

System.Linq.Tests.Perf_Enumerable.Where(input: IEnumerable)

System.Linq.Tests.Perf_Enumerable.AnyWithPredicate_LastElementMatches(input: List)

System.Linq.Tests.Perf_Enumerable.SelectToList(input: Array)

System.Linq.Tests.Perf_Enumerable.OrderByThenBy(input: IEnumerable)

System.Linq.Tests.Perf_Enumerable.Distinct(input: IEnumerable)

System.Linq.Tests.Perf_Enumerable.WhereFirst_LastElementMatches(input: Array)

System.Linq.Tests.Perf_Enumerable.WhereSingle_LastElementMatches(input: Array)

System.Linq.Tests.Perf_Enumerable.SelectToArray(input: Range)

System.Linq.Tests.Perf_Enumerable.OrderByDescending(input: IEnumerable)

System.Linq.Tests.Perf_Enumerable.Where(input: Array)

System.Linq.Tests.Perf_Enumerable.Count(input: IEnumerable)

System.Linq.Tests.Perf_Enumerable.WhereAny_LastElementMatches(input: Array)

System.Linq.Tests.Perf_Enumerable.SelectToArray(input: List)

System.Linq.Tests.Perf_Enumerable.OrderBy(input: IEnumerable)

System.Linq.Tests.Perf_Enumerable.WhereSelect(input: Array)

System.Linq.Tests.Perf_Enumerable.SelectToList(input: List)

System.Linq.Tests.Perf_Enumerable.Intersect(input: IEnumerable)

System.Linq.Tests.Perf_Enumerable.FirstWithPredicate_LastElementMatches(input: IOrderedEnumerable)

System.Linq.Tests.Perf_Enumerable.SelectToArray(input: Array)

System.Linq.Tests.Perf_Enumerable.Except(input: IEnumerable)

System.Linq.Tests.Perf_Enumerable.SelectToList(input: IEnumerable)

System.Linq.Tests.Perf_Enumerable.SelectToArray(input: IList)

System.Linq.Tests.Perf_Enumerable.ToDictionary(input: List)

System.Linq.Tests.Perf_Enumerable.ToDictionary(input: IEnumerable)

System.Linq.Tests.Perf_Enumerable.AnyWithPredicate_LastElementMatches(input: IOrderedEnumerable)

System.Linq.Tests.Perf_Enumerable.SelectToList(input: Range)

System.Linq.Tests.Perf_Enumerable.WhereLast_LastElementMatches(input: Array)

System.Linq.Tests.Perf_Enumerable.AnyWithPredicate_LastElementMatches(input: IEnumerable)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler
Copy link
Author

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Collections.IterateFor<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Array - Duration of single invocation 149.59 ns 368.97 ns 2.47 0.00 True
ReadOnlySpan - Duration of single invocation 149.77 ns 1.36 μs 9.09 0.00 True
List - Duration of single invocation 290.76 ns 687.22 ns 2.36 0.00 True
IList - Duration of single invocation 2.00 μs 2.29 μs 1.14 0.06 False
Span - Duration of single invocation 149.95 ns 1.36 μs 9.08 0.00 True
ImmutableArray - Duration of single invocation 149.76 ns 1.27 μs 8.45 0.00 True

graph
graph
graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Collections.IterateFor&lt;Int32&gt;*'

Payloads

Baseline
Compare

Histogram

System.Collections.IterateFor<Int32>.Array(Size: 512)

System.Collections.IterateFor<Int32>.ReadOnlySpan(Size: 512)

System.Collections.IterateFor<Int32>.List(Size: 512)

System.Collections.IterateFor<Int32>.IList(Size: 512)

System.Collections.IterateFor<Int32>.Span(Size: 512)

System.Collections.IterateFor<Int32>.ImmutableArray(Size: 512)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information
Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Text.Json.Serialization.Tests.ReadJson<BinaryData>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
DeserializeFromStream - Duration of single invocation 1.07 μs 1.19 μs 1.11 0.00 True
DeserializeFromString - Duration of single invocation 748.96 ns 862.38 ns 1.15 0.04 True
DeserializeFromUtf8Bytes - Duration of single invocation 590.65 ns 762.44 ns 1.29 0.03 True

graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Text.Json.Serialization.Tests.ReadJson&lt;BinaryData&gt;*'

Payloads

Baseline
Compare

Histogram

System.Text.Json.Serialization.Tests.ReadJson<BinaryData>.DeserializeFromStream

System.Text.Json.Serialization.Tests.ReadJson<BinaryData>.DeserializeFromString

System.Text.Json.Serialization.Tests.ReadJson<BinaryData>.DeserializeFromUtf8Bytes

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Text.Json.Serialization.Tests.WriteJson<IndexViewModel>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
SerializeObjectProperty - Duration of single invocation 20.07 μs 26.40 μs 1.31 0.05 True
SerializeToUtf8Bytes - Duration of single invocation 19.19 μs 25.01 μs 1.30 0.05 True
SerializeToStream - Duration of single invocation 19.17 μs 24.83 μs 1.30 0.06 True
SerializeToString - Duration of single invocation 20.37 μs 26.20 μs 1.29 0.04 True

graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Text.Json.Serialization.Tests.WriteJson&lt;IndexViewModel&gt;*'

Payloads

Baseline
Compare

Histogram

System.Text.Json.Serialization.Tests.WriteJson<IndexViewModel>.SerializeObjectProperty

System.Text.Json.Serialization.Tests.WriteJson<IndexViewModel>.SerializeToUtf8Bytes

System.Text.Json.Serialization.Tests.WriteJson<IndexViewModel>.SerializeToStream

System.Text.Json.Serialization.Tests.WriteJson<IndexViewModel>.SerializeToString

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in Benchstone.BenchI.Midpoint

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Test - Duration of single invocation 457.77 ms 524.77 ms 1.15 0.11 False

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'Benchstone.BenchI.Midpoint*'

Payloads

Baseline
Compare

Histogram

Benchstone.BenchI.Midpoint.Test

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Text.Perf_Utf8Encoding

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
GetByteCount - Duration of single invocation 8.82 μs 40.34 μs 4.58 0.00 True
GetBytes - Duration of single invocation 98.14 μs 127.39 μs 1.30 0.02 False
GetBytes - Duration of single invocation 93.69 μs 158.10 μs 1.69 0.00 True
GetByteCount - Duration of single invocation 8.13 μs 37.19 μs 4.57 0.00 True
GetByteCount - Duration of single invocation 17.54 μs 80.41 μs 4.58 0.00 True
GetByteCount - Duration of single invocation 6.94 μs 31.46 μs 4.53 0.00 True
GetBytes - Duration of single invocation 182.04 μs 212.88 μs 1.17 0.00 True
GetBytes - Duration of single invocation 113.85 μs 138.96 μs 1.22 0.00 True

graph
graph
graph
graph
graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Text.Perf_Utf8Encoding*'

Payloads

Baseline
Compare

Histogram

System.Text.Perf_Utf8Encoding.GetByteCount(Input: Greek)

System.Text.Perf_Utf8Encoding.GetBytes(Input: Chinese)

System.Text.Perf_Utf8Encoding.GetBytes(Input: EnglishMostlyAscii)

System.Text.Perf_Utf8Encoding.GetByteCount(Input: Chinese)

System.Text.Perf_Utf8Encoding.GetByteCount(Input: EnglishMostlyAscii)

System.Text.Perf_Utf8Encoding.GetByteCount(Input: Cyrillic)

System.Text.Perf_Utf8Encoding.GetBytes(Input: Greek)

System.Text.Perf_Utf8Encoding.GetBytes(Input: Cyrillic)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in Benchstone.BenchF.Adams

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Test - Duration of single invocation 449.00 ns 719.43 ns 1.60 0.00 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'Benchstone.BenchF.Adams*'

Payloads

Baseline
Compare

Histogram

Benchstone.BenchF.Adams.Test

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Text.Json.Serialization.Tests.ReadJson<HashSet<String>>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
DeserializeFromStream - Duration of single invocation 16.23 μs 17.59 μs 1.08 0.05 False
DeserializeFromUtf8Bytes - Duration of single invocation 14.01 μs 15.13 μs 1.08 0.07 False

graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Text.Json.Serialization.Tests.ReadJson&lt;HashSet&lt;String&gt;&gt;*'

Payloads

Baseline
Compare

Histogram

System.Text.Json.Serialization.Tests.ReadJson<HashSet<String>>.DeserializeFromStream

System.Text.Json.Serialization.Tests.ReadJson<HashSet<String>>.DeserializeFromUtf8Bytes

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in Benchstone.BenchF.NewtE

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Test - Duration of single invocation 188.91 ms 220.19 ms 1.17 0.00 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'Benchstone.BenchF.NewtE*'

Payloads

Baseline
Compare

Histogram

Benchstone.BenchF.NewtE.Test

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in SIMD.ConsoleMandel

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
VectorFloatSinglethreadADT - Duration of single invocation 134.44 ms 658.27 ms 4.90 0.03 True
ScalarFloatSinglethreadADT - Duration of single invocation 735.29 ms 1.27 secs 1.73 0.00 True
ScalarFloatSinglethreadRaw - Duration of single invocation 728.82 ms 1.99 secs 2.73 0.00 True
ScalarDoubleSinglethreadRaw - Duration of single invocation 728.06 ms 1.99 secs 2.74 0.00 True
ScalarDoubleSinglethreadADT - Duration of single invocation 741.87 ms 1.27 secs 1.72 0.00 True
VectorDoubleSinglethreadADT - Duration of single invocation 243.16 ms 1.21 secs 4.96 0.03 True
VectorDoubleSinglethreadRaw - Duration of single invocation 242.82 ms 900.40 ms 3.71 0.02 True
VectorFloatSinglethreadRaw - Duration of single invocation 134.94 ms 403.82 ms 2.99 0.03 True

graph
graph
graph
graph
graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'SIMD.ConsoleMandel*'

Payloads

Baseline
Compare

Histogram

SIMD.ConsoleMandel.VectorFloatSinglethreadADT

SIMD.ConsoleMandel.ScalarFloatSinglethreadADT

SIMD.ConsoleMandel.ScalarFloatSinglethreadRaw

SIMD.ConsoleMandel.ScalarDoubleSinglethreadRaw

SIMD.ConsoleMandel.ScalarDoubleSinglethreadADT

SIMD.ConsoleMandel.VectorDoubleSinglethreadADT

SIMD.ConsoleMandel.VectorDoubleSinglethreadRaw

SIMD.ConsoleMandel.VectorFloatSinglethreadRaw

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Text.Json.Serialization.Tests.ReadJson<IndexViewModel>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
DeserializeFromStream - Duration of single invocation 39.10 μs 43.89 μs 1.12 0.04 False
DeserializeFromString - Duration of single invocation 36.06 μs 41.10 μs 1.14 0.06 False
DeserializeFromUtf8Bytes - Duration of single invocation 35.28 μs 41.71 μs 1.18 0.04 False

graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Text.Json.Serialization.Tests.ReadJson&lt;IndexViewModel&gt;*'

Payloads

Baseline
Compare

Histogram

System.Text.Json.Serialization.Tests.ReadJson<IndexViewModel>.DeserializeFromStream

System.Text.Json.Serialization.Tests.ReadJson<IndexViewModel>.DeserializeFromString

System.Text.Json.Serialization.Tests.ReadJson<IndexViewModel>.DeserializeFromUtf8Bytes

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Collections.Sort<IntStruct>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
List - Duration of single invocation 5.49 μs 10.22 μs 1.86 0.07 True
Array_ComparerStruct - Duration of single invocation 27.34 μs 31.65 μs 1.16 0.10 False
Array_Comparison - Duration of single invocation 21.55 μs 22.98 μs 1.07 0.28 False
Array_ComparerClass - Duration of single invocation 21.46 μs 23.67 μs 1.10 0.15 False
Array - Duration of single invocation 4.82 μs 8.42 μs 1.75 0.08 True

graph
graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Collections.Sort&lt;IntStruct&gt;*'

Payloads

Baseline
Compare

Histogram

System.Collections.Sort<IntStruct>.List(Size: 512)

System.Collections.Sort<IntStruct>.Array_ComparerStruct(Size: 512)

System.Collections.Sort<IntStruct>.Array_Comparison(Size: 512)

System.Collections.Sort<IntStruct>.Array_ComparerClass(Size: 512)

System.Collections.Sort<IntStruct>.Array(Size: 512)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Buffers.Tests.ReadOnlySequenceTests<Byte>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
IterateTryGetSingleSegment - Duration of single invocation 14.32 ns 16.69 ns 1.17 0.24 False
IterateGetPositionSingleSegment - Duration of single invocation 26.30 ns 40.11 ns 1.52 0.01 True
IterateGetPositionArray - Duration of single invocation 18.62 ns 26.06 ns 1.40 0.02 True
SliceTenSegments - Duration of single invocation 26.47 ns 29.57 ns 1.12 0.04 False

graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Buffers.Tests.ReadOnlySequenceTests&lt;Byte&gt;*'

Payloads

Baseline
Compare

Histogram

System.Buffers.Tests.ReadOnlySequenceTests<Byte>.IterateTryGetSingleSegment

System.Buffers.Tests.ReadOnlySequenceTests<Byte>.IterateGetPositionSingleSegment

System.Buffers.Tests.ReadOnlySequenceTests<Byte>.IterateGetPositionArray

System.Buffers.Tests.ReadOnlySequenceTests<Byte>.SliceTenSegments

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Collections.Tests.Perf_SortedSet

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Max - Duration of single invocation 19.12 ns 23.76 ns 1.24 0.01 True
Min - Duration of single invocation 9.95 ns 13.74 ns 1.38 0.01 True

graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Collections.Tests.Perf_SortedSet*'

Payloads

Baseline
Compare

Histogram

System.Collections.Tests.Perf_SortedSet.Max

System.Collections.Tests.Perf_SortedSet.Min

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in GuardedDevirtualization.ThreeClassInterface

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Call - Duration of single invocation 8.02 ns 9.81 ns 1.22 0.01 True
Call - Duration of single invocation 7.70 ns 9.28 ns 1.21 0.00 True
Call - Duration of single invocation 8.03 ns 9.83 ns 1.22 0.01 True
Call - Duration of single invocation 8.02 ns 9.82 ns 1.22 0.01 True
Call - Duration of single invocation 9.00 ns 10.87 ns 1.21 0.03 True
Call - Duration of single invocation 7.70 ns 9.29 ns 1.21 0.00 True
Call - Duration of single invocation 7.70 ns 9.29 ns 1.21 0.00 True

graph
graph
graph
graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'GuardedDevirtualization.ThreeClassInterface*'

Payloads

Baseline
Compare

Histogram

GuardedDevirtualization.ThreeClassInterface.Call(testInput: pB=0.33 pD=0.00)

GuardedDevirtualization.ThreeClassInterface.Call(testInput: pB=0.67 pD=0.33)

GuardedDevirtualization.ThreeClassInterface.Call(testInput: pB=0.33 pD=0.67)

GuardedDevirtualization.ThreeClassInterface.Call(testInput: pB=0.00 pD=0.33)

GuardedDevirtualization.ThreeClassInterface.Call(testInput: pB=0.33 pD=0.33)

GuardedDevirtualization.ThreeClassInterface.Call(testInput: pB=0.67 pD=0.00)

GuardedDevirtualization.ThreeClassInterface.Call(testInput: pB=0.00 pD=0.67)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in MicroBenchmarks.Serializers.Json_ToString<IndexViewModel>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
JsonNet_ - Duration of single invocation 46.36 μs 59.54 μs 1.28 0.01 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'MicroBenchmarks.Serializers.Json_ToString&lt;IndexViewModel&gt;*'

Payloads

Baseline
Compare

Histogram

MicroBenchmarks.Serializers.Json_ToString<IndexViewModel>.JsonNet_

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler
Copy link
Author

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Collections.Concurrent.Count<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Stack - Duration of single invocation 578.47 ns 1.11 μs 1.92 0.00 True
Queue_EnqueueCountDequeue - Duration of single invocation 14.63 ns 19.52 ns 1.33 0.05 True
Bag - Duration of single invocation 27.95 ns 30.34 ns 1.09 0.01 False
Dictionary - Duration of single invocation 5.96 μs 6.81 μs 1.14 0.01 True

graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Collections.Concurrent.Count&lt;Int32&gt;*'

Payloads

Baseline
Compare

Histogram

System.Collections.Concurrent.Count<Int32>.Stack(Size: 512)

System.Collections.Concurrent.Count<Int32>.Queue_EnqueueCountDequeue(Size: 512)

System.Collections.Concurrent.Count<Int32>.Bag(Size: 512)

System.Collections.Concurrent.Count<Int32>.Dictionary(Size: 512)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information
Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in MicroBenchmarks.Serializers.Xml_FromStream<MyEventsListerViewModel>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
DataContractSerializer_ - Duration of single invocation 2.21 ms 2.58 ms 1.17 0.01 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'MicroBenchmarks.Serializers.Xml_FromStream&lt;MyEventsListerViewModel&gt;*'

Payloads

Baseline
Compare

Histogram

MicroBenchmarks.Serializers.Xml_FromStream<MyEventsListerViewModel>.DataContractSerializer_

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare d0a09199f8bf30cb3e3f46654117aeae1f72cd99
Diff Diff

Regressions in System.Collections.Tests.Perf_Dictionary

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
ContainsValue - Duration of single invocation 4.73 ms 13.20 ms 2.79 0.00 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Collections.Tests.Perf_Dictionary*'

Payloads

Baseline
Compare

Histogram

System.Collections.Tests.Perf_Dictionary.ContainsValue(Items: 3000)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in BenchmarksGame.SpectralNorm_1

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
RunBench - Duration of single invocation 1.18 ms 1.26 ms 1.07 0.00 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'BenchmarksGame.SpectralNorm_1*'

Payloads

Baseline
Compare

Histogram

BenchmarksGame.SpectralNorm_1.RunBench

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in V8.Crypto.Support

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Bench - Duration of single invocation 5.79 ms 7.35 ms 1.27 0.01 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'V8.Crypto.Support*'

Payloads

Baseline
Compare

Histogram

V8.Crypto.Support.Bench

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in MicroBenchmarks.Serializers.Json_FromStream<MyEventsListerViewModel>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
JsonNet_ - Duration of single invocation 945.69 μs 1.06 ms 1.12 0.02 False

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'MicroBenchmarks.Serializers.Json_FromStream&lt;MyEventsListerViewModel&gt;*'

Payloads

Baseline
Compare

Histogram

MicroBenchmarks.Serializers.Json_FromStream<MyEventsListerViewModel>.JsonNet_

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Collections.TryGetValueFalse<Int32, Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
SortedDictionary - Duration of single invocation 56.21 μs 61.71 μs 1.10 0.00 False
ConcurrentDictionary - Duration of single invocation 2.96 μs 3.42 μs 1.16 0.02 False

graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Collections.TryGetValueFalse&lt;Int32, Int32&gt;*'

Payloads

Baseline
Compare

Histogram

System.Collections.TryGetValueFalse<Int32, Int32>.SortedDictionary(Size: 512)

System.Collections.TryGetValueFalse<Int32, Int32>.ConcurrentDictionary(Size: 512)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Buffers.Binary.Tests.BinaryReadAndWriteTests

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
MeasureReverseEndianness - Duration of single invocation 562.63 ns 2.50 μs 4.44 0.05 True
MeasureReverseUsingNtoH - Duration of single invocation 631.67 ns 2.50 μs 3.95 0.04 True

graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Buffers.Binary.Tests.BinaryReadAndWriteTests*'

Payloads

Baseline
Compare

Histogram

System.Buffers.Binary.Tests.BinaryReadAndWriteTests.MeasureReverseEndianness

System.Buffers.Binary.Tests.BinaryReadAndWriteTests.MeasureReverseUsingNtoH

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in MicroBenchmarks.Serializers.Xml_FromStream<LoginViewModel>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
DataContractSerializer_ - Duration of single invocation 4.50 μs 4.86 μs 1.08 0.01 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'MicroBenchmarks.Serializers.Xml_FromStream&lt;LoginViewModel&gt;*'

Payloads

Baseline
Compare

Histogram

MicroBenchmarks.Serializers.Xml_FromStream<LoginViewModel>.DataContractSerializer_

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in BenchmarksGame.KNucleotide_9

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
RunBench - Duration of single invocation 56.94 ms 122.62 ms 2.15 0.15 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'BenchmarksGame.KNucleotide_9*'

Payloads

Baseline
Compare

Histogram

BenchmarksGame.KNucleotide_9.RunBench

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Collections.ContainsTrueComparer<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
HashSet - Duration of single invocation 5.71 μs 6.04 μs 1.06 0.01 False
ImmutableHashSet - Duration of single invocation 18.14 μs 19.68 μs 1.08 0.31 False
SortedSet - Duration of single invocation 26.04 μs 30.47 μs 1.17 0.03 False

graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Collections.ContainsTrueComparer&lt;Int32&gt;*'

Payloads

Baseline
Compare

Histogram

System.Collections.ContainsTrueComparer<Int32>.HashSet(Size: 512)

System.Collections.ContainsTrueComparer<Int32>.ImmutableHashSet(Size: 512)

System.Collections.ContainsTrueComparer<Int32>.SortedSet(Size: 512)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in Benchstone.BenchI.Array2

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Test - Duration of single invocation 445.08 ms 845.39 ms 1.90 0.00 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'Benchstone.BenchI.Array2*'

Payloads

Baseline
Compare

Histogram

Benchstone.BenchI.Array2.Test

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in MicroBenchmarks.Serializers.Xml_FromStream<SimpleStructWithProperties>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
DataContractSerializer_ - Duration of single invocation 3.00 μs 3.17 μs 1.05 0.01 False

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'MicroBenchmarks.Serializers.Xml_FromStream&lt;SimpleStructWithProperties&gt;*'

Payloads

Baseline
Compare

Histogram

MicroBenchmarks.Serializers.Xml_FromStream<SimpleStructWithProperties>.DataContractSerializer_

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in MicroBenchmarks.Serializers.Xml_ToStream<ClassImplementingIXmlSerialiable>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
DataContractSerializer_ - Duration of single invocation 758.10 ns 910.86 ns 1.20 0.02 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'MicroBenchmarks.Serializers.Xml_ToStream&lt;ClassImplementingIXmlSerialiable&gt;*'

Payloads

Baseline
Compare

Histogram

MicroBenchmarks.Serializers.Xml_ToStream<ClassImplementingIXmlSerialiable>.DataContractSerializer_

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Text.Json.Tests.Perf_Guids

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
WriteGuids - Duration of single invocation 3.74 ms 3.98 ms 1.06 0.00 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Text.Json.Tests.Perf_Guids*'

Payloads

Baseline
Compare

Histogram

System.Text.Json.Tests.Perf_Guids.WriteGuids(Formatted: False, SkipValidation: False)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in Benchstone.BenchI.MulMatrix

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Test - Duration of single invocation 433.46 ms 766.35 ms 1.77 0.02 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'Benchstone.BenchI.MulMatrix*'

Payloads

Baseline
Compare

Histogram

Benchstone.BenchI.MulMatrix.Test

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Text.Json.Serialization.Tests.WriteJson<Dictionary<String, String>>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
SerializeToStream - Duration of single invocation 13.09 μs 16.94 μs 1.29 0.10 True
SerializeObjectProperty - Duration of single invocation 12.15 μs 16.02 μs 1.32 0.06 True
SerializeToUtf8Bytes - Duration of single invocation 11.40 μs 15.51 μs 1.36 0.09 True
SerializeToString - Duration of single invocation 11.47 μs 16.24 μs 1.42 0.06 True

graph
graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Text.Json.Serialization.Tests.WriteJson&lt;Dictionary&lt;String, String&gt;&gt;*'

Payloads

Baseline
Compare

Histogram

System.Text.Json.Serialization.Tests.WriteJson<Dictionary<String, String>>.SerializeToStream

System.Text.Json.Serialization.Tests.WriteJson<Dictionary<String, String>>.SerializeObjectProperty

System.Text.Json.Serialization.Tests.WriteJson<Dictionary<String, String>>.SerializeToUtf8Bytes

System.Text.Json.Serialization.Tests.WriteJson<Dictionary<String, String>>.SerializeToString

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in XmlDocumentTests.XmlNodeListTests.Perf_XmlNodeList

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
GetCount - Duration of single invocation 9.07 ns 10.22 ns 1.13 0.05 False

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'XmlDocumentTests.XmlNodeListTests.Perf_XmlNodeList*'

Payloads

Baseline
Compare

Histogram

XmlDocumentTests.XmlNodeListTests.Perf_XmlNodeList.GetCount

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Text.Json.Serialization.Tests.WriteJson<ArrayList>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
SerializeToStream - Duration of single invocation 10.97 μs 11.73 μs 1.07 0.12 False
SerializeToUtf8Bytes - Duration of single invocation 11.32 μs 12.21 μs 1.08 0.08 False
SerializeToString - Duration of single invocation 11.27 μs 12.51 μs 1.11 0.10 False

graph
graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Text.Json.Serialization.Tests.WriteJson&lt;ArrayList&gt;*'

Payloads

Baseline
Compare

Histogram

System.Text.Json.Serialization.Tests.WriteJson<ArrayList>.SerializeToStream

System.Text.Json.Serialization.Tests.WriteJson<ArrayList>.SerializeToUtf8Bytes

System.Text.Json.Serialization.Tests.WriteJson<ArrayList>.SerializeToString

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline f6cc321fbd49b097364951137d3fd50c3b4872d2
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in Layout.SearchLoops

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
LoopReturn - Duration of single invocation 46.47 ns 253.37 ns 5.45 0.01 True
LoopGoto - Duration of single invocation 46.42 ns 253.48 ns 5.46 0.01 True

graph
graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'Layout.SearchLoops*'

Payloads

Baseline
Compare

Histogram

Layout.SearchLoops.LoopReturn

Layout.SearchLoops.LoopGoto

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline e363f9acfa1811904eaf9ce017120b8385a58443
Compare ca00588105feae898bc73b6d24bf9600d41b39db
Diff Diff

Regressions in System.Collections.ContainsTrue<String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
LinkedList - Duration of single invocation 629.35 μs 679.69 μs 1.08 0.02 True

graph
Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Collections.ContainsTrue&lt;String&gt;*'

Payloads

Baseline
Compare

Histogram

System.Collections.ContainsTrue<String>.LinkedList(Size: 512)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@kunalspathak kunalspathak mentioned this issue Jul 6, 2021
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
Needs Transfer refs/heads/main Regression Windows 10.0.19042 x64
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@DrewScoggins