[Perf] Windows/x64: 2 Regressions on 11/1/2022 1:15:18 PM

[performanceautofiler]

Run Information

Architecture	x64
OS	Windows 10.0.19042
Baseline	7d2de493f4407377faba16364b345660a77dca63
Compare	7ba371c7c5a7cec915d025d983d2ccedb839cc34
Diff	Diff

Regressions in System.Collections.ContainsKeyFalse<String, String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
SortedDictionary - Duration of single invocation	301.96 μs	339.81 μs	1.13	0.04	False
ImmutableSortedDictionary - Duration of single invocation	290.29 μs	311.25 μs	1.07	0.04	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.ContainsKeyFalse<String, String>*'

Related Issues

Regressions

• [Perf] Windows/arm64: 1 Regression on 11/1/2022 1:15:18 PM

Improvements

• [Perf] Windows/arm64: 1 Improvement on 11/1/2022 1:15:18 PM

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Collections.ContainsKeyFalse<String, String>.SortedDictionary(Size: 512)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 339.8119662267081 > 318.7910558894231.
IsChangePoint: Marked as a change because one of 9/23/2022 1:16:35 AM, 10/11/2022 8:42:28 PM, 10/26/2022 4:56:52 PM, 10/27/2022 9:35:54 AM, 11/1/2022 10:15:31 AM, 11/8/2022 2:29:58 AM falls between 10/30/2022 12:44:54 AM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -11.314044762999258 (T) = (0 -339440.83251085784) / Math.Sqrt((119839738.15851592 / (23)) + (19161793.93681896 / (7))) is less than -2.048407141790485 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (23) + (7) - 2, .025) and -0.10371322413414204 = (307544.4101679108 - 339440.83251085784) / 307544.4101679108 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Collections.ContainsKeyFalse<String, String>.ImmutableSortedDictionary(Size: 512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 311.25481209150325 > 301.1426729166667.
IsChangePoint: Marked as a change because one of 10/6/2022 2:13:23 PM, 10/7/2022 9:25:17 PM, 11/1/2022 4:32:17 PM, 11/8/2022 2:29:58 AM falls between 10/30/2022 12:44:54 AM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -7.935245098261172 (T) = (0 -306916.53590383584) / Math.Sqrt((40234119.00838339 / (25)) + (77355954.97085167 / (23))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (23) - 2, .025) and -0.061182143211994146 = (289221.3536263045 - 306916.53590383584) / 289221.3536263045 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository