[Perf] Changes at 7/5/2022 10:32:06 PM

[performanceautofiler]

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	338db1a1ba498f308797ce7a54c0ed54e7286d50
Compare	ffcb0149763663a55a79784be216afe81f6bf76c
Diff	Diff

Regressions in Benchstone.MDBenchI.MDMulMatrix

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Test - Duration of single invocation	538.19 ms	721.44 ms	1.34	0.00	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Benchstone.MDBenchI.MDMulMatrix*'

Payloads

Baseline
Compare

Histogram

Benchstone.MDBenchI.MDMulMatrix.Test

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 721.4352818461539 > 566.1697263687499.
IsChangePoint: Marked as a change because one of 7/5/2022 7:01:28 PM, 7/12/2022 10:14:57 AM falls between 7/3/2022 4:26:07 AM and 7/12/2022 10:14:57 AM.
IsRegressionStdDev: Marked as regression because -257.110001739793 (T) = (0 -722150207.6639632) / Math.Sqrt((3331464289143.54 / (31)) + (18376190102758.61 / (46))) is less than -1.9921021540016632 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (46) - 2, .025) and -0.33958011521902637 = (539086986.6307988 - 722150207.6639632) / 539086986.6307988 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	x64
OS	alpine 3.15
Baseline	338db1a1ba498f308797ce7a54c0ed54e7286d50
Compare	ffcb0149763663a55a79784be216afe81f6bf76c
Diff	Diff

Regressions in System.Collections.CreateAddAndClear<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ICollection - Duration of single invocation	1.10 μs	1.20 μs	1.09	0.02	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.CreateAddAndClear<Int32>*'

Payloads

Baseline
Compare

Histogram

System.Collections.CreateAddAndClear<Int32>.ICollection(Size: 512)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.1954257539590871 > 1.1450025410605038.
IsChangePoint: Marked as a change because one of 5/11/2022 11:37:12 AM, 5/20/2022 10:18:01 PM, 5/25/2022 1:42:32 AM, 5/30/2022 12:57:05 PM, 6/27/2022 8:54:23 AM, 7/5/2022 7:01:28 PM, 7/12/2022 10:14:57 AM falls between 7/3/2022 4:26:07 AM and 7/12/2022 10:14:57 AM.
IsRegressionStdDev: Marked as regression because -93.00829284830388 (T) = (0 -1201.2518811621171) / Math.Sqrt((22.85327157573512 / (31)) + (27.979709402633407 / (46))) is less than -1.9921021540016632 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (46) - 2, .025) and -0.09867115293622834 = (1093.368000016874 - 1201.2518811621171) / 1093.368000016874 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	338db1a1ba498f308797ce7a54c0ed54e7286d50
Compare	ffcb0149763663a55a79784be216afe81f6bf76c
Diff	Diff

Regressions in System.Collections.IterateFor<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ImmutableList - Duration of single invocation	10.79 μs	11.37 μs	1.05	0.02	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.IterateFor<Int32>*'

Payloads

Baseline
Compare

Histogram

System.Collections.IterateFor<Int32>.ImmutableList(Size: 512)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 11.36948709242424 > 11.330665921906984.
IsChangePoint: Marked as a change because one of 5/11/2022 7:02:26 PM, 5/23/2022 3:43:39 PM, 6/23/2022 8:35:19 AM, 7/5/2022 7:01:28 PM, 7/12/2022 10:14:57 AM falls between 7/3/2022 4:26:07 AM and 7/12/2022 10:14:57 AM.
IsRegressionStdDev: Marked as regression because -19.901078028946806 (T) = (0 -11408.779946606766) / Math.Sqrt((191.55726690278462 / (31)) + (43409.99729535955 / (46))) is less than -1.9921021540016632 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (46) - 2, .025) and -0.05681590606897437 = (10795.427927503353 - 11408.779946606766) / 10795.427927503353 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[AndyAyersMS]

dotnet/runtime#70271