[Perf] Windows/x64: 20 Regressions on 3/14/2024 9:26:54 PM

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	b60a541554cc075b903a4d218456ef8588092a8c
Compare	5c40bb5636b939fb548492fdeb9d501b599ac5f5
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Tests.Perf_Int32

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
ToString - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	9.67 ns	11.55 ns	1.20	0.34	False
ToString - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	12.62 ns	14.30 ns	1.13	0.23	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Int32*'

Payloads

Baseline
Compare

System.Tests.Perf_Int32.ToString(value: 12345)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Int32.ToString(value: 2147483647)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	b60a541554cc075b903a4d218456ef8588092a8c
Compare	5c40bb5636b939fb548492fdeb9d501b599ac5f5
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.Perf_Frozen<ReferenceType>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
ToFrozenDictionary - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	38.54 μs	42.81 μs	1.11	0.30	False
Contains_True - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	620.79 ns	681.27 ns	1.10	0.01	False
ToFrozenSet - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	46.95 μs	53.59 μs	1.14	0.33	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Perf_Frozen<ReferenceType>*'

Payloads

Baseline
Compare

System.Collections.Perf_Frozen<ReferenceType>.ToFrozenDictionary(Count: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_Frozen<ReferenceType>.Contains_True(Count: 64)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_Frozen<ReferenceType>.ToFrozenSet(Count: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	b60a541554cc075b903a4d218456ef8588092a8c
Compare	5c40bb5636b939fb548492fdeb9d501b599ac5f5
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Tests.Perf_Int64

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
ToString - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	22.89 ns	27.12 ns	1.18	0.03	False
TryFormat - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	15.61 ns	17.04 ns	1.09	0.05	False
ToString - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	11.18 ns	13.09 ns	1.17	0.13	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Int64*'

Payloads

Baseline
Compare

System.Tests.Perf_Int64.ToString(value: 9223372036854775807)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Int64.TryFormat(value: 9223372036854775807)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Int64.ToString(value: 12345)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	b60a541554cc075b903a4d218456ef8588092a8c
Compare	5c40bb5636b939fb548492fdeb9d501b599ac5f5
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Numerics.Tests.Perf_BigInteger

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
Remainder - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	631.18 ns	780.49 ns	1.24	0.01	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_BigInteger*'

Payloads

Baseline
Compare

System.Numerics.Tests.Perf_BigInteger.Remainder(arguments: 1024,512 bits)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	b60a541554cc075b903a4d218456ef8588092a8c
Compare	5c40bb5636b939fb548492fdeb9d501b599ac5f5
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Linq.Tests.Perf_Enumerable

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
Zip - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	706.42 ns	820.02 ns	1.16	0.03	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Linq.Tests.Perf_Enumerable*'

Payloads

Baseline
Compare

System.Linq.Tests.Perf_Enumerable.Zip(input: IEnumerable)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	b60a541554cc075b903a4d218456ef8588092a8c
Compare	5c40bb5636b939fb548492fdeb9d501b599ac5f5
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Tests.Perf_Version

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
TryFormatL - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	39.09 ns	45.65 ns	1.17	0.28	False
ToStringL - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	55.57 ns	64.32 ns	1.16	0.26	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Version*'

Payloads

Baseline
Compare

System.Tests.Perf_Version.TryFormatL

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Version.ToStringL

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	b60a541554cc075b903a4d218456ef8588092a8c
Compare	5c40bb5636b939fb548492fdeb9d501b599ac5f5
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Tests.Perf_UInt64

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
ToString - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	11.16 ns	12.47 ns	1.12	0.05	False
ToString - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	23.81 ns	26.97 ns	1.13	0.05	False
TryFormat - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	15.16 ns	17.11 ns	1.13	0.02	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_UInt64*'

Payloads

Baseline
Compare

System.Tests.Perf_UInt64.ToString(value: 12345)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_UInt64.ToString(value: 18446744073709551615)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_UInt64.TryFormat(value: 18446744073709551615)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	b60a541554cc075b903a4d218456ef8588092a8c
Compare	5c40bb5636b939fb548492fdeb9d501b599ac5f5
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.Perf_Frozen<Int16>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
ToFrozenDictionary - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	31.66 μs	38.09 μs	1.20	0.29	False
ToFrozenDictionary - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	2.82 μs	3.06 μs	1.08	0.06	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Perf_Frozen<Int16>*'

Payloads

Baseline
Compare

System.Collections.Perf_Frozen<Int16>.ToFrozenDictionary(Count: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_Frozen<Int16>.ToFrozenDictionary(Count: 64)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	b60a541554cc075b903a4d218456ef8588092a8c
Compare	5c40bb5636b939fb548492fdeb9d501b599ac5f5
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.CtorFromCollection<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
FrozenDictionaryOptimized - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	24.12 μs	29.25 μs	1.21	0.36	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.CtorFromCollection<Int32>*'

Payloads

Baseline
Compare

System.Collections.CtorFromCollection<Int32>.FrozenDictionaryOptimized(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	b60a541554cc075b903a4d218456ef8588092a8c
Compare	5c40bb5636b939fb548492fdeb9d501b599ac5f5
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.IO.Tests.Perf_Path

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
GetDirectoryName - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	52.33 ns	61.01 ns	1.17	0.07	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.IO.Tests.Perf_Path*'

Payloads

Baseline
Compare

System.IO.Tests.Perf_Path.GetDirectoryName

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	b60a541554cc075b903a4d218456ef8588092a8c
Compare	5c40bb5636b939fb548492fdeb9d501b599ac5f5
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.Perf_LengthBucketsFrozenDictionary

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
TryGetValue_True_FrozenDictionary - Duration of single invocation 📈 - ADX Test Multi Config Graph	11.93 μs	12.97 μs	1.09	0.05	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Perf_LengthBucketsFrozenDictionary*'

Payloads

Baseline
Compare

System.Collections.Perf_LengthBucketsFrozenDictionary.TryGetValue_True_FrozenDictionary(Count: 1000, ItemsPerBucket: 5)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository