[Perf] Linux/x64: 25 Regressions on 3/5/2024 8:17:11 PM

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	f84d33c7b8313d36f31f686920c7e5e9f038b60e
Compare	112240cce5df0808897405461864d40f040f550f
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_Random

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
Next_unseeded - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	22.94 ns	32.56 ns	1.42	0.65	False
Next_int_unseeded - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	27.20 ns	36.10 ns	1.33	0.68	False
Next_int - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	35.79 ns	44.19 ns	1.23	0.64	False
Next_long - Duration of single invocation 📈 - ADX Test Multi Config Graph	96.62 ns	110.43 ns	1.14	0.54	False
NextSingle - Duration of single invocation 📈 - ADX Test Multi Config Graph	24.53 ns	28.45 ns	1.16	0.63	False
Next_int_int_unseeded - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	20.81 ns	27.86 ns	1.34	0.64	False
Next_long_long_unseeded - Duration of single invocation 📈 - ADX Test Multi Config Graph	28.47 ns	38.78 ns	1.36	0.72	False
Next_int_int - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	26.51 ns	30.62 ns	1.16	0.61	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Random*'

Payloads

Baseline
Compare

System.Tests.Perf_Random.Next_unseeded

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Random.Next_int_unseeded

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Random.Next_int

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Random.Next_long

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Random.NextSingle

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Random.Next_int_int_unseeded

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Random.Next_long_long_unseeded

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Random.Next_int_int

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	f84d33c7b8313d36f31f686920c7e5e9f038b60e
Compare	112240cce5df0808897405461864d40f040f550f
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_Int64

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
TryFormat - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	56.16 ns	59.73 ns	1.06	0.65	False
Parse - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	67.65 ns	88.71 ns	1.31	0.54	False
TryParseSpan - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	47.47 ns	54.23 ns	1.14	0.59	False
ParseSpan - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	60.99 ns	71.58 ns	1.17	0.51	False
TryParse - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	41.67 ns	55.44 ns	1.33	0.59	False
TryFormat - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	71.25 ns	77.76 ns	1.09	0.41	False
TryParseSpan - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	60.89 ns	73.05 ns	1.20	0.42	False
TryParse - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	62.74 ns	72.38 ns	1.15	0.46	False
Parse - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	67.58 ns	90.14 ns	1.33	0.49	False
TryParse - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	58.29 ns	69.03 ns	1.18	0.47	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Int64*'

Payloads

Baseline
Compare

System.Tests.Perf_Int64.TryFormat(value: 9223372036854775807)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Int64.Parse(value: "-9223372036854775808")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Int64.TryParseSpan(value: "12345")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Int64.ParseSpan(value: "9223372036854775807")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Int64.TryParse(value: "12345")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Int64.TryFormat(value: -9223372036854775808)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Int64.TryParseSpan(value: "9223372036854775807")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Int64.TryParse(value: "-9223372036854775808")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Int64.Parse(value: "9223372036854775807")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Int64.TryParse(value: "9223372036854775807")

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	f84d33c7b8313d36f31f686920c7e5e9f038b60e
Compare	112240cce5df0808897405461864d40f040f550f
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Float

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
MaxBenchmark - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	6.59 ns	9.98 ns	1.51	0.87	False
AndNotBenchmark - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	3.30 ns	7.82 ns	2.37	0.88	False
GetHashCodeBenchmark - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	57.55 ns	82.55 ns	1.43	0.60	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Float*'

Payloads

Baseline
Compare

System.Runtime.Intrinsics.Tests.Perf_Vector128Float.MaxBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Float.AndNotBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Float.GetHashCodeBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	f84d33c7b8313d36f31f686920c7e5e9f038b60e
Compare	112240cce5df0808897405461864d40f040f550f
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Int

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
ConditionalSelectBenchmark - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	5.10 ns	9.70 ns	1.90	0.84	False
EqualsBenchmark - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	0.70 ns	1.90 ns	2.72	0.95	False
SquareRootBenchmark - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	17.26 ns	20.22 ns	1.17	0.79	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Int*'

Payloads

Baseline
Compare

System.Runtime.Intrinsics.Tests.Perf_Vector128Int.ConditionalSelectBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Int.EqualsBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Int.SquareRootBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	f84d33c7b8313d36f31f686920c7e5e9f038b60e
Compare	112240cce5df0808897405461864d40f040f550f
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Cache

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
IsMatch - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	21.13 ms	22.76 ms	1.08	0.07	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Cache*'

Payloads

Baseline
Compare

System.Text.RegularExpressions.Tests.Perf_Regex_Cache.IsMatch(total: 40000, unique: 1600, cacheSize: 3200)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[radekdoulik]

the range is dotnet/runtime@fb700b3...496f96e or possibly dotnet/runtime@23b4030...f6eb7bf