dotnet/perf-autofiling-issuesPublic

NotificationsYou must be signed in to change notification settings
Fork4
Star10

[Perf] Linux/x64: 31 Regressions on 9/24/2024 6:50:13 AM #42467

New issue

Open

[Perf] Linux/x64: 31 Regressions on 9/24/2024 6:50:13 AM#42467

Labels

arch-wasmarch-x64branch-refs/heads/mainkind-microos-linuxperf-regressionwasm-aot

Description

performanceautofiler

bot

opened

on Oct 3, 2024

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	4602f78bd93f14be24d2e89afde28e9f5ba5a33c
Compare	5f619a75c050082b1abdadb44a248fa4b3d69dd0
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
XorBenchmark - Duration of single invocation 📝 -Benchmark Source ADX - Test Multi Config Graph	3.07 ns	4.63 ns	1.51	0.54	False
LessThanAllBenchmark - Duration of single invocation 📝 -Benchmark Source ADX - Test Multi Config Graph	2.47 ns	3.91 ns	1.58	0.68	False
AddOperatorBenchmark - Duration of single invocation 📝 -Benchmark Source ADX - Test Multi Config Graph	3.48 ns	4.84 ns	1.39	0.59	False
GreaterThanOrEqualAnyBenchmark - Duration of single invocation 📝 -Benchmark Source ADX - Test Multi Config Graph	1.13 ns	3.13 ns	2.78	0.70	False

Test Report

Repro

General Docs link:https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.gitpython3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int64&gt;*'

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.XorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.LessThanAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.AddOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.GreaterThanOrEqualAnyBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	4602f78bd93f14be24d2e89afde28e9f5ba5a33c
Compare	5f619a75c050082b1abdadb44a248fa4b3d69dd0
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
LessThanAnyBenchmark - Duration of single invocation 📝 -Benchmark Source ADX - Test Multi Config Graph	1.23 ns	2.87 ns	2.33	0.69	False
DotBenchmark - Duration of single invocation 📝 -Benchmark Source ADX - Test Multi Config Graph	2.19 ns	3.33 ns	1.52	0.68	False
EqualsAllBenchmark - Duration of single invocation 📝 -Benchmark Source ADX - Test Multi Config Graph	1.35 ns	3.95 ns	2.92	0.69	False
LessThanOrEqualAllBenchmark - Duration of single invocation 📝 -Benchmark Source ADX - Test Multi Config Graph	2.45 ns	3.77 ns	1.54	0.69	False

Test Report

Repro

General Docs link:https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.gitpython3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int32&gt;*'

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.LessThanAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.DotBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.EqualsAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.LessThanOrEqualAllBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	4602f78bd93f14be24d2e89afde28e9f5ba5a33c
Compare	5f619a75c050082b1abdadb44a248fa4b3d69dd0
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_UInt32

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
TryParse - Duration of single invocation 📝 -Benchmark Source ADX - Test Multi Config Graph	35.10 ns	51.53 ns	1.47	0.37	True
TryParseHex - Duration of single invocation 📝 -Benchmark Source ADX - Test Multi Config Graph	44.83 ns	48.33 ns	1.08	0.41	False

Test Report

Repro

General Docs link:https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.gitpython3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_UInt32*'

System.Tests.Perf_UInt32.TryParse(value: "0")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_UInt32.TryParseHex(value: "3039")

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	4602f78bd93f14be24d2e89afde28e9f5ba5a33c
Compare	5f619a75c050082b1abdadb44a248fa4b3d69dd0
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
SumBenchmark - Duration of single invocation 📝 -Benchmark Source ADX - Test Multi Config Graph	2.43 ns	3.49 ns	1.43	0.82	False

Test Report

Repro

General Docs link:https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.gitpython3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Double&gt;*'

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.SumBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	b5833d2cd22f474485f74696609f6a6c3617cd15
Compare	5f619a75c050082b1abdadb44a248fa4b3d69dd0
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_Vector2

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
DivideByVector2Benchmark - Duration of single invocation 📝 -Benchmark Source ADX - Test Multi Config Graph	3.52 ns	5.73 ns	1.63	0.56	False

Test Report

Repro

General Docs link:https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.gitpython3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_Vector2*'

System.Numerics.Tests.Perf_Vector2.DivideByVector2Benchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	4602f78bd93f14be24d2e89afde28e9f5ba5a33c
Compare	5f619a75c050082b1abdadb44a248fa4b3d69dd0
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in Benchstone.BenchF.Secant

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
Test - Duration of single invocation 📝 -Benchmark Source ADX - Test Multi Config Graph	19.32 ns	25.24 ns	1.31	0.27	False

Test Report

Repro

General Docs link:https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.gitpython3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Benchstone.BenchF.Secant*'

Benchstone.BenchF.Secant.Test

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	4602f78bd93f14be24d2e89afde28e9f5ba5a33c
Compare	5f619a75c050082b1abdadb44a248fa4b3d69dd0
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in PerfLabTests.BlockCopyPerf

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
CallBlockCopy - Duration of single invocation 📝 -Benchmark Source ADX - Test Multi Config Graph	37.62 ns	40.84 ns	1.09	0.33	False

Test Report

Repro

General Docs link:https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.gitpython3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'PerfLabTests.BlockCopyPerf*'

PerfLabTests.BlockCopyPerf.CallBlockCopy(numElements: 10)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	4602f78bd93f14be24d2e89afde28e9f5ba5a33c
Compare	5f619a75c050082b1abdadb44a248fa4b3d69dd0
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Memory.Span<Byte>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
StartsWith - Duration of single invocation 📝 -Benchmark Source ADX - Test Multi Config Graph	10.76 ns	12.59 ns	1.17	0.47	False
SequenceEqual - Duration of single invocation 📝 -Benchmark Source ADX - Test Multi Config Graph	13.94 ns	17.06 ns	1.22	0.44	False
IndexOfAnyThreeValues - Duration of single invocation 📝 -Benchmark Source ADX - Test Multi Config Graph	11.37 ns	15.55 ns	1.37	0.45	False

Test Report

Repro

General Docs link:https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.gitpython3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.Span&lt;Byte&gt;*'

System.Memory.Span<Byte>.StartsWith(Size: 33)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Byte>.SequenceEqual(Size: 33)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Byte>.IndexOfAnyThreeValues(Size: 33)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	4602f78bd93f14be24d2e89afde28e9f5ba5a33c
Compare	5f619a75c050082b1abdadb44a248fa4b3d69dd0
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_UInt64

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
TryParse - Duration of single invocation 📝 -Benchmark Source ADX - Test Multi Config Graph	29.49 ns	37.61 ns	1.28	0.29	False
TryParse - Duration of single invocation 📝 -Benchmark Source ADX - Test Multi Config Graph	43.71 ns	49.49 ns	1.13	0.27	False

Test Report

Repro

General Docs link:https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.gitpython3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_UInt64*'

System.Tests.Perf_UInt64.TryParse(value: "0")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_UInt64.TryParse(value: "12345")

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	4602f78bd93f14be24d2e89afde28e9f5ba5a33c
Compare	5f619a75c050082b1abdadb44a248fa4b3d69dd0
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Memory.Span<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
IndexOfAnyTwoValues - Duration of single invocation 📝 -Benchmark Source ADX - Test Multi Config Graph	17.48 ns	19.52 ns	1.12	0.33	False

Test Report

Repro

General Docs link:https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.gitpython3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.Span&lt;Int32&gt;*'

System.Memory.Span<Int32>.IndexOfAnyTwoValues(Size: 33)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	4602f78bd93f14be24d2e89afde28e9f5ba5a33c
Compare	5f619a75c050082b1abdadb44a248fa4b3d69dd0
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.IO.Tests.Perf_Path

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
IsPathRooted - Duration of single invocation 📝 -Benchmark Source ADX - Test Multi Config Graph	3.50 ns	5.20 ns	1.48	0.65	False

Test Report

Repro

General Docs link:https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.gitpython3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.IO.Tests.Perf_Path*'

System.IO.Tests.Perf_Path.IsPathRooted

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	4602f78bd93f14be24d2e89afde28e9f5ba5a33c
Compare	5f619a75c050082b1abdadb44a248fa4b3d69dd0
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_Matrix3x2

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
CreateSkewFromScalarXYWithCenterBenchmark - Duration of single invocation 📝 -Benchmark Source ADX - Test Multi Config Graph	20.74 ns	22.50 ns	1.08	0.21	False

Test Report

Repro

General Docs link:https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.gitpython3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_Matrix3x2*'

System.Numerics.Tests.Perf_Matrix3x2.CreateSkewFromScalarXYWithCenterBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	b5833d2cd22f474485f74696609f6a6c3617cd15
Compare	5f619a75c050082b1abdadb44a248fa4b3d69dd0
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_String

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
Trim_CharArr - Duration of single invocation 📝 -Benchmark Source ADX - Test Multi Config Graph	22.13 ns	30.60 ns	1.38	0.31	True
Replace_Char - Duration of single invocation 📝 -Benchmark Source ADX - Test Multi Config Graph	14.87 ns	26.84 ns	1.80	0.46	True

Test Report

Repro

General Docs link:https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.gitpython3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_String*'

System.Tests.Perf_String.Trim_CharArr(s: "Test", c: [' ', ' '])

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_String.Replace_Char(text: "This is a very nice sentence", oldChar: 'z', newChar: 'y')

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Metadata

Assignees

No one assigned

Labels

arch-wasmarch-x64branch-refs/heads/mainkind-microos-linuxperf-regressionwasm-aot

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Movatterモバイル変換

[Perf] Linux/x64: 31 Regressions on 9/24/2024 6:50:13 AM #42467

Description

Run Information

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>

Repro

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.XorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.LessThanAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.AddOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.GreaterThanOrEqualAnyBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Run Information

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>

Repro

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.LessThanAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.DotBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.EqualsAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.LessThanOrEqualAllBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Run Information

Regressions in System.Tests.Perf_UInt32

Repro

System.Tests.Perf_UInt32.TryParse(value: "0")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_UInt32.TryParseHex(value: "3039")

ETL Files

Histogram

JIT Disasms

Docs

Run Information

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>

Repro

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.SumBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Run Information

Regressions in System.Numerics.Tests.Perf_Vector2

Repro

System.Numerics.Tests.Perf_Vector2.DivideByVector2Benchmark

ETL Files

Histogram

JIT Disasms

Docs

Run Information

Regressions in Benchstone.BenchF.Secant

Repro

Benchstone.BenchF.Secant.Test

ETL Files

Histogram

JIT Disasms

Docs

Run Information