dotnet/perf-autofiling-issuesPublic

NotificationsYou must be signed in to change notification settings
Fork4
Star10

[Perf] Linux/x64: 23 Regressions on 11/1/2024 7:42:33 PM #44362

New issue

Open

[Perf] Linux/x64: 23 Regressions on 11/1/2024 7:42:33 PM#44362

Labels

arch-wasmarch-x64branch-refs/heads/mainkind-microos-linuxperf-regressionwasm-aot

Description

performanceautofiler

bot

opened

on Nov 5, 2024

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	357b09da5abffaeb67d64c928e15293ca2a2de5e
Compare	a9ca41321284c0d1e423bfc240e9c9f8be970b8b
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Memory.Span<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
Reverse - Duration of single invocation 📝 -Benchmark Source ADX - Test Multi Config Graph	18.36 ns	26.56 ns	1.45	0.35	False
IndexOfAnyFiveValues - Duration of single invocation 📝 -Benchmark Source ADX - Test Multi Config Graph	14.96 ns	16.94 ns	1.13	0.37	False
BinarySearch - Duration of single invocation 📝 -Benchmark Source ADX - Test Multi Config Graph	21.64 ns	25.59 ns	1.18	0.27	False

Test Report

Repro

General Docs link:https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.gitpython3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.Span&lt;Int32&gt;*'

System.Memory.Span<Int32>.Reverse(Size: 33)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Int32>.IndexOfAnyFiveValues(Size: 4)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Int32>.BinarySearch(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	357b09da5abffaeb67d64c928e15293ca2a2de5e
Compare	a9ca41321284c0d1e423bfc240e9c9f8be970b8b
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.Perf_SingleCharFrozenDictionary

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
TryGetValue_True_FrozenDictionary - Duration of single invocation ADX - Test Multi Config Graph	3.78 μs	4.29 μs	1.13	0.31	False

Test Report

Repro

General Docs link:https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.gitpython3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Perf_SingleCharFrozenDictionary*'

System.Collections.Perf_SingleCharFrozenDictionary.TryGetValue_True_FrozenDictionary(Count: 100)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	357b09da5abffaeb67d64c928e15293ca2a2de5e
Compare	a9ca41321284c0d1e423bfc240e9c9f8be970b8b
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in PerfLabTests.CastingPerf

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
CheckArrayIsArrayByVariance - Duration of single invocation 📝 -Benchmark Source ADX - Test Multi Config Graph	3.26 ns	9.14 ns	2.80	0.62	False
CheckListIsVariantGenericInterface - Duration of single invocation 📝 -Benchmark Source ADX - Test Multi Config Graph	8.83 ns	15.24 ns	1.73	0.52	False
CheckArrayIsVariantGenericInterfaceNo - Duration of single invocation 📝 -Benchmark Source ADX - Test Multi Config Graph	9.82 ns	16.94 ns	1.72	0.52	False

Test Report

Repro

General Docs link:https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.gitpython3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'PerfLabTests.CastingPerf*'

PerfLabTests.CastingPerf.CheckArrayIsArrayByVariance

ETL Files

Histogram

JIT Disasms

PerfLabTests.CastingPerf.CheckListIsVariantGenericInterface

ETL Files

Histogram

JIT Disasms

PerfLabTests.CastingPerf.CheckArrayIsVariantGenericInterfaceNo

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	357b09da5abffaeb67d64c928e15293ca2a2de5e
Compare	a9ca41321284c0d1e423bfc240e9c9f8be970b8b
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Globalization.Tests.StringSearch

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
IsPrefix_DifferentFirstChar - Duration of single invocation 📝 -Benchmark Source ADX - Test Multi Config Graph	37.07 ns	42.74 ns	1.15	0.29	False

Test Report

Repro

General Docs link:https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.gitpython3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Globalization.Tests.StringSearch*'

System.Globalization.Tests.StringSearch.IsPrefix_DifferentFirstChar(Options: (en-US, IgnoreNonSpace, False))

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	357b09da5abffaeb67d64c928e15293ca2a2de5e
Compare	a9ca41321284c0d1e423bfc240e9c9f8be970b8b
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in PerfLabTests.BlockCopyPerf

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
CallBlockCopy - Duration of single invocation 📝 -Benchmark Source ADX - Test Multi Config Graph	34.03 ns	45.29 ns	1.33	0.38	False

Test Report

Repro

General Docs link:https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.gitpython3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'PerfLabTests.BlockCopyPerf*'

PerfLabTests.BlockCopyPerf.CallBlockCopy(numElements: 10)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	357b09da5abffaeb67d64c928e15293ca2a2de5e
Compare	a9ca41321284c0d1e423bfc240e9c9f8be970b8b
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Buffers.Tests.SearchValuesCharTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
IndexOfAnyExcept - Duration of single invocation 📝 -Benchmark Source ADX - Test Multi Config Graph	45.38 ns	47.75 ns	1.05	0.22	False

Test Report

Repro

General Docs link:https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.gitpython3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Buffers.Tests.SearchValuesCharTests*'

System.Buffers.Tests.SearchValuesCharTests.IndexOfAnyExcept(Values: "abcdefABCDEF0123456789")

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	357b09da5abffaeb67d64c928e15293ca2a2de5e
Compare	a9ca41321284c0d1e423bfc240e9c9f8be970b8b
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
SumOfMagnitudes - Duration of single invocation 📝 -Benchmark Source ADX - Test Multi Config Graph	53.11 ns	65.89 ns	1.24	0.33	False
IndexOfMax - Duration of single invocation 📝 -Benchmark Source ADX - Test Multi Config Graph	64.47 ns	74.17 ns	1.15	0.13	False

Test Report

Repro

General Docs link:https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.gitpython3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives&lt;Int32&gt;*'

System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives<Int32>.SumOfMagnitudes(BufferLength: 128)

ETL Files

Histogram

JIT Disasms

System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives<Int32>.IndexOfMax(BufferLength: 128)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	357b09da5abffaeb67d64c928e15293ca2a2de5e
Compare	a9ca41321284c0d1e423bfc240e9c9f8be970b8b
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives<Double>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
AddMultiply_ScalarMultiplier - Duration of single invocation 📝 -Benchmark Source ADX - Test Multi Config Graph	68.79 ns	78.58 ns	1.14	0.20	False

Test Report

Repro

General Docs link:https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.gitpython3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives&lt;Double&gt;*'

System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives<Double>.AddMultiply_ScalarMultiplier(BufferLength: 128)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	357b09da5abffaeb67d64c928e15293ca2a2de5e
Compare	a9ca41321284c0d1e423bfc240e9c9f8be970b8b
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_Random

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
Next_int - Duration of single invocation 📝 -Benchmark Source ADX - Test Multi Config Graph	33.52 ns	36.32 ns	1.08	0.26	False
Next_int_int - Duration of single invocation 📝 -Benchmark Source ADX - Test Multi Config Graph	21.09 ns	27.23 ns	1.29	0.37	False

Test Report

Repro

General Docs link:https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.gitpython3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Random*'

System.Tests.Perf_Random.Next_int

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Random.Next_int_int

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	357b09da5abffaeb67d64c928e15293ca2a2de5e
Compare	a9ca41321284c0d1e423bfc240e9c9f8be970b8b
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.IO.Tests.BinaryReaderTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
ReadDouble - Duration of single invocation 📝 -Benchmark Source ADX - Test Multi Config Graph	29.33 ns	37.39 ns	1.27	0.42	False

Test Report

Repro

General Docs link:https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.gitpython3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.IO.Tests.BinaryReaderTests*'

System.IO.Tests.BinaryReaderTests.ReadDouble

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	357b09da5abffaeb67d64c928e15293ca2a2de5e
Compare	a9ca41321284c0d1e423bfc240e9c9f8be970b8b
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.Perf_SubstringFrozenDictionary

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
TryGetValue_True_FrozenDictionary - Duration of single invocation ADX - Test Multi Config Graph	50.45 μs	53.54 μs	1.06	0.26	False

Test Report

Repro

General Docs link:https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.gitpython3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Perf_SubstringFrozenDictionary*'

System.Collections.Perf_SubstringFrozenDictionary.TryGetValue_True_FrozenDictionary(Count: 1000)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	357b09da5abffaeb67d64c928e15293ca2a2de5e
Compare	a9ca41321284c0d1e423bfc240e9c9f8be970b8b
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.TryAddGiventSize<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
Dictionary - Duration of single invocation 📝 -Benchmark Source ADX - Test Multi Config Graph	16.93 μs	21.68 μs	1.28	0.14	False

Test Report

Repro

General Docs link:https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.gitpython3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.TryAddGiventSize&lt;Int32&gt;*'

System.Collections.TryAddGiventSize<Int32>.Dictionary(Count: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	357b09da5abffaeb67d64c928e15293ca2a2de5e
Compare	a9ca41321284c0d1e423bfc240e9c9f8be970b8b
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Json.Tests.Perf_Base64

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
WriteByteArrayAsBase64_NoEscaping - Duration of single invocation 📝 -Benchmark Source ADX - Test Multi Config Graph	292.90 ns	319.32 ns	1.09	0.08	False

Test Report

Repro

General Docs link:https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.gitpython3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Tests.Perf_Base64*'

System.Text.Json.Tests.Perf_Base64.WriteByteArrayAsBase64_NoEscaping(NumberOfBytes: 100)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	357b09da5abffaeb67d64c928e15293ca2a2de5e
Compare	a9ca41321284c0d1e423bfc240e9c9f8be970b8b
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_Boolean

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
TryParse - Duration of single invocation 📝 -Benchmark Source ADX - Test Multi Config Graph	17.19 ns	20.65 ns	1.20	0.41	False

Test Report

Repro

General Docs link:https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.gitpython3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Boolean*'

System.Tests.Perf_Boolean.TryParse(value: "TRUE")

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	357b09da5abffaeb67d64c928e15293ca2a2de5e
Compare	a9ca41321284c0d1e423bfc240e9c9f8be970b8b
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
ConvertDoubleToULongBenchmark - Duration of single invocation 📝 -Benchmark Source ADX - Test Multi Config Graph	30.05 ns	36.15 ns	1.20	0.32	False

Test Report

Repro

General Docs link:https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.gitpython3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128*'

System.Runtime.Intrinsics.Tests.Perf_Vector128.ConvertDoubleToULongBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Metadata

Assignees

No one assigned

Labels

arch-wasmarch-x64branch-refs/heads/mainkind-microos-linuxperf-regressionwasm-aot

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Movatterモバイル変換

[Perf] Linux/x64: 23 Regressions on 11/1/2024 7:42:33 PM #44362

Description

Run Information

Regressions in System.Memory.Span<Int32>

Repro

System.Memory.Span<Int32>.Reverse(Size: 33)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Int32>.IndexOfAnyFiveValues(Size: 4)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Int32>.BinarySearch(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Run Information

Regressions in System.Collections.Perf_SingleCharFrozenDictionary

Repro

System.Collections.Perf_SingleCharFrozenDictionary.TryGetValue_True_FrozenDictionary(Count: 100)

ETL Files

Histogram

JIT Disasms

Docs

Run Information

Regressions in PerfLabTests.CastingPerf

Repro

PerfLabTests.CastingPerf.CheckArrayIsArrayByVariance

ETL Files

Histogram

JIT Disasms

PerfLabTests.CastingPerf.CheckListIsVariantGenericInterface

ETL Files

Histogram

JIT Disasms

PerfLabTests.CastingPerf.CheckArrayIsVariantGenericInterfaceNo

ETL Files

Histogram

JIT Disasms

Docs

Run Information

Regressions in System.Globalization.Tests.StringSearch

Repro

System.Globalization.Tests.StringSearch.IsPrefix_DifferentFirstChar(Options: (en-US, IgnoreNonSpace, False))

ETL Files

Histogram

JIT Disasms

Docs

Run Information

Regressions in PerfLabTests.BlockCopyPerf

Repro

PerfLabTests.BlockCopyPerf.CallBlockCopy(numElements: 10)

ETL Files

Histogram

JIT Disasms

Docs

Run Information

Regressions in System.Buffers.Tests.SearchValuesCharTests

Repro

System.Buffers.Tests.SearchValuesCharTests.IndexOfAnyExcept(Values: "abcdefABCDEF0123456789")

ETL Files

Histogram

JIT Disasms

Docs

Run Information

Regressions in System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives<Int32>

Repro

System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives<Int32>.SumOfMagnitudes(BufferLength: 128)

ETL Files

Histogram

JIT Disasms

System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives<Int32>.IndexOfMax(BufferLength: 128)

ETL Files

Histogram

JIT Disasms

Docs

Run Information