Payloads
Baseline
Compare
Histogram
Edge Detector Info
Collection Data
IfStatements.IfStatements.Single
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.IsImprovementWindowed:Marked as improvement because 32.24360716735254 < 61.848335634941215.IsChangePoint: Marked as a change because one of 11/1/2022 8:41:52 AM, 11/9/2022 1:54:51 PM falls between 10/31/2022 10:23:25 PM and 11/9/2022 1:54:51 PM.IsImprovementStdDev: Marked as improvement because 322.04281412524614 (T) = (0 -32265.290136511227) / Math.Sqrt((2169224.6288032285 / (248)) + (8303.988088221295 / (29))) is greater than 1.9686278708474185 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (248) + (29) - 2, .975) and 0.48682034075998704 = (62873.28337271611 - 32265.290136511227) / 62873.28337271611 is greater than 0.05.IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.```#### IfStatements.IfStatements.SingleArray```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.IsImprovementWindowed:Marked as improvement because 35.579103274487466 < 74.15371607016998.IsChangePoint: Marked as a change because one of 11/1/2022 8:41:52 AM, 11/9/2022 1:54:51 PM falls between 10/31/2022 10:23:25 PM and 11/9/2022 1:54:51 PM.IsImprovementStdDev: Marked as improvement because 460.6068564118743 (T) = (0 -35520.21771321987) / Math.Sqrt((1916274.9811927783 / (248)) + (523.5674591827595 / (12))) is greater than 1.9692013862338849 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (248) + (12) - 2, .975) and 0.5333841066167349 = (76123.03442061406 - 35520.21771321987) / 76123.03442061406 is greater than 0.05.IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Payloads
Baseline
Compare
Histogram
Edge Detector Info
Collection Data
System.Tests.Perf_Random.Next_long
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.IsImprovementWindowed:Marked as improvement because 35.96697726093585 < 45.69433633762902.IsChangePoint: Marked as a change because one of 11/1/2022 8:41:52 AM, 11/9/2022 1:54:51 PM falls between 10/31/2022 10:23:25 PM and 11/9/2022 1:54:51 PM.IsImprovementStdDev: Marked as improvement because 159.90437584277848 (T) = (0 -36.185021005774345) / Math.Sqrt((0.3689284038129063 / (299)) + (0.12865912497105744 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.24721327843238497 = (48.06809149133513 - 36.185021005774345) / 48.06809149133513 is greater than 0.05.IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.```#### System.Tests.Perf_Random.NextBytes_span```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.IsImprovementWindowed:Marked as improvement because 4.191785717880148 < 7.794704944073333.IsChangePoint: Marked as a change because one of 11/1/2022 8:41:52 AM, 11/9/2022 1:54:51 PM falls between 10/31/2022 10:23:25 PM and 11/9/2022 1:54:51 PM.IsImprovementStdDev: Marked as improvement because 1240.8423326247803 (T) = (0 -4193.968212114851) / Math.Sqrt((1325.8635453480001 / (299)) + (39.771960758686646 / (7))) is greater than 1.9677981407170237 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (7) - 2, .975) and 0.4848056764408173 = (8140.5559423503055 - 4193.968212114851) / 8140.5559423503055 is greater than 0.05.IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.```#### System.Tests.Perf_Random.NextDouble```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.IsImprovementWindowed:Marked as improvement because 5.480201574563121 < 9.343759610936175.IsChangePoint: Marked as a change because one of 11/1/2022 8:41:52 AM, 11/9/2022 1:54:51 PM falls between 10/31/2022 10:23:25 PM and 11/9/2022 1:54:51 PM.IsImprovementStdDev: Marked as improvement because 106.55533984739628 (T) = (0 -5.454400606891136) / Math.Sqrt((0.0679117371993256 / (299)) + (0.04367706971842197 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.444890434743205 = (9.825809080353205 - 5.454400606891136) / 9.825809080353205 is greater than 0.05.IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.```#### System.Tests.Perf_Random.Next_int_int```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.IsImprovementWindowed:Marked as improvement because 6.848887828290941 < 10.497395256481296.IsChangePoint: Marked as a change because one of 11/1/2022 8:41:52 AM, 11/9/2022 1:54:51 PM falls between 10/31/2022 10:23:25 PM and 11/9/2022 1:54:51 PM.IsImprovementStdDev: Marked as improvement because 58.96800885332623 (T) = (0 -6.8810543906213955) / Math.Sqrt((0.07655222310064919 / (299)) + (0.13402021989734336 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.37065838120083244 = (10.933734850955796 - 6.8810543906213955) / 10.933734850955796 is greater than 0.05.IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.```#### System.Tests.Perf_Random.Next_long_long```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.IsImprovementWindowed:Marked as improvement because 40.617226702758195 < 50.298054806309906.IsChangePoint: Marked as a change because one of 11/1/2022 8:41:52 AM, 11/9/2022 1:54:51 PM falls between 10/31/2022 10:23:25 PM and 11/9/2022 1:54:51 PM.IsImprovementStdDev: Marked as improvement because 186.85518993588823 (T) = (0 -40.60267573906873) / Math.Sqrt((0.578957880947749 / (299)) + (0.01498110740037631 / (7))) is greater than 1.9677981407170237 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (7) - 2, .975) and 0.22709956546209423 = (52.532867009376005 - 40.60267573906873) / 52.532867009376005 is greater than 0.05.IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.```#### System.Tests.Perf_Random.NextSingle```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.IsImprovementWindowed:Marked as improvement because 5.465740334277692 < 9.439761886047595.IsChangePoint: Marked as a change because one of 11/1/2022 8:41:52 AM, 11/9/2022 1:54:51 PM falls between 10/31/2022 10:23:25 PM and 11/9/2022 1:54:51 PM.IsImprovementStdDev: Marked as improvement because 61.38157335255541 (T) = (0 -5.442078090930788) / Math.Sqrt((0.03189901407676259 / (299)) + (0.1503090866063253 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.4465436080178418 = (9.83289409928113 - 5.442078090930788) / 9.83289409928113 is greater than 0.05.IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.```#### System.Tests.Perf_Random.NextBytes```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.IsImprovementWindowed:Marked as improvement because 4.337037524211399 < 7.681368820761547.IsChangePoint: Marked as a change because one of 11/1/2022 8:41:52 AM, 11/9/2022 1:54:51 PM falls between 10/31/2022 10:23:25 PM and 11/9/2022 1:54:51 PM.IsImprovementStdDev: Marked as improvement because 615.9690733638695 (T) = (0 -4325.635204662771) / Math.Sqrt((1216.612759890411 / (299)) + (224.42638689908563 / (7))) is greater than 1.9677981407170237 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (7) - 2, .975) and 0.46118878108209094 = (8028.109016270884 - 4325.635204662771) / 8028.109016270884 is greater than 0.05.IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository