Skip to content

[Perf] Linux/arm64: 85 Regressions on 1/14/2023 12:48:25 AM #11811

@performanceautofiler

Description

@performanceautofiler

Run Information

Architecture arm64
OS ubuntu 20.04
Baseline 52381a1f88c5b3c6c0bde46c7f6d2b4dba49aab5
Compare bd21232171668c318bdcd3446f27ee663a74e7bb
Diff Diff

Regressions in System.Text.Json.Tests.Perf_Doubles

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
WriteDoubles - Duration of single invocation 86.15 ms 144.18 ms 1.67 0.03 False
WriteDoubles - Duration of single invocation 88.89 ms 141.13 ms 1.59 0.02 False
WriteDoubles - Duration of single invocation 88.49 ms 143.80 ms 1.63 0.04 False
WriteDoubles - Duration of single invocation 87.64 ms 134.97 ms 1.54 0.04 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Tests.Perf_Doubles*'

Payloads

Baseline
Compare

Histogram

System.Text.Json.Tests.Perf_Doubles.WriteDoubles(Formatted: False, SkipValidation: False)


Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 144.1792567857143 > 91.12610216062501.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -21.998899790251347 (T) = (0 -138907805.8384782) / Math.Sqrt((118146921285548.23 / (22)) + (8805566641360.295 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -0.6485609125668402 = (84260038.42478356 - 138907805.8384782) / 84260038.42478356 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Doubles.WriteDoubles(Formatted: True, SkipValidation: True)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 141.12740340000002 > 92.6995007375.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -21.766820008789065 (T) = (0 -141507488.67056277) / Math.Sqrt((124037079474261.22 / (22)) + (9699455169313.46 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -0.6468101452391395 = (85928234.7024975 - 141507488.67056277) / 85928234.7024975 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Doubles.WriteDoubles(Formatted: True, SkipValidation: False)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 143.8019899 > 93.08843226125.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -22.04275855356004 (T) = (0 -141643927.17772228) / Math.Sqrt((122001493646991.12 / (22)) + (9619682272154.936 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -0.6510071829134964 = (85792435.45613553 - 141643927.17772228) / 85792435.45613553 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Doubles.WriteDoubles(Formatted: False, SkipValidation: True)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 134.97435863333334 > 91.530344908125.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -22.703359701645876 (T) = (0 -139630866.35) / Math.Sqrt((119035950847292.22 / (22)) + (6017566346836.912 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -0.6580237000432874 = (84215241.52299786 - 139630866.35) / 84215241.52299786 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information
Architecture arm64
OS ubuntu 20.04
Baseline 52381a1f88c5b3c6c0bde46c7f6d2b4dba49aab5
Compare bd21232171668c318bdcd3446f27ee663a74e7bb
Diff Diff

Regressions in System.Buffers.Text.Tests.Utf8FormatterTests

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
FormatterDouble - Duration of single invocation 581.03 ns 1.04 μs 1.80 0.06 False
FormatterDouble - Duration of single invocation 855.51 ns 1.31 μs 1.53 0.03 False
FormatterDouble - Duration of single invocation 891.42 ns 1.32 μs 1.48 0.02 False
FormatterInt32 - Duration of single invocation 101.60 ns 168.04 ns 1.65 0.19 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Buffers.Text.Tests.Utf8FormatterTests*'

Payloads

Baseline
Compare

Histogram

System.Buffers.Text.Tests.Utf8FormatterTests.FormatterDouble(value: 12345)


Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.0443771298653797 > 621.2602250860122.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -22.330410683870443 (T) = (0 -1039.5295575664525) / Math.Sqrt((6681.479719904247 / (22)) + (1524.1876049497682 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -0.8239976895515045 = (569.918242507236 - 1039.5295575664525) / 569.918242507236 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterDouble(value: -1.7976931348623157E+308)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.308134972532904 > 900.4946825477134.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -18.66479157836275 (T) = (0 -1307.655033672269) / Math.Sqrt((12907.709260648911 / (22)) + (551.986549304299 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -0.5630290552995387 = (836.6159472458879 - 1307.655033672269) / 836.6159472458879 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterDouble(value: 1.7976931348623157E+308)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.3163259766395987 > 903.0462250780093.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -19.137088288076054 (T) = (0 -1307.7313040674373) / Math.Sqrt((12970.904616639655 / (22)) + (209.7872979514165 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -0.5650202670139751 = (835.6002357481034 - 1307.7313040674373) / 835.6002357481034 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt32(value: -2147483648)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 168.03948883326922 > 104.37242863578727.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/15/2023 4:47:52 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -11.955916890703222 (T) = (0 -169.50046304284956) / Math.Sqrt((186.38173647227663 / (29)) + (120.30957495108424 / (4))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (29) + (4) - 2, .025) and -0.7426806784514022 = (97.26421204914759 - 169.50046304284956) / 97.26421204914759 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture arm64
OS ubuntu 20.04
Baseline 52381a1f88c5b3c6c0bde46c7f6d2b4dba49aab5
Compare bd21232171668c318bdcd3446f27ee663a74e7bb
Diff Diff

Regressions in System.Tests.Perf_Single

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
ToString - Duration of single invocation 534.28 ns 1.09 μs 2.05 0.03 False
ToStringWithCultureInfo - Duration of single invocation 531.45 ns 1.04 μs 1.96 0.02 False
TryParse - Duration of single invocation 267.78 ns 371.95 ns 1.39 0.03 False
ToStringWithFormat - Duration of single invocation 423.24 ns 922.78 ns 2.18 0.03 False
ToStringWithFormat - Duration of single invocation 545.90 ns 1.08 μs 1.97 0.02 False
ToStringWithFormat - Duration of single invocation 518.21 ns 1.00 μs 1.93 0.01 False
ToStringWithFormat - Duration of single invocation 462.70 ns 910.65 ns 1.97 0.03 False
ToString - Duration of single invocation 547.86 ns 1.04 μs 1.90 0.02 False
ToStringWithFormat - Duration of single invocation 520.66 ns 1.03 μs 1.97 0.01 False
ToString - Duration of single invocation 458.19 ns 960.61 ns 2.10 0.05 False
ToStringWithFormat - Duration of single invocation 576.17 ns 1.14 μs 1.98 0.05 False
Parse - Duration of single invocation 262.09 ns 374.71 ns 1.43 0.01 False
TryParse - Duration of single invocation 260.33 ns 380.08 ns 1.46 0.02 False
ToStringWithFormat - Duration of single invocation 564.15 ns 1.08 μs 1.92 0.02 False
ToStringWithFormat - Duration of single invocation 432.09 ns 942.63 ns 2.18 0.03 False
ToStringWithFormat - Duration of single invocation 469.16 ns 899.87 ns 1.92 0.05 False
ToStringWithCultureInfo - Duration of single invocation 521.32 ns 1.07 μs 2.06 0.01 False
Parse - Duration of single invocation 270.43 ns 381.11 ns 1.41 0.01 False
ToStringWithFormat - Duration of single invocation 553.26 ns 1.09 μs 1.98 0.02 False
ToStringWithFormat - Duration of single invocation 464.88 ns 968.84 ns 2.08 0.02 False
ToStringWithCultureInfo - Duration of single invocation 412.27 ns 904.28 ns 2.19 0.03 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Single*'

Payloads

Baseline
Compare

Histogram

System.Tests.Perf_Single.ToString(value: -3.4028235E+38)


Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.0940144647550774 > 568.9109405414339.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -32.71252641752556 (T) = (0 -1090.4646682314806) / Math.Sqrt((4748.190065288139 / (22)) + (876.6795090449701 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -1.064848191776336 = (528.1088811150721 - 1090.4646682314806) / 528.1088811150721 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Single.ToStringWithCultureInfo(value: -3.4028235E+38, culture: zh)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.040349428310654 > 557.9644782691596.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -31.29578767348893 (T) = (0 -1040.6490146822532) / Math.Sqrt((4577.228591246492 / (22)) + (820.8363582288528 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -1.0227491564427342 = (514.4725985264377 - 1040.6490146822532) / 514.4725985264377 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Single.TryParse(value: "-3.4028235E+38")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 371.95443351042417 > 282.39947623095395.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -16.431120793303368 (T) = (0 -377.6572530711475) / Math.Sqrt((773.2123208010917 / (22)) + (146.1390364532415 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -0.4342755548899039 = (263.3087148306985 - 377.6572530711475) / 263.3087148306985 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Single.ToStringWithFormat(value: 3.4028235E+38, format: "E")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 922.7775361234185 > 445.7259508563003.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -36.92009768495071 (T) = (0 -945.8801060422472) / Math.Sqrt((2707.5331263597477 / (22)) + (854.7993881529243 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -1.237521869446558 = (422.73558035712375 - 945.8801060422472) / 422.73558035712375 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Single.ToStringWithFormat(value: 3.4028235E+38, format: "R")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.0753949432203556 > 574.0708735525249.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -32.36347001260134 (T) = (0 -1098.914945690417) / Math.Sqrt((5164.04742338528 / (22)) + (742.673358592602 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -1.0491839778665861 = (536.269538294215 - 1098.914945690417) / 536.269538294215 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Single.ToStringWithFormat(value: 3.4028235E+38, format: "G17")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.0017189662173236 > 543.8827610272366.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -35.59338497924322 (T) = (0 -1039.0135704345462) / Math.Sqrt((3099.198370193167 / (22)) + (865.8201896164315 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -1.03099643413455 = (511.578234689167 - 1039.0135704345462) / 511.578234689167 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Single.ToStringWithFormat(value: 12345, format: "R")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 910.6513666510841 > 495.17323282284536.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -27.479313710534907 (T) = (0 -921.1396540033235) / Math.Sqrt((4043.4850905928274 / (22)) + (1093.8541684764155 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -1.0082696960354314 = (458.6732826879603 - 921.1396540033235) / 458.6732826879603 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Single.ToString(value: 3.4028235E+38)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.0408563785331675 > 565.9772102263504.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -32.43358030103064 (T) = (0 -1092.156708430564) / Math.Sqrt((4775.586869694899 / (22)) + (986.1551660296449 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -1.0837464937087677 = (524.1312759147985 - 1092.156708430564) / 524.1312759147985 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Single.ToStringWithFormat(value: -3.4028235E+38, format: "G17")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.0264138500122475 > 548.7963137560877.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -38.651646408104014 (T) = (0 -1039.4520785671532) / Math.Sqrt((3258.210677001105 / (22)) + (376.1141052998564 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -1.0082391919183546 = (517.5937621126818 - 1039.4520785671532) / 517.5937621126818 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Single.ToString(value: 12345)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 960.6132379754689 > 483.53541965030905.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -30.696747476814945 (T) = (0 -914.4239507190159) / Math.Sqrt((3884.1428082055645 / (22)) + (557.1680104333811 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -1.0243002835591295 = (451.72347113999984 - 914.4239507190159) / 451.72347113999984 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Single.ToStringWithFormat(value: 3.4028235E+38, format: "G")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.1412196820015554 > 577.9730969832802.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -28.987840526748034 (T) = (0 -1097.3907755941605) / Math.Sqrt((5284.215565521317 / (22)) + (1436.552088679689 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -1.0351989871586214 = (539.205641570335 - 1097.3907755941605) / 539.205641570335 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Single.Parse(value: "3.4028235E+38")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 374.70599184570017 > 274.81415679826904.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -19.777931025285636 (T) = (0 -370.6458304871487) / Math.Sqrt((671.9325573103959 / (22)) + (27.196412566223085 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -0.4421746882020833 = (257.00480913946836 - 370.6458304871487) / 257.00480913946836 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Single.TryParse(value: "3.4028235E+38")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 380.0756396795303 > 273.09033978773266.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -18.431980693095404 (T) = (0 -369.0071955489105) / Math.Sqrt((710.9146382427269 / (22)) + (57.14412114194219 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -0.4407536649002356 = (256.1209487358564 - 369.0071955489105) / 256.1209487358564 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Single.ToStringWithFormat(value: -3.4028235E+38, format: "G")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.0807208957671595 > 581.8720651281561.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -33.821788849279024 (T) = (0 -1111.3488259639898) / Math.Sqrt((5322.7212608941645 / (22)) + (452.26683607156855 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -1.0492456777601997 = (542.3209320508024 - 1111.3488259639898) / 542.3209320508024 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Single.ToStringWithFormat(value: -3.4028235E+38, format: "E")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 942.6272693407433 > 452.0084506995151.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -39.56013834869683 (T) = (0 -964.5858709159372) / Math.Sqrt((2785.3104064194617 / (22)) + (636.0441203450191 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -1.2571678162046038 = (427.3434451754123 - 964.5858709159372) / 427.3434451754123 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Single.ToStringWithFormat(value: 12345, format: "G")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 899.8723393220198 > 501.9359168411381.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -32.223033490616935 (T) = (0 -919.115349254561) / Math.Sqrt((4033.666376233582 / (22)) + (202.84633421848218 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -0.9921040264343877 = (461.3791935854175 - 919.115349254561) / 461.3791935854175 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Single.ToStringWithCultureInfo(value: 3.4028235E+38, culture: zh)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.0732752713692664 > 547.3890969902443.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -35.622211353745875 (T) = (0 -1056.8819589817374) / Math.Sqrt((4527.19473701261 / (22)) + (345.1040503465932 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -1.0792235914953983 = (508.30606352519186 - 1056.8819589817374) / 508.30606352519186 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Single.Parse(value: "-3.4028235E+38")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 381.1094532303394 > 282.38532515518887.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -19.02514610185643 (T) = (0 -378.4708978813185) / Math.Sqrt((716.632762929477 / (22)) + (46.06666719492705 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -0.4384069224102335 = (263.1181009940792 - 378.4708978813185) / 263.1181009940792 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Single.ToStringWithFormat(value: -3.4028235E+38, format: "R")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.092825987304167 > 583.4021907886233.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -34.01319294247653 (T) = (0 -1106.300624707004) / Math.Sqrt((5208.814660020266 / (22)) + (414.35401288165866 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -1.0379957066036587 = (542.8375639469161 - 1106.300624707004) / 542.8375639469161 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Single.ToStringWithFormat(value: 12345, format: "E")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 968.840055648648 > 488.4063912455135.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -40.33328120880908 (T) = (0 -986.5445207086457) / Math.Sqrt((3108.1413241387168 / (22)) + (376.1279214892162 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -1.1813398403889845 = (452.26539324231175 - 986.5445207086457) / 452.26539324231175 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Single.ToStringWithCultureInfo(value: 12345, culture: zh)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 904.2762007359582 > 436.1892330330309.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -33.369371008294934 (T) = (0 -849.1041108975164) / Math.Sqrt((2928.8415276772885 / (22)) + (449.0652879924252 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -1.0760949686672556 = (408.99097763461026 - 849.1041108975164) / 408.99097763461026 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions