-
Notifications
You must be signed in to change notification settings - Fork 4
Closed
Labels
LinkedFromMasterIs this issue linked from the master perf issueIs this issue linked from the master perf issuePGOApplied if there were any profile guided optimization updates in the observed interval.Applied if there were any profile guided optimization updates in the observed interval.amperearch-arm64branch-refs/heads/mainkind-micro_monomono-aotos-linuxperf-regressionruntime-mono
Description
Run Information
| Architecture | arm64 |
|---|---|
| OS | ubuntu 20.04 |
| Baseline | 52381a1f88c5b3c6c0bde46c7f6d2b4dba49aab5 |
| Compare | bd21232171668c318bdcd3446f27ee663a74e7bb |
| Diff | Diff |
Regressions in System.Text.Json.Tests.Perf_Doubles
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| WriteDoubles - Duration of single invocation | 86.15 ms | 144.18 ms | 1.67 | 0.03 | False | |||||
| WriteDoubles - Duration of single invocation | 88.89 ms | 141.13 ms | 1.59 | 0.02 | False | |||||
| WriteDoubles - Duration of single invocation | 88.49 ms | 143.80 ms | 1.63 | 0.04 | False | |||||
| WriteDoubles - Duration of single invocation | 87.64 ms | 134.97 ms | 1.54 | 0.04 | False |
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Tests.Perf_Doubles*'Payloads
Histogram
System.Text.Json.Tests.Perf_Doubles.WriteDoubles(Formatted: False, SkipValidation: False)
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 144.1792567857143 > 91.12610216062501.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -21.998899790251347 (T) = (0 -138907805.8384782) / Math.Sqrt((118146921285548.23 / (22)) + (8805566641360.295 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -0.6485609125668402 = (84260038.42478356 - 138907805.8384782) / 84260038.42478356 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Tests.Perf_Doubles.WriteDoubles(Formatted: True, SkipValidation: True)
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 141.12740340000002 > 92.6995007375.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -21.766820008789065 (T) = (0 -141507488.67056277) / Math.Sqrt((124037079474261.22 / (22)) + (9699455169313.46 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -0.6468101452391395 = (85928234.7024975 - 141507488.67056277) / 85928234.7024975 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Tests.Perf_Doubles.WriteDoubles(Formatted: True, SkipValidation: False)
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 143.8019899 > 93.08843226125.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -22.04275855356004 (T) = (0 -141643927.17772228) / Math.Sqrt((122001493646991.12 / (22)) + (9619682272154.936 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -0.6510071829134964 = (85792435.45613553 - 141643927.17772228) / 85792435.45613553 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Tests.Perf_Doubles.WriteDoubles(Formatted: False, SkipValidation: True)
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 134.97435863333334 > 91.530344908125.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -22.703359701645876 (T) = (0 -139630866.35) / Math.Sqrt((119035950847292.22 / (22)) + (6017566346836.912 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -0.6580237000432874 = (84215241.52299786 - 139630866.35) / 84215241.52299786 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
| Architecture | arm64 |
|---|---|
| OS | ubuntu 20.04 |
| Baseline | 52381a1f88c5b3c6c0bde46c7f6d2b4dba49aab5 |
| Compare | bd21232171668c318bdcd3446f27ee663a74e7bb |
| Diff | Diff |
Regressions in System.Buffers.Text.Tests.Utf8FormatterTests
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| FormatterDouble - Duration of single invocation | 581.03 ns | 1.04 μs | 1.80 | 0.06 | False | |||||
| FormatterDouble - Duration of single invocation | 855.51 ns | 1.31 μs | 1.53 | 0.03 | False | |||||
| FormatterDouble - Duration of single invocation | 891.42 ns | 1.32 μs | 1.48 | 0.02 | False | |||||
| FormatterInt32 - Duration of single invocation | 101.60 ns | 168.04 ns | 1.65 | 0.19 | False |
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Buffers.Text.Tests.Utf8FormatterTests*'Payloads
Histogram
System.Buffers.Text.Tests.Utf8FormatterTests.FormatterDouble(value: 12345)
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.0443771298653797 > 621.2602250860122.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -22.330410683870443 (T) = (0 -1039.5295575664525) / Math.Sqrt((6681.479719904247 / (22)) + (1524.1876049497682 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -0.8239976895515045 = (569.918242507236 - 1039.5295575664525) / 569.918242507236 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterDouble(value: -1.7976931348623157E+308)
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.308134972532904 > 900.4946825477134.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -18.66479157836275 (T) = (0 -1307.655033672269) / Math.Sqrt((12907.709260648911 / (22)) + (551.986549304299 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -0.5630290552995387 = (836.6159472458879 - 1307.655033672269) / 836.6159472458879 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterDouble(value: 1.7976931348623157E+308)
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.3163259766395987 > 903.0462250780093.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -19.137088288076054 (T) = (0 -1307.7313040674373) / Math.Sqrt((12970.904616639655 / (22)) + (209.7872979514165 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -0.5650202670139751 = (835.6002357481034 - 1307.7313040674373) / 835.6002357481034 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt32(value: -2147483648)
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 168.03948883326922 > 104.37242863578727.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/15/2023 4:47:52 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -11.955916890703222 (T) = (0 -169.50046304284956) / Math.Sqrt((186.38173647227663 / (29)) + (120.30957495108424 / (4))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (29) + (4) - 2, .025) and -0.7426806784514022 = (97.26421204914759 - 169.50046304284956) / 97.26421204914759 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
| Architecture | arm64 |
|---|---|
| OS | ubuntu 20.04 |
| Baseline | 52381a1f88c5b3c6c0bde46c7f6d2b4dba49aab5 |
| Compare | bd21232171668c318bdcd3446f27ee663a74e7bb |
| Diff | Diff |
Regressions in System.Tests.Perf_Single
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Single*'Payloads
Histogram
System.Tests.Perf_Single.ToString(value: -3.4028235E+38)
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.0940144647550774 > 568.9109405414339.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -32.71252641752556 (T) = (0 -1090.4646682314806) / Math.Sqrt((4748.190065288139 / (22)) + (876.6795090449701 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -1.064848191776336 = (528.1088811150721 - 1090.4646682314806) / 528.1088811150721 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Tests.Perf_Single.ToStringWithCultureInfo(value: -3.4028235E+38, culture: zh)
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.040349428310654 > 557.9644782691596.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -31.29578767348893 (T) = (0 -1040.6490146822532) / Math.Sqrt((4577.228591246492 / (22)) + (820.8363582288528 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -1.0227491564427342 = (514.4725985264377 - 1040.6490146822532) / 514.4725985264377 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Tests.Perf_Single.TryParse(value: "-3.4028235E+38")
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 371.95443351042417 > 282.39947623095395.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -16.431120793303368 (T) = (0 -377.6572530711475) / Math.Sqrt((773.2123208010917 / (22)) + (146.1390364532415 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -0.4342755548899039 = (263.3087148306985 - 377.6572530711475) / 263.3087148306985 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Tests.Perf_Single.ToStringWithFormat(value: 3.4028235E+38, format: "E")
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 922.7775361234185 > 445.7259508563003.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -36.92009768495071 (T) = (0 -945.8801060422472) / Math.Sqrt((2707.5331263597477 / (22)) + (854.7993881529243 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -1.237521869446558 = (422.73558035712375 - 945.8801060422472) / 422.73558035712375 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Tests.Perf_Single.ToStringWithFormat(value: 3.4028235E+38, format: "R")
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.0753949432203556 > 574.0708735525249.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -32.36347001260134 (T) = (0 -1098.914945690417) / Math.Sqrt((5164.04742338528 / (22)) + (742.673358592602 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -1.0491839778665861 = (536.269538294215 - 1098.914945690417) / 536.269538294215 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Tests.Perf_Single.ToStringWithFormat(value: 3.4028235E+38, format: "G17")
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.0017189662173236 > 543.8827610272366.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -35.59338497924322 (T) = (0 -1039.0135704345462) / Math.Sqrt((3099.198370193167 / (22)) + (865.8201896164315 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -1.03099643413455 = (511.578234689167 - 1039.0135704345462) / 511.578234689167 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Tests.Perf_Single.ToStringWithFormat(value: 12345, format: "R")
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 910.6513666510841 > 495.17323282284536.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -27.479313710534907 (T) = (0 -921.1396540033235) / Math.Sqrt((4043.4850905928274 / (22)) + (1093.8541684764155 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -1.0082696960354314 = (458.6732826879603 - 921.1396540033235) / 458.6732826879603 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Tests.Perf_Single.ToString(value: 3.4028235E+38)
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.0408563785331675 > 565.9772102263504.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -32.43358030103064 (T) = (0 -1092.156708430564) / Math.Sqrt((4775.586869694899 / (22)) + (986.1551660296449 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -1.0837464937087677 = (524.1312759147985 - 1092.156708430564) / 524.1312759147985 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Tests.Perf_Single.ToStringWithFormat(value: -3.4028235E+38, format: "G17")
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.0264138500122475 > 548.7963137560877.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -38.651646408104014 (T) = (0 -1039.4520785671532) / Math.Sqrt((3258.210677001105 / (22)) + (376.1141052998564 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -1.0082391919183546 = (517.5937621126818 - 1039.4520785671532) / 517.5937621126818 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Tests.Perf_Single.ToString(value: 12345)
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 960.6132379754689 > 483.53541965030905.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -30.696747476814945 (T) = (0 -914.4239507190159) / Math.Sqrt((3884.1428082055645 / (22)) + (557.1680104333811 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -1.0243002835591295 = (451.72347113999984 - 914.4239507190159) / 451.72347113999984 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Tests.Perf_Single.ToStringWithFormat(value: 3.4028235E+38, format: "G")
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.1412196820015554 > 577.9730969832802.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -28.987840526748034 (T) = (0 -1097.3907755941605) / Math.Sqrt((5284.215565521317 / (22)) + (1436.552088679689 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -1.0351989871586214 = (539.205641570335 - 1097.3907755941605) / 539.205641570335 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Tests.Perf_Single.Parse(value: "3.4028235E+38")
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 374.70599184570017 > 274.81415679826904.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -19.777931025285636 (T) = (0 -370.6458304871487) / Math.Sqrt((671.9325573103959 / (22)) + (27.196412566223085 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -0.4421746882020833 = (257.00480913946836 - 370.6458304871487) / 257.00480913946836 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Tests.Perf_Single.TryParse(value: "3.4028235E+38")
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 380.0756396795303 > 273.09033978773266.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -18.431980693095404 (T) = (0 -369.0071955489105) / Math.Sqrt((710.9146382427269 / (22)) + (57.14412114194219 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -0.4407536649002356 = (256.1209487358564 - 369.0071955489105) / 256.1209487358564 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Tests.Perf_Single.ToStringWithFormat(value: -3.4028235E+38, format: "G")
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.0807208957671595 > 581.8720651281561.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -33.821788849279024 (T) = (0 -1111.3488259639898) / Math.Sqrt((5322.7212608941645 / (22)) + (452.26683607156855 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -1.0492456777601997 = (542.3209320508024 - 1111.3488259639898) / 542.3209320508024 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Tests.Perf_Single.ToStringWithFormat(value: -3.4028235E+38, format: "E")
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 942.6272693407433 > 452.0084506995151.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -39.56013834869683 (T) = (0 -964.5858709159372) / Math.Sqrt((2785.3104064194617 / (22)) + (636.0441203450191 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -1.2571678162046038 = (427.3434451754123 - 964.5858709159372) / 427.3434451754123 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Tests.Perf_Single.ToStringWithFormat(value: 12345, format: "G")
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 899.8723393220198 > 501.9359168411381.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -32.223033490616935 (T) = (0 -919.115349254561) / Math.Sqrt((4033.666376233582 / (22)) + (202.84633421848218 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -0.9921040264343877 = (461.3791935854175 - 919.115349254561) / 461.3791935854175 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Tests.Perf_Single.ToStringWithCultureInfo(value: 3.4028235E+38, culture: zh)
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.0732752713692664 > 547.3890969902443.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -35.622211353745875 (T) = (0 -1056.8819589817374) / Math.Sqrt((4527.19473701261 / (22)) + (345.1040503465932 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -1.0792235914953983 = (508.30606352519186 - 1056.8819589817374) / 508.30606352519186 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Tests.Perf_Single.Parse(value: "-3.4028235E+38")
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 381.1094532303394 > 282.38532515518887.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -19.02514610185643 (T) = (0 -378.4708978813185) / Math.Sqrt((716.632762929477 / (22)) + (46.06666719492705 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -0.4384069224102335 = (263.1181009940792 - 378.4708978813185) / 263.1181009940792 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Tests.Perf_Single.ToStringWithFormat(value: -3.4028235E+38, format: "R")
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.092825987304167 > 583.4021907886233.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -34.01319294247653 (T) = (0 -1106.300624707004) / Math.Sqrt((5208.814660020266 / (22)) + (414.35401288165866 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -1.0379957066036587 = (542.8375639469161 - 1106.300624707004) / 542.8375639469161 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Tests.Perf_Single.ToStringWithFormat(value: 12345, format: "E")
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 968.840055648648 > 488.4063912455135.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -40.33328120880908 (T) = (0 -986.5445207086457) / Math.Sqrt((3108.1413241387168 / (22)) + (376.1279214892162 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -1.1813398403889845 = (452.26539324231175 - 986.5445207086457) / 452.26539324231175 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Tests.Perf_Single.ToStringWithCultureInfo(value: 12345, culture: zh)
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 904.2762007359582 > 436.1892330330309.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/11/2023 1:25:06 PM, 1/17/2023 2:54:07 AM falls between 1/8/2023 8:00:22 AM and 1/17/2023 2:54:07 AM.
IsRegressionStdDev: Marked as regression because -33.369371008294934 (T) = (0 -849.1041108975164) / Math.Sqrt((2928.8415276772885 / (22)) + (449.0652879924252 / (11))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (11) - 2, .025) and -1.0760949686672556 = (408.99097763461026 - 849.1041108975164) / 408.99097763461026 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Metadata
Metadata
Assignees
Labels
LinkedFromMasterIs this issue linked from the master perf issueIs this issue linked from the master perf issuePGOApplied if there were any profile guided optimization updates in the observed interval.Applied if there were any profile guided optimization updates in the observed interval.amperearch-arm64branch-refs/heads/mainkind-micro_monomono-aotos-linuxperf-regressionruntime-mono