-
Notifications
You must be signed in to change notification settings - Fork 4
Description
Run Information
| Name | Value |
|---|---|
| Architecture | x64 |
| OS | ubuntu 18.04 |
| Queue | TigerUbuntu |
| Baseline | 3e59d14a0434a23ccd5294f3bfd5d0869f036e6b |
| Compare | e14174bb2e7eeb353fda65f1bbdd4b250adc19b0 |
| Diff | Diff |
| Configs | CompilationMode:wasm, RunKind:micro |
Regressions in System.Collections.Tests.Perf_BitArray
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| BitArrayLeftShift - Duration of single invocation | 1.01 μs | 4.47 μs | 4.42 | 0.19 | False | |||||
| BitArrayBoolArrayCtor - Duration of single invocation | 2.47 μs | 12.14 μs | 4.91 | 0.22 | False | |||||
| BitArraySet - Duration of single invocation | 47.74 ns | 150.89 ns | 3.16 | 0.25 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Tests.Perf_BitArray*'Payloads
Histogram
System.Collections.Tests.Perf_BitArray.BitArrayLeftShift(Size: 512)
Description of detection logic
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 4.465496253436982 > 1.0603978261579903.
IsChangePoint: Marked as a change because one of 2/1/2023 12:50:52 AM, 2/28/2023 5:58:27 PM, 3/29/2023 4:47:17 AM, 3/30/2023 4:24:24 AM falls between 3/21/2023 12:39:01 PM and 3/30/2023 4:24:24 AM.
IsRegressionStdDev: Marked as regression because -225.44051703453226 (T) = (0 -4418.069199820823) / Math.Sqrt((4409.977844554535 / (52)) + (715.4121531477354 / (5))) is less than -2.0040447832881556 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (52) + (5) - 2, .025) and -3.353568624985466 = (1014.8155640559295 - 4418.069199820823) / 1014.8155640559295 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
System.Collections.Tests.Perf_BitArray.BitArrayBoolArrayCtor(Size: 512)
Description of detection logic
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 12.141236855358581 > 2.335757349509127.
IsChangePoint: Marked as a change because one of 2/24/2023 9:01:57 AM, 3/9/2023 8:37:21 PM, 3/29/2023 4:47:17 AM, 3/30/2023 4:24:24 AM falls between 3/21/2023 12:39:01 PM and 3/30/2023 4:24:24 AM.
IsRegressionStdDev: Marked as regression because -674.3077314665737 (T) = (0 -12117.817432352196) / Math.Sqrt((9377.382814339115 / (52)) + (171.95728207642773 / (5))) is less than -2.0040447832881556 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (52) + (5) - 2, .025) and -4.417398130129685 = (2236.8334653045176 - 12117.817432352196) / 2236.8334653045176 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
System.Collections.Tests.Perf_BitArray.BitArraySet(Size: 4)
Description of detection logic
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 150.88783437855798 > 42.72682387130256.
IsChangePoint: Marked as a change because one of 2/1/2023 12:50:52 AM, 3/9/2023 8:37:21 PM, 3/29/2023 4:47:17 AM, 3/30/2023 4:24:24 AM falls between 3/21/2023 12:39:01 PM and 3/30/2023 4:24:24 AM.
IsRegressionStdDev: Marked as regression because -127.70992622433148 (T) = (0 -151.80629638318896) / Math.Sqrt((14.775091891386515 / (52)) + (2.393453184895901 / (5))) is less than -2.0040447832881556 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (52) + (5) - 2, .025) and -2.7702280645242765 = (40.26448633481904 - 151.80629638318896) / 40.26448633481904 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
| Name | Value |
|---|---|
| Architecture | x64 |
| OS | ubuntu 18.04 |
| Queue | TigerUbuntu |
| Baseline | 3e59d14a0434a23ccd5294f3bfd5d0869f036e6b |
| Compare | e14174bb2e7eeb353fda65f1bbdd4b250adc19b0 |
| Diff | Diff |
| Configs | CompilationMode:wasm, RunKind:micro |
Regressions in System.Text.Json.Tests.Perf_Segment
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| ReadSingleSegmentSequenceByN - Duration of single invocation | 103.53 μs | 162.98 μs | 1.57 | 0.12 | False | |||||
| ReadMultiSegmentSequenceUsingSpan - Duration of single invocation | 998.98 μs | 1.58 ms | 1.58 | 0.11 | False | |||||
| ReadSingleSegmentSequenceByN - Duration of single invocation | 9.93 ms | 16.14 ms | 1.63 | 0.10 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Tests.Perf_Segment*'Payloads
Histogram
System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequenceByN(numberOfBytes: 4096, TestCase: Json4KB)
Description of detection logic
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 162.97831575520834 > 109.6178105034538.
IsChangePoint: Marked as a change because one of 2/1/2023 12:50:52 AM, 3/1/2023 3:09:21 PM, 3/2/2023 11:15:04 AM, 3/29/2023 4:47:17 AM, 3/30/2023 4:24:24 AM falls between 3/21/2023 12:39:01 PM and 3/30/2023 4:24:24 AM.
IsRegressionStdDev: Marked as regression because -2.4828176848389294 (T) = (0 -164351.65393730171) / Math.Sqrt((6761729828.756508 / (52)) + (5071840.107662644 / (5))) is less than -2.0040447832881556 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (52) + (5) - 2, .025) and -0.2090962345502728 = (135929.34064378493 - 164351.65393730171) / 135929.34064378493 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequenceUsingSpan(segmentSize: 4096, TestCase: Json40KB)
Description of detection logic
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.578788028125 > 1.0630431485764722.
IsChangePoint: Marked as a change because one of 2/1/2023 12:50:52 AM, 3/1/2023 3:09:21 PM, 3/2/2023 11:15:04 AM, 3/29/2023 4:47:17 AM, 3/30/2023 4:24:24 AM falls between 3/21/2023 12:39:01 PM and 3/30/2023 4:24:24 AM.
IsRegressionStdDev: Marked as regression because -2.0589016232965545 (T) = (0 -1596100.0322996795) / Math.Sqrt((693281063453.0587 / (52)) + (277537340.40924454 / (5))) is less than -2.0040447832881556 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (52) + (5) - 2, .025) and -0.17544119757926374 = (1357873.1420905888 - 1596100.0322996795) / 1357873.1420905888 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequenceByN(numberOfBytes: 8192, TestCase: Json400KB)
Description of detection logic
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 16.1396978021978 > 10.481075743999998.
IsChangePoint: Marked as a change because one of 2/1/2023 12:50:52 AM, 3/1/2023 3:09:21 PM, 3/2/2023 11:15:04 AM, 3/29/2023 4:47:17 AM, 3/30/2023 4:24:24 AM falls between 3/21/2023 12:39:01 PM and 3/30/2023 4:24:24 AM.
IsRegressionStdDev: Marked as regression because -4.493157577023089 (T) = (0 -16013722.737743592) / Math.Sqrt((40275405812380.19 / (52)) + (10129995976.022243 / (5))) is less than -2.0040447832881556 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (52) + (5) - 2, .025) and -0.3284709508248496 = (12054251.338955246 - 16013722.737743592) / 12054251.338955246 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
| Name | Value |
|---|---|
| Architecture | x64 |
| OS | ubuntu 18.04 |
| Queue | TigerUbuntu |
| Baseline | 3e59d14a0434a23ccd5294f3bfd5d0869f036e6b |
| Compare | e14174bb2e7eeb353fda65f1bbdd4b250adc19b0 |
| Diff | Diff |
| Configs | CompilationMode:wasm, RunKind:micro |
Regressions in MicroBenchmarks.Serializers.Json_FromStream<IndexViewModel>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| SystemTextJson_Reflection_ - Duration of single invocation | 518.47 μs | 784.36 μs | 1.51 | 0.05 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'MicroBenchmarks.Serializers.Json_FromStream<IndexViewModel>*'Payloads
Histogram
MicroBenchmarks.Serializers.Json_FromStream<IndexViewModel>.SystemTextJson_Reflection_
Description of detection logic
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 784.3624992187501 > 549.7397544678382.
IsChangePoint: Marked as a change because one of 2/1/2023 12:50:52 AM, 3/1/2023 3:09:21 PM, 3/2/2023 11:15:04 AM, 3/29/2023 4:47:17 AM, 3/30/2023 4:24:24 AM falls between 3/21/2023 12:39:01 PM and 3/30/2023 4:24:24 AM.
IsRegressionStdDev: Marked as regression because -7.2237487414576105 (T) = (0 -790943.1803491301) / Math.Sqrt((44531358363.884796 / (52)) + (18183952.58488488 / (5))) is less than -2.0040447832881556 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (52) + (5) - 2, .025) and -0.3658141135433945 = (579100.1663448547 - 790943.1803491301) / 579100.1663448547 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
| Name | Value |
|---|---|
| Architecture | x64 |
| OS | ubuntu 18.04 |
| Queue | TigerUbuntu |
| Baseline | 3e59d14a0434a23ccd5294f3bfd5d0869f036e6b |
| Compare | e14174bb2e7eeb353fda65f1bbdd4b250adc19b0 |
| Diff | Diff |
| Configs | CompilationMode:wasm, RunKind:micro |
Regressions in System.Text.Json.Serialization.Tests.ReadJson<BinaryData>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| DeserializeFromReader - Duration of single invocation | 22.72 μs | 78.42 μs | 3.45 | 0.09 | False | |||||
| DeserializeFromReader - Duration of single invocation | 22.41 μs | 78.09 μs | 3.48 | 0.11 | False | |||||
| DeserializeFromString - Duration of single invocation | 18.46 μs | 47.21 μs | 2.56 | 0.07 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Serialization.Tests.ReadJson<BinaryData>*'Payloads
Histogram
System.Text.Json.Serialization.Tests.ReadJson<BinaryData>.DeserializeFromReader(Mode: SourceGen)
Description of detection logic
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 78.41950140123696 > 23.80182715442195.
IsChangePoint: Marked as a change because one of 2/1/2023 12:50:52 AM, 3/1/2023 3:09:21 PM, 3/2/2023 11:15:04 AM, 3/29/2023 4:47:17 AM, 3/30/2023 4:24:24 AM falls between 3/21/2023 12:39:01 PM and 3/30/2023 4:24:24 AM.
IsRegressionStdDev: Marked as regression because -162.33036423649494 (T) = (0 -78332.25765017739) / Math.Sqrt((5513120.791258522 / (52)) + (41568.1483383106 / (5))) is less than -2.0040447832881556 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (52) + (5) - 2, .025) and -2.341434586568807 = (23442.702713690956 - 78332.25765017739) / 23442.702713690956 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
System.Text.Json.Serialization.Tests.ReadJson<BinaryData>.DeserializeFromReader(Mode: Reflection)
Description of detection logic
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 78.08622625000001 > 23.589083358201705.
IsChangePoint: Marked as a change because one of 2/1/2023 12:50:52 AM, 3/1/2023 3:09:21 PM, 3/2/2023 11:15:04 AM, 3/29/2023 4:47:17 AM, 3/29/2023 3:17:08 PM, 3/30/2023 4:24:24 AM falls between 3/21/2023 12:39:01 PM and 3/30/2023 4:24:24 AM.
IsRegressionStdDev: Marked as regression because -5.517254939929748 (T) = (0 -77975.93762019232) / Math.Sqrt((3374188751.115722 / (55)) + (24327.163729716216 / (2))) is less than -2.0040447832881556 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (55) + (2) - 2, .025) and -1.2434301256518225 = (34757.4621240038 - 77975.93762019232) / 34757.4621240038 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
System.Text.Json.Serialization.Tests.ReadJson<BinaryData>.DeserializeFromString(Mode: Reflection)
Description of detection logic
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 47.21026922013274 > 19.335621664450354.
IsChangePoint: Marked as a change because one of 2/1/2023 12:50:52 AM, 3/1/2023 3:09:21 PM, 3/2/2023 11:15:04 AM, 3/29/2023 4:47:17 AM, 3/30/2023 4:24:24 AM falls between 3/21/2023 12:39:01 PM and 3/30/2023 4:24:24 AM.
IsRegressionStdDev: Marked as regression because -85.3803063627543 (T) = (0 -46575.4118538265) / Math.Sqrt((3586769.1626767754 / (52)) + (175293.69811774162 / (5))) is less than -2.0040447832881556 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (52) + (5) - 2, .025) and -1.4466439810609273 = (19036.448381684946 - 46575.4118538265) / 19036.448381684946 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
| Name | Value |
|---|---|
| Architecture | x64 |
| OS | ubuntu 18.04 |
| Queue | TigerUbuntu |
| Baseline | 3e59d14a0434a23ccd5294f3bfd5d0869f036e6b |
| Compare | e14174bb2e7eeb353fda65f1bbdd4b250adc19b0 |
| Diff | Diff |
| Configs | CompilationMode:wasm, RunKind:micro |
Regressions in System.Text.Json.Reader.Tests.Perf_Base64
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| ReadBase64EncodedByteArray_HeavyEscaping - Duration of single invocation | 11.11 μs | 37.81 μs | 3.40 | 0.12 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Reader.Tests.Perf_Base64*'Payloads
Histogram
System.Text.Json.Reader.Tests.Perf_Base64.ReadBase64EncodedByteArray_HeavyEscaping(NumberOfBytes: 1000)
Description of detection logic
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 37.80708944174757 > 11.645339269313274.
IsChangePoint: Marked as a change because one of 2/1/2023 12:50:52 AM, 3/1/2023 3:09:21 PM, 3/2/2023 11:15:04 AM, 3/29/2023 4:47:17 AM, 3/30/2023 4:24:24 AM falls between 3/21/2023 12:39:01 PM and 3/30/2023 4:24:24 AM.
IsRegressionStdDev: Marked as regression because -166.19403567937448 (T) = (0 -37931.75583022223) / Math.Sqrt((897967.1639334555 / (52)) + (38925.36634265819 / (5))) is less than -2.0040447832881556 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (52) + (5) - 2, .025) and -2.2626719923558443 = (11625.978927422992 - 37931.75583022223) / 11625.978927422992 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository




_1.png)
_1.png)
_2.png)
_3.png)
