[Perf] Windows/x86: 3 Improvements on 6/3/2023 12:54:16 AM #18505
Description
Run Information
| Name | Value |
|---|---|
| Architecture | x86 |
| OS | Windows 10.0.18362 |
| Queue | TigerWindows |
| Baseline | 0214a047483067a6a813a34be5b6b1f757600961 |
| Compare | 2f18320e731cc3b06bc43cdb4d82dffc4f8f81fc |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Improvements in System.Collections.CtorFromCollection<Int32>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| ImmutableSortedSet - Duration of single invocation | 17.22 μs | 13.09 μs | 0.76 | 0.03 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.CtorFromCollection<Int32>*'Payloads
Histogram
System.Collections.CtorFromCollection<Int32>.ImmutableSortedSet(Size: 512)
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 13.092314892428053 < 16.306872842880193.
IsChangePoint: Marked as a change because one of 4/25/2023 6:46:56 PM, 5/19/2023 10:30:38 AM, 6/2/2023 6:53:36 PM, 6/5/2023 10:43:22 AM falls between 5/27/2023 2:31:56 PM and 6/5/2023 10:43:22 AM.
IsImprovementStdDev: Marked as improvement because 42.3318717334003 (T) = (0 -13088.495347491731) / Math.Sqrt((3006704.9962540055 / (299)) + (594.262553273221 / (7))) is greater than 1.9677981407170237 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (7) - 2, .975) and 0.24567953491959818 = (17351.372464880227 - 13088.495347491731) / 17351.372464880227 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
| Name | Value |
|---|---|
| Architecture | x86 |
| OS | Windows 10.0.18362 |
| Queue | TigerWindows |
| Baseline | 0214a047483067a6a813a34be5b6b1f757600961 |
| Compare | 2f18320e731cc3b06bc43cdb4d82dffc4f8f81fc |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Improvements in System.Numerics.Tests.Perf_BigInteger
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| Ctor_ByteArray - Duration of single invocation | 134.71 ns | 111.82 ns | 0.83 | 0.01 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_BigInteger*'Payloads
Histogram
System.Numerics.Tests.Perf_BigInteger.Ctor_ByteArray(numberString: 12345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890)
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 111.82363801944527 < 128.1258724234867.
IsChangePoint: Marked as a change because one of 5/1/2023 3:42:23 PM, 5/24/2023 7:12:11 AM, 6/2/2023 6:53:36 PM, 6/5/2023 10:43:22 AM falls between 5/27/2023 2:31:56 PM and 6/5/2023 10:43:22 AM.
IsImprovementStdDev: Marked as improvement because 25.655595753221622 (T) = (0 -110.50937438851975) / Math.Sqrt((141.84795308368638 / (299)) + (0.4822486544124467 / (7))) is greater than 1.9677981407170237 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (7) - 2, .975) and 0.14611719254445965 = (129.4198377384167 - 110.50937438851975) / 129.4198377384167 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
| Name | Value |
|---|---|
| Architecture | x86 |
| OS | Windows 10.0.18362 |
| Queue | TigerWindows |
| Baseline | 0214a047483067a6a813a34be5b6b1f757600961 |
| Compare | 2f18320e731cc3b06bc43cdb4d82dffc4f8f81fc |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Improvements in System.IO.Tests.BinaryWriterTests
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| WriteAsciiChar - Duration of single invocation | 7.20 ns | 5.61 ns | 0.78 | 0.18 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.IO.Tests.BinaryWriterTests*'Payloads
Histogram
System.IO.Tests.BinaryWriterTests.WriteAsciiChar
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 5.609221002044963 < 6.325095474971852.
IsChangePoint: Marked as a change because one of 5/19/2023 10:30:38 AM, 5/24/2023 6:07:01 PM, 6/2/2023 6:53:36 PM, 6/5/2023 10:43:22 AM falls between 5/27/2023 2:31:56 PM and 6/5/2023 10:43:22 AM.
IsImprovementStdDev: Marked as improvement because 5.804499434850641 (T) = (0 -5.722158168603843) / Math.Sqrt((0.10541657373853898 / (299)) + (0.08664034315601261 / (7))) is greater than 1.9677981407170237 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (7) - 2, .975) and 0.10269621742270119 = (6.377057892443359 - 5.722158168603843) / 6.377057892443359 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository