-
Notifications
You must be signed in to change notification settings - Fork 4
Closed
Description
Run Information
| Architecture | arm64 |
|---|---|
| OS | Windows 10.0.19041 |
| Baseline | 54c717a4ed822f46a23893479b8d4398596c041d |
| Compare | 1926f0939a855d6ef41593377c75ab4c31e9fcbb |
| Diff | Diff |
Improvements in System.IO.Compression.Gzip
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| Decompress - Duration of single invocation | 515.11 μs | 460.45 μs | 0.89 | 0.00 | False | |||||
| Decompress - Duration of single invocation | 167.04 μs | 152.49 μs | 0.91 | 0.00 | False | |||||
| Decompress - Duration of single invocation | 668.88 μs | 620.02 μs | 0.93 | 0.00 | False |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.IO.Compression.Gzip*'Payloads
Histogram
System.IO.Compression.Gzip.Decompress(level: Optimal, file: "TestDocument.pdf")
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 460.45242909663864 < 488.93993809523806.
IsChangePoint: Marked as a change because one of 5/9/2022 6:32:22 AM, 8/2/2022 9:32:02 PM, 8/11/2022 10:02:44 AM falls between 8/2/2022 9:32:02 PM and 8/11/2022 10:02:44 AM.
IsImprovementStdDev: Marked as improvement because 426.82410753841543 (T) = (0 -460173.8796191555) / Math.Sqrt((1761612.9510928676 / (299)) + (210802.16832529882 / (19))) is greater than 1.9674995188240387 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (19) - 2, .975) and 0.10784935356627681 = (515802.88761617936 - 460173.8796191555) / 515802.88761617936 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.IO.Compression.Gzip.Decompress(level: Optimal, file: "sum")
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 152.4870792880259 < 159.25776706801184.
IsChangePoint: Marked as a change because one of 5/9/2022 6:32:22 AM, 8/2/2022 9:32:02 PM, 8/11/2022 10:02:44 AM falls between 8/2/2022 9:32:02 PM and 8/11/2022 10:02:44 AM.
IsImprovementStdDev: Marked as improvement because 117.45173172724341 (T) = (0 -152632.71661216684) / Math.Sqrt((1590318.8395787845 / (299)) + (181587.34589520644 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.08718711062503383 = (167211.39500635187 - 152632.71661216684) / 167211.39500635187 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.IO.Compression.Gzip.Decompress(level: Optimal, file: "alice29.txt")
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 620.0210833333334 < 633.4980094246031.
IsChangePoint: Marked as a change because one of 5/9/2022 6:32:22 AM, 6/15/2022 7:24:26 PM, 8/2/2022 9:32:02 PM, 8/11/2022 10:02:44 AM falls between 8/2/2022 9:32:02 PM and 8/11/2022 10:02:44 AM.
IsImprovementStdDev: Marked as improvement because 140.08009744976368 (T) = (0 -620069.8250000002) / Math.Sqrt((38657243.93722757 / (299)) + (521700.93270126334 / (19))) is greater than 1.9674995188240387 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (19) - 2, .975) and 0.0820977125687964 = (675529.2295166812 - 620069.8250000002) / 675529.2295166812 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


