-
Couldn't load subscription status.
- Fork 5.2k
Closed
Labels
arch-arm64area-GC-coreclros-linuxLinux OS (any supported distro)Linux OS (any supported distro)tenet-performancePerformance related issuePerformance related issuetenet-performance-benchmarksIssue from performance benchmarkIssue from performance benchmark
Milestone
Description
Run Information
| Architecture | arm64 |
|---|---|
| OS | ubuntu 20.04 |
| Baseline | b8ffae56d3269050ec84551fad44835536deffb3 |
| Compare | f19591801305bc61f353ab91c65e50360175b44c |
| Diff | Diff |
Regressions in System.Tests.Perf_GC<Char>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| AllocateArray - Duration of single invocation | 1.70 μs | 1.99 μs | 1.17 | 0.21 | False |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_GC<Char>*'Payloads
Histogram
System.Tests.Perf_GC<Char>.AllocateArray(length: 10000, pinned: True)
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.9887751958823037 > 1.785409919366763.
IsChangePoint: Marked as a change because one of 5/25/2022 3:58:08 AM, 6/22/2022 5:33:38 PM, 8/9/2022 6:41:10 AM, 8/11/2022 10:02:44 AM falls between 8/2/2022 9:32:02 PM and 8/11/2022 10:02:44 AM.
IsRegressionStdDev: Marked as regression because -10.287781099837073 (T) = (0 -1886.985139769478) / Math.Sqrt((1684.5295488491151 / (41)) + (3499.320117393215 / (9))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (41) + (9) - 2, .025) and -0.12744805521796737 = (1673.6781185051323 - 1886.985139769478) / 1673.6781185051323 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
| Architecture | arm64 |
|---|---|
| OS | ubuntu 20.04 |
| Baseline | b8ffae56d3269050ec84551fad44835536deffb3 |
| Compare | f19591801305bc61f353ab91c65e50360175b44c |
| Diff | Diff |
Regressions in PerfLabTests.StackWalk
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| Walk - Duration of single invocation | 55.79 ms | 59.80 ms | 1.07 | 0.26 | False |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'PerfLabTests.StackWalk*'Payloads
Histogram
PerfLabTests.StackWalk.Walk
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 59.80228970833333 > 56.1062545640625.
IsChangePoint: Marked as a change because one of 6/22/2022 5:33:38 PM, 8/9/2022 6:41:10 AM, 8/11/2022 10:02:44 AM falls between 8/2/2022 9:32:02 PM and 8/11/2022 10:02:44 AM.
IsRegressionStdDev: Marked as regression because -9.161701620784251 (T) = (0 -61593219.02079894) / Math.Sqrt((2859028143406.5073 / (41)) + (6867895428098.425 / (9))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (41) + (9) - 2, .025) and -0.15706510535612203 = (53232284.62744259 - 61593219.02079894) / 53232284.62744259 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Metadata
Metadata
Assignees
Labels
arch-arm64area-GC-coreclros-linuxLinux OS (any supported distro)Linux OS (any supported distro)tenet-performancePerformance related issuePerformance related issuetenet-performance-benchmarksIssue from performance benchmarkIssue from performance benchmark
_1.png)
