Skip to content

Regressions from "More precise writebarrier for regions" #73783

@performanceautofiler

Description

@performanceautofiler

Run Information

Architecture arm64
OS ubuntu 20.04
Baseline b8ffae56d3269050ec84551fad44835536deffb3
Compare f19591801305bc61f353ab91c65e50360175b44c
Diff Diff

Regressions in System.Tests.Perf_GC<Char>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
AllocateArray - Duration of single invocation 1.70 μs 1.99 μs 1.17 0.21 False

graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_GC&lt;Char&gt;*'

Payloads

Baseline
Compare

Histogram

System.Tests.Perf_GC<Char>.AllocateArray(length: 10000, pinned: True)


Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.9887751958823037 > 1.785409919366763.
IsChangePoint: Marked as a change because one of 5/25/2022 3:58:08 AM, 6/22/2022 5:33:38 PM, 8/9/2022 6:41:10 AM, 8/11/2022 10:02:44 AM falls between 8/2/2022 9:32:02 PM and 8/11/2022 10:02:44 AM.
IsRegressionStdDev: Marked as regression because -10.287781099837073 (T) = (0 -1886.985139769478) / Math.Sqrt((1684.5295488491151 / (41)) + (3499.320117393215 / (9))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (41) + (9) - 2, .025) and -0.12744805521796737 = (1673.6781185051323 - 1886.985139769478) / 1673.6781185051323 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information
Architecture arm64
OS ubuntu 20.04
Baseline b8ffae56d3269050ec84551fad44835536deffb3
Compare f19591801305bc61f353ab91c65e50360175b44c
Diff Diff

Regressions in PerfLabTests.StackWalk

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Walk - Duration of single invocation 55.79 ms 59.80 ms 1.07 0.26 False

graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'PerfLabTests.StackWalk*'

Payloads

Baseline
Compare

Histogram

PerfLabTests.StackWalk.Walk


Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 59.80228970833333 > 56.1062545640625.
IsChangePoint: Marked as a change because one of 6/22/2022 5:33:38 PM, 8/9/2022 6:41:10 AM, 8/11/2022 10:02:44 AM falls between 8/2/2022 9:32:02 PM and 8/11/2022 10:02:44 AM.
IsRegressionStdDev: Marked as regression because -9.161701620784251 (T) = (0 -61593219.02079894) / Math.Sqrt((2859028143406.5073 / (41)) + (6867895428098.425 / (9))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (41) + (9) - 2, .025) and -0.15706510535612203 = (53232284.62744259 - 61593219.02079894) / 53232284.62744259 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Metadata

Metadata

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions