Performance Shift(s): 7c87fb2a #6087
Description
Benchmark comparison has identified performance shifts at:
- commit 7c87fb2 (Mesh nonexperimental #6061).
Please review the report below and take corrective/congratulatory action as appropriate :slightly_smiling_face:
⏱️ Performance Benchmark Report: 7c87fb2
Performance shifts
| Change | Before [c333b7f7] <main~1> | After [7c87fb2a] <main> | Ratio | Benchmark (Parameter) |
|----------|------------------------------|---------------------------|---------|--------------------------------------------------------------------------------------------------------|
| ! | 392±1ns | failed | n/a | experimental.ugrid.regions_combine.CombineRegionsComputeRealData.time_compute_data(50) |
| ! | 255±1ms | failed | n/a | experimental.ugrid.regions_combine.CombineRegionsComputeRealData.time_compute_data(500) |
| ! | 0.6 | failed | n/a | experimental.ugrid.regions_combine.CombineRegionsComputeRealData.track_addedmem_compute_data(50) |
| ! | 57.3 | failed | n/a | experimental.ugrid.regions_combine.CombineRegionsComputeRealData.track_addedmem_compute_data(500) |
| ! | 14.4±0.2ms | failed | n/a | experimental.ugrid.regions_combine.CombineRegionsCreateCube.time_create_combined_cube(50) |
| ! | 16.0±0.4ms | failed | n/a | experimental.ugrid.regions_combine.CombineRegionsCreateCube.time_create_combined_cube(500) |
| ! | 0.5 | failed | n/a | experimental.ugrid.regions_combine.CombineRegionsCreateCube.track_addedmem_create_combined_cube(50) |
| ! | 11.8 | failed | n/a | experimental.ugrid.regions_combine.CombineRegionsCreateCube.track_addedmem_create_combined_cube(500) |
| ! | 106±2ms | failed | n/a | experimental.ugrid.regions_combine.CombineRegionsFileStreamedCalc.time_stream_file2file(50) |
| ! | 693±3ms | failed | n/a | experimental.ugrid.regions_combine.CombineRegionsFileStreamedCalc.time_stream_file2file(500) |
| ! | 1.4 | failed | n/a | experimental.ugrid.regions_combine.CombineRegionsFileStreamedCalc.track_addedmem_stream_file2file(50) |
| ! | 92.0 | failed | n/a | experimental.ugrid.regions_combine.CombineRegionsFileStreamedCalc.track_addedmem_stream_file2file(500) |
| ! | 65.8±0.7ms | failed | n/a | experimental.ugrid.regions_combine.CombineRegionsSaveData.time_save(50) |
| ! | 647±4ms | failed | n/a | experimental.ugrid.regions_combine.CombineRegionsSaveData.time_save(500) |
| ! | 1.4 | failed | n/a | experimental.ugrid.regions_combine.CombineRegionsSaveData.track_addedmem_save(50) |
| ! | 92.0 | failed | n/a | experimental.ugrid.regions_combine.CombineRegionsSaveData.track_addedmem_save(500) |
| ! | 2.1752849999999997 | failed | n/a | experimental.ugrid.regions_combine.CombineRegionsSaveData.track_filesize_saved(50) |
| ! | 216.01528499999998 | failed | n/a | experimental.ugrid.regions_combine.CombineRegionsSaveData.track_filesize_saved(500) |
| ! | 8.07±0.09ms | failed | n/a | load.LoadAndRealise.time_load((1280, 960, 5), False, 'FF') |
| ! | 29.0±0.4ms | failed | n/a | load.LoadAndRealise.time_load((1280, 960, 5), False, 'NetCDF') |
| ! | 8.79±0.08ms | failed | n/a | load.LoadAndRealise.time_load((1280, 960, 5), False, 'PP') |
| ! | 8.05±0.06ms | failed | n/a | load.LoadAndRealise.time_load((1280, 960, 5), True, 'FF') |
| ! | 26.8±0.3ms | failed | n/a | load.LoadAndRealise.time_load((1280, 960, 5), True, 'NetCDF') |
| ! | 8.93±0.1ms | failed | n/a | load.LoadAndRealise.time_load((1280, 960, 5), True, 'PP') |
| ! | 1.33±0.02s | failed | n/a | load.LoadAndRealise.time_load((2, 2, 1000), False, 'FF') |
| ! | 26.4±0.2ms | failed | n/a | load.LoadAndRealise.time_load((2, 2, 1000), False, 'NetCDF') |
| ! | 1.48±0.01s | failed | n/a | load.LoadAndRealise.time_load((2, 2, 1000), False, 'PP') |
| ! | 1.33±0.01s | failed | n/a | load.LoadAndRealise.time_load((2, 2, 1000), True, 'FF') |
| ! | 26.5±0.4ms | failed | n/a | load.LoadAndRealise.time_load((2, 2, 1000), True, 'NetCDF') |
| ! | 1.48±0.02s | failed | n/a | load.LoadAndRealise.time_load((2, 2, 1000), True, 'PP') |
| ! | 3.91±0.05ms | failed | n/a | load.LoadAndRealise.time_load((50, 50, 2), False, 'FF') |
| ! | 25.4±0.3ms | failed | n/a | load.LoadAndRealise.time_load((50, 50, 2), False, 'NetCDF') |
| ! | 4.22±0.03ms | failed | n/a | load.LoadAndRealise.time_load((50, 50, 2), False, 'PP') |
| ! | 3.89±0.03ms | failed | n/a | load.LoadAndRealise.time_load((50, 50, 2), True, 'FF') |
| ! | 25.4±0.1ms | failed | n/a | load.LoadAndRealise.time_load((50, 50, 2), True, 'NetCDF') |
| ! | 4.14±0.02ms | failed | n/a | load.LoadAndRealise.time_load((50, 50, 2), True, 'PP') |
| ! | 31.3±3ms | failed | n/a | load.LoadAndRealise.time_realise((1280, 960, 5), False, 'FF') |
| ! | 18.5±0.7ms | failed | n/a | load.LoadAndRealise.time_realise((1280, 960, 5), False, 'NetCDF') |
| ! | 12.9±2ms | failed | n/a | load.LoadAndRealise.time_realise((1280, 960, 5), False, 'PP') |
| ! | 25.9±2ms | failed | n/a | load.LoadAndRealise.time_realise((1280, 960, 5), True, 'FF') |
| ! | 69.7±2ms | failed | n/a | load.LoadAndRealise.time_realise((1280, 960, 5), True, 'NetCDF') |
| ! | 25.1±2ms | failed | n/a | load.LoadAndRealise.time_realise((1280, 960, 5), True, 'PP') |
| ! | 432±9ms | failed | n/a | load.LoadAndRealise.time_realise((2, 2, 1000), False, 'FF') |
| ! | 2.84±0.1ms | failed | n/a | load.LoadAndRealise.time_realise((2, 2, 1000), False, 'NetCDF') |
| ! | 444±9ms | failed | n/a | load.LoadAndRealise.time_realise((2, 2, 1000), False, 'PP') |
| ! | 443±8ms | failed | n/a | load.LoadAndRealise.time_realise((2, 2, 1000), True, 'FF') |
| ! | 2.75±0.08ms | failed | n/a | load.LoadAndRealise.time_realise((2, 2, 1000), True, 'NetCDF') |
| ! | 447±10ms | failed | n/a | load.LoadAndRealise.time_realise((2, 2, 1000), True, 'PP') |
| ! | 1.55±0.09ms | failed | n/a | load.LoadAndRealise.time_realise((50, 50, 2), False, 'FF') |
| ! | 2.74±0.1ms | failed | n/a | load.LoadAndRealise.time_realise((50, 50, 2), False, 'NetCDF') |
| ! | 1.60±0.08ms | failed | n/a | load.LoadAndRealise.time_realise((50, 50, 2), False, 'PP') |
| ! | 1.54±0.09ms | failed | n/a | load.LoadAndRealise.time_realise((50, 50, 2), True, 'FF') |
| ! | 2.88±0.1ms | failed | n/a | load.LoadAndRealise.time_realise((50, 50, 2), True, 'NetCDF') |
| ! | 1.57±0.08ms | failed | n/a | load.LoadAndRealise.time_realise((50, 50, 2), True, 'PP') |
| ! | 499±3ms | failed | n/a | load.ManyVars.time_many_var_load |
| ! | 8.18±0.04ms | failed | n/a | load.STASHConstraint.time_stash_constraint((1280, 960, 5), 'FF') |
| ! | 8.98±0.05ms | failed | n/a | load.STASHConstraint.time_stash_constraint((1280, 960, 5), 'PP') |
| ! | 1.35±0.01s | failed | n/a | load.STASHConstraint.time_stash_constraint((2, 2, 1000), 'FF') |
| ! | 1.50±0.02s | failed | n/a | load.STASHConstraint.time_stash_constraint((2, 2, 1000), 'PP') |
| ! | 3.98±0.06ms | failed | n/a | load.STASHConstraint.time_stash_constraint((2, 2, 2), 'FF') |
| ! | 4.26±0.02ms | failed | n/a | load.STASHConstraint.time_stash_constraint((2, 2, 2), 'PP') |
| ! | 8.06±0.05ms | failed | n/a | load.StructuredFF.time_structured_load((1280, 960, 5), False) |
| ! | 4.75±0.02ms | failed | n/a | load.StructuredFF.time_structured_load((1280, 960, 5), True) |
| ! | 1.33±0.01s | failed | n/a | load.StructuredFF.time_structured_load((2, 2, 1000), False) |
| ! | 368±4ms | failed | n/a | load.StructuredFF.time_structured_load((2, 2, 1000), True) |
| ! | 3.91±0.03ms | failed | n/a | load.StructuredFF.time_structured_load((2, 2, 2), False) |
| ! | 3.56±0.02ms | failed | n/a | load.StructuredFF.time_structured_load((2, 2, 2), True) |
| ! | 149±2ms | failed | n/a | load.TimeConstraint.time_time_constraint(20, 'FF') |
| ! | 28.9±0.06ms | failed | n/a | load.TimeConstraint.time_time_constraint(20, 'NetCDF') |
| ! | 164±2ms | failed | n/a | load.TimeConstraint.time_time_constraint(20, 'PP') |
| ! | 29.4±0.2ms | failed | n/a | load.TimeConstraint.time_time_constraint(3, 'FF') |
| ! | 29.0±0.3ms | failed | n/a | load.TimeConstraint.time_time_constraint(3, 'NetCDF') |
| ! | 31.8±0.3ms | failed | n/a | load.TimeConstraint.time_time_constraint(3, 'PP') |
Full benchmark results
Benchmarks that have stayed the same:
| Change | Before [c333b7f7] <main~1> | After [7c87fb2a] <main> | Ratio | Benchmark (Parameter) |
|----------|------------------------------|---------------------------|---------|-------------------------------------------------------------------------------|
| | 52.8±0.5ms | 52.8±0.7ms | 1.00 | aggregate_collapse.Aggregation.time_aggregated_by_COUNT(False) |
| | 53.6±0.9ms | 53.6±0.9ms | 1.00 | aggregate_collapse.Aggregation.time_aggregated_by_COUNT(True) |
| | 187±2ms | 188±4ms | 1.00 | aggregate_collapse.Aggregation.time_aggregated_by_FAST_PERCENTILE(False) |
| | 188±2ms | 188±4ms | 1.00 | aggregate_collapse.Aggregation.time_aggregated_by_FAST_PERCENTILE(True) |
| | 35.9±0.3ms | 36.0±0.5ms | 1.00 | aggregate_collapse.Aggregation.time_aggregated_by_GMEAN(False) |
| | 36.4±0.6ms | 36.9±0.4ms | 1.01 | aggregate_collapse.Aggregation.time_aggregated_by_GMEAN(True) |
| | 36.5±0.7ms | 36.5±0.5ms | 1.00 | aggregate_collapse.Aggregation.time_aggregated_by_HMEAN(False) |
| | 36.1±0.5ms | 36.6±0.5ms | 1.01 | aggregate_collapse.Aggregation.time_aggregated_by_HMEAN(True) |
| | 46.0±0.4ms | 46.2±1ms | 1.01 | aggregate_collapse.Aggregation.time_aggregated_by_MAX(False) |
| | 46.7±0.4ms | 46.9±0.8ms | 1.00 | aggregate_collapse.Aggregation.time_aggregated_by_MAX(True) |
| | 121±1ms | 119±1ms | 0.99 | aggregate_collapse.Aggregation.time_aggregated_by_MAX_RUN(False) |
| | 121±1ms | 122±2ms | 1.00 | aggregate_collapse.Aggregation.time_aggregated_by_MAX_RUN(True) |
| | 50.7±0.6ms | 50.8±0.8ms | 1.00 | aggregate_collapse.Aggregation.time_aggregated_by_MEAN(False) |
| | 51.2±0.5ms | 51.3±0.7ms | 1.00 | aggregate_collapse.Aggregation.time_aggregated_by_MEAN(True) |
| | 35.9±0.3ms | 36.3±0.6ms | 1.01 | aggregate_collapse.Aggregation.time_aggregated_by_MEDIAN(False) |
| | 36.6±0.5ms | 36.7±0.3ms | 1.00 | aggregate_collapse.Aggregation.time_aggregated_by_MEDIAN(True) |
| | 45.8±0.3ms | 46.3±1ms | 1.01 | aggregate_collapse.Aggregation.time_aggregated_by_MIN(False) |
| | 46.4±0.5ms | 46.7±0.7ms | 1.01 | aggregate_collapse.Aggregation.time_aggregated_by_MIN(True) |
| | 1.31±0.01s | 1.33±0.02s | 1.01 | aggregate_collapse.Aggregation.time_aggregated_by_PEAK(False) |
| | 1.32±0.02s | 1.31±0.01s | 0.99 | aggregate_collapse.Aggregation.time_aggregated_by_PEAK(True) |
| | 667±10ms | 668±10ms | 1.00 | aggregate_collapse.Aggregation.time_aggregated_by_PERCENTILE(False) |
| | 664±10ms | 666±10ms | 1.00 | aggregate_collapse.Aggregation.time_aggregated_by_PERCENTILE(True) |
| | 34.4±0.3ms | 34.4±0.5ms | 1.00 | aggregate_collapse.Aggregation.time_aggregated_by_PROPORTION(False) |
| | 35.0±0.3ms | 35.1±0.6ms | 1.01 | aggregate_collapse.Aggregation.time_aggregated_by_PROPORTION(True) |
| | 61.4±0.9ms | 61.3±0.8ms | 1.00 | aggregate_collapse.Aggregation.time_aggregated_by_RMS(False) |
| | 62.0±1ms | 62.4±1ms | 1.01 | aggregate_collapse.Aggregation.time_aggregated_by_RMS(True) |
| | 65.4±0.4ms | 65.2±0.5ms | 1.00 | aggregate_collapse.Aggregation.time_aggregated_by_STD_DEV(False) |
| | 65.4±0.6ms | 66.5±0.7ms | 1.02 | aggregate_collapse.Aggregation.time_aggregated_by_STD_DEV(True) |
| | 60.5±0.9ms | 60.8±0.9ms | 1.00 | aggregate_collapse.Aggregation.time_aggregated_by_VARIANCE(False) |
| | 61.0±0.8ms | 61.3±1ms | 1.01 | aggregate_collapse.Aggregation.time_aggregated_by_VARIANCE(True) |
| | 19.1±0.8ms | 19.1±0.1ms | 1.00 | aggregate_collapse.Aggregation.time_collapsed_by_COUNT(False) |
| | 22.7±0.7ms | 22.7±0.4ms | 1.00 | aggregate_collapse.Aggregation.time_collapsed_by_COUNT(True) |
| | 128±2ms | 128±1ms | 1.00 | aggregate_collapse.Aggregation.time_collapsed_by_FAST_PERCENTILE(False) |
| | 141±2ms | 142±0.7ms | 1.01 | aggregate_collapse.Aggregation.time_collapsed_by_FAST_PERCENTILE(True) |
| | 17.4±0.6ms | 17.6±0.5ms | 1.01 | aggregate_collapse.Aggregation.time_collapsed_by_GMEAN(False) |
| | 21.0±0.7ms | 21.2±0.2ms | 1.01 | aggregate_collapse.Aggregation.time_collapsed_by_GMEAN(True) |
| | 17.4±0.7ms | 17.5±0.4ms | 1.00 | aggregate_collapse.Aggregation.time_collapsed_by_HMEAN(False) |
| | 21.2±0.6ms | 21.1±0.7ms | 1.00 | aggregate_collapse.Aggregation.time_collapsed_by_HMEAN(True) |
| | 18.0±0.6ms | 17.9±0.2ms | 1.00 | aggregate_collapse.Aggregation.time_collapsed_by_MAX(False) |
| | 21.5±0.8ms | 21.6±0.4ms | 1.01 | aggregate_collapse.Aggregation.time_collapsed_by_MAX(True) |
| | 34.0±0.9ms | 34.0±0.6ms | 1.00 | aggregate_collapse.Aggregation.time_collapsed_by_MAX_RUN(False) |
| | 37.5±0.7ms | 37.4±1ms | 1.00 | aggregate_collapse.Aggregation.time_collapsed_by_MAX_RUN(True) |
| | 18.4±0.9ms | 18.9±0.6ms | 1.02 | aggregate_collapse.Aggregation.time_collapsed_by_MEAN(False) |
| | 22.2±0.5ms | 22.0±0.6ms | 0.99 | aggregate_collapse.Aggregation.time_collapsed_by_MEAN(True) |
| | 18.1±0.6ms | 18.5±0.5ms | 1.02 | aggregate_collapse.Aggregation.time_collapsed_by_MEDIAN(False) |
| | 22.0±0.6ms | 22.1±0.6ms | 1.01 | aggregate_collapse.Aggregation.time_collapsed_by_MEDIAN(True) |
| | 18.1±0.4ms | 18.5±0.6ms | 1.02 | aggregate_collapse.Aggregation.time_collapsed_by_MIN(False) |
| | 21.6±0.6ms | 21.5±0.6ms | 1.00 | aggregate_collapse.Aggregation.time_collapsed_by_MIN(True) |
| | 555±5ms | 552±5ms | 1.00 | aggregate_collapse.Aggregation.time_collapsed_by_PEAK(False) |
| | 554±4ms | 554±6ms | 1.00 | aggregate_collapse.Aggregation.time_collapsed_by_PEAK(True) |
| | 147±2ms | 148±0.9ms | 1.01 | aggregate_collapse.Aggregation.time_collapsed_by_PERCENTILE(False) |
| | 164±2ms | 165±1ms | 1.01 | aggregate_collapse.Aggregation.time_collapsed_by_PERCENTILE(True) |
| | 17.2±0.5ms | 17.3±0.5ms | 1.00 | aggregate_collapse.Aggregation.time_collapsed_by_PROPORTION(False) |
| | 21.0±0.5ms | 20.8±0.7ms | 0.99 | aggregate_collapse.Aggregation.time_collapsed_by_PROPORTION(True) |
| | 20.5±0.6ms | 20.3±0.5ms | 0.99 | aggregate_collapse.Aggregation.time_collapsed_by_RMS(False) |
| | 24.2±0.4ms | 24.3±0.9ms | 1.00 | aggregate_collapse.Aggregation.time_collapsed_by_RMS(True) |
| | 20.6±0.4ms | 20.6±0.4ms | 1.00 | aggregate_collapse.Aggregation.time_collapsed_by_STD_DEV(False) |
| | 24.3±0.5ms | 24.6±0.6ms | 1.01 | aggregate_collapse.Aggregation.time_collapsed_by_STD_DEV(True) |
| | 20.0±0.4ms | 19.8±0.5ms | 0.99 | aggregate_collapse.Aggregation.time_collapsed_by_VARIANCE(False) |
| | 23.5±0.5ms | 23.6±0.6ms | 1.00 | aggregate_collapse.Aggregation.time_collapsed_by_VARIANCE(True) |
| | 82.4±1ms | 82.0±1ms | 1.00 | aggregate_collapse.WeightedAggregation.time_w_aggregated_by_MEAN(False) |
| | 83.4±1ms | 82.3±0.9ms | 0.99 | aggregate_collapse.WeightedAggregation.time_w_aggregated_by_MEAN(True) |
| | 94.1±1ms | 93.3±1ms | 0.99 | aggregate_collapse.WeightedAggregation.time_w_aggregated_by_RMS(False) |
| | 94.8±0.8ms | 94.6±1ms | 1.00 | aggregate_collapse.WeightedAggregation.time_w_aggregated_by_RMS(True) |
| | 57.5±0.8ms | 57.4±0.5ms | 1.00 | aggregate_collapse.WeightedAggregation.time_w_aggregated_by_SUM(False) |
| | 58.8±0.6ms | 57.9±0.5ms | 0.99 | aggregate_collapse.WeightedAggregation.time_w_aggregated_by_SUM(True) |
| | 28.5±0.6ms | 28.6±0.2ms | 1.01 | aggregate_collapse.WeightedAggregation.time_w_collapsed_by_MEAN(False) |
| | 32.1±0.5ms | 32.2±0.5ms | 1.01 | aggregate_collapse.WeightedAggregation.time_w_collapsed_by_MEAN(True) |
| | 30.4±0.6ms | 30.6±0.3ms | 1.00 | aggregate_collapse.WeightedAggregation.time_w_collapsed_by_RMS(False) |
| | 34.8±0.8ms | 34.0±0.3ms | 0.98 | aggregate_collapse.WeightedAggregation.time_w_collapsed_by_RMS(True) |
| | 25.1±0.2ms | 25.1±0.2ms | 1.00 | aggregate_collapse.WeightedAggregation.time_w_collapsed_by_SUM(False) |
| | 28.7±0.2ms | 28.6±0.3ms | 1.00 | aggregate_collapse.WeightedAggregation.time_w_collapsed_by_SUM(True) |
| | 324±2ms | 323±5ms | 1.00 | aggregate_collapse.WeightedAggregation.time_w_collapsed_by_WPERCENTILE(False) |
| | 344±3ms | 346±2ms | 1.01 | aggregate_collapse.WeightedAggregation.time_w_collapsed_by_WPERCENTILE(True) |
| | 1.13±0.01ms | 1.10±0.02ms | 0.97 | cube.CubeCreation.time_create(False, 'construct') |
| | 404±3μs | 398±5μs | 0.99 | cube.CubeCreation.time_create(False, 'instantiate') |
| | 960±20μs | 946±10μs | 0.99 | cube.CubeCreation.time_create(True, 'construct') |
| | 583±7μs | 575±10μs | 0.99 | cube.CubeCreation.time_create(True, 'instantiate') |
| | 217±4ms | 219±2ms | 1.01 | cube.CubeEquality.time_equality(False, False, 'all_equal') |
| | 112±2ms | 111±1ms | 0.99 | cube.CubeEquality.time_equality(False, False, 'coord_inequality') |
| | 230±4ms | 229±3ms | 1.00 | cube.CubeEquality.time_equality(False, False, 'data_inequality') |
| | 16.7±0.2μs | 16.9±0.1μs | 1.01 | cube.CubeEquality.time_equality(False, False, 'metadata_inequality') |
| | 303±4ms | 302±5ms | 1.00 | cube.CubeEquality.time_equality(False, True, 'all_equal') |
| | 196±2ms | 195±2ms | 0.99 | cube.CubeEquality.time_equality(False, True, 'coord_inequality') |
| | 313±3ms | 312±4ms | 1.00 | cube.CubeEquality.time_equality(False, True, 'data_inequality') |
| | 16.5±0.3μs | 16.8±0.2μs | 1.02 | cube.CubeEquality.time_equality(False, True, 'metadata_inequality') |
| | 214±5ms | 218±2ms | 1.02 | cube.CubeEquality.time_equality(True, False, 'all_equal') |
| | 111±1ms | 112±1ms | 1.01 | cube.CubeEquality.time_equality(True, False, 'coord_inequality') |
| | 229±2ms | 229±1ms | 1.00 | cube.CubeEquality.time_equality(True, False, 'data_inequality') |
| | 53.4±0.6μs | 54.2±0.8μs | 1.01 | cube.CubeEquality.time_equality(True, False, 'metadata_inequality') |
| | 302±5ms | 303±3ms | 1.00 | cube.CubeEquality.time_equality(True, True, 'all_equal') |
| | 196±2ms | 196±2ms | 1.00 | cube.CubeEquality.time_equality(True, True, 'coord_inequality') |
| | 315±4ms | 310±5ms | 0.98 | cube.CubeEquality.time_equality(True, True, 'data_inequality') |
| | 55.1±0.8μs | 55.4±0.4μs | 1.01 | cube.CubeEquality.time_equality(True, True, 'metadata_inequality') |
| | 663±8μs | 662±8μs | 1.00 | import_iris.Iris.time__concatenate |
| | 181±2μs | 179±2μs | 0.99 | import_iris.Iris.time__constraints |
| | 110±0.4μs | 109±0.7μs | 0.98 | import_iris.Iris.time__data_manager |
| | 95.3±0.9μs | 93.4±0.4μs | 0.98 | import_iris.Iris.time__deprecation |
| | 137±0.7μs | 137±0.8μs | 1.00 | import_iris.Iris.time__lazy_data |
| | 900±10μs | 888±7μs | 0.99 | import_iris.Iris.time__merge |
| | 77.0±0.3μs | 77.2±0.7μs | 1.00 | import_iris.Iris.time__representation |
| | 482±4μs | 480±2μs | 1.00 | import_iris.Iris.time_analysis |
| | 141±3μs | 140±3μs | 0.99 | import_iris.Iris.time_analysis__area_weighted |
| | 110±0.9μs | 110±0.7μs | 1.00 | import_iris.Iris.time_analysis__grid_angles |
| | 245±4μs | 241±2μs | 0.98 | import_iris.Iris.time_analysis__interpolation |
| | 190±2μs | 186±1μs | 0.98 | import_iris.Iris.time_analysis__regrid |
| | 112±0.6μs | 111±0.3μs | 0.99 | import_iris.Iris.time_analysis__scipy_interpolate |
| | 141±4μs | 138±2μs | 0.97 | import_iris.Iris.time_analysis_calculus |
| | 328±2μs | 322±3μs | 0.98 | import_iris.Iris.time_analysis_cartography |
| | 95.9±2μs | 94.5±0.7μs | 0.99 | import_iris.Iris.time_analysis_geomerty |
| | 218±2μs | 215±1μs | 0.99 | import_iris.Iris.time_analysis_maths |
| | 97.4±0.7μs | 97.6±0.6μs | 1.00 | import_iris.Iris.time_analysis_stats |
| | 175±2μs | 173±2μs | 0.99 | import_iris.Iris.time_analysis_trajectory |
| | 310±2μs | 304±2μs | 0.98 | import_iris.Iris.time_aux_factory |
| | 84.3±0.6μs | 84.5±0.5μs | 1.00 | import_iris.Iris.time_common |
| | 163±0.8μs | 161±1μs | 0.99 | import_iris.Iris.time_common_lenient |
| | 991±8μs | 981±8μs | 0.99 | import_iris.Iris.time_common_metadata |
| | 133±0.5μs | 133±0.9μs | 1.00 | import_iris.Iris.time_common_mixin |
| | 1.18±0.01ms | 1.18±0.01ms | 1.00 | import_iris.Iris.time_common_resolve |
| | 200±3μs | 199±1μs | 0.99 | import_iris.Iris.time_config |
| | 117±2μs | 116±2μs | 1.00 | import_iris.Iris.time_coord_categorisation |
| | 368±5μs | 364±3μs | 0.99 | import_iris.Iris.time_coord_systems |
| | 747±7μs | 738±4μs | 0.99 | import_iris.Iris.time_coords |
| | 672±4μs | 664±1μs | 0.99 | import_iris.Iris.time_cube |
| | 226±3μs | 227±1μs | 1.00 | import_iris.Iris.time_exceptions |
| | 78.3±0.5μs | 78.1±0.4μs | 1.00 | import_iris.Iris.time_experimental |
| | 187±1μs | 185±0.8μs | 0.99 | import_iris.Iris.time_fileformats |
| | 254±1μs | 252±2μs | 0.99 | import_iris.Iris.time_fileformats__ff |
| | 2.72±0.05ms | 2.65±0.01ms | 0.98 | import_iris.Iris.time_fileformats__ff_cross_references |
| | 79.7±0.3μs | 79.9±0.6μs | 1.00 | import_iris.Iris.time_fileformats__pp_lbproc_pairs |
| | 116±0.8μs | 115±0.6μs | 0.99 | import_iris.Iris.time_fileformats_abf |
| | 363±3μs | 365±5μs | 1.00 | import_iris.Iris.time_fileformats_cf |
| | 5.33±0.04ms | 5.36±0.06ms | 1.00 | import_iris.Iris.time_fileformats_dot |
| | 74.9±0.3μs | 74.3±0.8μs | 0.99 | import_iris.Iris.time_fileformats_name |
| | 258±4μs | 253±3μs | 0.98 | import_iris.Iris.time_fileformats_name_loaders |
| | 120±1μs | 118±0.9μs | 0.98 | import_iris.Iris.time_fileformats_netcdf |
| | 123±0.8μs | 121±0.9μs | 0.98 | import_iris.Iris.time_fileformats_nimrod |
| | 214±2μs | 209±3μs | 0.98 | import_iris.Iris.time_fileformats_nimrod_load_rules |
| | 783±3μs | 774±3μs | 0.99 | import_iris.Iris.time_fileformats_pp |
| | 179±1μs | 180±5μs | 1.00 | import_iris.Iris.time_fileformats_pp_load_rules |
| | 135±0.7μs | 132±1μs | 0.98 | import_iris.Iris.time_fileformats_pp_save_rules |
| | 515±3μs | 508±4μs | 0.99 | import_iris.Iris.time_fileformats_rules |
| | 220±2μs | 220±3μs | 1.00 | import_iris.Iris.time_fileformats_structured_array_identification |
| | 83.9±0.8μs | 83.0±0.3μs | 0.99 | import_iris.Iris.time_fileformats_um |
| | 161±1μs | 159±1μs | 0.99 | import_iris.Iris.time_fileformats_um__fast_load |
| | 139±2μs | 137±0.7μs | 0.98 | import_iris.Iris.time_fileformats_um__fast_load_structured_fields |
| | 75.7±0.5μs | 76.1±0.6μs | 1.01 | import_iris.Iris.time_fileformats_um__ff_replacement |
| | 82.7±0.8μs | 82.3±0.4μs | 1.00 | import_iris.Iris.time_fileformats_um__optimal_array_structuring |
| | 993±30μs | 983±7μs | 0.99 | import_iris.Iris.time_fileformats_um_cf_map |
| | 137±0.6μs | 136±0.7μs | 0.99 | import_iris.Iris.time_io |
| | 173±1μs | 171±2μs | 0.98 | import_iris.Iris.time_io_format_picker |
| | 229±4μs | 228±1μs | 1.00 | import_iris.Iris.time_iris |
| | 128±0.5μs | 127±1μs | 1.00 | import_iris.Iris.time_iterate |
| | 8.38±0.1ms | 8.33±0.05ms | 0.99 | import_iris.Iris.time_palette |
| | 2.22±0.04ms | 2.21±0.04ms | 0.99 | import_iris.Iris.time_plot |
| | 105±0.7μs | 104±0.6μs | 0.99 | import_iris.Iris.time_quickplot |
| | 2.12±0.03ms | 2.12±0.03ms | 1.00 | import_iris.Iris.time_std_names |
| | 1.79±0.02ms | 1.77±0.01ms | 0.99 | import_iris.Iris.time_symbols |
| | 34.1±0.9ms | 33.8±0.7ms | 0.99 | import_iris.Iris.time_tests |
| | 255±3μs | 253±2μs | 0.99 | import_iris.Iris.time_third_party_cartopy |
| | 4.81±0.03ms | 4.82±0.02ms | 1.00 | import_iris.Iris.time_third_party_cf_units |
| | 120±0.9μs | 119±0.7μs | 0.99 | import_iris.Iris.time_third_party_cftime |
| | 2.79±0.1ms | 2.77±0.01ms | 0.99 | import_iris.Iris.time_third_party_matplotlib |
| | 1.07±0.02ms | 1.08±0ms | 1.01 | import_iris.Iris.time_third_party_numpy |
| | 171±1μs | 170±0.4μs | 0.99 | import_iris.Iris.time_third_party_scipy |
| | 100±0.7μs | 99.7±1μs | 1.00 | import_iris.Iris.time_time |
| | 322±2μs | 316±3μs | 0.98 | import_iris.Iris.time_util |
| | 73.1±1μs | 73.5±0.9μs | 1.00 | iterate.IZip.time_izip |
| | 17.5±0.3ms | 17.5±0.3ms | 1.00 | load.ugrid.BasicLoading.time_load_file(1) |
| | 40.5±1ms | 39.9±0.4ms | 0.98 | load.ugrid.BasicLoading.time_load_file(200000) |
| | 14.2±0.3ms | 14.1±0.3ms | 0.99 | load.ugrid.BasicLoading.time_load_mesh(1) |
| | 21.7±0.7ms | 21.4±0.3ms | 0.99 | load.ugrid.BasicLoading.time_load_mesh(200000) |
| | 17.8±0.1ms | 17.3±0.1ms | 0.97 | load.ugrid.BasicLoadingTime.time_load_file(1) |
| | 20.4±0.5ms | 19.7±0.2ms | 0.97 | load.ugrid.BasicLoadingTime.time_load_file(200000) |
| | 14.6±0.2ms | 14.2±0.09ms | 0.97 | load.ugrid.BasicLoadingTime.time_load_mesh(1) |
| | 16.7±0.4ms | 16.4±0.2ms | 0.98 | load.ugrid.BasicLoadingTime.time_load_mesh(200000) |
| | 18.5±0.2ms | 18.4±0.2ms | 0.99 | load.ugrid.Callback.time_load_file_callback(1) |
| | 49.4±0.7ms | 48.5±0.3ms | 0.98 | load.ugrid.Callback.time_load_file_callback(200000) |
| | 18.7±0.3ms | 18.3±0.2ms | 0.98 | load.ugrid.CallbackTime.time_load_file_callback(1) |
| | 22.1±0.9ms | 21.5±0.3ms | 0.97 | load.ugrid.CallbackTime.time_load_file_callback(200000) |
| | 2.72±0.1ms | 2.61±0.03ms | 0.96 | load.ugrid.DataRealisation.time_realise_data(10000) |
| | 5.25±0.9ms | 3.49±0.4ms | ~0.67 | load.ugrid.DataRealisation.time_realise_data(200000) |
| | 35.2±2ms | 35.5±0.3ms | 1.01 | load.ugrid.DataRealisationTime.time_realise_data(10000) |
| | 771±7ms | 772±7ms | 1.00 | load.ugrid.DataRealisationTime.time_realise_data(200000) |
| | 118±3ms | 118±0.8ms | 1.00 | merge_concat.Concatenate.time_concatenate |
| | 24.1 | 24.0 | 1.00 | merge_concat.Concatenate.track_mem_merge |
| | 46.7±0.6ms | 46.6±0.2ms | 1.00 | merge_concat.Merge.time_merge |
| | 11.0 | 11.0 | 1.00 | merge_concat.Merge.track_mem_merge |
| | 6.55±0.05ms | 6.52±0.06ms | 1.00 | plot.AuxSort.time_aux_sort |
| | 76.0±2ms | 73.5±5ms | 0.97 | regridding.CurvilinearRegridding.time_regrid_pic |
| | 144.9 | 144.9 | 1.00 | regridding.CurvilinearRegridding.track_mem_regrid_pic |
| | 97.1±0.7ms | 96.8±0.4ms | 1.00 | regridding.HorizontalChunkedRegridding.time_regrid_area_w |
| | 46.4±1ms | 45.9±0.7ms | 0.99 | regridding.HorizontalChunkedRegridding.time_regrid_area_w_new_grid |
| | 111.6 | 111.6 | 1.00 | regridding.HorizontalChunkedRegridding.track_mem_regrid_area_w |
| | 150.6 | 150.6 | 1.00 | regridding.HorizontalChunkedRegridding.track_mem_regrid_area_w_new_grid |
| | 4.01±0.07ms | 4.03±0.02ms | 1.01 | save.NetcdfSave.time_netcdf_save_cube(50, False) |
| | 70.4±0.9ms | 70.2±0.4ms | 1.00 | save.NetcdfSave.time_netcdf_save_cube(50, True) |
| | 52.0±0.9ms | 51.7±0.7ms | 0.99 | save.NetcdfSave.time_netcdf_save_cube(600, False) |
| | 551±2ms | 552±2ms | 1.00 | save.NetcdfSave.time_netcdf_save_cube(600, True) |
| | 89.4±0.8ns | 88.7±0.5ns | 0.99 | save.NetcdfSave.time_netcdf_save_mesh(50, False) |
| | 53.6±0.5ms | 54.0±0.3ms | 1.01 | save.NetcdfSave.time_netcdf_save_mesh(50, True) |
| | 89.9±0.5ns | 90.0±0.3ns | 1.00 | save.NetcdfSave.time_netcdf_save_mesh(600, False) |
| | 488±3ms | 484±2ms | 0.99 | save.NetcdfSave.time_netcdf_save_mesh(600, True) |
| | 0.3 | 0.3 | 1.00 | save.NetcdfSave.track_addedmem_netcdf_save(50, False) |
| | 2.1 | 2.0 | 0.95 | save.NetcdfSave.track_addedmem_netcdf_save(50, True) |
| | 0.3 | 0.3 | 1.00 | save.NetcdfSave.track_addedmem_netcdf_save(600, False) |
| | 181.6 | 181.7 | 1.00 | save.NetcdfSave.track_addedmem_netcdf_save(600, True) |
| | 42.1±1ms | 42.9±1ms | 1.02 | stats.PearsonR.time_lazy |
| | 18.8±0.2ms | 19.0±0.3ms | 1.01 | stats.PearsonR.time_real |
| | 19.6 | 19.6 | 1.00 | stats.PearsonR.track_lazy |
| | 17.8 | 17.8 | 1.00 | stats.PearsonR.track_real |
| | 22.5±0.4ms | 22.5±0.7ms | 1.00 | trajectory.TrajectoryInterpolation.time_trajectory_linear |
| | 60.9±2ms | 60.9±0.7ms | 1.00 | trajectory.TrajectoryInterpolation.time_trajectory_nearest |
| | 32.2 | 32.2 | 1.00 | trajectory.TrajectoryInterpolation.track_trajectory_linear |
| | 21.6 | 21.6 | 1.00 | trajectory.TrajectoryInterpolation.track_trajectory_nearest |
Benchmarks that have got worse:
| Change | Before [c333b7f7] <main~1> | After [7c87fb2a] <main> | Ratio | Benchmark (Parameter) |
|----------|------------------------------|---------------------------|---------|--------------------------------------------------------------------------------------------------------|
| ! | 392±1ns | failed | n/a | experimental.ugrid.regions_combine.CombineRegionsComputeRealData.time_compute_data(50) |
| ! | 255±1ms | failed | n/a | experimental.ugrid.regions_combine.CombineRegionsComputeRealData.time_compute_data(500) |
| ! | 0.6 | failed | n/a | experimental.ugrid.regions_combine.CombineRegionsComputeRealData.track_addedmem_compute_data(50) |
| ! | 57.3 | failed | n/a | experimental.ugrid.regions_combine.CombineRegionsComputeRealData.track_addedmem_compute_data(500) |
| ! | 14.4±0.2ms | failed | n/a | experimental.ugrid.regions_combine.CombineRegionsCreateCube.time_create_combined_cube(50) |
| ! | 16.0±0.4ms | failed | n/a | experimental.ugrid.regions_combine.CombineRegionsCreateCube.time_create_combined_cube(500) |
| ! | 0.5 | failed | n/a | experimental.ugrid.regions_combine.CombineRegionsCreateCube.track_addedmem_create_combined_cube(50) |
| ! | 11.8 | failed | n/a | experimental.ugrid.regions_combine.CombineRegionsCreateCube.track_addedmem_create_combined_cube(500) |
| ! | 106±2ms | failed | n/a | experimental.ugrid.regions_combine.CombineRegionsFileStreamedCalc.time_stream_file2file(50) |
| ! | 693±3ms | failed | n/a | experimental.ugrid.regions_combine.CombineRegionsFileStreamedCalc.time_stream_file2file(500) |
| ! | 1.4 | failed | n/a | experimental.ugrid.regions_combine.CombineRegionsFileStreamedCalc.track_addedmem_stream_file2file(50) |
| ! | 92.0 | failed | n/a | experimental.ugrid.regions_combine.CombineRegionsFileStreamedCalc.track_addedmem_stream_file2file(500) |
| ! | 65.8±0.7ms | failed | n/a | experimental.ugrid.regions_combine.CombineRegionsSaveData.time_save(50) |
| ! | 647±4ms | failed | n/a | experimental.ugrid.regions_combine.CombineRegionsSaveData.time_save(500) |
| ! | 1.4 | failed | n/a | experimental.ugrid.regions_combine.CombineRegionsSaveData.track_addedmem_save(50) |
| ! | 92.0 | failed | n/a | experimental.ugrid.regions_combine.CombineRegionsSaveData.track_addedmem_save(500) |
| ! | 2.1752849999999997 | failed | n/a | experimental.ugrid.regions_combine.CombineRegionsSaveData.track_filesize_saved(50) |
| ! | 216.01528499999998 | failed | n/a | experimental.ugrid.regions_combine.CombineRegionsSaveData.track_filesize_saved(500) |
| ! | 8.07±0.09ms | failed | n/a | load.LoadAndRealise.time_load((1280, 960, 5), False, 'FF') |
| ! | 29.0±0.4ms | failed | n/a | load.LoadAndRealise.time_load((1280, 960, 5), False, 'NetCDF') |
| ! | 8.79±0.08ms | failed | n/a | load.LoadAndRealise.time_load((1280, 960, 5), False, 'PP') |
| ! | 8.05±0.06ms | failed | n/a | load.LoadAndRealise.time_load((1280, 960, 5), True, 'FF') |
| ! | 26.8±0.3ms | failed | n/a | load.LoadAndRealise.time_load((1280, 960, 5), True, 'NetCDF') |
| ! | 8.93±0.1ms | failed | n/a | load.LoadAndRealise.time_load((1280, 960, 5), True, 'PP') |
| ! | 1.33±0.02s | failed | n/a | load.LoadAndRealise.time_load((2, 2, 1000), False, 'FF') |
| ! | 26.4±0.2ms | failed | n/a | load.LoadAndRealise.time_load((2, 2, 1000), False, 'NetCDF') |
| ! | 1.48±0.01s | failed | n/a | load.LoadAndRealise.time_load((2, 2, 1000), False, 'PP') |
| ! | 1.33±0.01s | failed | n/a | load.LoadAndRealise.time_load((2, 2, 1000), True, 'FF') |
| ! | 26.5±0.4ms | failed | n/a | load.LoadAndRealise.time_load((2, 2, 1000), True, 'NetCDF') |
| ! | 1.48±0.02s | failed | n/a | load.LoadAndRealise.time_load((2, 2, 1000), True, 'PP') |
| ! | 3.91±0.05ms | failed | n/a | load.LoadAndRealise.time_load((50, 50, 2), False, 'FF') |
| ! | 25.4±0.3ms | failed | n/a | load.LoadAndRealise.time_load((50, 50, 2), False, 'NetCDF') |
| ! | 4.22±0.03ms | failed | n/a | load.LoadAndRealise.time_load((50, 50, 2), False, 'PP') |
| ! | 3.89±0.03ms | failed | n/a | load.LoadAndRealise.time_load((50, 50, 2), True, 'FF') |
| ! | 25.4±0.1ms | failed | n/a | load.LoadAndRealise.time_load((50, 50, 2), True, 'NetCDF') |
| ! | 4.14±0.02ms | failed | n/a | load.LoadAndRealise.time_load((50, 50, 2), True, 'PP') |
| ! | 31.3±3ms | failed | n/a | load.LoadAndRealise.time_realise((1280, 960, 5), False, 'FF') |
| ! | 18.5±0.7ms | failed | n/a | load.LoadAndRealise.time_realise((1280, 960, 5), False, 'NetCDF') |
| ! | 12.9±2ms | failed | n/a | load.LoadAndRealise.time_realise((1280, 960, 5), False, 'PP') |
| ! | 25.9±2ms | failed | n/a | load.LoadAndRealise.time_realise((1280, 960, 5), True, 'FF') |
| ! | 69.7±2ms | failed | n/a | load.LoadAndRealise.time_realise((1280, 960, 5), True, 'NetCDF') |
| ! | 25.1±2ms | failed | n/a | load.LoadAndRealise.time_realise((1280, 960, 5), True, 'PP') |
| ! | 432±9ms | failed | n/a | load.LoadAndRealise.time_realise((2, 2, 1000), False, 'FF') |
| ! | 2.84±0.1ms | failed | n/a | load.LoadAndRealise.time_realise((2, 2, 1000), False, 'NetCDF') |
| ! | 444±9ms | failed | n/a | load.LoadAndRealise.time_realise((2, 2, 1000), False, 'PP') |
| ! | 443±8ms | failed | n/a | load.LoadAndRealise.time_realise((2, 2, 1000), True, 'FF') |
| ! | 2.75±0.08ms | failed | n/a | load.LoadAndRealise.time_realise((2, 2, 1000), True, 'NetCDF') |
| ! | 447±10ms | failed | n/a | load.LoadAndRealise.time_realise((2, 2, 1000), True, 'PP') |
| ! | 1.55±0.09ms | failed | n/a | load.LoadAndRealise.time_realise((50, 50, 2), False, 'FF') |
| ! | 2.74±0.1ms | failed | n/a | load.LoadAndRealise.time_realise((50, 50, 2), False, 'NetCDF') |
| ! | 1.60±0.08ms | failed | n/a | load.LoadAndRealise.time_realise((50, 50, 2), False, 'PP') |
| ! | 1.54±0.09ms | failed | n/a | load.LoadAndRealise.time_realise((50, 50, 2), True, 'FF') |
| ! | 2.88±0.1ms | failed | n/a | load.LoadAndRealise.time_realise((50, 50, 2), True, 'NetCDF') |
| ! | 1.57±0.08ms | failed | n/a | load.LoadAndRealise.time_realise((50, 50, 2), True, 'PP') |
| ! | 499±3ms | failed | n/a | load.ManyVars.time_many_var_load |
| ! | 8.18±0.04ms | failed | n/a | load.STASHConstraint.time_stash_constraint((1280, 960, 5), 'FF') |
| ! | 8.98±0.05ms | failed | n/a | load.STASHConstraint.time_stash_constraint((1280, 960, 5), 'PP') |
| ! | 1.35±0.01s | failed | n/a | load.STASHConstraint.time_stash_constraint((2, 2, 1000), 'FF') |
| ! | 1.50±0.02s | failed | n/a | load.STASHConstraint.time_stash_constraint((2, 2, 1000), 'PP') |
| ! | 3.98±0.06ms | failed | n/a | load.STASHConstraint.time_stash_constraint((2, 2, 2), 'FF') |
| ! | 4.26±0.02ms | failed | n/a | load.STASHConstraint.time_stash_constraint((2, 2, 2), 'PP') |
| ! | 8.06±0.05ms | failed | n/a | load.StructuredFF.time_structured_load((1280, 960, 5), False) |
| ! | 4.75±0.02ms | failed | n/a | load.StructuredFF.time_structured_load((1280, 960, 5), True) |
| ! | 1.33±0.01s | failed | n/a | load.StructuredFF.time_structured_load((2, 2, 1000), False) |
| ! | 368±4ms | failed | n/a | load.StructuredFF.time_structured_load((2, 2, 1000), True) |
| ! | 3.91±0.03ms | failed | n/a | load.StructuredFF.time_structured_load((2, 2, 2), False) |
| ! | 3.56±0.02ms | failed | n/a | load.StructuredFF.time_structured_load((2, 2, 2), True) |
| ! | 149±2ms | failed | n/a | load.TimeConstraint.time_time_constraint(20, 'FF') |
| ! | 28.9±0.06ms | failed | n/a | load.TimeConstraint.time_time_constraint(20, 'NetCDF') |
| ! | 164±2ms | failed | n/a | load.TimeConstraint.time_time_constraint(20, 'PP') |
| ! | 29.4±0.2ms | failed | n/a | load.TimeConstraint.time_time_constraint(3, 'FF') |
| ! | 29.0±0.3ms | failed | n/a | load.TimeConstraint.time_time_constraint(3, 'NetCDF') |
| ! | 31.8±0.3ms | failed | n/a | load.TimeConstraint.time_time_constraint(3, 'PP') |
Generated by GHA run 10102738639