-
Notifications
You must be signed in to change notification settings - Fork 298
Closed as not planned
Labels
Description
Benchmark comparison has identified performance shifts at:
- commit 4585059 (Mesh nonexperimental extra #6077).
Please review the report below and take corrective/congratulatory action as appropriate :slightly_smiling_face:
⏱️ Performance Benchmark Report: 4585059
Performance shifts
| Change | Before [7c87fb2a] <main~2> | After [4585059b] <main~1> | Ratio | Benchmark (Parameter) |
|----------|------------------------------|-----------------------------|---------|---------------------------------------|
| + | 997±9μs | 1.34±0.01ms | 1.35 | import_iris.Iris.time_common_metadata |
Full benchmark results
Benchmarks that have improved:
| Change | Before [7c87fb2a] <main~2> | After [4585059b] <main~1> | Ratio | Benchmark (Parameter) |
|----------|------------------------------|-----------------------------|---------|------------------------------------------------------------------------------------------------|
| | failed | 54.1±0.8ms | n/a | aggregate_collapse.Aggregation.time_aggregated_by_COUNT(False) |
| | failed | 54.8±0.6ms | n/a | aggregate_collapse.Aggregation.time_aggregated_by_COUNT(True) |
| | failed | 193±2ms | n/a | aggregate_collapse.Aggregation.time_aggregated_by_FAST_PERCENTILE(False) |
| | failed | 194±2ms | n/a | aggregate_collapse.Aggregation.time_aggregated_by_FAST_PERCENTILE(True) |
| | failed | 37.1±0.4ms | n/a | aggregate_collapse.Aggregation.time_aggregated_by_GMEAN(False) |
| | failed | 37.8±0.5ms | n/a | aggregate_collapse.Aggregation.time_aggregated_by_GMEAN(True) |
| | failed | 36.8±0.5ms | n/a | aggregate_collapse.Aggregation.time_aggregated_by_HMEAN(False) |
| | failed | 37.7±0.4ms | n/a | aggregate_collapse.Aggregation.time_aggregated_by_HMEAN(True) |
| | failed | 47.2±0.3ms | n/a | aggregate_collapse.Aggregation.time_aggregated_by_MAX(False) |
| | failed | 47.1±0.5ms | n/a | aggregate_collapse.Aggregation.time_aggregated_by_MAX(True) |
| | failed | 122±1ms | n/a | aggregate_collapse.Aggregation.time_aggregated_by_MAX_RUN(False) |
| | failed | 123±1ms | n/a | aggregate_collapse.Aggregation.time_aggregated_by_MAX_RUN(True) |
| | failed | 51.1±0.8ms | n/a | aggregate_collapse.Aggregation.time_aggregated_by_MEAN(False) |
| | failed | 52.0±0.9ms | n/a | aggregate_collapse.Aggregation.time_aggregated_by_MEAN(True) |
| | failed | 37.0±0.8ms | n/a | aggregate_collapse.Aggregation.time_aggregated_by_MEDIAN(False) |
| | failed | 37.6±0.6ms | n/a | aggregate_collapse.Aggregation.time_aggregated_by_MEDIAN(True) |
| | failed | 46.9±0.8ms | n/a | aggregate_collapse.Aggregation.time_aggregated_by_MIN(False) |
| | failed | 47.7±0.8ms | n/a | aggregate_collapse.Aggregation.time_aggregated_by_MIN(True) |
| | failed | 1.32±0.01s | n/a | aggregate_collapse.Aggregation.time_aggregated_by_PEAK(False) |
| | failed | 1.32±0.01s | n/a | aggregate_collapse.Aggregation.time_aggregated_by_PEAK(True) |
| | failed | 683±10ms | n/a | aggregate_collapse.Aggregation.time_aggregated_by_PERCENTILE(False) |
| | failed | 682±10ms | n/a | aggregate_collapse.Aggregation.time_aggregated_by_PERCENTILE(True) |
| | failed | 35.3±0.3ms | n/a | aggregate_collapse.Aggregation.time_aggregated_by_PROPORTION(False) |
| | failed | 36.0±0.5ms | n/a | aggregate_collapse.Aggregation.time_aggregated_by_PROPORTION(True) |
| | failed | 62.2±0.7ms | n/a | aggregate_collapse.Aggregation.time_aggregated_by_RMS(False) |
| | failed | 62.9±0.9ms | n/a | aggregate_collapse.Aggregation.time_aggregated_by_RMS(True) |
| | failed | 66.1±0.6ms | n/a | aggregate_collapse.Aggregation.time_aggregated_by_STD_DEV(False) |
| | failed | 67.0±0.9ms | n/a | aggregate_collapse.Aggregation.time_aggregated_by_STD_DEV(True) |
| | failed | 61.7±0.8ms | n/a | aggregate_collapse.Aggregation.time_aggregated_by_VARIANCE(False) |
| | failed | 62.7±0.5ms | n/a | aggregate_collapse.Aggregation.time_aggregated_by_VARIANCE(True) |
| | failed | 20.2±0.5ms | n/a | aggregate_collapse.Aggregation.time_collapsed_by_COUNT(False) |
| | failed | 23.8±0.6ms | n/a | aggregate_collapse.Aggregation.time_collapsed_by_COUNT(True) |
| | failed | 134±2ms | n/a | aggregate_collapse.Aggregation.time_collapsed_by_FAST_PERCENTILE(False) |
| | failed | 146±2ms | n/a | aggregate_collapse.Aggregation.time_collapsed_by_FAST_PERCENTILE(True) |
| | failed | 18.5±0.9ms | n/a | aggregate_collapse.Aggregation.time_collapsed_by_GMEAN(False) |
| | failed | 22.2±0.4ms | n/a | aggregate_collapse.Aggregation.time_collapsed_by_GMEAN(True) |
| | failed | 18.3±0.4ms | n/a | aggregate_collapse.Aggregation.time_collapsed_by_HMEAN(False) |
| | failed | 22.3±0.6ms | n/a | aggregate_collapse.Aggregation.time_collapsed_by_HMEAN(True) |
| | failed | 18.9±1ms | n/a | aggregate_collapse.Aggregation.time_collapsed_by_MAX(False) |
| | failed | 23.0±0.6ms | n/a | aggregate_collapse.Aggregation.time_collapsed_by_MAX(True) |
| | failed | 34.6±2ms | n/a | aggregate_collapse.Aggregation.time_collapsed_by_MAX_RUN(False) |
| | failed | 38.4±1ms | n/a | aggregate_collapse.Aggregation.time_collapsed_by_MAX_RUN(True) |
| | failed | 19.4±0.6ms | n/a | aggregate_collapse.Aggregation.time_collapsed_by_MEAN(False) |
| | failed | 23.0±0.5ms | n/a | aggregate_collapse.Aggregation.time_collapsed_by_MEAN(True) |
| | failed | 19.0±0.3ms | n/a | aggregate_collapse.Aggregation.time_collapsed_by_MEDIAN(False) |
| | failed | 22.8±0.4ms | n/a | aggregate_collapse.Aggregation.time_collapsed_by_MEDIAN(True) |
| | failed | 19.1±0.4ms | n/a | aggregate_collapse.Aggregation.time_collapsed_by_MIN(False) |
| | failed | 22.8±0.6ms | n/a | aggregate_collapse.Aggregation.time_collapsed_by_MIN(True) |
| | failed | 551±3ms | n/a | aggregate_collapse.Aggregation.time_collapsed_by_PEAK(False) |
| | failed | 554±5ms | n/a | aggregate_collapse.Aggregation.time_collapsed_by_PEAK(True) |
| | failed | 152±3ms | n/a | aggregate_collapse.Aggregation.time_collapsed_by_PERCENTILE(False) |
| | failed | 168±3ms | n/a | aggregate_collapse.Aggregation.time_collapsed_by_PERCENTILE(True) |
| | failed | 18.7±0.7ms | n/a | aggregate_collapse.Aggregation.time_collapsed_by_PROPORTION(False) |
| | failed | 21.5±0.3ms | n/a | aggregate_collapse.Aggregation.time_collapsed_by_PROPORTION(True) |
| | failed | 21.2±0.4ms | n/a | aggregate_collapse.Aggregation.time_collapsed_by_RMS(False) |
| | failed | 25.7±0.6ms | n/a | aggregate_collapse.Aggregation.time_collapsed_by_RMS(True) |
| | failed | 21.1±0.4ms | n/a | aggregate_collapse.Aggregation.time_collapsed_by_STD_DEV(False) |
| | failed | 25.0±0.3ms | n/a | aggregate_collapse.Aggregation.time_collapsed_by_STD_DEV(True) |
| | failed | 21.1±0.4ms | n/a | aggregate_collapse.Aggregation.time_collapsed_by_VARIANCE(False) |
| | failed | 24.4±0.4ms | n/a | aggregate_collapse.Aggregation.time_collapsed_by_VARIANCE(True) |
| | failed | 82.9±0.6ms | n/a | aggregate_collapse.WeightedAggregation.time_w_aggregated_by_MEAN(False) |
| | failed | 83.4±0.9ms | n/a | aggregate_collapse.WeightedAggregation.time_w_aggregated_by_MEAN(True) |
| | failed | 95.3±1ms | n/a | aggregate_collapse.WeightedAggregation.time_w_aggregated_by_RMS(False) |
| | failed | 96.4±1ms | n/a | aggregate_collapse.WeightedAggregation.time_w_aggregated_by_RMS(True) |
| | failed | 58.5±0.6ms | n/a | aggregate_collapse.WeightedAggregation.time_w_aggregated_by_SUM(False) |
| | failed | 59.6±0.5ms | n/a | aggregate_collapse.WeightedAggregation.time_w_aggregated_by_SUM(True) |
| | failed | 29.5±0.7ms | n/a | aggregate_collapse.WeightedAggregation.time_w_collapsed_by_MEAN(False) |
| | failed | 33.1±0.7ms | n/a | aggregate_collapse.WeightedAggregation.time_w_collapsed_by_MEAN(True) |
| | failed | 31.2±0.7ms | n/a | aggregate_collapse.WeightedAggregation.time_w_collapsed_by_RMS(False) |
| | failed | 35.0±0.6ms | n/a | aggregate_collapse.WeightedAggregation.time_w_collapsed_by_RMS(True) |
| | failed | 26.5±0.5ms | n/a | aggregate_collapse.WeightedAggregation.time_w_collapsed_by_SUM(False) |
| | failed | 30.2±0.4ms | n/a | aggregate_collapse.WeightedAggregation.time_w_collapsed_by_SUM(True) |
| | failed | 326±3ms | n/a | aggregate_collapse.WeightedAggregation.time_w_collapsed_by_WPERCENTILE(False) |
| | failed | 347±4ms | n/a | aggregate_collapse.WeightedAggregation.time_w_collapsed_by_WPERCENTILE(True) |
| | failed | 1.12±0.01ms | n/a | cube.CubeCreation.time_create(False, 'construct') |
| | failed | 399±6μs | n/a | cube.CubeCreation.time_create(False, 'instantiate') |
| | failed | 948±10μs | n/a | cube.CubeCreation.time_create(True, 'construct') |
| | failed | 573±5μs | n/a | cube.CubeCreation.time_create(True, 'instantiate') |
| | failed | 225±2ms | n/a | cube.CubeEquality.time_equality(False, False, 'all_equal') |
| | failed | 115±2ms | n/a | cube.CubeEquality.time_equality(False, False, 'coord_inequality') |
| | failed | 238±3ms | n/a | cube.CubeEquality.time_equality(False, False, 'data_inequality') |
| | failed | 16.7±0.2μs | n/a | cube.CubeEquality.time_equality(False, False, 'metadata_inequality') |
| | failed | 316±4ms | n/a | cube.CubeEquality.time_equality(False, True, 'all_equal') |
| | failed | 203±3ms | n/a | cube.CubeEquality.time_equality(False, True, 'coord_inequality') |
| | failed | 322±3ms | n/a | cube.CubeEquality.time_equality(False, True, 'data_inequality') |
| | failed | 16.8±0.1μs | n/a | cube.CubeEquality.time_equality(False, True, 'metadata_inequality') |
| | failed | 224±2ms | n/a | cube.CubeEquality.time_equality(True, False, 'all_equal') |
| | failed | 113±2ms | n/a | cube.CubeEquality.time_equality(True, False, 'coord_inequality') |
| | failed | 237±3ms | n/a | cube.CubeEquality.time_equality(True, False, 'data_inequality') |
| | failed | 53.3±0.5μs | n/a | cube.CubeEquality.time_equality(True, False, 'metadata_inequality') |
| | failed | 313±3ms | n/a | cube.CubeEquality.time_equality(True, True, 'all_equal') |
| | failed | 202±2ms | n/a | cube.CubeEquality.time_equality(True, True, 'coord_inequality') |
| | failed | 322±5ms | n/a | cube.CubeEquality.time_equality(True, True, 'data_inequality') |
| | failed | 54.9±0.9μs | n/a | cube.CubeEquality.time_equality(True, True, 'metadata_inequality') |
| | failed | 8.13±0.09ms | n/a | load.LoadAndRealise.time_load((1280, 960, 5), False, 'FF') |
| | failed | 30.7±0.4ms | n/a | load.LoadAndRealise.time_load((1280, 960, 5), False, 'NetCDF') |
| | failed | 8.82±0.09ms | n/a | load.LoadAndRealise.time_load((1280, 960, 5), False, 'PP') |
| | failed | 8.03±0.07ms | n/a | load.LoadAndRealise.time_load((1280, 960, 5), True, 'FF') |
| | failed | 27.1±0.2ms | n/a | load.LoadAndRealise.time_load((1280, 960, 5), True, 'NetCDF') |
| | failed | 8.82±0.1ms | n/a | load.LoadAndRealise.time_load((1280, 960, 5), True, 'PP') |
| | failed | 1.35±0.01s | n/a | load.LoadAndRealise.time_load((2, 2, 1000), False, 'FF') |
| | failed | 26.8±0.2ms | n/a | load.LoadAndRealise.time_load((2, 2, 1000), False, 'NetCDF') |
| | failed | 1.51±0.01s | n/a | load.LoadAndRealise.time_load((2, 2, 1000), False, 'PP') |
| | failed | 1.37±0.01s | n/a | load.LoadAndRealise.time_load((2, 2, 1000), True, 'FF') |
| | failed | 27.0±0.4ms | n/a | load.LoadAndRealise.time_load((2, 2, 1000), True, 'NetCDF') |
| | failed | 1.50±0.01s | n/a | load.LoadAndRealise.time_load((2, 2, 1000), True, 'PP') |
| | failed | 3.92±0.03ms | n/a | load.LoadAndRealise.time_load((50, 50, 2), False, 'FF') |
| | failed | 26.0±0.2ms | n/a | load.LoadAndRealise.time_load((50, 50, 2), False, 'NetCDF') |
| | failed | 4.22±0.05ms | n/a | load.LoadAndRealise.time_load((50, 50, 2), False, 'PP') |
| | failed | 3.89±0.02ms | n/a | load.LoadAndRealise.time_load((50, 50, 2), True, 'FF') |
| | failed | 26.1±0.4ms | n/a | load.LoadAndRealise.time_load((50, 50, 2), True, 'NetCDF') |
| | failed | 4.17±0.05ms | n/a | load.LoadAndRealise.time_load((50, 50, 2), True, 'PP') |
| | failed | 31.3±1ms | n/a | load.LoadAndRealise.time_realise((1280, 960, 5), False, 'FF') |
| | failed | 19.8±0.4ms | n/a | load.LoadAndRealise.time_realise((1280, 960, 5), False, 'NetCDF') |
| | failed | 13.0±3ms | n/a | load.LoadAndRealise.time_realise((1280, 960, 5), False, 'PP') |
| | failed | 25.6±0.9ms | n/a | load.LoadAndRealise.time_realise((1280, 960, 5), True, 'FF') |
| | failed | 70.5±2ms | n/a | load.LoadAndRealise.time_realise((1280, 960, 5), True, 'NetCDF') |
| | failed | 25.8±2ms | n/a | load.LoadAndRealise.time_realise((1280, 960, 5), True, 'PP') |
| | failed | 444±3ms | n/a | load.LoadAndRealise.time_realise((2, 2, 1000), False, 'FF') |
| | failed | 3.01±0.1ms | n/a | load.LoadAndRealise.time_realise((2, 2, 1000), False, 'NetCDF') |
| | failed | 449±3ms | n/a | load.LoadAndRealise.time_realise((2, 2, 1000), False, 'PP') |
| | failed | 452±2ms | n/a | load.LoadAndRealise.time_realise((2, 2, 1000), True, 'FF') |
| | failed | 3.05±0.06ms | n/a | load.LoadAndRealise.time_realise((2, 2, 1000), True, 'NetCDF') |
| | failed | 458±3ms | n/a | load.LoadAndRealise.time_realise((2, 2, 1000), True, 'PP') |
| | failed | 1.55±0.07ms | n/a | load.LoadAndRealise.time_realise((50, 50, 2), False, 'FF') |
| | failed | 3.01±0.1ms | n/a | load.LoadAndRealise.time_realise((50, 50, 2), False, 'NetCDF') |
| | failed | 1.60±0.1ms | n/a | load.LoadAndRealise.time_realise((50, 50, 2), False, 'PP') |
| | failed | 1.57±0.1ms | n/a | load.LoadAndRealise.time_realise((50, 50, 2), True, 'FF') |
| | failed | 3.05±0.1ms | n/a | load.LoadAndRealise.time_realise((50, 50, 2), True, 'NetCDF') |
| | failed | 1.60±0.1ms | n/a | load.LoadAndRealise.time_realise((50, 50, 2), True, 'PP') |
| | failed | 503±4ms | n/a | load.ManyVars.time_many_var_load |
| | failed | 8.17±0.05ms | n/a | load.STASHConstraint.time_stash_constraint((1280, 960, 5), 'FF') |
| | failed | 8.97±0.06ms | n/a | load.STASHConstraint.time_stash_constraint((1280, 960, 5), 'PP') |
| | failed | 1.38±0.01s | n/a | load.STASHConstraint.time_stash_constraint((2, 2, 1000), 'FF') |
| | failed | 1.54±0.02s | n/a | load.STASHConstraint.time_stash_constraint((2, 2, 1000), 'PP') |
| | failed | 3.96±0.04ms | n/a | load.STASHConstraint.time_stash_constraint((2, 2, 2), 'FF') |
| | failed | 4.27±0.04ms | n/a | load.STASHConstraint.time_stash_constraint((2, 2, 2), 'PP') |
| | failed | 8.06±0.07ms | n/a | load.StructuredFF.time_structured_load((1280, 960, 5), False) |
| | failed | 4.85±0.09ms | n/a | load.StructuredFF.time_structured_load((1280, 960, 5), True) |
| | failed | 1.35±0.01s | n/a | load.StructuredFF.time_structured_load((2, 2, 1000), False) |
| | failed | 371±4ms | n/a | load.StructuredFF.time_structured_load((2, 2, 1000), True) |
| | failed | 3.87±0.02ms | n/a | load.StructuredFF.time_structured_load((2, 2, 2), False) |
| | failed | 3.56±0.02ms | n/a | load.StructuredFF.time_structured_load((2, 2, 2), True) |
| | failed | 148±1ms | n/a | load.TimeConstraint.time_time_constraint(20, 'FF') |
| | failed | 29.6±0.3ms | n/a | load.TimeConstraint.time_time_constraint(20, 'NetCDF') |
| | failed | 164±2ms | n/a | load.TimeConstraint.time_time_constraint(20, 'PP') |
| | failed | 29.7±0.5ms | n/a | load.TimeConstraint.time_time_constraint(3, 'FF') |
| | failed | 29.5±0.2ms | n/a | load.TimeConstraint.time_time_constraint(3, 'NetCDF') |
| | failed | 32.1±0.6ms | n/a | load.TimeConstraint.time_time_constraint(3, 'PP') |
| | failed | 17.6±0.2ms | n/a | load.ugrid.BasicLoading.time_load_file(1) |
| | failed | 41.5±0.5ms | n/a | load.ugrid.BasicLoading.time_load_file(200000) |
| | failed | 14.5±0.3ms | n/a | load.ugrid.BasicLoading.time_load_mesh(1) |
| | failed | 22.4±0.5ms | n/a | load.ugrid.BasicLoading.time_load_mesh(200000) |
| | failed | 18.2±0.4ms | n/a | load.ugrid.BasicLoadingTime.time_load_file(1) |
| | failed | 20.6±0.2ms | n/a | load.ugrid.BasicLoadingTime.time_load_file(200000) |
| | failed | 14.2±0.4ms | n/a | load.ugrid.BasicLoadingTime.time_load_mesh(1) |
| | failed | 17.3±0.4ms | n/a | load.ugrid.BasicLoadingTime.time_load_mesh(200000) |
| | failed | 18.6±0.2ms | n/a | load.ugrid.Callback.time_load_file_callback(1) |
| | failed | 50.7±0.7ms | n/a | load.ugrid.Callback.time_load_file_callback(200000) |
| | failed | 19.5±0.6ms | n/a | load.ugrid.CallbackTime.time_load_file_callback(1) |
| | failed | 22.3±0.3ms | n/a | load.ugrid.CallbackTime.time_load_file_callback(200000) |
| | failed | 2.80±0.1ms | n/a | load.ugrid.DataRealisation.time_realise_data(10000) |
| | failed | 5.49±0.7ms | n/a | load.ugrid.DataRealisation.time_realise_data(200000) |
| | failed | 39.2±1ms | n/a | load.ugrid.DataRealisationTime.time_realise_data(10000) |
| | failed | 804±8ms | n/a | load.ugrid.DataRealisationTime.time_realise_data(200000) |
| | failed | 121±1ms | n/a | merge_concat.Concatenate.time_concatenate |
| | failed | 24.1 | n/a | merge_concat.Concatenate.track_mem_merge |
| | failed | 48.6±0.6ms | n/a | merge_concat.Merge.time_merge |
| | failed | 11.0 | n/a | merge_concat.Merge.track_mem_merge |
| | failed | 398±3ns | n/a | mesh.utils.regions_combine.CombineRegionsComputeRealData.time_compute_data(50) |
| | failed | 258±2ms | n/a | mesh.utils.regions_combine.CombineRegionsComputeRealData.time_compute_data(500) |
| | failed | 0.6 | n/a | mesh.utils.regions_combine.CombineRegionsComputeRealData.track_addedmem_compute_data(50) |
| | failed | 57.3 | n/a | mesh.utils.regions_combine.CombineRegionsComputeRealData.track_addedmem_compute_data(500) |
| | failed | 14.5±0.3ms | n/a | mesh.utils.regions_combine.CombineRegionsCreateCube.time_create_combined_cube(50) |
| | failed | 16.3±0.6ms | n/a | mesh.utils.regions_combine.CombineRegionsCreateCube.time_create_combined_cube(500) |
| | failed | 0.5 | n/a | mesh.utils.regions_combine.CombineRegionsCreateCube.track_addedmem_create_combined_cube(50) |
| | failed | 11.8 | n/a | mesh.utils.regions_combine.CombineRegionsCreateCube.track_addedmem_create_combined_cube(500) |
| | failed | 108±2ms | n/a | mesh.utils.regions_combine.CombineRegionsFileStreamedCalc.time_stream_file2file(50) |
| | failed | 708±3ms | n/a | mesh.utils.regions_combine.CombineRegionsFileStreamedCalc.time_stream_file2file(500) |
| | failed | 1.4 | n/a | mesh.utils.regions_combine.CombineRegionsFileStreamedCalc.track_addedmem_stream_file2file(50) |
| | failed | 92.0 | n/a | mesh.utils.regions_combine.CombineRegionsFileStreamedCalc.track_addedmem_stream_file2file(500) |
| | failed | 67.0±1ms | n/a | mesh.utils.regions_combine.CombineRegionsSaveData.time_save(50) |
| | failed | 662±4ms | n/a | mesh.utils.regions_combine.CombineRegionsSaveData.time_save(500) |
| | failed | 1.3 | n/a | mesh.utils.regions_combine.CombineRegionsSaveData.track_addedmem_save(50) |
| | failed | 92.0 | n/a | mesh.utils.regions_combine.CombineRegionsSaveData.track_addedmem_save(500) |
| | failed | 2.1752849999999997 | n/a | mesh.utils.regions_combine.CombineRegionsSaveData.track_filesize_saved(50) |
| | failed | 216.01528499999998 | n/a | mesh.utils.regions_combine.CombineRegionsSaveData.track_filesize_saved(500) |
| | failed | 4.08±0.2ms | n/a | save.NetcdfSave.time_netcdf_save_cube(50, False) |
| | failed | 72.4±1ms | n/a | save.NetcdfSave.time_netcdf_save_cube(50, True) |
| | failed | 52.3±1ms | n/a | save.NetcdfSave.time_netcdf_save_cube(600, False) |
| | failed | 566±6ms | n/a | save.NetcdfSave.time_netcdf_save_cube(600, True) |
| | failed | 90.8±0.7ns | n/a | save.NetcdfSave.time_netcdf_save_mesh(50, False) |
| | failed | 57.0±2ms | n/a | save.NetcdfSave.time_netcdf_save_mesh(50, True) |
| | failed | 92.6±2ns | n/a | save.NetcdfSave.time_netcdf_save_mesh(600, False) |
| | failed | 498±4ms | n/a | save.NetcdfSave.time_netcdf_save_mesh(600, True) |
| | failed | 0.3 | n/a | save.NetcdfSave.track_addedmem_netcdf_save(50, False) |
| | failed | 1.7 | n/a | save.NetcdfSave.track_addedmem_netcdf_save(50, True) |
| | failed | 0.3 | n/a | save.NetcdfSave.track_addedmem_netcdf_save(600, False) |
| | failed | 181.6 | n/a | save.NetcdfSave.track_addedmem_netcdf_save(600, True) |
Benchmarks that have stayed the same:
| Change | Before [7c87fb2a] <main~2> | After [4585059b] <main~1> | Ratio | Benchmark (Parameter) |
|----------|------------------------------|-----------------------------|---------|-------------------------------------------------------------------------|
| | 667±8μs | 661±4μs | 0.99 | import_iris.Iris.time__concatenate |
| | 180±1μs | 183±2μs | 1.01 | import_iris.Iris.time__constraints |
| | 110±2μs | 112±1μs | 1.01 | import_iris.Iris.time__data_manager |
| | 93.3±0.9μs | 95.4±3μs | 1.02 | import_iris.Iris.time__deprecation |
| | 140±1μs | 137±1μs | 0.98 | import_iris.Iris.time__lazy_data |
| | 917±30μs | 895±8μs | 0.98 | import_iris.Iris.time__merge |
| | 77.3±0.7μs | 77.0±0.5μs | 1 | import_iris.Iris.time__representation |
| | 486±10μs | 490±5μs | 1.01 | import_iris.Iris.time_analysis |
| | 138±1μs | 141±0.9μs | 1.02 | import_iris.Iris.time_analysis__area_weighted |
| | 111±1μs | 111±2μs | 1 | import_iris.Iris.time_analysis__grid_angles |
| | 243±3μs | 243±2μs | 1 | import_iris.Iris.time_analysis__interpolation |
| | 190±3μs | 187±3μs | 0.98 | import_iris.Iris.time_analysis__regrid |
| | 111±0.7μs | 112±2μs | 1.01 | import_iris.Iris.time_analysis__scipy_interpolate |
| | 139±2μs | 140±1μs | 1.01 | import_iris.Iris.time_analysis_calculus |
| | 329±4μs | 324±3μs | 0.99 | import_iris.Iris.time_analysis_cartography |
| | 96.7±0.9μs | 94.2±2μs | 0.97 | import_iris.Iris.time_analysis_geomerty |
| | 216±5μs | 218±2μs | 1.01 | import_iris.Iris.time_analysis_maths |
| | 100±2μs | 98.4±1μs | 0.98 | import_iris.Iris.time_analysis_stats |
| | 180±4μs | 175±3μs | 0.97 | import_iris.Iris.time_analysis_trajectory |
| | 313±3μs | 309±3μs | 0.99 | import_iris.Iris.time_aux_factory |
| | 84.3±0.8μs | 84.3±1μs | 1 | import_iris.Iris.time_common |
| | 169±4μs | 162±1μs | 0.96 | import_iris.Iris.time_common_lenient |
| | 132±1μs | 133±2μs | 1 | import_iris.Iris.time_common_mixin |
| | 1.20±0.01ms | 1.19±0.01ms | 0.99 | import_iris.Iris.time_common_resolve |
| | 198±2μs | 200±3μs | 1.01 | import_iris.Iris.time_config |
| | 117±0.7μs | 117±1μs | 1.01 | import_iris.Iris.time_coord_categorisation |
| | 378±20μs | 369±5μs | 0.97 | import_iris.Iris.time_coord_systems |
| | 781±20μs | 743±6μs | 0.95 | import_iris.Iris.time_coords |
| | 677±6μs | 676±7μs | 1 | import_iris.Iris.time_cube |
| | 226±3μs | 226±2μs | 1 | import_iris.Iris.time_exceptions |
| | 77.6±0.5μs | 77.2±0.8μs | 1 | import_iris.Iris.time_experimental |
| | 185±1μs | 187±2μs | 1.01 | import_iris.Iris.time_fileformats |
| | 253±5μs | 250±5μs | 0.99 | import_iris.Iris.time_fileformats__ff |
| | 2.75±0.09ms | 2.70±0.02ms | 0.98 | import_iris.Iris.time_fileformats__ff_cross_references |
| | 80.0±0.3μs | 79.8±0.6μs | 1 | import_iris.Iris.time_fileformats__pp_lbproc_pairs |
| | 116±0.9μs | 115±0.6μs | 0.99 | import_iris.Iris.time_fileformats_abf |
| | 364±4μs | 411±4μs | 1.13 | import_iris.Iris.time_fileformats_cf |
| | 5.43±0.07ms | 5.57±0.2ms | 1.03 | import_iris.Iris.time_fileformats_dot |
| | 75.9±2μs | 75.8±0.7μs | 1 | import_iris.Iris.time_fileformats_name |
| | 266±8μs | 257±2μs | 0.97 | import_iris.Iris.time_fileformats_name_loaders |
| | 118±1μs | 118±1μs | 1 | import_iris.Iris.time_fileformats_netcdf |
| | 122±1μs | 123±3μs | 1.01 | import_iris.Iris.time_fileformats_nimrod |
| | 216±6μs | 214±2μs | 0.99 | import_iris.Iris.time_fileformats_nimrod_load_rules |
| | 790±6μs | 788±9μs | 1 | import_iris.Iris.time_fileformats_pp |
| | 189±3μs | 184±2μs | 0.97 | import_iris.Iris.time_fileformats_pp_load_rules |
| | 135±1μs | 135±2μs | 1 | import_iris.Iris.time_fileformats_pp_save_rules |
| | 516±3μs | 511±4μs | 0.99 | import_iris.Iris.time_fileformats_rules |
| | 220±2μs | 225±4μs | 1.02 | import_iris.Iris.time_fileformats_structured_array_identification |
| | 84.4±0.6μs | 86.0±2μs | 1.02 | import_iris.Iris.time_fileformats_um |
| | 161±2μs | 160±0.4μs | 0.99 | import_iris.Iris.time_fileformats_um__fast_load |
| | 142±4μs | 137±1μs | 0.96 | import_iris.Iris.time_fileformats_um__fast_load_structured_fields |
| | 75.8±0.4μs | 75.9±0.5μs | 1 | import_iris.Iris.time_fileformats_um__ff_replacement |
| | 82.8±0.8μs | 82.3±1μs | 0.99 | import_iris.Iris.time_fileformats_um__optimal_array_structuring |
| | 980±10μs | 990±10μs | 1.01 | import_iris.Iris.time_fileformats_um_cf_map |
| | 137±2μs | 138±2μs | 1.01 | import_iris.Iris.time_io |
| | 177±5μs | 174±2μs | 0.98 | import_iris.Iris.time_io_format_picker |
| | 231±4μs | 232±5μs | 1 | import_iris.Iris.time_iris |
| | 127±1μs | 128±1μs | 1.01 | import_iris.Iris.time_iterate |
| | 8.38±0.06ms | 8.38±0.03ms | 1 | import_iris.Iris.time_palette |
| | 2.23±0.04ms | 2.23±0.04ms | 1 | import_iris.Iris.time_plot |
| | 107±2μs | 104±0.7μs | 0.97 | import_iris.Iris.time_quickplot |
| | 2.20±0.03ms | 2.16±0.01ms | 0.98 | import_iris.Iris.time_std_names |
| | 1.77±0.03ms | 1.76±0.01ms | 1 | import_iris.Iris.time_symbols |
| | 11.9±0.6ms | 13.4±0.9ms | 1.13 | import_iris.Iris.time_tests |
| | 256±3μs | 256±3μs | 1 | import_iris.Iris.time_third_party_cartopy |
| | 4.83±0.02ms | 4.82±0.02ms | 1 | import_iris.Iris.time_third_party_cf_units |
| | 120±1μs | 121±1μs | 1.01 | import_iris.Iris.time_third_party_cftime |
| | 2.84±0.03ms | 2.78±0.01ms | 0.98 | import_iris.Iris.time_third_party_matplotlib |
| | 1.07±0ms | 1.06±0.01ms | 0.99 | import_iris.Iris.time_third_party_numpy |
| | 172±3μs | 174±2μs | 1.01 | import_iris.Iris.time_third_party_scipy |
| | 99.2±0.5μs | 99.9±0.7μs | 1.01 | import_iris.Iris.time_time |
| | 324±5μs | 321±4μs | 0.99 | import_iris.Iris.time_util |
| | 72.4±0.6μs | 73.3±0.8μs | 1.01 | iterate.IZip.time_izip |
| | 6.52±0.05ms | 6.57±0.08ms | 1.01 | plot.AuxSort.time_aux_sort |
| | 76.5±6ms | 78.4±2ms | 1.03 | regridding.CurvilinearRegridding.time_regrid_pic |
| | 144.9 | 144.9 | 1 | regridding.CurvilinearRegridding.track_mem_regrid_pic |
| | 98.8±0.5ms | 98.1±1ms | 0.99 | regridding.HorizontalChunkedRegridding.time_regrid_area_w |
| | 49.8±2ms | 48.3±2ms | 0.97 | regridding.HorizontalChunkedRegridding.time_regrid_area_w_new_grid |
| | 111.6 | 111.6 | 1 | regridding.HorizontalChunkedRegridding.track_mem_regrid_area_w |
| | 150.6 | 150.6 | 1 | regridding.HorizontalChunkedRegridding.track_mem_regrid_area_w_new_grid |
| | 43.5±1ms | 43.1±1ms | 0.99 | stats.PearsonR.time_lazy |
| | 18.9±0.3ms | 19.1±0.4ms | 1.01 | stats.PearsonR.time_real |
| | 19.6 | 19.6 | 1 | stats.PearsonR.track_lazy |
| | 17.8 | 17.8 | 1 | stats.PearsonR.track_real |
| | 23.7±1ms | 23.6±0.8ms | 1 | trajectory.TrajectoryInterpolation.time_trajectory_linear |
| | 61.9±0.9ms | 61.2±0.6ms | 0.99 | trajectory.TrajectoryInterpolation.time_trajectory_nearest |
| | 32.2 | 32.2 | 1 | trajectory.TrajectoryInterpolation.track_trajectory_linear |
| | 21.6 | 21.6 | 1 | trajectory.TrajectoryInterpolation.track_trajectory_nearest |
Benchmarks that have got worse:
| Change | Before [7c87fb2a] <main~2> | After [4585059b] <main~1> | Ratio | Benchmark (Parameter) |
|----------|------------------------------|-----------------------------|---------|---------------------------------------|
| + | 997±9μs | 1.34±0.01ms | 1.35 | import_iris.Iris.time_common_metadata |
Generated by GHA run 10118635661