Skip to content

Conversation

@udesou
Copy link
Contributor

@udesou udesou commented Jun 25, 2024

This PR introduces the is_mmtk_object feature supporting a valid object (VO) bit for conservative stack scanning. It also sets this feature as default.

NB: merge with mmtk/julia#59.
NB2: it requires a change in mmtk-core to expose an api function to bulk set the VO bit. (see mmtk/mmtk-core#1157)

@udesou udesou requested a review from qinsoon June 26, 2024 06:30
@udesou udesou changed the title Support vo bit Support VO bit Jun 26, 2024
@udesou
Copy link
Contributor Author

udesou commented Jul 1, 2024

Performance comparison of using the VO bit (inlined in the fastpath allocation):

|                                                                                                                                                 |   total time |   total time error |     gc time |   mutator time |
|:------------------------------------------------------------------------------------------------------------------------------------------------|-------------:|-------------------:|------------:|---------------:|
| ('multithreaded-big_arrays-issue-52937', 'julia-mmtk-conservative-moving-immix(1.554x minheap,.mmtk_gc_threads-12)')                            |     1.34483  |        0.0309335   |   0.0128755 |       1.37572  |
| ('multithreaded-big_arrays-issue-52937', 'julia-mmtk-conservative-moving-immix(2.058x minheap,.mmtk_gc_threads-12)')                            |     1.35561  |        0.00306292  |   0.0432486 |       1.38604  |
| ('multithreaded-big_arrays-issue-52937', 'julia-mmtk-conservative-moving-immix(3.069x minheap,.mmtk_gc_threads-12)')                            |     1.29234  |        0.00519569  |   0         |       1.32231  |
| ('multithreaded-big_arrays-issue-52937', 'julia-mmtk-conservative-moving-stickyimmix(1.554x minheap,.mmtk_gc_threads-12)')                      |     1.34783  |        0.0331935   |   0         |       1.37909  |
| ('multithreaded-big_arrays-issue-52937', 'julia-mmtk-conservative-moving-stickyimmix(2.058x minheap,.mmtk_gc_threads-12)')                      |     1.35673  |        0.00485861  |   0.0244305 |       1.38762  |
| ('multithreaded-big_arrays-issue-52937', 'julia-mmtk-conservative-moving-stickyimmix(3.069x minheap,.mmtk_gc_threads-12)')                      |     1.28937  |        0.00165631  |   0         |       1.31926  |
| ('multithreaded-big_arrays-issue-52937', 'julia-mmtk-moving-immix(1.554x minheap,.mmtk_gc_threads-12)')                                         |     1.34757  |        0.0431616   |   0         |       1.37882  |
| ('multithreaded-big_arrays-issue-52937', 'julia-mmtk-moving-immix(2.058x minheap,.mmtk_gc_threads-12)')                                         |     1.35059  |        0.0177035   |   0.0439089 |       1.38089  |
| ('multithreaded-big_arrays-issue-52937', 'julia-mmtk-moving-immix(3.069x minheap,.mmtk_gc_threads-12)')                                         |     1.29219  |        0.00822768  |   0         |       1.32216  |
| ('multithreaded-big_arrays-issue-52937', 'julia-mmtk-moving-stickyimmix(1.554x minheap,.mmtk_gc_threads-12)')                                   |     1.35515  |        0.0131507   |   0         |       1.38657  |
| ('multithreaded-big_arrays-issue-52937', 'julia-mmtk-moving-stickyimmix(2.058x minheap,.mmtk_gc_threads-12)')                                   |     1.3544   |        0.0133547   |   0.0254209 |       1.38522  |
| ('multithreaded-big_arrays-issue-52937', 'julia-mmtk-moving-stickyimmix(3.069x minheap,.mmtk_gc_threads-12)')                                   |     1.29488  |        0.00350994  |   0         |       1.32491  |
| ('multithreaded-big_arrays-issue-52937', 'julia-stock-fixed-heap(1.554x minheap,.julia_gc_threads-12)')                                         |     1        |        0.0184924   |   1         |       1        |
| ('multithreaded-big_arrays-issue-52937', 'julia-stock-fixed-heap(2.058x minheap,.julia_gc_threads-12)')                                         |     0.99578  |        0.00378773  |   0.968967  |       0.996402 |
| ('multithreaded-big_arrays-issue-52937', 'julia-stock-fixed-heap(3.069x minheap,.julia_gc_threads-12)')                                         |     0.997134 |        0.00797125  |   0.950479  |       0.998216 |
| ('multithreaded-big_arrays-objarray', 'julia-mmtk-conservative-moving-immix(1.554x minheap,.mmtk_gc_threads-12)')                               |     1.07092  |        0.0128648   |   0.0864023 |       1.78178  |
| ('multithreaded-big_arrays-objarray', 'julia-mmtk-conservative-moving-immix(2.058x minheap,.mmtk_gc_threads-12)')                               |     1.12633  |        0.00200875  |   0.050375  |       1.9032   |
| ('multithreaded-big_arrays-objarray', 'julia-mmtk-conservative-moving-immix(3.069x minheap,.mmtk_gc_threads-12)')                               |     3.79936  |        0.0042895   |   0.0695474 |       6.49244  |
| ('multithreaded-big_arrays-objarray', 'julia-mmtk-conservative-moving-stickyimmix(1.554x minheap,.mmtk_gc_threads-12)')                         |     1.1483   |        0.00477119  |   0.189196  |       1.84082  |
| ('multithreaded-big_arrays-objarray', 'julia-mmtk-conservative-moving-stickyimmix(2.058x minheap,.mmtk_gc_threads-12)')                         |     1.16529  |        0.0138706   |   0.0502275 |       1.97041  |
| ('multithreaded-big_arrays-objarray', 'julia-mmtk-conservative-moving-stickyimmix(3.069x minheap,.mmtk_gc_threads-12)')                         |     6.0932   |        0.00446961  |   0.0709169 |      10.4415   |
| ('multithreaded-big_arrays-objarray', 'julia-mmtk-moving-immix(1.554x minheap,.mmtk_gc_threads-12)')                                            |     1.03614  |        0.00207247  |   0.0872451 |       1.72128  |
| ('multithreaded-big_arrays-objarray', 'julia-mmtk-moving-immix(2.058x minheap,.mmtk_gc_threads-12)')                                            |     1.09422  |        0.00102484  |   0.0514074 |       1.84718  |
| ('multithreaded-big_arrays-objarray', 'julia-mmtk-moving-immix(3.069x minheap,.mmtk_gc_threads-12)')                                            |     3.76701  |        0.00801474  |   0.070011  |       6.4364   |
| ('multithreaded-big_arrays-objarray', 'julia-mmtk-moving-stickyimmix(1.554x minheap,.mmtk_gc_threads-12)')                                      |     1.14323  |        0.00483421  |   0.189027  |       1.83221  |
| ('multithreaded-big_arrays-objarray', 'julia-mmtk-moving-stickyimmix(2.058x minheap,.mmtk_gc_threads-12)')                                      |     1.16099  |        0.00300033  |   0.0507753 |       1.96261  |
| ('multithreaded-big_arrays-objarray', 'julia-mmtk-moving-stickyimmix(3.069x minheap,.mmtk_gc_threads-12)')                                      |     6.09358  |        0.00738751  |   0.0704955 |      10.4425   |
| ('multithreaded-big_arrays-objarray', 'julia-stock-fixed-heap(1.554x minheap,.julia_gc_threads-12)')                                            |     1        |        0.00258547  |   1         |       1        |
| ('multithreaded-big_arrays-objarray', 'julia-stock-fixed-heap(2.058x minheap,.julia_gc_threads-12)')                                            |     0.999311 |        0.00169429  |   1.00011   |       0.998737 |
| ('multithreaded-big_arrays-objarray', 'julia-stock-fixed-heap(3.069x minheap,.julia_gc_threads-12)')                                            |     1.00044  |        0.00178239  |   1.00185   |       0.999422 |
| ('multithreaded-binary_tree-tree_immutable', 'julia-mmtk-conservative-moving-immix(1.554x minheap,.mmtk_gc_threads-12)')                        |     0.926529 |        0.0155976   |   1.17642   |       0.856613 |
| ('multithreaded-binary_tree-tree_immutable', 'julia-mmtk-conservative-moving-immix(2.058x minheap,.mmtk_gc_threads-12)')                        |     0.846092 |        0.00280414  |   0.739896  |       0.875804 |
| ('multithreaded-binary_tree-tree_immutable', 'julia-mmtk-conservative-moving-immix(3.069x minheap,.mmtk_gc_threads-12)')                        |     0.781969 |        0.00577226  |   0.466879  |       0.870126 |
| ('multithreaded-binary_tree-tree_immutable', 'julia-mmtk-conservative-moving-stickyimmix(1.554x minheap,.mmtk_gc_threads-12)')                  |     0.828311 |        0.00826921  |   0.438705  |       0.937315 |
| ('multithreaded-binary_tree-tree_immutable', 'julia-mmtk-conservative-moving-stickyimmix(2.058x minheap,.mmtk_gc_threads-12)')                  |     0.789889 |        0.00450886  |   0.238806  |       0.944072 |
| ('multithreaded-binary_tree-tree_immutable', 'julia-mmtk-conservative-moving-stickyimmix(3.069x minheap,.mmtk_gc_threads-12)')                  |     0.772217 |        0.00433727  |   0.139192  |       0.949327 |
| ('multithreaded-binary_tree-tree_immutable', 'julia-mmtk-moving-immix(1.554x minheap,.mmtk_gc_threads-12)')                                     |     0.911461 |        0.00424155  |   1.19151   |       0.833107 |
| ('multithreaded-binary_tree-tree_immutable', 'julia-mmtk-moving-immix(2.058x minheap,.mmtk_gc_threads-12)')                                     |     0.8315   |        0.0101975   |   0.757672  |       0.852156 |
| ('multithreaded-binary_tree-tree_immutable', 'julia-mmtk-moving-immix(3.069x minheap,.mmtk_gc_threads-12)')                                     |     0.763712 |        0.00646755  |   0.461177  |       0.848355 |
| ('multithreaded-binary_tree-tree_immutable', 'julia-mmtk-moving-stickyimmix(1.554x minheap,.mmtk_gc_threads-12)')                               |     0.814966 |        0.0279387   |   0.425122  |       0.924037 |
| ('multithreaded-binary_tree-tree_immutable', 'julia-mmtk-moving-stickyimmix(2.058x minheap,.mmtk_gc_threads-12)')                               |     0.772474 |        0.00316671  |   0.23998   |       0.921456 |
| ('multithreaded-binary_tree-tree_immutable', 'julia-mmtk-moving-stickyimmix(3.069x minheap,.mmtk_gc_threads-12)')                               |     0.755573 |        0.00323666  |   0.139024  |       0.928072 |
| ('multithreaded-binary_tree-tree_immutable', 'julia-stock-fixed-heap(1.554x minheap,.julia_gc_threads-12)')                                     |     1        |        0.0132196   |   1         |       1        |
| ('multithreaded-binary_tree-tree_immutable', 'julia-stock-fixed-heap(2.058x minheap,.julia_gc_threads-12)')                                     |     0.997654 |        0.0132092   |   0.985242  |       1.00113  |
| ('multithreaded-binary_tree-tree_immutable', 'julia-stock-fixed-heap(3.069x minheap,.julia_gc_threads-12)')                                     |     0.990248 |        0.0340207   |   0.977193  |       0.9939   |
| ('multithreaded-binary_tree-tree_mutable', 'julia-mmtk-conservative-moving-immix(1.554x minheap,.mmtk_gc_threads-12)')                          |     0.658044 |        0.00389508  |   0.642544  |       0.663763 |
| ('multithreaded-binary_tree-tree_mutable', 'julia-mmtk-conservative-moving-immix(2.058x minheap,.mmtk_gc_threads-12)')                          |     0.604838 |        0.00111392  |   0.431219  |       0.668892 |
| ('multithreaded-binary_tree-tree_mutable', 'julia-mmtk-conservative-moving-immix(3.069x minheap,.mmtk_gc_threads-12)')                          |     0.561469 |        0.00228547  |   0.27271   |       0.668002 |
| ('multithreaded-binary_tree-tree_mutable', 'julia-mmtk-conservative-moving-stickyimmix(1.554x minheap,.mmtk_gc_threads-12)')                    |     0.613649 |        0.00889403  |   0.266679  |       0.741657 |
| ('multithreaded-binary_tree-tree_mutable', 'julia-mmtk-conservative-moving-stickyimmix(2.058x minheap,.mmtk_gc_threads-12)')                    |     0.580134 |        0.00332551  |   0.13572   |       0.744092 |
| ('multithreaded-binary_tree-tree_mutable', 'julia-mmtk-conservative-moving-stickyimmix(3.069x minheap,.mmtk_gc_threads-12)')                    |     0.56809  |        0.00114983  |   0.0852536 |       0.746224 |
| ('multithreaded-binary_tree-tree_mutable', 'julia-mmtk-moving-immix(1.554x minheap,.mmtk_gc_threads-12)')                                       |     0.642579 |        0.00519929  |   0.640259  |       0.643434 |
| ('multithreaded-binary_tree-tree_mutable', 'julia-mmtk-moving-immix(2.058x minheap,.mmtk_gc_threads-12)')                                       |     0.5885   |        0.0101568   |   0.436615  |       0.644535 |
| ('multithreaded-binary_tree-tree_mutable', 'julia-mmtk-moving-immix(3.069x minheap,.mmtk_gc_threads-12)')                                       |     0.543095 |        0.00638288  |   0.271059  |       0.643458 |
| ('multithreaded-binary_tree-tree_mutable', 'julia-mmtk-moving-stickyimmix(1.554x minheap,.mmtk_gc_threads-12)')                                 |     0.598731 |        0.00255099  |   0.265283  |       0.72175  |
| ('multithreaded-binary_tree-tree_mutable', 'julia-mmtk-moving-stickyimmix(2.058x minheap,.mmtk_gc_threads-12)')                                 |     0.565438 |        0.00287079  |   0.134197  |       0.724537 |
| ('multithreaded-binary_tree-tree_mutable', 'julia-mmtk-moving-stickyimmix(3.069x minheap,.mmtk_gc_threads-12)')                                 |     0.55596  |        0.00302876  |   0.0844918 |       0.7299   |
| ('multithreaded-binary_tree-tree_mutable', 'julia-stock-fixed-heap(1.554x minheap,.julia_gc_threads-12)')                                       |     1        |        0.00631203  |   1         |       1        |
| ('multithreaded-binary_tree-tree_mutable', 'julia-stock-fixed-heap(2.058x minheap,.julia_gc_threads-12)')                                       |     0.999453 |        0.00172159  |   0.978607  |       1.00714  |
| ('multithreaded-binary_tree-tree_mutable', 'julia-stock-fixed-heap(3.069x minheap,.julia_gc_threads-12)')                                       |     0.999384 |        0.0130315   |   0.982797  |       1.0055   |
| ('multithreaded-mergesort_parallel-mergesort_parallel', 'julia-mmtk-conservative-moving-immix(1.554x minheap,.mmtk_gc_threads-12)')             |     1.03675  |        0.0101139   |   0         |       1.12439  |
| ('multithreaded-mergesort_parallel-mergesort_parallel', 'julia-mmtk-conservative-moving-immix(2.058x minheap,.mmtk_gc_threads-12)')             |     1.03472  |        0.00271686  |   0         |       1.12219  |
| ('multithreaded-mergesort_parallel-mergesort_parallel', 'julia-mmtk-conservative-moving-immix(3.069x minheap,.mmtk_gc_threads-12)')             |     1.03472  |        0.00302694  |   0         |       1.12219  |
| ('multithreaded-mergesort_parallel-mergesort_parallel', 'julia-mmtk-conservative-moving-stickyimmix(1.554x minheap,.mmtk_gc_threads-12)')       |     1.21677  |        0.00189257  |   0         |       1.31962  |
| ('multithreaded-mergesort_parallel-mergesort_parallel', 'julia-mmtk-conservative-moving-stickyimmix(2.058x minheap,.mmtk_gc_threads-12)')       |     1.21634  |        0.0019944   |   0         |       1.31916  |
| ('multithreaded-mergesort_parallel-mergesort_parallel', 'julia-mmtk-conservative-moving-stickyimmix(3.069x minheap,.mmtk_gc_threads-12)')       |     1.2169   |        0.0079937   |   0         |       1.31976  |
| ('multithreaded-mergesort_parallel-mergesort_parallel', 'julia-mmtk-moving-immix(1.554x minheap,.mmtk_gc_threads-12)')                          |     1.03995  |        0.00101441  |   0         |       1.12786  |
| ('multithreaded-mergesort_parallel-mergesort_parallel', 'julia-mmtk-moving-immix(2.058x minheap,.mmtk_gc_threads-12)')                          |     1.04286  |        0.00733531  |   0         |       1.13102  |
| ('multithreaded-mergesort_parallel-mergesort_parallel', 'julia-mmtk-moving-immix(3.069x minheap,.mmtk_gc_threads-12)')                          |     1.03835  |        0.0023665   |   0         |       1.12613  |
| ('multithreaded-mergesort_parallel-mergesort_parallel', 'julia-mmtk-moving-stickyimmix(1.554x minheap,.mmtk_gc_threads-12)')                    |     1.23266  |        0.00378515  |   0         |       1.33686  |
| ('multithreaded-mergesort_parallel-mergesort_parallel', 'julia-mmtk-moving-stickyimmix(2.058x minheap,.mmtk_gc_threads-12)')                    |     1.23161  |        0.00472673  |   0         |       1.33572  |
| ('multithreaded-mergesort_parallel-mergesort_parallel', 'julia-mmtk-moving-stickyimmix(3.069x minheap,.mmtk_gc_threads-12)')                    |     1.23279  |        0.0032171   |   0         |       1.337    |
| ('multithreaded-mergesort_parallel-mergesort_parallel', 'julia-stock-fixed-heap(1.554x minheap,.julia_gc_threads-12)')                          |     1        |        0.006692    |   1         |       1        |
| ('multithreaded-mergesort_parallel-mergesort_parallel', 'julia-stock-fixed-heap(2.058x minheap,.julia_gc_threads-12)')                          |     1.00206  |        0.00797138  |   1.02055   |       1.0005   |
| ('multithreaded-mergesort_parallel-mergesort_parallel', 'julia-stock-fixed-heap(3.069x minheap,.julia_gc_threads-12)')                          |     1.00023  |        0.00374573  |   1.00965   |       0.999433 |
| ('multithreaded-mm_divide_and_conquer-mm_divide_and_conquer', 'julia-mmtk-conservative-moving-immix(1.554x minheap,.mmtk_gc_threads-12)')       |     0.993598 |        0.00163961  |   0         |       0.99931  |
| ('multithreaded-mm_divide_and_conquer-mm_divide_and_conquer', 'julia-mmtk-conservative-moving-immix(2.058x minheap,.mmtk_gc_threads-12)')       |     0.998552 |        0.00426297  |   0         |       1.00429  |
| ('multithreaded-mm_divide_and_conquer-mm_divide_and_conquer', 'julia-mmtk-conservative-moving-immix(3.069x minheap,.mmtk_gc_threads-12)')       |     0.99657  |        0.00312817  |   0         |       1.0023   |
| ('multithreaded-mm_divide_and_conquer-mm_divide_and_conquer', 'julia-mmtk-conservative-moving-stickyimmix(1.554x minheap,.mmtk_gc_threads-12)') |     0.996113 |        0.0034236   |   0         |       1.00184  |
| ('multithreaded-mm_divide_and_conquer-mm_divide_and_conquer', 'julia-mmtk-conservative-moving-stickyimmix(2.058x minheap,.mmtk_gc_threads-12)') |     0.997333 |        0.00345486  |   0         |       1.00307  |
| ('multithreaded-mm_divide_and_conquer-mm_divide_and_conquer', 'julia-mmtk-conservative-moving-stickyimmix(3.069x minheap,.mmtk_gc_threads-12)') |     0.996799 |        0.00142937  |   0         |       1.00253  |
| ('multithreaded-mm_divide_and_conquer-mm_divide_and_conquer', 'julia-mmtk-moving-immix(1.554x minheap,.mmtk_gc_threads-12)')                    |     0.994055 |        0.00378177  |   0         |       0.99977  |
| ('multithreaded-mm_divide_and_conquer-mm_divide_and_conquer', 'julia-mmtk-moving-immix(2.058x minheap,.mmtk_gc_threads-12)')                    |     1.00899  |        0.00150272  |   2.21333   |       1.00207  |
| ('multithreaded-mm_divide_and_conquer-mm_divide_and_conquer', 'julia-mmtk-moving-immix(3.069x minheap,.mmtk_gc_threads-12)')                    |     0.995808 |        0.0017352   |   0         |       1.00153  |
| ('multithreaded-mm_divide_and_conquer-mm_divide_and_conquer', 'julia-mmtk-moving-stickyimmix(1.554x minheap,.mmtk_gc_threads-12)')              |     0.99558  |        0.00280176  |   0         |       1.0013   |
| ('multithreaded-mm_divide_and_conquer-mm_divide_and_conquer', 'julia-mmtk-moving-stickyimmix(2.058x minheap,.mmtk_gc_threads-12)')              |     0.99939  |        0.00948707  |   0.666667  |       1.0013   |
| ('multithreaded-mm_divide_and_conquer-mm_divide_and_conquer', 'julia-mmtk-moving-stickyimmix(3.069x minheap,.mmtk_gc_threads-12)')              |     0.996799 |        0.00215032  |   0         |       1.00253  |
| ('multithreaded-mm_divide_and_conquer-mm_divide_and_conquer', 'julia-stock-fixed-heap(1.554x minheap,.julia_gc_threads-12)')                    |     1        |        0.000655842 |   1         |       1        |
| ('multithreaded-mm_divide_and_conquer-mm_divide_and_conquer', 'julia-stock-fixed-heap(2.058x minheap,.julia_gc_threads-12)')                    |     1.0013   |        0.00771138  |   1         |       1.0013   |
| ('multithreaded-mm_divide_and_conquer-mm_divide_and_conquer', 'julia-stock-fixed-heap(3.069x minheap,.julia_gc_threads-12)')                    |     0.998933 |        0.00300545  |   1         |       0.998927 |
| ('serial-TimeZones-TimeZones', 'julia-mmtk-conservative-moving-immix(1.554x minheap,.mmtk_gc_threads-12)')                                      |     1.11942  |        0.0040173   |   0         |       1.25539  |
| ('serial-TimeZones-TimeZones', 'julia-mmtk-conservative-moving-immix(2.058x minheap,.mmtk_gc_threads-12)')                                      |     1.1244   |        0.00303447  |   0         |       1.26097  |
| ('serial-TimeZones-TimeZones', 'julia-mmtk-conservative-moving-immix(3.069x minheap,.mmtk_gc_threads-12)')                                      |     1.11979  |        0.00196505  |   0         |       1.2558   |
| ('serial-TimeZones-TimeZones', 'julia-mmtk-conservative-moving-stickyimmix(1.554x minheap,.mmtk_gc_threads-12)')                                |     1.30957  |        0.0111826   |   0         |       1.46863  |
| ('serial-TimeZones-TimeZones', 'julia-mmtk-conservative-moving-stickyimmix(2.058x minheap,.mmtk_gc_threads-12)')                                |     1.30752  |        0.00506396  |   0         |       1.46633  |
| ('serial-TimeZones-TimeZones', 'julia-mmtk-conservative-moving-stickyimmix(3.069x minheap,.mmtk_gc_threads-12)')                                |     1.30774  |        0.00113452  |   0         |       1.46658  |
| ('serial-TimeZones-TimeZones', 'julia-mmtk-moving-immix(1.554x minheap,.mmtk_gc_threads-12)')                                                   |     1.14999  |        0.00600332  |   0         |       1.28967  |
| ('serial-TimeZones-TimeZones', 'julia-mmtk-moving-immix(2.058x minheap,.mmtk_gc_threads-12)')                                                   |     1.15241  |        0.00245757  |   0         |       1.29238  |
| ('serial-TimeZones-TimeZones', 'julia-mmtk-moving-immix(3.069x minheap,.mmtk_gc_threads-12)')                                                   |     1.14999  |        0.00629319  |   0         |       1.28967  |
| ('serial-TimeZones-TimeZones', 'julia-mmtk-moving-stickyimmix(1.554x minheap,.mmtk_gc_threads-12)')                                             |     1.29852  |        0.00577638  |   0         |       1.45625  |
| ('serial-TimeZones-TimeZones', 'julia-mmtk-moving-stickyimmix(2.058x minheap,.mmtk_gc_threads-12)')                                             |     1.29845  |        0.000832511 |   0         |       1.45616  |
| ('serial-TimeZones-TimeZones', 'julia-mmtk-moving-stickyimmix(3.069x minheap,.mmtk_gc_threads-12)')                                             |     1.29845  |        0.0035039   |   0         |       1.45616  |
| ('serial-TimeZones-TimeZones', 'julia-stock-fixed-heap(1.554x minheap,.julia_gc_threads-12)')                                                   |     1        |        0.0365154   |   1         |       1        |
| ('serial-TimeZones-TimeZones', 'julia-stock-fixed-heap(2.058x minheap,.julia_gc_threads-12)')                                                   |     0.99532  |        0.0343411   |   0.996624  |       0.995161 |
| ('serial-TimeZones-TimeZones', 'julia-stock-fixed-heap(3.069x minheap,.julia_gc_threads-12)')                                                   |     0.981059 |        0.00582757  |   0.991897  |       0.979742 |
| ('serial-append-append', 'julia-mmtk-conservative-moving-immix(1.554x minheap,.mmtk_gc_threads-12)')                                            |     3.29613  |        0.30354     | 153.577     |       1.03474  |
| ('serial-append-append', 'julia-mmtk-conservative-moving-immix(2.058x minheap,.mmtk_gc_threads-12)')                                            |     1.37423  |        0.016325    |  23.5691    |       1.04025  |
| ('serial-append-append', 'julia-mmtk-conservative-moving-immix(3.069x minheap,.mmtk_gc_threads-12)')                                            |     1.16428  |        0.00622295  |   8.29268   |       1.05701  |
| ('serial-append-append', 'julia-mmtk-conservative-moving-stickyimmix(1.554x minheap,.mmtk_gc_threads-12)')                                      |     4.15741  |        0.0424729   | 207.65      |       1.0953   |
| ('serial-append-append', 'julia-mmtk-conservative-moving-stickyimmix(2.058x minheap,.mmtk_gc_threads-12)')                                      |     1.17476  |        0.00937754  |   5.82927   |       1.10472  |
| ('serial-append-append', 'julia-mmtk-conservative-moving-stickyimmix(3.069x minheap,.mmtk_gc_threads-12)')                                      |     1.13607  |        0.00946318  |   2.28455   |       1.11879  |
| ('serial-append-append', 'julia-mmtk-moving-immix(1.554x minheap,.mmtk_gc_threads-12)')                                                         |     3.22707  |        0.0918281   | 148.935     |       1.0345   |
| ('serial-append-append', 'julia-mmtk-moving-immix(2.058x minheap,.mmtk_gc_threads-12)')                                                         |     1.37339  |        0.00815011  |  23.6748    |       1.0378   |
| ('serial-append-append', 'julia-mmtk-moving-immix(3.069x minheap,.mmtk_gc_threads-12)')                                                         |     1.16223  |        0.011086    |   8.20325   |       1.05628  |
| ('serial-append-append', 'julia-mmtk-moving-stickyimmix(1.554x minheap,.mmtk_gc_threads-12)')                                                   |     4.09859  |        0.0494448   | 203.65      |       1.09579  |
| ('serial-append-append', 'julia-mmtk-moving-stickyimmix(2.058x minheap,.mmtk_gc_threads-12)')                                                   |     1.17223  |        0.00546357  |   5.80488   |       1.10252  |
| ('serial-append-append', 'julia-mmtk-moving-stickyimmix(3.069x minheap,.mmtk_gc_threads-12)')                                                   |     1.13475  |        0.00934882  |   2.27642   |       1.11757  |
| ('serial-append-append', 'julia-stock-fixed-heap(1.554x minheap,.julia_gc_threads-12)')                                                         |     1        |        0.00363006  |   1         |       1        |
| ('serial-append-append', 'julia-stock-fixed-heap(2.058x minheap,.julia_gc_threads-12)')                                                         |     1.0006   |        0.0025929   |   0.99187   |       1.00073  |
| ('serial-append-append', 'julia-stock-fixed-heap(3.069x minheap,.julia_gc_threads-12)')                                                         |     1.00048  |        0.00323853  |   0.99187   |       1.00061  |
| ('serial-big_arrays-many_refs', 'julia-mmtk-conservative-moving-immix(1.554x minheap,.mmtk_gc_threads-12)')                                     |     0.510431 |        0.0340414   |   0.368574  |       0.869779 |
| ('serial-big_arrays-many_refs', 'julia-mmtk-conservative-moving-immix(2.058x minheap,.mmtk_gc_threads-12)')                                     |     0.530076 |        0.0423875   |   0.375364  |       0.92199  |
| ('serial-big_arrays-many_refs', 'julia-mmtk-conservative-moving-immix(3.069x minheap,.mmtk_gc_threads-12)')                                     |     0.521732 |        0.0616794   |   0.363967  |       0.921376 |
| ('serial-big_arrays-many_refs', 'julia-mmtk-conservative-moving-stickyimmix(1.554x minheap,.mmtk_gc_threads-12)')                               |     0.527816 |        0.00906935  |   0.368574  |       0.931204 |
| ('serial-big_arrays-many_refs', 'julia-mmtk-conservative-moving-stickyimmix(2.058x minheap,.mmtk_gc_threads-12)')                               |     0.553025 |        0.0205809   |   0.379243  |       0.993243 |
| ('serial-big_arrays-many_refs', 'julia-mmtk-conservative-moving-stickyimmix(3.069x minheap,.mmtk_gc_threads-12)')                               |     0.547114 |        0.0373714   |   0.371242  |       0.992629 |
| ('serial-big_arrays-many_refs', 'julia-mmtk-moving-immix(1.554x minheap,.mmtk_gc_threads-12)')                                                  |     0.489395 |        0.0288936   |   0.351358  |       0.839066 |
| ('serial-big_arrays-many_refs', 'julia-mmtk-moving-immix(2.058x minheap,.mmtk_gc_threads-12)')                                                  |     0.502608 |        0.0136092   |   0.348448  |       0.89312  |
| ('serial-big_arrays-many_refs', 'julia-mmtk-moving-immix(3.069x minheap,.mmtk_gc_threads-12)')                                                  |     0.50991  |        0.0147344   |   0.35839   |       0.893735 |
| ('serial-big_arrays-many_refs', 'julia-mmtk-moving-stickyimmix(1.554x minheap,.mmtk_gc_threads-12)')                                            |     0.515299 |        0.00593728  |   0.360572  |       0.907248 |
| ('serial-big_arrays-many_refs', 'julia-mmtk-moving-stickyimmix(2.058x minheap,.mmtk_gc_threads-12)')                                            |     0.544159 |        0.0169094   |   0.376091  |       0.969902 |
| ('serial-big_arrays-many_refs', 'julia-mmtk-moving-stickyimmix(3.069x minheap,.mmtk_gc_threads-12)')                                            |     0.545723 |        0.0299211   |   0.379001  |       0.968059 |
| ('serial-big_arrays-many_refs', 'julia-stock-fixed-heap(1.554x minheap,.julia_gc_threads-12)')                                                  |     1        |        0.0113197   |   1         |       1        |
| ('serial-big_arrays-many_refs', 'julia-stock-fixed-heap(2.058x minheap,.julia_gc_threads-12)')                                                  |     1.01565  |        0.0402756   |   1.00218   |       1.04975  |
| ('serial-big_arrays-many_refs', 'julia-stock-fixed-heap(3.069x minheap,.julia_gc_threads-12)')                                                  |     1.0146   |        0.0344336   |   1.00655   |       1.03501  |
| ('serial-big_arrays-single_ref', 'julia-mmtk-conservative-moving-immix(1.554x minheap,.mmtk_gc_threads-12)')                                    |     2.5757   |        0.0714819   |   5.39821   |       0.953642 |
| ('serial-big_arrays-single_ref', 'julia-mmtk-conservative-moving-immix(2.058x minheap,.mmtk_gc_threads-12)')                                    |     2.60935  |        0.207967    |   5.49168   |       0.952907 |
| ('serial-big_arrays-single_ref', 'julia-mmtk-conservative-moving-immix(3.069x minheap,.mmtk_gc_threads-12)')                                    |     2.65467  |        0.0888078   |   5.61588   |       0.952907 |
| ('serial-big_arrays-single_ref', 'julia-mmtk-conservative-moving-stickyimmix(1.554x minheap,.mmtk_gc_threads-12)')                              |     2.58598  |        0.18774     |   5.22023   |       1.07211  |
| ('serial-big_arrays-single_ref', 'julia-mmtk-conservative-moving-stickyimmix(2.058x minheap,.mmtk_gc_threads-12)')                              |     2.56168  |        0.0589276   |   5.19846   |       1.04636  |
| ('serial-big_arrays-single_ref', 'julia-mmtk-conservative-moving-stickyimmix(3.069x minheap,.mmtk_gc_threads-12)')                              |     2.50794  |        0.197335    |   5.04994   |       1.04709  |
| ('serial-big_arrays-single_ref', 'julia-mmtk-moving-immix(1.554x minheap,.mmtk_gc_threads-12)')                                                 |     2.5486   |        0.0573281   |   5.32138   |       0.955114 |
| ('serial-big_arrays-single_ref', 'julia-mmtk-moving-immix(2.058x minheap,.mmtk_gc_threads-12)')                                                 |     2.5972   |        0.118829    |   5.45711   |       0.953642 |
| ('serial-big_arrays-single_ref', 'julia-mmtk-moving-immix(3.069x minheap,.mmtk_gc_threads-12)')                                                 |     2.60234  |        0.180023    |   5.47503   |       0.951435 |
| ('serial-big_arrays-single_ref', 'julia-mmtk-moving-stickyimmix(1.554x minheap,.mmtk_gc_threads-12)')                                           |     2.44533  |        0.0701115   |   4.8822    |       1.04489  |
| ('serial-big_arrays-single_ref', 'julia-mmtk-moving-stickyimmix(2.058x minheap,.mmtk_gc_threads-12)')                                           |     2.57991  |        0.177786    |   5.24712   |       1.04709  |
| ('serial-big_arrays-single_ref', 'julia-mmtk-moving-stickyimmix(3.069x minheap,.mmtk_gc_threads-12)')                                           |     2.53832  |        0.101011    |   5.13956   |       1.04341  |
| ('serial-big_arrays-single_ref', 'julia-stock-fixed-heap(1.554x minheap,.julia_gc_threads-12)')                                                 |     1        |        0.0985187   |   1         |       1        |
| ('serial-big_arrays-single_ref', 'julia-stock-fixed-heap(2.058x minheap,.julia_gc_threads-12)')                                                 |     1.02383  |        0.0600489   |   1.02561   |       1.02281  |
| ('serial-big_arrays-single_ref', 'julia-stock-fixed-heap(3.069x minheap,.julia_gc_threads-12)')                                                 |     1.01542  |        0.0513389   |   1.00512   |       1.02134  |
| ('serial-bigint-pollard', 'julia-mmtk-conservative-moving-immix(1.554x minheap,.mmtk_gc_threads-12)')                                           |     1.11184  |        0.0499253   |   1.97425   |       0.838695 |
| ('serial-bigint-pollard', 'julia-mmtk-conservative-moving-immix(2.058x minheap,.mmtk_gc_threads-12)')                                           |     1.10151  |        0.00444183  |   1.81402   |       0.87585  |
| ('serial-bigint-pollard', 'julia-mmtk-conservative-moving-immix(3.069x minheap,.mmtk_gc_threads-12)')                                           |     0.848589 |        0.00924641  |   0.905579  |       0.830539 |
| ('serial-bigint-pollard', 'julia-mmtk-conservative-moving-stickyimmix(1.554x minheap,.mmtk_gc_threads-12)')                                     |     1.15279  |        0.0162867   |   2.09442   |       0.854554 |
| ('serial-bigint-pollard', 'julia-mmtk-conservative-moving-stickyimmix(2.058x minheap,.mmtk_gc_threads-12)')                                     |     1.11493  |        0.0205159   |   1.75966   |       0.910739 |
| ('serial-bigint-pollard', 'julia-mmtk-conservative-moving-stickyimmix(3.069x minheap,.mmtk_gc_threads-12)')                                     |     0.938747 |        0.00148061  |   0.875536  |       0.958768 |
| ('serial-bigint-pollard', 'julia-mmtk-moving-immix(1.554x minheap,.mmtk_gc_threads-12)')                                                        |     1.12836  |        0.00678501  |   2.00143   |       0.851835 |
| ('serial-bigint-pollard', 'julia-mmtk-moving-immix(2.058x minheap,.mmtk_gc_threads-12)')                                                        |     1.11287  |        0.011752    |   1.81688   |       0.889896 |
| ('serial-bigint-pollard', 'julia-mmtk-moving-immix(3.069x minheap,.mmtk_gc_threads-12)')                                                        |     0.843083 |        0.00970901  |   0.881259  |       0.830992 |
| ('serial-bigint-pollard', 'julia-mmtk-moving-stickyimmix(1.554x minheap,.mmtk_gc_threads-12)')                                                  |     1.15141  |        0.0256876   |   2.10587   |       0.849116 |
| ('serial-bigint-pollard', 'julia-mmtk-moving-stickyimmix(2.058x minheap,.mmtk_gc_threads-12)')                                                  |     1.11906  |        0.0209913   |   1.79685   |       0.904395 |
| ('serial-bigint-pollard', 'julia-mmtk-moving-stickyimmix(3.069x minheap,.mmtk_gc_threads-12)')                                                  |     0.930833 |        0.00783465  |   0.868383  |       0.950612 |
| ('serial-bigint-pollard', 'julia-stock-fixed-heap(1.554x minheap,.julia_gc_threads-12)')                                                        |     1        |        0.00824369  |   1         |       1        |
| ('serial-bigint-pollard', 'julia-stock-fixed-heap(2.058x minheap,.julia_gc_threads-12)')                                                        |     0.998624 |        0.00533842  |   1.00286   |       0.997281 |
| ('serial-bigint-pollard', 'julia-stock-fixed-heap(3.069x minheap,.julia_gc_threads-12)')                                                        |     1.00103  |        0.00740305  |   1         |       1.00136  |
| ('serial-linked-list', 'julia-mmtk-conservative-moving-immix(1.554x minheap,.mmtk_gc_threads-12)')                                              |     0.564184 |        0.00391979  |   0         |       0.960075 |
| ('serial-linked-list', 'julia-mmtk-conservative-moving-immix(2.058x minheap,.mmtk_gc_threads-12)')                                              |     0.565132 |        0.00189242  |   0         |       0.961688 |
| ('serial-linked-list', 'julia-mmtk-conservative-moving-immix(3.069x minheap,.mmtk_gc_threads-12)')                                              |     0.563552 |        0.00101967  |   0         |       0.959    |
| ('serial-linked-list', 'julia-mmtk-conservative-moving-stickyimmix(1.554x minheap,.mmtk_gc_threads-12)')                                        |     0.633699 |        0.00212261  |   0         |       1.07837  |
| ('serial-linked-list', 'julia-mmtk-conservative-moving-stickyimmix(2.058x minheap,.mmtk_gc_threads-12)')                                        |     0.632988 |        0.00358095  |   0         |       1.07716  |
| ('serial-linked-list', 'julia-mmtk-conservative-moving-stickyimmix(3.069x minheap,.mmtk_gc_threads-12)')                                        |     0.633699 |        0.00117741  |   0         |       1.07837  |
| ('serial-linked-list', 'julia-mmtk-moving-immix(1.554x minheap,.mmtk_gc_threads-12)')                                                           |     0.549727 |        0.00169944  |   0         |       0.935475 |
| ('serial-linked-list', 'julia-mmtk-moving-immix(2.058x minheap,.mmtk_gc_threads-12)')                                                           |     0.548306 |        0.000899261 |   0         |       0.933056 |
| ('serial-linked-list', 'julia-mmtk-moving-immix(3.069x minheap,.mmtk_gc_threads-12)')                                                           |     0.549411 |        0.00271911  |   0         |       0.934937 |
| ('serial-linked-list', 'julia-mmtk-moving-stickyimmix(1.554x minheap,.mmtk_gc_threads-12)')                                                     |     0.621139 |        0.00212261  |   0         |       1.057    |
| ('serial-linked-list', 'julia-mmtk-moving-stickyimmix(2.058x minheap,.mmtk_gc_threads-12)')                                                     |     0.620586 |        0.000679778 |   0         |       1.05606  |
| ('serial-linked-list', 'julia-mmtk-moving-stickyimmix(3.069x minheap,.mmtk_gc_threads-12)')                                                     |     0.621534 |        0.00245097  |   0         |       1.05767  |
| ('serial-linked-list', 'julia-stock-fixed-heap(1.554x minheap,.julia_gc_threads-12)')                                                           |     1        |        0.00589685  |   1         |       1        |
| ('serial-linked-list', 'julia-stock-fixed-heap(2.058x minheap,.julia_gc_threads-12)')                                                           |     1.00901  |        0.035368    |   1.00307   |       1.01317  |
| ('serial-linked-list', 'julia-stock-fixed-heap(3.069x minheap,.julia_gc_threads-12)')                                                           |     1.03144  |        0.125249    |   1.00211   |       1.05202  |
| ('serial-linked-tree', 'julia-mmtk-conservative-moving-immix(1.554x minheap,.mmtk_gc_threads-12)')                                              |     0.897335 |        0.0102818   |   0         |       0.965364 |
| ('serial-linked-tree', 'julia-mmtk-conservative-moving-immix(2.058x minheap,.mmtk_gc_threads-12)')                                              |     0.900656 |        0.00703366  |   0         |       0.968938 |
| ('serial-linked-tree', 'julia-mmtk-conservative-moving-immix(3.069x minheap,.mmtk_gc_threads-12)')                                              |     0.894794 |        0.0028211   |   0         |       0.962631 |
| ('serial-linked-tree', 'julia-mmtk-conservative-moving-stickyimmix(1.554x minheap,.mmtk_gc_threads-12)')                                        |     0.914155 |        0.00203726  |   0         |       0.98346  |
| ('serial-linked-tree', 'julia-mmtk-conservative-moving-stickyimmix(2.058x minheap,.mmtk_gc_threads-12)')                                        |     0.917804 |        0.0167542   |   0         |       0.987385 |
| ('serial-linked-tree', 'julia-mmtk-conservative-moving-stickyimmix(3.069x minheap,.mmtk_gc_threads-12)')                                        |     0.915256 |        0.0138263   |   0         |       0.984645 |
| ('serial-linked-tree', 'julia-mmtk-moving-immix(1.554x minheap,.mmtk_gc_threads-12)')                                                           |     0.904087 |        0.00734393  |   0         |       0.972629 |
| ('serial-linked-tree', 'julia-mmtk-moving-immix(2.058x minheap,.mmtk_gc_threads-12)')                                                           |     0.899815 |        0.0154087   |   0         |       0.968033 |
| ('serial-linked-tree', 'julia-mmtk-moving-immix(3.069x minheap,.mmtk_gc_threads-12)')                                                           |     0.905061 |        0.00466083  |   0         |       0.973677 |
| ('serial-linked-tree', 'julia-mmtk-moving-stickyimmix(1.554x minheap,.mmtk_gc_threads-12)')                                                     |     0.914827 |        0.00839496  |   0         |       0.984183 |
| ('serial-linked-tree', 'julia-mmtk-moving-stickyimmix(2.058x minheap,.mmtk_gc_threads-12)')                                                     |     0.920865 |        0.00837686  |   0         |       0.990679 |
| ('serial-linked-tree', 'julia-mmtk-moving-stickyimmix(3.069x minheap,.mmtk_gc_threads-12)')                                                     |     0.917217 |        0.0135941   |   0         |       0.986754 |
| ('serial-linked-tree', 'julia-stock-fixed-heap(1.554x minheap,.julia_gc_threads-12)')                                                           |     1        |        0.00338463  |   1         |       1        |
| ('serial-linked-tree', 'julia-stock-fixed-heap(2.058x minheap,.julia_gc_threads-12)')                                                           |     0.996261 |        0.0159758   |   0.996651  |       0.996231 |
| ('serial-linked-tree', 'julia-stock-fixed-heap(3.069x minheap,.julia_gc_threads-12)')                                                           |     0.993296 |        0.0111988   |   0.998197  |       0.992924 |
| ('serial-strings-strings', 'julia-mmtk-conservative-moving-immix(1.554x minheap,.mmtk_gc_threads-12)')                                          |     0.896499 |        0.0676475   |   0         |       1.06412  |
| ('serial-strings-strings', 'julia-mmtk-conservative-moving-immix(2.058x minheap,.mmtk_gc_threads-12)')                                          |     0.876353 |        0.0158112   |   0         |       1.0402   |
| ('serial-strings-strings', 'julia-mmtk-conservative-moving-immix(3.069x minheap,.mmtk_gc_threads-12)')                                          |     0.874197 |        0.0144101   |   0         |       1.03765  |
| ('serial-strings-strings', 'julia-mmtk-conservative-moving-stickyimmix(1.554x minheap,.mmtk_gc_threads-12)')                                    |     0.89147  |        0.0147999   |   0         |       1.05815  |
| ('serial-strings-strings', 'julia-mmtk-conservative-moving-stickyimmix(2.058x minheap,.mmtk_gc_threads-12)')                                    |     0.893161 |        0.0137937   |   0         |       1.06016  |
| ('serial-strings-strings', 'julia-mmtk-conservative-moving-stickyimmix(3.069x minheap,.mmtk_gc_threads-12)')                                    |     0.897322 |        0.00845486  |   0         |       1.06509  |
| ('serial-strings-strings', 'julia-mmtk-moving-immix(1.554x minheap,.mmtk_gc_threads-12)')                                                       |     0.873733 |        0.0123872   |   0         |       1.0371   |
| ('serial-strings-strings', 'julia-mmtk-moving-immix(2.058x minheap,.mmtk_gc_threads-12)')                                                       |     0.874826 |        0.0251534   |   0         |       1.03839  |
| ('serial-strings-strings', 'julia-mmtk-moving-immix(3.069x minheap,.mmtk_gc_threads-12)')                                                       |     0.880125 |        0.0261406   |   0         |       1.04468  |
| ('serial-strings-strings', 'julia-mmtk-moving-stickyimmix(1.554x minheap,.mmtk_gc_threads-12)')                                                 |     0.888402 |        0.0167127   |   0         |       1.05451  |
| ('serial-strings-strings', 'julia-mmtk-moving-stickyimmix(2.058x minheap,.mmtk_gc_threads-12)')                                                 |     0.889629 |        0.0120821   |   0         |       1.05596  |
| ('serial-strings-strings', 'julia-mmtk-moving-stickyimmix(3.069x minheap,.mmtk_gc_threads-12)')                                                 |     0.889539 |        0.010816    |   0         |       1.05586  |
| ('serial-strings-strings', 'julia-stock-fixed-heap(1.554x minheap,.julia_gc_threads-12)')                                                       |     1        |        0.00674577  |   1         |       1        |
| ('serial-strings-strings', 'julia-stock-fixed-heap(2.058x minheap,.julia_gc_threads-12)')                                                       |     0.996408 |        0.0354811   |   0.97691   |       1.00005  |
| ('serial-strings-strings', 'julia-stock-fixed-heap(3.069x minheap,.julia_gc_threads-12)')                                                       |     1.00284  |        0.0256709   |   0.978145  |       1.00746  |
| ('slow-bigint-pidigits', 'julia-mmtk-conservative-moving-immix(1.554x minheap,.mmtk_gc_threads-12)')                                            |     6.02043  |        0.617697    |  37.6736    |       0.978402 |
| ('slow-bigint-pidigits', 'julia-mmtk-conservative-moving-immix(2.058x minheap,.mmtk_gc_threads-12)')                                            |     2.73256  |        0.0103147   |  14.6749    |       0.830272 |
| ('slow-bigint-pidigits', 'julia-mmtk-conservative-moving-immix(3.069x minheap,.mmtk_gc_threads-12)')                                            |     1.59884  |        0.00524208  |   6.69224   |       0.78752  |
| ('slow-bigint-pidigits', 'julia-mmtk-conservative-moving-stickyimmix(1.554x minheap,.mmtk_gc_threads-12)')                                      |     6.15686  |        0.0566968   |  38.8678    |       0.946354 |
| ('slow-bigint-pidigits', 'julia-mmtk-conservative-moving-stickyimmix(2.058x minheap,.mmtk_gc_threads-12)')                                      |     2.8616   |        0.0152383   |  15.6105    |       0.830825 |
| ('slow-bigint-pidigits', 'julia-mmtk-conservative-moving-stickyimmix(3.069x minheap,.mmtk_gc_threads-12)')                                      |     1.65344  |        0.00797857  |   7.09691   |       0.78635  |
| ('slow-bigint-pidigits', 'julia-mmtk-moving-immix(1.554x minheap,.mmtk_gc_threads-12)')                                                         |     5.84163  |        0.0382336   |  36.5877    |       0.9441   |
| ('slow-bigint-pidigits', 'julia-mmtk-moving-immix(2.058x minheap,.mmtk_gc_threads-12)')                                                         |     2.72555  |        0.0204288   |  14.6358    |       0.828375 |
| ('slow-bigint-pidigits', 'julia-mmtk-moving-immix(3.069x minheap,.mmtk_gc_threads-12)')                                                         |     1.59149  |        0.00739095  |   6.66      |       0.78413  |
| ('slow-bigint-pidigits', 'julia-mmtk-moving-stickyimmix(1.554x minheap,.mmtk_gc_threads-12)')                                                   |     6.17307  |        0.0192619   |  38.9743    |       0.94817  |
| ('slow-bigint-pidigits', 'julia-mmtk-moving-stickyimmix(2.058x minheap,.mmtk_gc_threads-12)')                                                   |     2.87211  |        0.0702417   |  15.7034    |       0.828214 |
| ('slow-bigint-pidigits', 'julia-mmtk-moving-stickyimmix(3.069x minheap,.mmtk_gc_threads-12)')                                                   |     1.65518  |        0.047003    |   7.10689   |       0.786776 |
| ('slow-bigint-pidigits', 'julia-stock-fixed-heap(1.554x minheap,.julia_gc_threads-12)')                                                         |     1        |        0.0156332   |   1         |       1        |
| ('slow-bigint-pidigits', 'julia-stock-fixed-heap(2.058x minheap,.julia_gc_threads-12)')                                                         |     1.02189  |        0.0460076   |   1.03398   |       1.01997  |
| ('slow-bigint-pidigits', 'julia-stock-fixed-heap(3.069x minheap,.julia_gc_threads-12)')                                                         |     1.03143  |        0.0148361   |   1.0473    |       1.0289   |
| ('slow-rb_tree-rb_tree', 'julia-mmtk-conservative-moving-immix(1.554x minheap,.mmtk_gc_threads-12)')                                            |     0.575335 |        0.0260984   |   0.690534  |       0.574469 |
| ('slow-rb_tree-rb_tree', 'julia-mmtk-conservative-moving-immix(2.058x minheap,.mmtk_gc_threads-12)')                                            |     0.577762 |        0.00245138  |   0         |       0.582105 |
| ('slow-rb_tree-rb_tree', 'julia-mmtk-conservative-moving-immix(3.069x minheap,.mmtk_gc_threads-12)')                                            |     0.577045 |        0.00968215  |   0         |       0.581382 |
| ('slow-rb_tree-rb_tree', 'julia-mmtk-conservative-moving-stickyimmix(1.554x minheap,.mmtk_gc_threads-12)')                                      |     0.59448  |        0.00934887  |   0.843879  |       0.592606 |
| ('slow-rb_tree-rb_tree', 'julia-mmtk-conservative-moving-stickyimmix(2.058x minheap,.mmtk_gc_threads-12)')                                      |     0.574628 |        0.00243369  |   0         |       0.578947 |
| ('slow-rb_tree-rb_tree', 'julia-mmtk-conservative-moving-stickyimmix(3.069x minheap,.mmtk_gc_threads-12)')                                      |     0.578454 |        0.009581    |   0         |       0.582802 |
| ('slow-rb_tree-rb_tree', 'julia-mmtk-moving-immix(1.554x minheap,.mmtk_gc_threads-12)')                                                         |     0.565102 |        0.0103263   |   0.69369   |       0.564135 |
| ('slow-rb_tree-rb_tree', 'julia-mmtk-moving-immix(2.058x minheap,.mmtk_gc_threads-12)')                                                         |     0.559924 |        0.00865064  |   0         |       0.564132 |
| ('slow-rb_tree-rb_tree', 'julia-mmtk-moving-immix(3.069x minheap,.mmtk_gc_threads-12)')                                                         |     0.556769 |        0.00252811  |   0         |       0.560953 |
| ('slow-rb_tree-rb_tree', 'julia-mmtk-moving-stickyimmix(1.554x minheap,.mmtk_gc_threads-12)')                                                   |     0.595062 |        0.00893307  |   0.845135  |       0.593182 |
| ('slow-rb_tree-rb_tree', 'julia-mmtk-moving-stickyimmix(2.058x minheap,.mmtk_gc_threads-12)')                                                   |     0.575599 |        0.00796205  |   0         |       0.579925 |
| ('slow-rb_tree-rb_tree', 'julia-mmtk-moving-stickyimmix(3.069x minheap,.mmtk_gc_threads-12)')                                                   |     0.575573 |        0.00894439  |   0         |       0.579899 |
| ('slow-rb_tree-rb_tree', 'julia-stock-fixed-heap(1.554x minheap,.julia_gc_threads-12)')                                                         |     1        |        0.0213526   |   1         |       1        |
| ('slow-rb_tree-rb_tree', 'julia-stock-fixed-heap(2.058x minheap,.julia_gc_threads-12)')                                                         |     1.00386  |        0.0160627   |   1.00681   |       1.00384  |
| ('slow-rb_tree-rb_tree', 'julia-stock-fixed-heap(3.069x minheap,.julia_gc_threads-12)')                                                         |     0.997436 |        0.0173269   |   1.00096   |       0.99741  |

@udesou
Copy link
Contributor Author

udesou commented Jul 1, 2024

output_hr

@udesou udesou marked this pull request as ready for review July 8, 2024 05:30
mmtk/src/api.rs Outdated
bytes: usize,
semantics: AllocationSemantics,
) {
#[cfg(all(feature = "object_pinning", not(feature = "non_moving")))]
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Did you include this code when you ran benchmarks in #158 (comment)?

This should be fixed in mmtk-core by bulk clearing the pinning bits. We don't want to clear the bits here for every object.

Copy link
Contributor Author

@udesou udesou Jul 8, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, I did include it. Is it fixed in the mmtk-core version we're currently using?
I'll remove that code then and maybe try to re-run the benchmarks in the meantime.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't think we have fixed it in mmtk-core. But we should fix it in mmtk-core.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You also only clear the bits in this function, not in the JIT'd code. So for objects allocated in the JIT'd code, the pinning bits are not cleared properly.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You also only clear the bits in this function, not in the JIT'd code. So for objects allocated in the JIT'd code, the pinning bits are not cleared properly.

I think I'm clearing them in the slowpath, not sure if they need to be cleared in the fastpath as well (since they will be bulk cleared for the memory chunk I get in the slowpath).

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There is no slowpath or fastpath for post_alloc. We either inline them, or not inline them. Both versions should be the same.

Copy link
Contributor Author

@udesou udesou Jul 9, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What I meant was that in the allocation slowpath, you could clear the pin bits by calling mmtk_post_alloc, and it would be cleared for the chunk of memory you get between the new cursor and limit. But I checked the Julia PR and I wasn't calling mmtk_post_alloc there either, since I'm now inlining the code to set the VO bit. So, in fact, that code to bulk zero the pinning bits was not being executed in the results above.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I see you removed the code for the pin bits. Just make sure that we are on the same page. With this PR, the pin bits are not cleared, right? It sounds fine to me. But it is an issue that we will need to fix.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That's right. It should be fixed inside mmtk-core. I'm currently looking into it and will open a PR there instead.

@udesou udesou requested a review from qinsoon July 9, 2024 06:00
Copy link
Member

@qinsoon qinsoon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@udesou udesou merged commit cdc68ee into mmtk:v1.9.2+RAI Jul 11, 2024
@qinsoon qinsoon mentioned this pull request Dec 3, 2024
qinsoon added a commit that referenced this pull request Dec 4, 2024
This PR ports #158 to `dev`, and
updates Julia to mmtk/julia#76.
qinsoon added a commit to qinsoon/mmtk-julia that referenced this pull request Feb 6, 2025
This PR ports mmtk#158 to `dev`, and
updates Julia to mmtk/julia#76.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants