Skip to content

Commit faa18a4

Browse files
committed
Implement SSZ union type (#2579)
## Issue Addressed NA ## Proposed Changes Implements the "union" type from the SSZ spec for `ssz`, `ssz_derive`, `tree_hash` and `tree_hash_derive` so it may be derived for `enums`: https://github.com/ethereum/consensus-specs/blob/v1.1.0-beta.3/ssz/simple-serialize.md#union The union type is required for the merge, since the `Transaction` type is defined as a single-variant union `Union[OpaqueTransaction]`. ### Crate Updates This PR will (hopefully) cause CI to publish new versions for the following crates: - `eth2_ssz_derive`: `0.2.1` -> `0.3.0` - `eth2_ssz`: `0.3.0` -> `0.4.0` - `eth2_ssz_types`: `0.2.0` -> `0.2.1` - `tree_hash`: `0.3.0` -> `0.4.0` - `tree_hash_derive`: `0.3.0` -> `0.4.0` These these crates depend on each other, I've had to add a workspace-level `[patch]` for these crates. A follow-up PR will need to remove this patch, ones the new versions are published. ### Union Behaviors We already had SSZ `Encode` and `TreeHash` derive for enums, however it just did a "transparent" pass-through of the inner value. Since the "union" decoding from the spec is in conflict with the transparent method, I've required that all `enum` have exactly one of the following enum-level attributes: #### SSZ - `#[ssz(enum_behaviour = "union")]` - matches the spec used for the merge - `#[ssz(enum_behaviour = "transparent")]` - maintains existing functionality - not supported for `Decode` (never was) #### TreeHash - `#[tree_hash(enum_behaviour = "union")]` - matches the spec used for the merge - `#[tree_hash(enum_behaviour = "transparent")]` - maintains existing functionality This means that we can maintain the existing transparent behaviour, but all existing users will get a compile-time error until they explicitly opt-in to being transparent. ### Legacy Option Encoding Before this PR, we already had a union-esque encoding for `Option<T>`. However, this was with the *old* SSZ spec where the union selector was 4 bytes. During merge specification, the spec was changed to use 1 byte for the selector. Whilst the 4-byte `Option` encoding was never used in the spec, we used it in our database. Writing a migrate script for all occurrences of `Option` in the database would be painful, especially since it's used in the `CommitteeCache`. To avoid the migrate script, I added a serde-esque `#[ssz(with = "module")]` field-level attribute to `ssz_derive` so that we can opt into the 4-byte encoding on a field-by-field basis. The `ssz::legacy::four_byte_impl!` macro allows a one-liner to define the module required for the `#[ssz(with = "module")]` for some `Option<T> where T: Encode + Decode`. Notably, **I have removed `Encode` and `Decode` impls for `Option`**. I've done this to force a break on downstream users. Like I mentioned, `Option` isn't used in the spec so I don't think it'll be *that* annoying. I think it's nicer than quietly having two different union implementations or quietly breaking the existing `Option` impl. ### Crate Publish Ordering I've modified the order in which CI publishes crates to ensure that we don't publish a crate without ensuring we already published a crate that it depends upon. ## TODO - [ ] Queue a follow-up `[patch]`-removing PR.
1 parent 00a7ef0 commit faa18a4

File tree

63 files changed

+1509
-565
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

63 files changed

+1509
-565
lines changed

.github/workflows/publish-crate.yml

Lines changed: 14 additions & 14 deletions
Original file line numberDiff line numberDiff line change
@@ -36,22 +36,26 @@ jobs:
3636
- name: Cargo login
3737
run: |
3838
echo "${CARGO_API_TOKEN}" | cargo login
39-
- name: publish tree hash
40-
if: startsWith(env.TAG, 'tree-hash-v')
41-
run: |
42-
./scripts/ci/publish.sh consensus/tree_hash tree_hash "$TAG"
43-
- name: publish tree hash derive
44-
if: startsWith(env.TAG, 'tree-hash-derive-v')
39+
- name: publish eth2 ssz derive
40+
if: startsWith(env.TAG, 'eth2-ssz-derive-v')
4541
run: |
46-
./scripts/ci/publish.sh consensus/tree_hash_derive tree_hash_derive "$TAG"
42+
./scripts/ci/publish.sh consensus/ssz_derive eth2_ssz_derive "$TAG"
4743
- name: publish eth2 ssz
4844
if: startsWith(env.TAG, 'eth2-ssz-v')
4945
run: |
5046
./scripts/ci/publish.sh consensus/ssz eth2_ssz "$TAG"
51-
- name: publish eth2 ssz derive
52-
if: startsWith(env.TAG, 'eth2-ssz-derive-v')
47+
- name: publish eth2 hashing
48+
if: startsWith(env.TAG, 'eth2-hashing-v')
5349
run: |
54-
./scripts/ci/publish.sh consensus/ssz_derive eth2_ssz_derive "$TAG"
50+
./scripts/ci/publish.sh crypto/eth2_hashing eth2_hashing "$TAG"
51+
- name: publish tree hash derive
52+
if: startsWith(env.TAG, 'tree-hash-derive-v')
53+
run: |
54+
./scripts/ci/publish.sh consensus/tree_hash_derive tree_hash_derive "$TAG"
55+
- name: publish tree hash
56+
if: startsWith(env.TAG, 'tree-hash-v')
57+
run: |
58+
./scripts/ci/publish.sh consensus/tree_hash tree_hash "$TAG"
5559
- name: publish ssz types
5660
if: startsWith(env.TAG, 'eth2-ssz-types-v')
5761
run: |
@@ -60,7 +64,3 @@ jobs:
6064
if: startsWith(env.TAG, 'eth2-serde-util-v')
6165
run: |
6266
./scripts/ci/publish.sh consensus/serde_utils eth2_serde_utils "$TAG"
63-
- name: publish eth2 hashing
64-
if: startsWith(env.TAG, 'eth2-hashing-v')
65-
run: |
66-
./scripts/ci/publish.sh crypto/eth2_hashing eth2_hashing "$TAG"

0 commit comments

Comments
 (0)