KEP-4008: CRDValidationRatcheting: Add Benchmarks

[alexzielenski]

What type of PR is this?

/kind feature

What this PR does / why we need it:

Which issue(s) this PR fixes:

Adds benchmarks of validation of Gateway API CRDs with and without ratcheting. Gateway API was chosen due to its extensive usage of CRD schema validations and CEL validiations.

To benchmark ratcheting we test ValidateUpdate(new, old) for the following sets of pairs of new and old:

• For each valid and invalid test case, benchmark ValidateUpdate(validCase, invalidCase)
• For each invalid test case, benchmark ValidateUpdate with every other invalid case, including itself

On my system the difference is minimal (and may be reduced further by #121343

goos: darwin
goarch: arm64
pkg: k8s.io/apiextensions-apiserver/test/integration
=== RUN   BenchmarkRatcheting
BenchmarkRatcheting
=== RUN   BenchmarkRatcheting/RatchetingEnabled
BenchmarkRatcheting/RatchetingEnabled
=== RUN   BenchmarkRatcheting/RatchetingEnabled/ValidXValid
BenchmarkRatcheting/RatchetingEnabled/ValidXValid
BenchmarkRatcheting/RatchetingEnabled/ValidXValid-20                   2         654126666 ns/op       550194772 B/op   9789306 allocs/op
    /Users/alex/go/src/k8s.io/kubernetes/staging/src/k8s.io/apiextensions-apiserver/test/integration/ratcheting_test.go:1893: Hits: 160
=== RUN   BenchmarkRatcheting/RatchetingEnabled/ValidXInvalid
BenchmarkRatcheting/RatchetingEnabled/ValidXInvalid
BenchmarkRatcheting/RatchetingEnabled/ValidXInvalid-20                 4         312041740 ns/op       260796202 B/op   4650428 allocs/op
    /Users/alex/go/src/k8s.io/kubernetes/staging/src/k8s.io/apiextensions-apiserver/test/integration/ratcheting_test.go:1901: Hits: 292
=== RUN   BenchmarkRatcheting/RatchetingEnabled/InvalidXInvalid
BenchmarkRatcheting/RatchetingEnabled/InvalidXInvalid
BenchmarkRatcheting/RatchetingEnabled/InvalidXInvalid-20              13          86722939 ns/op       73554363 B/op    1324085 allocs/op
    /Users/alex/go/src/k8s.io/kubernetes/staging/src/k8s.io/apiextensions-apiserver/test/integration/ratcheting_test.go:1909: Hits: 15219
=== RUN   BenchmarkRatcheting/RatchetingDisabled
BenchmarkRatcheting/RatchetingDisabled
=== RUN   BenchmarkRatcheting/RatchetingDisabled/ValidXValid
BenchmarkRatcheting/RatchetingDisabled/ValidXValid
BenchmarkRatcheting/RatchetingDisabled/ValidXValid-20                  2         631920688 ns/op       536041164 B/op   9622970 allocs/op
    /Users/alex/go/src/k8s.io/kubernetes/staging/src/k8s.io/apiextensions-apiserver/test/integration/ratcheting_test.go:1893: Hits: 0
=== RUN   BenchmarkRatcheting/RatchetingDisabled/ValidXInvalid
BenchmarkRatcheting/RatchetingDisabled/ValidXInvalid
BenchmarkRatcheting/RatchetingDisabled/ValidXInvalid-20                4         305517083 ns/op       254641550 B/op   4577617 allocs/op
    /Users/alex/go/src/k8s.io/kubernetes/staging/src/k8s.io/apiextensions-apiserver/test/integration/ratcheting_test.go:1901: Hits: 0
=== RUN   BenchmarkRatcheting/RatchetingDisabled/InvalidXInvalid
BenchmarkRatcheting/RatchetingDisabled/InvalidXInvalid
BenchmarkRatcheting/RatchetingDisabled/InvalidXInvalid-20             13          83273772 ns/op       69889626 B/op    1278588 allocs/op
    /Users/alex/go/src/k8s.io/kubernetes/staging/src/k8s.io/apiextensions-apiserver/test/integration/ratcheting_test.go:1909: Hits: 0
PASS
ok      k8s.io/apiextensions-apiserver/test/integration 11.808s

Special notes for your reviewer:

Based on #121016

/assign @apelisse
/sig api-machinery

Does this PR introduce a user-facing change?

NONE

Additional documentation e.g., KEPs (Kubernetes Enhancement Proposals), usage docs, etc.:

- [KEP]: https://kep.k8s.io/4008

[leilajal]

/triage accepted

[apelisse]

/lgtm
/approve
Thanks!

[k8s-ci-robot]

LGTM label has been added.

Git tree hash: 0b8ed37d309995b03fde36017a298588d7e59ac0

[jpbetz]

/approve
/lgtm

Noticed a minor typo, not blocking on it, but happy to retag if it gets fixed.

[k8s-ci-robot]

LGTM label has been added.

Git tree hash: 640639351dc5d54c9504cbaca2f4b9457c943343

[k8s-ci-robot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: alexzielenski, apelisse, jpbetz

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• staging/src/k8s.io/apiextensions-apiserver/OWNERS [jpbetz]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[alexzielenski]

/retest

[apelisse]

/lgtm

[k8s-ci-robot]

LGTM label has been added.

Git tree hash: ab26df1982fd57163c9f837b724c3c3a87c9b3b8