feat: emitting partial join results in HashJoinStream (#8020)

* HashJoin partial batch emitting

* batch splitting tests

* stream state & extended tests

* fmt & clippy warns fixed

* Apply suggestions from code review

Co-authored-by: Andrew Lamb <[email protected]>

* review comments

* ported join limited output

* comments & formatting

* Reuse hashes buffer

* Apply suggestions from code review

Co-authored-by: Andrew Lamb <[email protected]>

* fixed metrics and updated comment

* precalculate hashes & remove iterators

* draft: preparing for review

---------

Co-authored-by: Andrew Lamb <[email protected]>

Author: korowa

datafusion/physical-plan/Cargo.toml

@@ -61,6 +61,7 @@ uuid = { version = "^1.2", features = ["v4"] }
 
 [dev-dependencies]
 rstest = { workspace = true }
+rstest_reuse = "0.6.0"
 termtree = "0.4.1"
 tokio = { version = "1.28", features = [
     "macros",