Skip to content

Conversation

@tobodner
Copy link
Member

@tobodner tobodner commented Nov 3, 2025

Blocked by

  • #739

This optimization rule searches for AggregateOperatorProxy nodes, and splits the operation into two nodes as follows:

         ...
          |
AggregateOperatorProxy (pipeline-breaker => final aggregation)
          |
AggregateOperatorProxy (no pipeline-breaker => partial aggregatation)
         ...

The lower Aggregate operation can be scaled out across multiple partitions. The final aggregate, however, is a pipeline breaker and must thus be computed by a single worker.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants