-
Notifications
You must be signed in to change notification settings - Fork 1.7k
Closed
Labels
enhancementNew feature or requestNew feature or request
Description
Is your feature request related to a problem or challenge? Please describe what you are trying to do.
We could both improve the performance and save the memory of GroupedHashAggregate by employing row format.
By using Vec<u8> backed rows, we are able to:
- compare compound grouping keys by comparing raw bytes directly.
- create all accumulator states by just creating a
Vec<u8>for each key, and update the contents in place - reduce the memory footprint for each group state, by changing from
Vec<ScalarValue>based state toVec<u8>based state with less datatype information.
Describe the solution you'd like
- A new Accumulator trait to manipulate state's updating/merging based on
Vec<u8> - branching
AggregateExec::executeto employ row-based aggregate when applicable.
Describe alternatives you've considered
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request