-
Notifications
You must be signed in to change notification settings - Fork 1.7k
Closed
Labels
enhancementNew feature or requestNew feature or request
Description
Is your feature request related to a problem or challenge?
As I noted on #9025 https://github.com/apache/arrow-datafusion/pull/9025/files#r1468533266
There is a custom allocation pattern in VecAllocExt that doubles the size of the allocation each time
https://github.com/apache/arrow-datafusion/blob/d594e6257b34a5ad47112e26d41516aaeb19e6dd/datafusion/execution/src/memory_pool/proxy.rs#L39-L50
The actual rust stdlib also uses ths approach, but appears to handle overflows better :
Thus I don't know why we have our own custom doubling implementation
Describe the solution you'd like
No response
Describe alternatives you've considered
No response
Additional context
No response
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request