-
Notifications
You must be signed in to change notification settings - Fork 1.7k
Open
Labels
enhancementNew feature or requestNew feature or request
Description
Is your feature request related to a problem or challenge? Please describe what you are trying to do.
While looking at adding support for more statistics on the Delta Lake TableProvider implementation I bumped into some limitation in our statistics API.
Currently columnstatistics is a Option<Vec<ColumnStatistics>>.
So, it should return the statistics by (correct) index regardless of the order in the files.
Describe the solution you'd like
Either:
- Return a
HashMap<String, ColumnStatistics>rather than aOption<Vec<ColumnStatistics>> - Pass a
Schemaparameter toTableProvider::statisiticsso the positions of the fields can be calculated.
FWIW, Delta Lake / delta-rs takes the first approach and seems straightforward to implement and use.
Describe alternatives you've considered
Additional context
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request