-
Notifications
You must be signed in to change notification settings - Fork 1.7k
Closed
Labels
bugSomething isn't workingSomething isn't working
Description
Describe the bug
The logic that coerces timestamps to a different resolution iterates through fields and uses their key in the Parquet schema as a key to match against the Arrow schema.
| pub fn coerce_int96_to_resolution( |
However, this is insufficient (consider a schema with structs each with an id field) to disambiguate nested fields. I think we might need a combination of Parquet ColumnDesc's path and a normalized Arrow schema to fix the mapping.
To Reproduce
CometFuzzTestSuite for INT96 reproduces the issue immediately. I will work on including an slt test in the fix PR.
Expected behavior
No response
Additional context
Metadata
Metadata
Assignees
Labels
bugSomething isn't workingSomething isn't working