Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Extend or replace parquet read support to support calendar interval type #176

Open
ravjotbrar opened this issue Jul 23, 2021 · 3 comments
Open
Labels
enhancement New feature or request High Priority

Comments

@ravjotbrar
Copy link
Collaborator

The converter from Spark to Parquet that we are using from Spark (ParquetWriteSupport) does not support CalendarIntervalType. Extend or replace this to allow for writing this type.

@alexey-temnikov
Copy link
Collaborator

Need to verify if it has been implemented

@jeremyprime
Copy link
Collaborator

We have a modified version of ParquetReadSupport, but not ParquetWriteSupport.

There is handling of CalendarIntervalType in SchemaTools, but I do not believe it deals with writing to parquet.

@jeremyprime
Copy link
Collaborator

jeremyprime commented Jun 2, 2023

See also #455, which may be an alternative solution (if CalendarIntervalType is supported by the Parquet data source).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request High Priority
Projects
None yet
Development

No branches or pull requests

3 participants