Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support writing CASA Tables from Arrow Tables #3

Open
sjperkins opened this issue Mar 20, 2023 · 0 comments
Open

Support writing CASA Tables from Arrow Tables #3

sjperkins opened this issue Mar 20, 2023 · 0 comments
Labels
enhancement New feature or request low Low priority

Comments

@sjperkins
Copy link
Member

sjperkins commented Mar 20, 2023

Initially only conversion of CASA Tables to Arrow Tables is supported. It may be worth supporting CASA Table writes.

There are three general cases to consider:

  1. CREATE a new table. Table Descriptors and Data Managers must be synthesised from the schema of the supplied Arrow Table and the MSv2.0 spec.

  2. APPEND to an existing table. The Arrow Table will have to conform to the existing Table Descriptor and Data Managers.

  3. UPDATE an existing table. The Arrow Table will have to conform to the existing Table Descriptor and Data Managers. New Table Descriptor and Data Manager entries must be synthesised for any columns that are not present on the CASA Table.

From experience with dask-ms, (3) is the most complex case. I think this should be low priority unless there is a demonstrably useful case for returning to the CTDS format.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request low Low priority
Projects
None yet
Development

No branches or pull requests

1 participant