Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Feature: Support DML execution on the data lake #16373

Open
Dousir9 opened this issue Sep 3, 2024 · 0 comments
Open

Feature: Support DML execution on the data lake #16373

Dousir9 opened this issue Sep 3, 2024 · 0 comments
Labels
A-storage Area: databend storage C-feature Category: feature

Comments

@Dousir9
Copy link
Member

Dousir9 commented Sep 3, 2024 •
edited
Loading

Summary

Support DML execution on the data lake (Apache Iceberg, Delta Lake, ...).

Design

  1. Construct row ids for data on data lake (using a method similar to Fuse Table to construct row ids).
  2. Add DML adaptation for data lake: mutation source, data writing back to the data lake, transaction submission.
  3. The rest reuses the current DML implementation.
@dosubot dosubot bot added A-storage Area: databend storage C-feature Category: feature labels Sep 3, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
A-storage Area: databend storage C-feature Category: feature
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@Dousir9