Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Roadmap 2022 #134

Open
6 of 20 tasks
zhangyangyu opened this issue Jan 10, 2022 · 4 comments
Open
6 of 20 tasks

Roadmap 2022 #134

zhangyangyu opened this issue Jan 10, 2022 · 4 comments

Comments

@zhangyangyu
Copy link
Collaborator

zhangyangyu commented Jan 10, 2022 •
edited by xuanyu66
Loading

This is TiBigData roadmap 2022.

It's under iterative edition and we welcome everyone to make advice.

Features

Flink

  • Fast Lookup with PK & Secondary Indices
  • Support Pre Split & Auto Random & Auto Increment when batch load
  • Support Upsert & Delete DML
  • Unified Batch & Streaming Processing
  • Support Catalog
  • Support External Connector Interface
  • Support FDW integration and Cloud EMR integration
  • Support Async Query
  • SSL Support
  • Telemetry

Spark (we'd like to merge TiSpark into TiBigData)

  • Support Pre Split & Auto Random & Auto Increment when batch load
  • Support Upsert & Delete DML
  • Unified Batch & Streaming Processing
  • Support Catalog
  • Support External Connector Interface
  • Support FDW integration and Cloud EMR integration
  • Support Async Query
  • SSL Support
  • Telemetry

Quality

  • Establish GA criteria
@sunxiaoguang sunxiaoguang pinned this issue Jan 10, 2022
@humengyu2012
Copy link
Collaborator

What's the Async Query?

@sunxiaoguang
Copy link
Collaborator

What's the Async Query?

It's about using FDW to submit asynchronous query to Spark / Flink from TiDB directly.

@gbzy
Copy link

gbzy commented Jan 21, 2022

It's important to support tikv native writing, the writing speed is the bottleneck of flink batch job.

@sunxiaoguang
Copy link
Collaborator

It's important to support tikv native writing, the writing speed is the bottleneck of flink batch job.

This particular feature is what you want

  • Support Upsert & Delete DML

@shiyuhang0 shiyuhang0 unpinned this issue Jun 16, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@zhangyangyu @sunxiaoguang @gbzy @humengyu2012