Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

support MySQL's entire database synchronization without many Flink SQL #332

Open
chenhaifengkeda opened this issue Jan 22, 2024 · 0 comments

Comments

@chenhaifengkeda
Copy link
Contributor

chenhaifengkeda commented Jan 22, 2024

At Present, synchronizing mysql data in real time takes two steps. Firstly, synchronize database & table schema with SMT. Secondly, synchronize data with Flink SQL.
There are three areas for improvement in this method of data synchronization. First of all, flink SQL does not support dynamic schema change during data synchronization. After that, too many binlog parsing clients put a lot of pressure on MySQL servers. Finally, it is very troublesome for users that using two steps to complete real-time data synchronization.
A new data synchronization method is needed to optimize the above three problems.

@chenhaifengkeda chenhaifengkeda changed the title support MySQL's entire database synchronization support MySQL's entire database synchronization without many Flink SQL Jan 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant