Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FLINK-35143][pipeline-connector][mysql] Expose newly added tables capture in mysql pipeline connector. #3411

Merged

Conversation

qg-lin
Copy link
Contributor

@qg-lin qg-lin commented Jun 12, 2024

@github-actions github-actions bot added docs Improvements or additions to documentation mysql-pipeline-connector labels Jun 12, 2024
@ruanhang1993
Copy link
Contributor

@qg-lin Thanks for your PR.
Please rebase the master branch and resolve the conflicts. Then let's run the CI.

If you need helps, please be free to notice me. Thanks.

@qg-lin
Copy link
Contributor Author

qg-lin commented Jun 20, 2024

@qg-lin Thanks for your PR. Please rebase the master branch and resolve the conflicts. Then let's run the CI.

If you need helps, please be free to notice me. Thanks.

Thanks for your review, I've resolved it.

Copy link
Contributor

@morazow morazow left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @qg-lin 👍

Minor wording suggestion from my side, otherwise looks good!

.booleanType()
.defaultValue(false)
.withDescription(
"Whether capture the scan the newly added tables or not, by default is false. This option is only useful when we start the job from a savepoint/checkpoint.");
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could we drop the capture here?

For example:

Whether to scan the newly added ...

With both capture and scan it seems hard to understand what the flag enables.

…line-connector-mysql/src/main/java/org/apache/flink/cdc/connectors/mysql/source/MySqlDataSourceOptions.java

Co-authored-by: Muhammet Orazov <[email protected]>
@morazow
Copy link
Contributor

morazow commented Jun 20, 2024

Got it 👍 I missed that there is doc for the flag, the doc version was already understandable.

Looks good!

Copy link
Contributor

@ruanhang1993 ruanhang1993 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@ruanhang1993
Copy link
Contributor

@qg-lin Please rebase the master branch and let's pass the CI.

@qg-lin
Copy link
Contributor Author

qg-lin commented Aug 5, 2024

@qg-lin Please rebase the master branch and let's pass the CI.

done

@ruanhang1993
Copy link
Contributor

@qg-lin It seems that some tests failed. Please take a look at them. Thanks.

@qg-lin
Copy link
Contributor Author

qg-lin commented Aug 8, 2024

@qg-lin It seems that some tests failed. Please take a look at them. Thanks.

@ruanhang1993 Done, please trigger again.

@ruanhang1993 ruanhang1993 changed the title [FLINK-35143][cdc-connector][mysql] Expose newly added tables capture in mysql pipeline connector. [FLINK-35143][pipeline-connector][mysql] Expose newly added tables capture in mysql pipeline connector. Aug 9, 2024
@ruanhang1993 ruanhang1993 merged commit 09f36a4 into apache:master Aug 9, 2024
22 checks passed
qiaozongmi pushed a commit to qiaozongmi/flink-cdc that referenced this pull request Sep 23, 2024
…pture in mysql pipeline connector. (apache#3411)


Co-authored-by: Muhammet Orazov <[email protected]>
Co-authored-by: north.lin <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved docs Improvements or additions to documentation mysql-pipeline-connector reviewed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants