Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[opt](routine load) optimize routine load timeout logic (#40818) #41135

Merged
merged 1 commit into from
Sep 25, 2024

Conversation

sollhui
Copy link
Contributor

@sollhui sollhui commented Sep 23, 2024

pick #40818

If IO/CPU resources are tight, routine load task is likely to timeout. The current method is self-adaption backoff
#32227, but the problem is it will do some ineffective work to match proper timeout. For one routine load task, a better way to handle task is finishing executing instead of retry when resources are tight. Therefore, this pr increase timeout to make "task always finish even if it is slow when resources are tight".

If IO/CPU resources are tight, routine load task is likely to timeout.
The current method is self-adaption backoff
apache#32227, but the problem is it will
do some ineffective work to match proper timeout. For one routine load
task, a better way to handle task is finishing executing instead of
retry when resources are tight. Therefore, this pr increase timeout to
make "task always finish even if it is slow when resources are tight".
@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@sollhui
Copy link
Contributor Author

sollhui commented Sep 23, 2024

run buildall

@liaoxin01 liaoxin01 merged commit 11bad4c into apache:branch-2.1 Sep 25, 2024
21 of 22 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants