Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[opt](fe) Optimize calculate load job num metric in FE #39268

Merged
merged 2 commits into from
Aug 13, 2024

Conversation

htyoung
Copy link
Contributor

@htyoung htyoung commented Aug 13, 2024

cherry pick from #31952 #34020

Issue Number: close #xxx

* Reduce redundant loop for calculating every load job type and state num
  when job num is huge, it cost too much time

(cherry picked from commit 7399892)
…he#34020)

* When starting fe with lots of finished job, it maybe `OOM`, so
  we remove expired loadJob when replaying editlog

(cherry picked from commit a78a237)
@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@github-actions github-actions bot added the area/load Issues or PRs related to all kinds of load label Aug 13, 2024
@morningman morningman merged commit ab2d94f into apache:branch-1.2-lts Aug 13, 2024
14 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/load Issues or PRs related to all kinds of load
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants