Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[trimaran.targetloadpacking]: Hot Issues in continuous scheduling #797

Open
ShyunnY opened this issue Aug 29, 2024 · 2 comments
Open

[trimaran.targetloadpacking]: Hot Issues in continuous scheduling #797

ShyunnY opened this issue Aug 29, 2024 · 2 comments

Comments

@ShyunnY
Copy link

ShyunnY commented Aug 29, 2024

Background:
I am currently using the trimaran.targetloadpacking scheduler plugin. Because my current scenario will encounter multiple Pods being scheduled continuously at a certain point in time. The targetloadpacking plugin uses metricsWatch + eventHandler to avoid hot spots, but this seems to have limitations.
In the case of large-scale pod continuous scheduling, perhaps the previous pod has just experienced the SchedulerCycle and is still waiting for the Bind operation in the background. At this time, EventHandler cannot observe and draw conclusions (because the Pod is not actually bound to the node).

Idea:
Can we introduce a simple flag in targetloadpacking to identify the NodeName bound to the previous round of Pods? When calculating the Node score, if the current Node is the Node that was scheduled in the previous round, we will appropriately reduce the score.

Tasks

No tasks being tracked yet.
@binacs
Copy link
Member

binacs commented Sep 8, 2024

/cc

In fact, the root of the problem is that "plugins are not aware of scheduling decisions based on memory operations."

More precisely: after the scheduler completes the scheduling algorithm and before handle the binding event, all Assume behaviors cannot have their due impact on the execution logic of the plugins (not just trimaran.targetloadpacking).

We should provide plug-in-granular universal storage in the scheduler's cache to eliminate such problems.

@ShyunnY
Copy link
Author

ShyunnY commented Sep 8, 2024

@binacs SGTM, if possible, I would like to work on this together

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants