Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Increase limits for rmc #125

Open
lukebrowning opened this issue Jun 4, 2021 · 1 comment
Open

Increase limits for rmc #125

lukebrowning opened this issue Jun 4, 2021 · 1 comment

Comments

@lukebrowning
Copy link

lukebrowning commented Jun 4, 2021

OOM occurred on worker-1 node. rmcd process targeted.

Events:
Type Reason Age From Message


Warning SystemOOM 8h kubelet System OOM encountered, victim process: rmcd, pid: 6150
Warning SystemOOM 8h kubelet System OOM encountered, victim process: rmcd, pid: 1483512
Warning SystemOOM 8h kubelet System OOM encountered, victim process: rmcd, pid: 1486672
Warning SystemOOM 8h kubelet System OOM encountered, victim process: rmcd, pid: 1486690

I couldn't access worker nodes, but on a master node, the ps -elf indicated rmc had 10000 pages. That's ~640 MBs on mostly idle servers - master nodes. The failure above occurred on worker nodes, where ocs is deployed and I am running ocs-ci performance suite which deploys a bunch of fio pods...

The limit should be increased from 1 Gi to 1.5 or 2 Gi.

@lukebrowning
Copy link
Author

It could be that there is a memory leak in rmcd. @manojnkumar reported that after talking Myung Bae.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant