Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Auto-kill legacy Metabase workers taking too much memory #25

Open
preaction opened this issue Jun 2, 2018 · 1 comment
Open

Auto-kill legacy Metabase workers taking too much memory #25

preaction opened this issue Jun 2, 2018 · 1 comment

Comments

@preaction
Copy link
Member

The legacy Metabase API (bin/cpantesters-legacy-metabase) starts out at about 70MB resident memory. Once it starts serving requests, it immediately goes to 100MB, and starts growing. I've seen worker processes taking up 2GB of resident memory.

I've reduced the number of requests a single worker can serve before they're killed by the master, and that should help, but it would be better if we could more directly terminate a worker once they go past 400MB or so. By that time, they've spent 10 minutes serving requests and it will be fine to kill them.

The best module to use for this is Mojolicious::Plugin::SizeLimit, but it seems unmaintained. I've left a note on the Github issue saying I will take maintainership (augensalat/mojolicious-plugin-sizelimit#4). If I get no response for a week or so, I should contact them directly. If I get no response after that, I should start looking in to getting COMAINT via PAUSE admins.

This ticket is not to look in to what is causing the memory usage to rise. That is another ticket.

@wsdookadr
Copy link

@preaction Please review and try out Mojolicious::Plugin::SizeLimit PR 5

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants