Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Excessive memory utilization when ingesting files into Timeline #44

Open
rbuch opened this issue Sep 28, 2016 · 1 comment
Open

Excessive memory utilization when ingesting files into Timeline #44

rbuch opened this issue Sep 28, 2016 · 1 comment
Assignees
Labels

Comments

@rbuch
Copy link
Contributor

rbuch commented Sep 28, 2016

Original issue: https://charm.cs.illinois.edu/redmine/issues/1230


When loading files into Timeline (and later), there's a lot of memory usage. For some logs, e.g. prudence:/scratch/nitin/charity_proj_logs/1, the memory usage is high enough that they take unreasonably long to load. This can probably be made more efficient.

@rbuch rbuch added the bug label Apr 12, 2019
@rbuch rbuch self-assigned this Apr 12, 2019
@nitbhat
Copy link

nitbhat commented Apr 12, 2019

Original date: 2016-11-06 14:32:24


These logs which take really long to load and on loading become unresponsive are from a single core ChaNGa run (SMP mode) with -tracemode projections. The application takes about 250 seconds for the entire run. Log file size is about 110 MB. I tried opening the logs on prudence with increased memory too. (Explicitly increased memory to 48G in the projections script). This didn't help in loading the log files.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants