Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

use tracemalloc and vmprof to track mem usage #254

Open
wants to merge 3 commits into
base: master
Choose a base branch
from
Open

Conversation

qcdll
Copy link
Contributor

@qcdll qcdll commented Dec 7, 2018

FYI purpose, not going to merge at the moment

@qcdll
Copy link
Contributor Author

qcdll commented Dec 7, 2018

in the end, tracemalloc's compare_to() in snapshot helped identify the root cause of memory leak in #252

we can use this PR in the future if memory issue arises again

@qcdll
Copy link
Contributor Author

qcdll commented Dec 13, 2018

in addition to objgraph, tracking size of objects:

slave.add_block_futures
shard.state.new_block_pool
shard.add_block_futures
shard.state.db.m_header_pool
shard.state.db.m_meta_pool
shard.state.db.x_shard_set
shard.state.db.r_header_pool
shard.state.db.r_minor_header_pool
shard.state.db.height_to_minor_block_hashes

@qcdll
Copy link
Contributor Author

qcdll commented Dec 13, 2018

looks shard.state.db.height_to_minor_block_hashes has steady increase over time but the count is not out of ordinary, will revisit with new testnet 23

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant