Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Parallelize SAM algorithm in mineraly.py using Joblib #177

Closed
aheermann opened this issue Oct 17, 2019 · 2 comments
Closed

Parallelize SAM algorithm in mineraly.py using Joblib #177

aheermann opened this issue Oct 17, 2019 · 2 comments
Assignees
Milestone

Comments

@aheermann
Copy link
Contributor

Along with dask and Pytorch, we want another option for parallelization. This one is Joblib, a Python library often used for "embarassingly parallel for loops", that just runs on the CPU. The target code to parallelize is the same as issues #168 and #172, and this works to give users more choice when running Pycoal. Documentation on Joblib is linked below.
https://joblib.readthedocs.io/en/latest/index.html
https://joblib.readthedocs.io/en/latest/parallel.html

@lewismc
Copy link
Member

lewismc commented Oct 17, 2019

Thanks @aheermann is there a PR for this yet?

@aheermann
Copy link
Contributor Author

Not yet, @lewismc. I made a branch for the issue, but I am still making a few fixes

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants