Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

pip install can be slow #18

Open
bbucior opened this issue Apr 14, 2019 · 1 comment
Open

pip install can be slow #18

bbucior opened this issue Apr 14, 2019 · 1 comment
Labels
wontfix This will not be worked on

Comments

@bbucior
Copy link
Contributor

bbucior commented Apr 14, 2019

The installation step pip install . can run slowly depending on the project environment. The root cause is in pip (pypa/pip#2195). Any source files under the parent directory (including the .git folder) are copied as part of the installation process. Therefore, if subdirectories like Data, Notebooks, Output, etc., are large, then pip will have to copy many files.

A workaround recommended in the Github issue is to use the -e (--editable) flag. The resulting symlinks work on my laptop but not the .travis.yml file for some reason. See the mofid pip branch for some failed attempts at resolving this issue.

@bbucior bbucior added the wontfix This will not be worked on label Apr 14, 2019
@bbucior
Copy link
Contributor Author

bbucior commented May 29, 2019

Another workaround I've been using on the HPC cluster: since I save my CIFs in ./Data, I tend to run something like module load python; mv Data ../temp-Data; pip install --user .; mv ../temp-Data Data

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
wontfix This will not be worked on
Projects
None yet
Development

No branches or pull requests

1 participant