Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dockerfile.jax: install JAX for TE build #997

Merged
merged 17 commits into from
Aug 19, 2024
Merged

Dockerfile.jax: install JAX for TE build #997

merged 17 commits into from
Aug 19, 2024

Conversation

olupton
Copy link
Collaborator

@olupton olupton commented Aug 14, 2024

NVIDIA/TransformerEngine#946 made TE's build process expect to be able to import jax.

@gpupuck
Copy link
Contributor

gpupuck commented Aug 19, 2024

It looks good, thanks for figuring out the symlinks solution!

The only suggestion is that could we have a separate script to create the link farm for all the necessary libraries? (Even in build-jax.sh could be okay) Because developers may have their own way to install a different cuDNN to test from the developer website. Having an individual script (or simply in build-jax.sh) could make the dev/test process easier.

Copy link
Contributor

@gpupuck gpupuck left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We've decided to take care of the link farm creation in a separate change.

@gpupuck gpupuck merged commit fde0cc2 into main Aug 19, 2024
231 of 259 checks passed
@gpupuck gpupuck deleted the olupton/fix-te branch August 19, 2024 21:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants