Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Exclude cuDNN 9 and CUDA 12 DLLs from manylinux wheel #21738

Merged
merged 1 commit into from
Aug 15, 2024

Conversation

tianleiwu
Copy link
Contributor

Description

Exclude cuDNN 9 and CUDA 12 DLLs from manylinux wheel to reduce python package size.

Motivation and Context

The 1.20.0 ort-nightly-gpu python wheels on linux are suddenly > 800 MB in size. The wheels built on 1.19 release branch have a size of around 220 MB.

The size change is caused by #19470.

@mszhanyi
Copy link
Contributor

I run the packaging pipeline with the branch
But the wheel size is still bigger than 900M
https://dev.azure.com/aiinfra/Lotus/_build/results?buildId=533959&view=logs&j=4247dab7-5c30-5f6f-48cd-4c47d64d18f0&t=84c07cd3-e50d-5988-733e-d5aa07cdd6b5

@tianleiwu
Copy link
Contributor Author

@mszhanyi, I will add another PR for cuDNN 8 and CUDA 11 DLLs.

@tianleiwu tianleiwu merged commit 212bcc9 into main Aug 15, 2024
103 of 135 checks passed
@tianleiwu tianleiwu deleted the tlwu/add_cudnn_dll_dependencies_in_setup branch August 15, 2024 07:03
tianleiwu added a commit that referenced this pull request Aug 15, 2024
### Description
It is a follow up of #21738
to exclude cudnn 8 DLLs since some python packaging pipelines (like
training package) are still using cudnn 8.9 and cuda 11.8.

### Motivation and Context

Size of python package for training pipeline increases a lot due to some
DLLs are added to package:

![image](https://github.com/user-attachments/assets/643a808e-760b-4382-ba55-57d7d722ee9a)
@snnn
Copy link
Member

snnn commented Oct 11, 2024

The line with libnvrtc-builtins is wrong.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants