Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

tritonserver install problem. #334

Open
noname111234 opened this issue Jul 12, 2024 · 3 comments
Open

tritonserver install problem. #334

noname111234 opened this issue Jul 12, 2024 · 3 comments
Labels
bug Something isn't working

Comments

@noname111234
Copy link

noname111234 commented Jul 12, 2024

There are some erros based on your Dockerfile.

  1. cupy cuml cudf cugraph was not installed.

Here is your Dockerfile

FROM nvcr.io/nvidia/tritonserver:22.07-py3
LABEL maintainer="NVIDIA"
LABEL repository="tritonserver"

RUN apt-get update && apt-get -y install swig && apt-get -y install python3-dev && apt-get install -y cmake
RUN pip3 install torch==1.10.0+cu113 torchvision==0.11.1+cu113 torchaudio==0.10.0+cu113 -f https://download.pytorch.org/whl/cu113/torch_stable.html
RUN pip3 install -v kaldifeat
RUN python3 -m pip install cupy
RUN python3 -m pip install soundfile
RUN pip3 install --upgrade pip
RUN pip install --extra-index-url https://pypi.nvidia.com cudf_cu11
RUN pip install --extra-index-url https://pypi.nvidia.com cuml_cu11
RUN pip install --extra-index-url https://pypi.nvidia.com cugraph_cu11

Can you re-share updated Dockerfile?

@JiJiJiang JiJiJiang added the bug Something isn't working label Jul 12, 2024
@JiJiJiang
Copy link
Collaborator

@wd929 Please follow this issue

@noname111234 noname111234 changed the title tritonserver not working in multi gpu tritonserver install problem. Jul 15, 2024
@wd929
Copy link
Contributor

wd929 commented Jul 16, 2024

Hi, I have pre-built docker image in docker.io. Could you please first try it?
docker pull wd929/wespeaker_server:v1
BTW, I'm now working on re-building the image using the same dockerfile and also will try to upgrade the triton version.
Thanks!

@humblemh
Copy link

same issue.
Thanks in advance

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

4 participants