Skip to content

Commit

Permalink
⚗️ try rust + rsync
Browse files Browse the repository at this point in the history
Signed-off-by: Joe Runde <[email protected]>
  • Loading branch information
joerunde committed Oct 15, 2024
1 parent 21d359d commit 8ba9351
Showing 1 changed file with 9 additions and 2 deletions.
11 changes: 9 additions & 2 deletions Dockerfile.ubi
Original file line number Diff line number Diff line change
@@ -1,10 +1,17 @@
# Start from released image
FROM quay.io/opendatahub/vllm:cuda-pr-173 as vllm-grpc-adapter
FROM quay.io/opendatahub/vllm:fast-ibm-6308d91 as vllm-grpc-adapter

USER root

# Copy source code changes into the installed location to overwrite the installed python code
COPY vllm /opt/vllm/lib64/python3.12/site-packages/vllm
# COPY vllm /opt/vllm/lib64/python3.12/site-packages/vllm

# install rustup
RUN curl https://sh.rustup.rs -sSf | bash -s -- -y
ENV PATH="${HOME}/.cargo/bin:${PATH}"

# install rsync
RUN microdnf install -y rsync

ENV GRPC_PORT=8033 \
PORT=8000 \
Expand Down

0 comments on commit 8ba9351

Please sign in to comment.