Skip to content
build container images

feat(vllm): Allow to set quantization #2686

Sign in to view logs

feat(vllm): Allow to set quantization

feat(vllm): Allow to set quantization #2686

Triggered via pull request September 22, 2023 13:49
@mudlermudler
opened #1094
vllm_quant
Status Cancelled
Total duration 3m 20s
Artifacts –

image.yml

on: pull_request
Matrix: docker
Fit to window
Zoom out
Zoom in

Annotations

12 errors
docker (cublas, 12, 1, linux/amd64, false, -cublas-cuda12)
Canceling since a higher priority waiting request for 'ci-vllm_quant-go-skynet/LocalAI' exists
docker (cublas, 12, 1, linux/amd64, false, -cublas-cuda12)
The operation was canceled.
docker (cublas, 11, 7, linux/amd64, false, -cublas-cuda11)
Canceling since a higher priority waiting request for 'ci-vllm_quant-go-skynet/LocalAI' exists
docker (cublas, 11, 7, linux/amd64, false, -cublas-cuda11)
The operation was canceled.
docker (cublas, 11, 7, linux/amd64, false, -cublas-cuda11-ffmpeg, true)
Canceling since a higher priority waiting request for 'ci-vllm_quant-go-skynet/LocalAI' exists
docker (cublas, 11, 7, linux/amd64, false, -cublas-cuda11-ffmpeg, true)
The operation was canceled.
docker (cublas, 12, 1, linux/amd64, false, -cublas-cuda12-ffmpeg, true)
Canceling since a higher priority waiting request for 'ci-vllm_quant-go-skynet/LocalAI' exists
docker (cublas, 12, 1, linux/amd64, false, -cublas-cuda12-ffmpeg, true)
The operation was canceled.
docker (linux/amd64,linux/arm64, false, -ffmpeg, true)
Canceling since a higher priority waiting request for 'ci-vllm_quant-go-skynet/LocalAI' exists
docker (linux/amd64,linux/arm64, false, -ffmpeg, true)
The operation was canceled.
docker (linux/amd64,linux/arm64, auto)
Canceling since a higher priority waiting request for 'ci-vllm_quant-go-skynet/LocalAI' exists
docker (linux/amd64,linux/arm64, auto)
The operation was canceled.