Skip to content
Back to pull request #5684

server: add KV cache quantization options #8565

Sign in to view logs

server: add KV cache quantization options

server: add KV cache quantization options #8565

Run time

Learn about OS pricing on GitHub Actions
Job Run time
Push Docker image to Docker Hub (light, .devops/main.Dockerfile, linux/amd64,linux/arm64)
22m 17s
Push Docker image to Docker Hub (full, .devops/full.Dockerfile, linux/amd64,linux/arm64)
24m 16s
Push Docker image to Docker Hub (server, .devops/server.Dockerfile, linux/amd64,linux/arm64)
20m 40s
Push Docker image to Docker Hub (light-cuda, .devops/main-cuda.Dockerfile, linux/amd64)
11m 16s
Push Docker image to Docker Hub (full-cuda, .devops/full-cuda.Dockerfile, linux/amd64)
13m 28s
Push Docker image to Docker Hub (server-cuda, .devops/server-cuda.Dockerfile, linux/amd64)
10m 11s
Push Docker image to Docker Hub (light-rocm, .devops/main-rocm.Dockerfile, linux/amd64,linux/arm64)
10m 10s
Push Docker image to Docker Hub (full-rocm, .devops/full-rocm.Dockerfile, linux/amd64,linux/arm64)
12m 33s
Push Docker image to Docker Hub (server-rocm, .devops/server-rocm.Dockerfile, linux/amd64,linux/a...
14m 3s
Push Docker image to Docker Hub (light-intel, .devops/main-intel.Dockerfile, linux/amd64)
8m 17s
Push Docker image to Docker Hub (server-intel, .devops/server-intel.Dockerfile, linux/amd64)
6m 53s
2h 34m 4s