Explain where the engine args go when using Docker (vllm-project#12041)

Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
GWS0428 · Feb 12, 2025 · 9bd2c45 · 9bd2c45
1 parent 800d5f9
commit 9bd2c45
Showing 1 changed file with 2 additions and 0 deletions.
diff --git a/docs/source/deployment/docker.md b/docs/source/deployment/docker.md
@@ -19,6 +19,8 @@ $ docker run --runtime nvidia --gpus all \
     --model mistralai/Mistral-7B-v0.1
 ```
 
+You can add any other <project:#engine-args> you need after the image tag (`vllm/vllm-openai:latest`).
+
 ```{note}
 You can either use the `ipc=host` flag or `--shm-size` flag to allow the
 container to access the host's shared memory. vLLM uses PyTorch, which uses shared