Skip to content

Commit

Permalink
[LMI] not sharing container info (#1915)
Browse files Browse the repository at this point in the history
  • Loading branch information
Qing Lan authored May 15, 2024
1 parent 8a0499a commit 5837ddf
Showing 1 changed file with 2 additions and 0 deletions.
2 changes: 2 additions & 0 deletions serving/docker/lmi.Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -51,6 +51,8 @@ ENV PYTORCH_LIBRARY_PATH=/usr/local/lib/python3.10/dist-packages/torch/lib
ENV PYTORCH_PRECXX11=true
ENV PYTORCH_VERSION=${torch_version}
ENV PYTORCH_FLAVOR=cu121-precxx11
ENV VLLM_NO_USAGE_STATS=1


ENV HF_HOME=/tmp/.cache/huggingface
ENV PYTORCH_KERNEL_CACHE_PATH=/tmp/.cache
Expand Down

0 comments on commit 5837ddf

Please sign in to comment.