Code

Add vLLM TPU Multihost example#234

Code

Merged

k8s-ci-robot merged 6 commits intokubernetes-sigs:mainkubernetes-sigs/lws:mainfrom Edwinhr716:vllm-tpu-guideEdwinhr716/lws:vllm-tpu-guideCopy head branch name to clipboardOct 24, 2024

+215-6

Commits

Commits on Oct 18, 2024

• added vLLM TPU multihost example, re-organized the vllm folder. Updated vllm image to be latest and now using LWS_GROUP_SIZE

  Edwinhr716

  committed
  523bc25

  Copy full SHA for 523bc25

• fix the numbr of vLLM model replicas

  Edwinhr716

  committed
  cce57c6

  Copy full SHA for cce57c6

Commits on Oct 24, 2024

• Update docs/examples/vllm/TPU/README.md

  Show description for e7b828f
  

  Edwinhr716

  and

  liurupeng

  authored
  e7b828f

  Copy full SHA for e7b828f

• Update docs/examples/vllm/TPU/README.md

  Show description for 977c7f4
  

  Edwinhr716

  and

  liurupeng

  authored
  977c7f4

  Copy full SHA for 977c7f4

• Update docs/examples/vllm/TPU/README.md

  Show description for 58d826f
  

  Edwinhr716

  and

  liurupeng

  authored
  58d826f

  Copy full SHA for 58d826f

• addressed comments

  Edwinhr716

  committed
  d8cf552

  Copy full SHA for d8cf552