add vllm distributed inference examples#133

Merged

k8s-ci-robot merged 2 commits intokubernetes-sigs:mainfrom gujingit:doc/distributed-vLLM

May 10, 2024

+283

Commits on May 8, 2024

add distributed vllm inference examples
gujingit
committed

Commits on May 10, 2024

1) update README.md 2) update the leader pod commands 3) remove namespace in service.yaml 4) update subcommand from head to leader
gujingit
committed