Skip to content

[VLLM] Set max_num_batched_tokens for vllm rollout #196

[VLLM] Set max_num_batched_tokens for vllm rollout

[VLLM] Set max_num_batched_tokens for vllm rollout #196

ray

succeeded Jan 27, 2025 in 1m 20s