Skip to content

[VLLM] Set max_num_batched_tokens for vllm rollout #246

[VLLM] Set max_num_batched_tokens for vllm rollout

[VLLM] Set max_num_batched_tokens for vllm rollout #246

vllm

succeeded Jan 27, 2025 in 2m 6s