Skip to content

[VLLM] Set max_num_batched_tokens for vllm rollout #255

[VLLM] Set max_num_batched_tokens for vllm rollout

[VLLM] Set max_num_batched_tokens for vllm rollout #255

Annotations

1 warning

sanity (3.10)

succeeded Jan 27, 2025 in 2m 29s