Skip to content

[VLLM] Set max_num_batched_tokens for vllm rollout #177

[VLLM] Set max_num_batched_tokens for vllm rollout

[VLLM] Set max_num_batched_tokens for vllm rollout #177

model_rmpad

succeeded Jan 27, 2025 in 52s