Skip to content

[VLLM] Set max_num_batched_tokens for vllm rollout #177

[VLLM] Set max_num_batched_tokens for vllm rollout

[VLLM] Set max_num_batched_tokens for vllm rollout #177

Triggered via pull request January 27, 2025 03:02
Status Success
Total duration 19m 13s
Artifacts

model.yml

on: pull_request
model_rmpad
52s
model_rmpad
Fit to window
Zoom out
Zoom in