Skip to content
Back to pull request #11694

Update default max_num_batch_tokens for chunked prefill #31145

Sign in to view logs

Update default max_num_batch_tokens for chunked prefill

Update default max_num_batch_tokens for chunked prefill #31145

Run time

Learn about OS pricing on GitHub Actions
Job Run time
ruff (3.12)
12s
12s