Update default max_num_batch_tokens for chunked prefill #31145
Annotations
1 warning
|
ruff (3.12)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|