Skip to content

[Core] Increase default max_num_batched_tokens for multimodal models #233

[Core] Increase default max_num_batched_tokens for multimodal models

[Core] Increase default max_num_batched_tokens for multimodal models #233