[Core] Increase default max_num_batched_tokens
for multimodal models
#233
Job | Run time |
---|---|
3s | |
3s |
max_num_batched_tokens
for multimodal models
#233
Job | Run time |
---|---|
3s | |
3s |