Skip to content

[Benchmark] More accurate TPOT calc in benchmark_serving.py#12288

Merged
DarkLight1337 merged 1 commit intovllm-project:mainfrom njhill:bench-tpot-tokensJan 22, 2025

Commits

Commits on Jan 22, 2025