[Bugfix][Disaggregated] patch the inflight batching on the decode node in SimpleConnector to avoid hangs in SimpleBuffer (nccl based)#13987
Merged
KuntaiDu merged 1 commit intovllm-project:mainfrom hasB4K:vllm-public-hasb4k-2025-02-27_disagg-patchFeb 28, 2025
+15-2