[Serve] Modify max_concurrency in actor options to respect max_ongoing_requests (#47681)#48274
Merged
zcin merged 10 commits intoray-project:masterfrom akyang-anyscale:alexyang/serve-max-ongoing-cappedOct 30, 2024
+43-1
Commits
Commits on Oct 25, 2024
Commits on Oct 28, 2024
Commits on Oct 29, 2024
- committed
- committed
- committed
- committed