[Serve] Add more bucket size (#35242)

Increase the bucket size. 
- Still providing current granularity with 0 - 100 ms latency.
- Providing more buckets for 100ms - 1000ms latency precision out of the box.
- Increase the bucket range to handle heavier use case.

**note: we are going to increase 2x stats points for the latency, it should be trivial comparing with host network bandwidth.**

python/ray/serve/_private/constants.py

@@ -62,10 +62,23 @@
     50,
     100,
     200,
+    300,
+    400,
     500,
     1000,
     2000,
+    # 5 seconds
     5000,
+    # 10 seconds
+    10000,
+    # 60 seconds
+    60000,
+    # 2min
+    120000,
+    # 5 min
+    300000,
+    # 10 min
+    600000,
 ]
 
 #: Name of deployment health check method implemented by user.