[Backport 2.x] Optimize ML inference connection retry logic

[opensearch-trigger-bot]

Backport 4c119f0 from #1054

[junqiu-lei]

CI failed due to Randomness.get().nextLong(int,int) not avaliable in 2.x OpenSearch:

> Task :compileJava FAILED
/Users/junqiu/dev/neural-search/src/main/java/org/opensearch/neuralsearch/util/RetryUtil.java:62: error: method nextLong in class Random cannot be applied to given types;
        long jitter = Randomness.get().nextLong(10, 50); // Add jitter between 10ms and 50ms
                                      ^
  required: no arguments
  found:    int,int
  reason: actual and formal argument lists differ in length
Note: /Users/junqiu/dev/neural-search/src/main/java/org/opensearch/neuralsearch/processor/combination/ScoreCombinationUtil.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
1 error

Manually raised another backport PR #1059 to fix this issue for 2.x.