[Backport 2.x] Add request tracing framework (#7648)

[suranjay]

Backport below changes,

• Add request tracing framework

• Introduce ThreadContextStatePropagator to propagate request and transient headers within ThreadContext

Cherry-picked commit: 03bc192

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/18670/
• CommitID: d62c268
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/18678/
• CommitID: d62c268
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/18682/
• CommitID: d62c268
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/18910/
• CommitID: 45ddf38
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/18913/
• CommitID: bb3b861
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/18915/
• CommitID: 45ddf38
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/18916/
• CommitID: 45ddf38
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/18914/
• CommitID: 23a32ac
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/18987/
• CommitID: 23a32ac
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: UNSTABLE ❕
• TEST FAILURES:

      1 org.opensearch.search.SearchWeightedRoutingIT.testStrictWeightedRoutingWithCustomString
      1 org.opensearch.remotestore.SegmentReplicationUsingRemoteStoreIT.testDropPrimaryDuringReplication

• URL: https://build.ci.opensearch.org/job/gradle-check/19024/
• CommitID: dba020b
  Please review all flaky tests that succeeded after retry and create an issue if one does not already exist to track the flaky failure.

[codecov]

Codecov Report

Merging #8343 (dba020b) into 2.x (3fdc5b7) will decrease coverage by 0.02%.
The diff coverage is 77.25%.

@@             Coverage Diff              @@
##                2.x    #8343      +/-   ##
============================================
- Coverage     70.68%   70.66%   -0.02%     
- Complexity    56969    57049      +80     
============================================
  Files          4717     4736      +19     
  Lines        269776   270042     +266     
  Branches      39886    39900      +14     
============================================
+ Hits         190686   190837     +151     
- Misses        62717    62802      +85     
- Partials      16373    16403      +30     

Impacted Files	Coverage Δ
...rg/opensearch/telemetry/tracing/SpanReference.java	0.00% <0.00%> (ø)
...pensearch/common/settings/FeatureFlagSettings.java	50.00% <ø> (ø)
...racing/ThreadContextBasedTracerContextStorage.java	16.66% <16.66%> (ø)
.../opensearch/telemetry/tracing/noop/NoopTracer.java	25.00% <25.00%> (ø)
server/src/main/java/org/opensearch/node/Node.java	85.08% <27.27%> (-0.89%)	⬇️
...pensearch/telemetry/tracing/NoopTracerFactory.java	50.00% <50.00%> (ø)
...elemetry/tracing/OTelTracingContextPropagator.java	75.00% <75.00%> (ø)
...va/org/opensearch/telemetry/TelemetrySettings.java	75.00% <75.00%> (ø)
...search/telemetry/tracing/OTelTracingTelemetry.java	82.35% <82.35%> (ø)
...rg/opensearch/telemetry/tracing/OTelTelemetry.java	83.33% <83.33%> (ø)
... and 14 more

... and 482 files with indirect coverage changes