[BUG] org.opensearch.search.pipeline.common.SearchPipelineCommonYamlTestSuiteIT.test {yaml=search_pipeline/50_script_processor/Test supported search source builder fields} is flaky

[reta]

Describe the bug
org.opensearch.search.pipeline.common.SearchPipelineCommonYamlTestSuiteIT.test {yaml=search_pipeline/50_script_processor/Test supported search source builder fields} is flaky:

java.lang.AssertionError: Failure at [search_pipeline/50_script_processor:86]: _shards.total didn't match expected value:
                 _shards.total: expected Integer [1] but was Integer [2]

To Reproduce

./gradlew ':modules:search-pipeline-common:yamlRestTest' --tests "org.opensearch.search.pipeline.common.SearchPipelineCommonYamlTestSuiteIT.test {yaml=search_pipeline/50_script_processor/Test supported search source builder fields}" -Dtests.seed=AB70D7E6202B781B

See please:

https://build.ci.opensearch.org/job/gradle-check/16134/testReport/junit/org.opensearch.search.pipeline.common/SearchPipelineCommonYamlTestSuiteIT/test__yaml_search_pipeline_50_script_processor_Test_supported_search_source_builder_fields_/

Expected behavior
Test must pass reliably

Plugins
Standard

Screenshots
If applicable, add screenshots to help explain your problem.

Host/Environment (please complete the following information):

• CI

Additional context
Observed on 2.x branch so far

[reta]

@noCharger could you please take a look, seems to be caused by #7607, thank you

[noCharger]

PS C:\Users\louis\louis-dev\OpenSearch-Louis> ./gradlew ':modules:search-pipeline-common:yamlRestTest' --tests "org.opensearch.search.pipeline.common.SearchPipelineCommonYamlTestSuiteIT.test {yaml=search_pipeline/50_script_processor/Test supported search source builder fields}"                              

> Configure project :plugins:repository-hdfs
hdfsFixture unsupported, please set HADOOP_HOME and put HADOOP_HOME\bin in PATH
=======================================
OpenSearch Build Hamster says Hello!
  Gradle Version        : 8.1.1
  OS Info               : Windows 11 10.0 (amd64)
  JDK Version           : 17 (Eclipse Temurin JDK)
  JAVA_HOME             : C:\Program Files\Eclipse Adoptium\jdk-17.0.6.10-hotspot
  Random Testing Seed   : 43F0DAF9B5108C5F
  In FIPS 140 mode      : false
=======================================

> Task :modules:search-pipeline-common:yamlRestTest
WARNING: A terminally deprecated method in java.lang.System has been called
WARNING: System::setSecurityManager has been called by org.opensearch.bootstrap.BootstrapForTesting (file:/C:/Users/louis/louis-dev/OpenSearch-Louis/test/framework/build/distributions/framework-3.0.0-SNAPSHOT.jar)
WARNING: Please consider reporting this to the maintainers of org.opensearch.bootstrap.BootstrapForTesting
WARNING: System::setSecurityManager will be removed in a future release
WARNING: A terminally deprecated method in java.lang.System has been called
WARNING: System::setSecurityManager has been called by org.gradle.api.internal.tasks.testing.worker.TestWorker (file:/C:/Users/louis/.gradle/wrapper/dists/gradle-8.1.1-all/bs1rrjki8hh9bujwbsqnxtuzr/gradle-8.1.1/lib/plugins/gradle-testing-base-8.1.1.jar)
WARNING: Please consider reporting this to the maintainers of org.gradle.api.internal.tasks.testing.worker.TestWorker
WARNING: System::setSecurityManager will be removed in a future release

BUILD SUCCESSFUL in 32s
172 actionable tasks: 4 executed, 168 up-to-date

Can't really reproduce it on my local. But to unblock gradle check, will remove these match conditions