Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] org.opensearch.backwards.MixedClusterClientYamlTestSuiteIT.test {p0=nodes.stats/20_response_filtering/Nodes Stats filtered using both includes and excludes filters} is flaky #10032

Closed
kotwanikunal opened this issue Sep 13, 2023 · 3 comments
Assignees
Labels
bug Something isn't working flaky-test Random test failure that succeeds on second run

Comments

@kotwanikunal
Copy link
Member

Describe the bug
org.opensearch.backwards.MixedClusterClientYamlTestSuiteIT.test {p0=nodes.stats/20_response_filtering/Nodes Stats filtered using both includes and excludes filters} is flaky

To Reproduce
REPRODUCE WITH: ./gradlew ':qa:mixed-cluster:v2.11.0#mixedClusterTest' --tests "org.opensearch.backwards.MixedClusterClientYamlTestSuiteIT" -Dtests.method="test {p0=nodes.stats/11_indices_metrics/Metric - blank}" -Dtests.seed=2F3DFE87E8073580 -Dtests.security.manager=true -Dtests.jvm.argline="-XX:TieredStopAtLevel=1 -XX:ReservedCodeCacheSize=64m" -Dtests.locale=zh-Hans-CN -Dtests.timezone=Asia/Tbilisi -Druntime.java=20

Expected behavior
Test to pass

Screenshots

java.lang.AssertionError: Failure at [nodes.stats/20_response_filtering:173]: field [nodes.$node_id.name] doesn't have a true value
Expected: not null
     but: was null

Host/Environment (please complete the following information):
Jenkins CI

Additional context

@kotwanikunal kotwanikunal added bug Something isn't working untriaged flaky-test Random test failure that succeeds on second run and removed untriaged labels Sep 13, 2023
@msfroh
Copy link
Collaborator

msfroh commented Sep 13, 2023

Taking a look -- not sure that this one is "flaky", since it seems to be failing pretty consistently. Checking to see if something legitimately broke.

@msfroh msfroh self-assigned this Sep 13, 2023
@msfroh
Copy link
Collaborator

msfroh commented Sep 13, 2023

May have been fixed by 91821c7 ?

@msfroh
Copy link
Collaborator

msfroh commented Sep 13, 2023

Yeah -- I tried to reproduce a bunch of times on my machine but wasn't able to.

I locally reverted 91821c7, and I was able to reproduce the failure on my second attempt.

I think we can safely say that 91821c7 fixed this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working flaky-test Random test failure that succeeds on second run
Projects
None yet
Development

No branches or pull requests

2 participants