Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-32575][CORE][TESTS] Bump up timeouts in BlockManagerDecommissionIntegrationSuite to reduce flakyness #29388

Closed
wants to merge 1 commit into from

Conversation

agrawaldevesh
Copy link
Contributor

@agrawaldevesh agrawaldevesh commented Aug 8, 2020

What changes were proposed in this pull request?

As reported by @HyukjinKwon, BlockManagerDecommissionIntegrationSuite test is apparently still flaky (even after #29226): #29226 (comment).

The new flakyness is because the executors are not launching in the 6 seconds time out I had given them when run under github checks.

Bumped up the timeouts.

Why are the changes needed?

To make this test not flaky so that it can give us high signal if decommissioning regresses.

Does this PR introduce any user-facing change?

No, unit test only check.

How was this patch tested?

No new tests. Just github and jenkins.

@SparkQA
Copy link

SparkQA commented Aug 8, 2020

Test build #127220 has finished for PR 29388 at commit f69da10.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@srowen
Copy link
Member

srowen commented Aug 8, 2020

Please fill out the description

@agrawaldevesh
Copy link
Contributor Author

Thanks @srowen.

cc: @HyukjinKwon and @holdenk ... this PR is ready for review but first it would be great if someone could whitelist it to run on jenkins.

@agrawaldevesh agrawaldevesh changed the title [WIP] more bm test hardening tweaking Bump up timeouts in BlockManagerDecommissionIntegrationSuite to reduce flakyness Aug 9, 2020
@holdenk
Copy link
Contributor

holdenk commented Aug 9, 2020

Jenkins add to white list

@holdenk
Copy link
Contributor

holdenk commented Aug 9, 2020

Jenkins ok to test

Copy link
Member

@dongjoon-hyun dongjoon-hyun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi, @agrawaldevesh .
Since you are one of the active contributor, it would be great if you file a JIRA and use it in the PR title. :)

@agrawaldevesh agrawaldevesh changed the title Bump up timeouts in BlockManagerDecommissionIntegrationSuite to reduce flakyness [SPARK-32575] Bump up timeouts in BlockManagerDecommissionIntegrationSuite to reduce flakyness Aug 10, 2020
@SparkQA
Copy link

SparkQA commented Aug 10, 2020

Test build #127245 has finished for PR 29388 at commit f69da10.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@dongjoon-hyun
Copy link
Member

I observed the failure here, too.

@dongjoon-hyun dongjoon-hyun changed the title [SPARK-32575] Bump up timeouts in BlockManagerDecommissionIntegrationSuite to reduce flakyness [SPARK-32575][CORE][TESTS] Bump up timeouts in BlockManagerDecommissionIntegrationSuite to reduce flakyness Aug 10, 2020
Copy link
Member

@dongjoon-hyun dongjoon-hyun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1, LGTM. Thank you, @agrawaldevesh .
Merged to master.

Copy link
Member

@HyukjinKwon HyukjinKwon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ah, late LGTM. Thanks

@holdenk
Copy link
Contributor

holdenk commented Aug 10, 2020

Thanks for taking care of this :)

holdenk pushed a commit to holdenk/spark that referenced this pull request Oct 27, 2020
…onIntegrationSuite to reduce flakyness

### What changes were proposed in this pull request?

As reported by HyukjinKwon, BlockManagerDecommissionIntegrationSuite test is apparently still flaky (even after apache#29226): apache#29226 (comment).

The new flakyness is because the executors are not launching in the 6 seconds time out I had given them when run under github checks.

Bumped up the timeouts.

### Why are the changes needed?

To make this test not flaky so that it can give us high signal if decommissioning regresses.

### Does this PR introduce _any_ user-facing change?

No, unit test only check.

### How was this patch tested?

No new tests. Just github and jenkins.

Closes apache#29388 from agrawaldevesh/more_bm_harden.

Authored-by: Devesh Agrawal <devesh.agrawal@gmail.com>
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

7 participants