Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-23197][DStreams] Increased timeouts to resolve flakiness #20371

Closed
wants to merge 1 commit into from

Conversation

tdas
Copy link
Contributor

@tdas tdas commented Jan 23, 2018

What changes were proposed in this pull request?

Increased timeout from 50 ms to 300 ms (50 ms was really too low).

How was this patch tested?

Multiple rounds of tests.

@tdas
Copy link
Contributor Author

tdas commented Jan 23, 2018

@sameeragarwal this PR should fix this flakiness.

@@ -105,13 +105,13 @@ class ReceiverSuite extends TestSuiteBase with TimeLimits with Serializable {
assert(executor.errors.head.eq(exception))

// Verify restarting actually stops and starts the receiver
receiver.restart("restarting", null, 100)
eventually(timeout(50 millis), interval(10 millis)) {
receiver.restart("restarting", null, 600)
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If these timeout bumps fix the flakiness, we should also consider enabling the "block generator throttling" test below (it was disabled via b69c4f9)

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yeah. lets fix one at a time.

@sameeragarwal
Copy link
Member

LGTM, pending jenkins. Thanks!

@SparkQA
Copy link

SparkQA commented Jan 24, 2018

Test build #4076 has finished for PR 20371 at commit 2446aa0.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@SparkQA
Copy link

SparkQA commented Jan 24, 2018

Test build #4074 has finished for PR 20371 at commit 2446aa0.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@SparkQA
Copy link

SparkQA commented Jan 24, 2018

Test build #4075 has finished for PR 20371 at commit 2446aa0.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@SparkQA
Copy link

SparkQA commented Jan 24, 2018

Test build #4072 has finished for PR 20371 at commit 2446aa0.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@SparkQA
Copy link

SparkQA commented Jan 24, 2018

Test build #4073 has finished for PR 20371 at commit 2446aa0.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@SparkQA
Copy link

SparkQA commented Jan 24, 2018

Test build #86550 has finished for PR 20371 at commit 2446aa0.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

asfgit pushed a commit that referenced this pull request Jan 24, 2018
## What changes were proposed in this pull request?

Increased timeout from 50 ms to 300 ms (50 ms was really too low).

## How was this patch tested?
Multiple rounds of tests.

Author: Tathagata Das <tathagata.das1565@gmail.com>

Closes #20371 from tdas/SPARK-23197.

(cherry picked from commit 15adcc8)
Signed-off-by: Tathagata Das <tathagata.das1565@gmail.com>
@asfgit asfgit closed this in 15adcc8 Jan 24, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants