-
Notifications
You must be signed in to change notification settings - Fork 28.5k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
SPARK-3639 | Removed settings master in examples #2536
SPARK-3639 | Removed settings master in examples #2536
Conversation
This patch removes setting of master as local in Kinesis examples so that users can set it using submit-job.
Can one of the admins verify this patch? |
/* Setup the and SparkConfig and StreamingContext */ | ||
/* Spark Streaming batch interval */ | ||
val batchInterval = Milliseconds(2000) | ||
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can you remove random new lines here?
ok to test. If tests pass this LGTM. |
QA tests have started for PR 2536 at commit
|
QA tests have finished for PR 2536 at commit
|
Test PASSed. |
This patch removes setting of master as local in Kinesis examples so that users can set it using submit-job.
…nto Kinesis-Examples-Master-Unset Conflicts: extras/kinesis-asl/src/main/java/org/apache/spark/examples/streaming/JavaKinesisWordCountASL.java extras/kinesis-asl/src/main/scala/org/apache/spark/examples/streaming/KinesisWordCountASL.scala
QA tests have started for PR 2536 at commit
|
@andrewor14 thanks for reviewing this. All review comments have been incorporated. Please review once again. |
QA tests have finished for PR 2536 at commit
|
Test PASSed. |
Ok I'm merging this into master and 1.1. Thanks. |
This patch removes setting of master as local in Kinesis examples so that users can set it using submit-job. Author: aniketbhatnagar <aniket.bhatnagar@gmail.com> Closes #2536 from aniketbhatnagar/Kinesis-Examples-Master-Unset and squashes the following commits: c9723ac [aniketbhatnagar] Merge remote-tracking branch 'origin/Kinesis-Examples-Master-Unset' into Kinesis-Examples-Master-Unset fec8ead [aniketbhatnagar] SPARK-3639 | Removed settings master in examples 31cdc59 [aniketbhatnagar] SPARK-3639 | Removed settings master in examples (cherry picked from commit d16e161) Signed-off-by: Andrew Or <andrewor14@gmail.com>
This patch removes setting of master as local in Kinesis examples so that users can set it using submit-job.