Skip to content

Commit

Permalink
simplify now that SPARK-16106 is in
Browse files Browse the repository at this point in the history
  • Loading branch information
squito committed Jun 28, 2016
1 parent 860ee1a commit 60cd959
Showing 1 changed file with 1 addition and 4 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -613,10 +613,7 @@ private[spark] class TaskSetManager(

// If no executors have registered yet, don't abort the stage, just wait. We probably
// got here because a task set was added before the executors registered.
// Workaround for SPARK-16106: just checking executorsByHost.nonEmpty should be enough, but
// because of that issue we can end up with hosts with no executors.
val numExecs = executorsByHost.values.map{_.size}.sum
if (numExecs > 0) {
if (executorsByHost.nonEmpty) {
// take any task that needs to be scheduled, and see if we can find some executor it *could*
// run on
pendingTask.foreach { taskId =>
Expand Down

0 comments on commit 60cd959

Please sign in to comment.