Skip to content

Commit

Permalink
Clear up a couple things
Browse files Browse the repository at this point in the history
  • Loading branch information
sryza committed Nov 10, 2014
1 parent 34d53de commit 37a1d19
Showing 1 changed file with 3 additions and 3 deletions.
6 changes: 3 additions & 3 deletions docs/configuration.md
Original file line number Diff line number Diff line change
Expand Up @@ -563,16 +563,16 @@ Apart from these, the following properties are also available, and may be useful
<td><code>spark.default.parallelism</code></td>
<td>
For distributed shuffle operations like <code>reduceByKey</code> and <code>join</code>, the
largest number of partitions in parent RDD. For operations like <code>parallelize</code> with
no parent RDDs, it depends on the cluster manager:
largest number of partitions in a parent RDD. For operations like <code>parallelize</code>
with no parent RDDs, it depends on the cluster manager:
<ul>
<li>Local mode: number of cores on the local machine</li>
<li>Mesos fine grained mode: 8</li>
<li>Others: total number of cores on all executor nodes or 2, whichever is larger</li>
</ul>
</td>
<td>
Default number of output partitions for operations like <code>join</code>,
Default number of partitions in RDDs returned by transformations like <code>join</code>,
<code>reduceByKey</code>, and <code>parallelize</code> when not set by user.
</td>
</tr>
Expand Down

0 comments on commit 37a1d19

Please sign in to comment.