Skip to content

Commit

Permalink
add docs for two configs
Browse files Browse the repository at this point in the history
  • Loading branch information
davies committed Sep 13, 2014
1 parent dadee1a commit 15d6f18
Showing 1 changed file with 17 additions and 0 deletions.
17 changes: 17 additions & 0 deletions docs/configuration.md
Original file line number Diff line number Diff line change
Expand Up @@ -206,6 +206,23 @@ Apart from these, the following properties are also available, and may be useful
used during aggregation goes above this amount, it will spill the data into disks.
</td>
</tr>
<tr>
<td><code>spark.python.profile</code></td>
<td>false</td>
<td>
Enable profiling in Python worker, the profile result will show up by `rdd.show_profile()`,
or it will show up before the driver exit. It also can be dumped into disk by
`rdd.dump_profile(path)`.
</td>
</tr>
<tr>
<td><code>spark.python.profile.dump</code></td>
<td>(none)</td>
<td>
The directory which is used to dump the profile result. The results will be dumped
as sepereted file for each RDD. They can be loaded by ptats.Stats().
</td>
</tr>
<tr>
<td><code>spark.executorEnv.[EnvironmentVariableName]</code></td>
<td>(none)</td>
Expand Down

0 comments on commit 15d6f18

Please sign in to comment.