Skip to content

Writing some Spark jobs to exercise the Spark APIs.

License

Notifications You must be signed in to change notification settings

jsoltren/spark-demos

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

7 Commits
 
 
 
 
 
 
 
 

Repository files navigation

spark-demos

Writing some Spark jobs to exercise the Spark APIs.

Some quick and dirty Spark jobs to verify that a Spark cluster is at least partially functional. Not intended to be an exhaustive test, many of these samples are unremarkable.

Sample usage:

$ sbt package
$ path/to/spark-submit \
    --class "org.soltren.spark.examples.ShuffleGroupCount" \
    --master local[4] \
    ./target/scala-2.11/spark-demos-by-jsoltren_2.11-0.1.jar

About

Writing some Spark jobs to exercise the Spark APIs.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages