CS 511: Project 1 HDFS/Spark

Please refer to the instructions at https://ddkang.github.io/teaching/2024-spring/p1.

To get started, spin up the cluster.

bash start-all.sh

Test HDFS deployment.

bash test_hdfs.sh

Test Spark deployment.

bash test_spark.sh