Skip to content

dimensionblockchain/spark-notebooks

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

33 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

spark-notebooks

A collection of my work in Scala using spylon kernel in jupyter notebooks through anaconda on Ubuntu 20. I created a 4 core/default partitioned spark cluster w/ 14756MB RAM along with hive and yarn for resource manager. I created the cluster from scratch. I am using java 8/1.8 SE - Scala 2.11 - I have learned from Harish Masand's Big Data Courses on Udemy. He is a fantastic teacher. https://harishmasand.com/

I did this to not use spark-shell and have a better experience where I could work on on my Scala Spark projects.

I am using GitKraken for Git staging/push commits.

I will be adding to this with great frequency.

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published