Skip to content

bassamadnan/MapReduce

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

30 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

MapReduce

TODO:

  1. start the servers in go routines instead of main routine (done)
  2. implement map and reduce functions in pkg/utils.go (done)
  3. execute tasks on worker side (done)
  4. assign next after worker is finished with current task
  5. notify master of finished tasks after map (done)
  6. simulate failures
  7. handle failures for workers (done , not tested , point 6)
  8. change reduce function input from list of key value pair to key, list of value pair (involves changing how the mapper will send data) (done)
  9. debug kernel case (done)

Instructions to run

  1. At seperate terminals run the workers
go run cmd/worker/main.go -port 707(0/1/2/3/)
  1. Run the master
go run cmd/master/main.go
  1. To generate new test cases, run gen.py

About

Implementation of map reduce using gRPC in Go

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published