[SPARK-19659] Fetch big blocks to disk when shuffle-read.#16989

Closed

jinxing64 wants to merge 6 commits intoapache:masterfrom jinxing64:SPARK-19659

+254-47

Commits on May 23, 2017

[SPARK-19659] Fetch big blocks to disk when shuffle-read.
jinxing
committed
Remove the MemoryConsumer logic and refine logic of deleting shuffle files.
jinxing
committed
Remove all files in cleanup(), which is already registered as TaskCompletionListener
jinxing
committed

Commits on May 24, 2017

Do not remove shuffle files when release()
jinxing
committed
Generate tmp files by createTempLocalBlock and refine some log info.
jinxing
committed

Commits on May 25, 2017

fix
jinxing
committed