[SPARK-4874] [CORE] Collect record count metrics#4067

Closed

ksakellis wants to merge 11 commits intoapache:masterfrom ksakellis:kostas-spark-4874

+548-146

Commits on Feb 6, 2015

[SPARK-4874] [CORE] Collect record count metrics
Kostas Sakellis
committed
CR Feedback
Kostas Sakellis
committed
Removed the generic InterceptingIterator and repalced it with specific implementation
Kostas Sakellis
committed
Conforms to SPARK-3288
Kostas Sakellis
committed
Combined Bytes and # records into one column
Kostas Sakellis
committed
Merge AfterNextInterceptingIterator with InterruptableIterator to save a function call
Kostas Sakellis
committed
Removed AtomicLong in favour of using Long
Kostas Sakellis
committed
CR Feedback
Kostas Sakellis
committed
Renamed _recordsWritten in ShuffleWriteMetrics to be more consistent
Kostas Sakellis
committed
Add a comment and check to BlockObjectWriter so that it cannot be reopend.
Kostas Sakellis
committed
Changed 'Records Read' in shuffleReadMetrics json output to 'Total Records Read'
Kostas Sakellis
committed