Skip to content

Commit

Permalink
[SPARK-28699][Core] Disable using radix sort for ShuffleExchangeExec …
Browse files Browse the repository at this point in the history
…in repartition case
  • Loading branch information
xuanyuanking committed Aug 19, 2019
1 parent a5df5ff commit 1256c87
Showing 1 changed file with 2 additions and 2 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -242,7 +242,7 @@ object ShuffleExchangeExec {
}
// The comparator for comparing row hashcode, which should always be Integer.
val prefixComparator = PrefixComparators.LONG
val canUseRadixSort = SQLConf.get.enableRadixSort

// The prefix computer generates row hashcode as the prefix, so we may decrease the
// probability that the prefixes are equal when input rows choose column values from a
// limited range.
Expand All @@ -264,7 +264,7 @@ object ShuffleExchangeExec {
prefixComparator,
prefixComputer,
pageSize,
canUseRadixSort)
false /* canUseRadixSort */)
sorter.sort(iter.asInstanceOf[Iterator[UnsafeRow]])
}
} else {
Expand Down

0 comments on commit 1256c87

Please sign in to comment.