You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
We know that hash partitioning is faster than sorting. In GpuHashAggregate if the intermediate values get to be too large we end up sorting the intermediate results and then doing a final pass to output the answer.
In many cases it might be good to have a heuristic in place that sees if the output got smaller so we can decide if we do #7404 instead. But in the cases when we see the output is getting a lot smaller than the input or if it is not a partial aggregate, we probably should look at doing hash partitioning of the intermediate results instead of sorting the result.
The text was updated successfully, but these errors were encountered:
Is your feature request related to a problem? Please describe.
We know that hash partitioning is faster than sorting. In GpuHashAggregate if the intermediate values get to be too large we end up sorting the intermediate results and then doing a final pass to output the answer.
In many cases it might be good to have a heuristic in place that sees if the output got smaller so we can decide if we do #7404 instead. But in the cases when we see the output is getting a lot smaller than the input or if it is not a partial aggregate, we probably should look at doing hash partitioning of the intermediate results instead of sorting the result.
The text was updated successfully, but these errors were encountered: