Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow aggregate window transformation to operate with multiple predecessors #4814

Closed
jsternberg opened this issue May 31, 2022 · 1 comment
Closed
Assignees

Comments

@jsternberg
Copy link
Contributor

The aggregate window transformation currently only allows one predecessor. It will take an input table chunk, compute an internal state for that table chunk, merge it with an existing state (if one exists), and then it will compute a final output when all of the inputs have been consumed.

We want to modify the transformation so it is able to do this with multiple predecessors and to then allow itself to be used with a parallelization factor so it can aggregate chunks from its parent concurrently.

DOD:

  • Aggregate window can take inputs from multiple predecessor datasets and then merge them.
  • It exposes planner attributes that identify it as a merge node.
@jsternberg jsternberg self-assigned this Jun 2, 2022
@jsternberg
Copy link
Contributor Author

Fixed by #4851.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant