Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Replicate HostColumnVector.ColumnBuilder in plugin to enable host memory oom work #10519

Merged
merged 2 commits into from
Mar 1, 2024

Conversation

jbrennan333
Copy link
Contributor

To help enable work on host memory oom handling in GpuRowToColumnarIterator for feature #8887, this patch makes a copy of the HostColumnVector.ColumnBuilder class in the plugin and replaces plugin uses of ColumnBuilder with the new class RapidsHostColumnBuilder.

I am putting this up as a draft to get feedback and consider whether we want to put this change in, or hold off until the rest of the work on GpuRowToColumnarIterator is completed.

…ory oom work

Signed-off-by: Jim Brennan <jimb@nvidia.com>
@jbrennan333 jbrennan333 added feature request New feature or request reliability Features to improve reliability or bugs that severly impact the reliability of the plugin labels Feb 29, 2024
@jbrennan333 jbrennan333 self-assigned this Feb 29, 2024
@jbrennan333
Copy link
Contributor Author

build

@jbrennan333
Copy link
Contributor Author

build

@jbrennan333
Copy link
Contributor Author

RapidsHostColumnBuilder currently has copies of these cudf methods: BitVectorHelper.setNullAt and HostColumnVectorCore.convertDecimal128FromJavaToCudf.
If desired, I can make changes in cudf to make these accessible from the plugin.

@jlowe
Copy link
Contributor

jlowe commented Feb 29, 2024

pacakge-tests-scala213 (350,false) failure is unrelated, should be fixed by #10521.

@jbrennan333 jbrennan333 marked this pull request as ready for review March 1, 2024 16:32
@jbrennan333 jbrennan333 merged commit e3479a0 into NVIDIA:branch-24.04 Mar 1, 2024
39 of 41 checks passed
@sameerz sameerz removed the feature request New feature or request label Mar 3, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
reliability Features to improve reliability or bugs that severly impact the reliability of the plugin
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants