Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Research spill prefetch when a low priority task may raise in priority (retry framework) #7711

Open
Tracked by #8026
abellina opened this issue Feb 8, 2023 · 0 comments
Labels
reliability Features to improve reliability or bugs that severly impact the reliability of the plugin

Comments

@abellina
Copy link
Collaborator

abellina commented Feb 8, 2023

Related to #7710 and #7253

As threads up in priority and get more of the GPU, should we also move spilled buffers for such high priority thread(s) into GPU memory? The idea is to figure out whether we want some smart "prefetch" to occur.

I can see a number of issues with this since we do not know what pattern the high priority thread wants to follow with the spilled buffers. If we have cases where we always need N spilled buffers before we can call into cuDF then that seems somewhat reasonable, and so this issue could evolve into creating a batch unspill API.

Tracking this to check once things have settled a bit if there are cases where high priority tasks are stuck waiting or iterating back and forth with the spill framework.

@mattahrens mattahrens added the reliability Features to improve reliability or bugs that severly impact the reliability of the plugin label Oct 24, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
reliability Features to improve reliability or bugs that severly impact the reliability of the plugin
Projects
None yet
Development

No branches or pull requests

2 participants