Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[native] Fix peakNodeTotalMemoryReservationInBytes report in TaskStatus #22432

Merged
merged 1 commit into from
Apr 6, 2024

Conversation

xiaoxmeng
Copy link
Contributor

@xiaoxmeng xiaoxmeng commented Apr 5, 2024

Currently peakNodeTotalMemoryReservationInBytes is set to query task's peak memory reservation
which should be the query pool's peak memory reservation

@xiaoxmeng xiaoxmeng requested a review from a team as a code owner April 5, 2024 22:02
@xiaoxmeng xiaoxmeng changed the title Fix the peak node usage report in TaskStatus Fix peakNodeTotalMemoryReservationInBytes report in TaskStatus Apr 5, 2024
@xiaoxmeng xiaoxmeng changed the title Fix peakNodeTotalMemoryReservationInBytes report in TaskStatus [native] Fix peakNodeTotalMemoryReservationInBytes report in TaskStatus Apr 5, 2024
mbasmanova
mbasmanova previously approved these changes Apr 5, 2024
Copy link
Contributor

@mbasmanova mbasmanova left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks.

info.taskStatus.systemMemoryReservationInBytes = 0;
info.taskStatus.peakNodeTotalMemoryReservationInBytes =
veloxMemStats.peakBytes;
task->queryCtx()->pool()->peakBytes();
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Perhaps, add a comment to explain that a given worker may run multiple tasks from the same query. peakNodeTotalMemoryReservationInBytes represents peak memory usage across all these tasks.

Currently peakNodeTotalMemoryReservationInBytes is set to query task's peak memory reservation
which should be the query pool's peak memory reservation
@tanjialiang
Copy link
Contributor

Thanks for fixing it

@xiaoxmeng xiaoxmeng merged commit e66597f into prestodb:master Apr 6, 2024
58 of 59 checks passed
@xiaoxmeng xiaoxmeng deleted the task branch April 6, 2024 00:35
@wanglinsong wanglinsong mentioned this pull request May 1, 2024
48 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants