Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-33132][WEBUI] Make formatBytes return 0.0 B for negative input instead of NaN #30030

Closed
wants to merge 1 commit into from
Closed

Conversation

echohlne
Copy link
Contributor

@echohlne echohlne commented Oct 13, 2020

What changes were proposed in this pull request?

when bytesRead metric was negative, formatBytes in ui.js should just return 0.0 B to avoid NaN Undefined result.

Why are the changes needed?

Strengthen the parameter validataion to improve metric display on Summary Metrics of Spark Stage UI.

Does this PR introduce any user-facing change?

No

How was this patch tested?

It's a small change, just manual test.

@maropu maropu changed the title [SPARK-33132] Fix The 'Shuffle Read Size / Records' field in Stage Summary metrics was shown as 'NaN Undefined' [SPARK-33132][WEBUI] Fix The 'Shuffle Read Size / Records' field in Stage Summary metrics was shown as 'NaN Undefined' Oct 13, 2020
@maropu
Copy link
Member

maropu commented Oct 13, 2020

cc: @sarutak @gengliangwang

@dongjoon-hyun dongjoon-hyun changed the title [SPARK-33132][WEBUI] Fix The 'Shuffle Read Size / Records' field in Stage Summary metrics was shown as 'NaN Undefined' [SPARK-33132][WEBUI] Make formatBytes return 0.0 B for negative input instead of NaN Oct 13, 2020
@dongjoon-hyun
Copy link
Member

+1, LGTM. Thank you for your first contribution, @akiyamaneko .

  • This is merged to master branch for Apache Spark 3.1.0.
  • I added you to the Apache Spark contributor group.
  • SPARK-33132 is assigned to you.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants