Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[#1464] improvement(spark): Improve the error log message for checkBlockSendResult #1465

Merged

Conversation

rickyma
Copy link
Contributor

@rickyma rickyma commented Jan 17, 2024

What changes were proposed in this pull request?

Improve the error log message for checkBlockSendResult.
As described in #1464, it will print out the shuffle server's IP and ports.

Why are the changes needed?

For #1464

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Manually.

@rickyma
Copy link
Contributor Author

rickyma commented Jan 17, 2024

PTAL @zuston @jerqi

@rickyma rickyma force-pushed the detailed-failed-log-for-sending-to-server branch from 119ca8b to 09a7633 Compare January 17, 2024 09:35
@rickyma rickyma changed the title [#1464] fix(client): Improve the error log message for checkBlockSendResult [#1464] improvement(client): Improve the error log message for checkBlockSendResult Jan 17, 2024
@rickyma rickyma force-pushed the detailed-failed-log-for-sending-to-server branch from 09a7633 to ecc1756 Compare January 17, 2024 09:42
@codecov-commenter
Copy link

codecov-commenter commented Jan 17, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Comparison is base (3ee1688) 54.15% compared to head (64cc170) 55.14%.

Additional details and impacted files
@@             Coverage Diff              @@
##             master    #1465      +/-   ##
============================================
+ Coverage     54.15%   55.14%   +0.99%     
- Complexity     2773     2774       +1     
============================================
  Files           423      403      -20     
  Lines         24204    21843    -2361     
  Branches       2061     2061              
============================================
- Hits          13107    12045    -1062     
+ Misses        10285     9057    -1228     
+ Partials        812      741      -71     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@rickyma rickyma force-pushed the detailed-failed-log-for-sending-to-server branch from ecc1756 to 758a1f1 Compare January 17, 2024 09:54
@rickyma rickyma force-pushed the detailed-failed-log-for-sending-to-server branch from 64cc170 to 7b3532b Compare January 17, 2024 12:41
Copy link
Contributor

@jerqi jerqi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thanks @rickyma

@zuston zuston changed the title [#1464] improvement(client): Improve the error log message for checkBlockSendResult [#1464] improvement(spark): Improve the error log message for checkBlockSendResult Jan 18, 2024
@zuston zuston merged commit 25d0585 into apache:master Jan 18, 2024
36 checks passed
@zuston
Copy link
Member

zuston commented Jan 18, 2024

Merged. Thanks @rickyma

jerqi pushed a commit that referenced this pull request Jan 22, 2024
…that blocks fail to send (#1473)

### What changes were proposed in this pull request?

The output of failed shuffle servers' result has not been successfully deduplicated.

### Why are the changes needed?

It's a followup PR for [#1465](#1465).

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

Existing UTs.
@rickyma rickyma deleted the detailed-failed-log-for-sending-to-server branch May 5, 2024 08:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants