[FEATURE] Support pending for ShuffleDataFlushEvent in DefaultFlushEventHandler #1460
Closed
2 of 3 tasks
Comments
zuston
added a commit
that referenced
this issue
Jan 18, 2024
…pport event retry into pending queue (#1461) ### What changes were proposed in this pull request? 1. Refactor DefaultFlushEventHandler to unify the logic of handling event 2. Fix incorrect some metrics 3. Support retry event into pending queue 4. Fix the incorrect inFlushQueueSize 5. Introduce the underlying executor queue metrics ### Why are the changes needed? Fix: #1459 #1460 ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? Existing UTs
zuston
added a commit
to zuston/incubator-uniffle
that referenced
this issue
May 27, 2024
…and support event retry into pending queue (apache#1461) ### What changes were proposed in this pull request? 1. Refactor DefaultFlushEventHandler to unify the logic of handling event 2. Fix incorrect some metrics 3. Support retry event into pending queue 4. Fix the incorrect inFlushQueueSize 5. Introduce the underlying executor queue metrics ### Why are the changes needed? Fix: apache#1459 apache#1460 ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? Existing UTs
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Code of Conduct
Search before asking
Describe the feature
Currently, the event will be discarded when flushing failure happens. This is not friendly for flushing to HDFS that is not stable.
I think this features should be supported after #1459 done
Motivation
No response
Describe the solution
No response
Additional context
No response
Are you willing to submit PR?
The text was updated successfully, but these errors were encountered: