-
Notifications
You must be signed in to change notification settings - Fork 5.5k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Async batch #60269
base: master
Are you sure you want to change the base?
Async batch #60269
Conversation
136bf98
to
7b44013
Compare
@vzhestkov Just a heads up, there are quite a few merge conflicts here. |
@garethgreenaway thanks for pinging, I'll resolve them once I get some time for it, will try to do it as soon as possible |
7b44013
to
3cb0d22
Compare
There are test failures |
@vzhestkov A few test failures here and some requested changes. |
We are close to tagging for the RC release for phosphorus. I would like to get this one in if the tests get fixed up |
Thanks for pinging. I'll try to fix all the suggestions today or tomorrow morning |
70c4853
to
e1e4b03
Compare
e1e4b03
to
a37729a
Compare
@twangboy thanks for pointing again, accidentally missed it. Fixed |
a37729a
to
2def713
Compare
Theres a few tests failing on multiple platforms that seem to be related. |
b34e6fe
to
a9884d8
Compare
edc0e9c
to
d351117
Compare
1609a7e
to
e6a4b8e
Compare
Co-authored-by: Mihai Dinca <dincamihai@gmail.com>
batch async: enhance trace logging batch async: do not block event handler additionally, only try to execute next batch once all previous minions has been processed somehow batch async: do not block current find_job execution batch async: just start batch if all minions returns the ping batch_async: ensure the start/done events are fired batch async: do not wait to finalize batch execution batch async: only trigger find job for current batch active minions Prevent traceback due missing 'send' method when socket was closed Modify some batch_async trace logs
e6a4b8e
to
f7414b0
Compare
What does this PR do?
Implementation of RFC#0002
#50546 port to
master
All related tests migrated to
pytest