Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Async batch #60269

Open
wants to merge 10 commits into
base: master
Choose a base branch
from
Open

Async batch #60269

wants to merge 10 commits into from

Conversation

vzhestkov
Copy link
Contributor

What does this PR do?

Implementation of RFC#0002

#50546 port to master

All related tests migrated to pytest

@vzhestkov vzhestkov requested a review from a team as a code owner May 28, 2021 06:32
@vzhestkov vzhestkov requested review from twangboy and removed request for a team May 28, 2021 06:32
@garethgreenaway
Copy link
Contributor

@vzhestkov Just a heads up, there are quite a few merge conflicts here.

@vzhestkov
Copy link
Contributor Author

@garethgreenaway thanks for pinging, I'll resolve them once I get some time for it, will try to do it as soon as possible

@garethgreenaway garethgreenaway added the Phosphorus v3005.0 Release code name and version label Apr 20, 2022
@Ch3LL
Copy link
Contributor

Ch3LL commented May 20, 2022

There are test failures

@garethgreenaway
Copy link
Contributor

@vzhestkov A few test failures here and some requested changes.

@Ch3LL
Copy link
Contributor

Ch3LL commented Jun 9, 2022

We are close to tagging for the RC release for phosphorus. I would like to get this one in if the tests get fixed up

@vzhestkov
Copy link
Contributor Author

Thanks for pinging. I'll try to fix all the suggestions today or tomorrow morning

@vzhestkov vzhestkov force-pushed the batch-async-impl branch 9 times, most recently from 70c4853 to e1e4b03 Compare June 10, 2022 14:32
@vzhestkov
Copy link
Contributor Author

@twangboy thanks for pointing again, accidentally missed it. Fixed

twangboy
twangboy previously approved these changes Jun 14, 2022
@Ch3LL
Copy link
Contributor

Ch3LL commented Jun 16, 2022

Theres a few tests failing on multiple platforms that seem to be related.

meaksh added a commit to meaksh/salt that referenced this pull request Nov 12, 2024
@vzhestkov vzhestkov requested a review from a team as a code owner January 21, 2025 10:10
@vzhestkov vzhestkov force-pushed the batch-async-impl branch 2 times, most recently from 1609a7e to e6a4b8e Compare January 21, 2025 10:54
vzhestkov and others added 10 commits January 21, 2025 12:16
Co-authored-by: Mihai Dinca <dincamihai@gmail.com>
batch async: enhance trace logging

batch async: do not block event handler

additionally, only try to execute next batch once all previous minions
has been processed somehow

batch async: do not block current find_job execution

batch async: just start batch if all minions returns the ping

batch_async: ensure the start/done events are fired

batch async: do not wait to finalize batch execution

batch async: only trigger find job for current batch active minions

Prevent traceback due missing 'send' method when socket was closed

Modify some batch_async trace logs
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
test:full Run the full test suite
Projects
None yet
Development

Successfully merging this pull request may close these issues.

9 participants