Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix(controller): Tolerate resource quota conflict errors. Fixes #3217 #3721

Closed
wants to merge 6 commits into from

Conversation

alexec
Copy link
Contributor

@alexec alexec commented Aug 10, 2020

Checklist:

  • Either (a) I've created an enhancement proposal and discussed it with the community, (b) this is a bug fix, or (c) this is a chore.
  • The title of the PR is (a) conventional, (b) states what changed, and (c) suffixes the related issues number. E.g. "fix(controller): Updates such and such. Fixes #1234".
  • I've signed the CLA.
  • I have written unit and/or e2e tests for my change. PRs without these are unlikely to be merged.
  • My builds are green. Try syncing with master if they are not.
  • My organization is added to USERS.md.

Fixes #3217

@alexec alexec marked this pull request as ready for review August 10, 2020 23:43
@alexec alexec changed the title fix(controller): Tolerate resourcequota conflict errors. Fixes #3217 fix(controller): Tolerate resource quota conflict errors. Fixes #3217 Aug 10, 2020
@alexec alexec marked this pull request as draft August 12, 2020 18:48
@alexec
Copy link
Contributor Author

alexec commented Aug 12, 2020

Converting to draft pending request for testing from community.

@alexec
Copy link
Contributor Author

alexec commented Aug 14, 2020

build failed on Install Kustomize

@@ -2156,7 +2156,7 @@ func (woc *wfOperationCtx) executeScript(nodeName string, templateScope string,
}

func (woc *wfOperationCtx) checkForbiddenErrorAndResubmitAllowed(err error, nodeName string, tmpl *wfv1.Template) (*wfv1.NodeStatus, error) {
if (apierr.IsForbidden(err) || apierr.IsTooManyRequests(err)) && isResubmitAllowed(tmpl) {
if (apierr.IsForbidden(err) || apierr.IsTooManyRequests(err) || retry.IsResourceQuotaConflictErr(err)) && isResubmitAllowed(tmpl) {
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I feel like resubmitPendingPods should always be true

@alexec alexec closed this Aug 18, 2020
@alexec
Copy link
Contributor Author

alexec commented Aug 18, 2020

Merged into #3800.

@alexec alexec deleted the fix-3217 branch August 18, 2020 19:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
2 participants