Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

helm-chart: fix missing PDB config maxUnavailable, and default to 1 #1418

Merged
merged 2 commits into from
Oct 11, 2021

Conversation

consideRatio
Copy link
Member

@consideRatio consideRatio commented Oct 10, 2021

PDBs are tricky resources resource that can make things lock stuck in some situations unless we are careful. If we for example have one single replica and have minAvailable: 1 then automated k8s node upgrades will fail until someone manually deletes the pod on the old node bing removed.

PDBs can block automated maintenance in a k8s cluster and shouldn't do that unless explicitly configured to do so I'd say. But it should help ensure that if you have two replicas running, both shouldn't be removed at the same time. To do that, one can either use minAvailable: 1 or maxUnavailable: 1. Using maxUnavailable: 1 can work well with both one or two replicas of a pod, while minAvailable: 1 can only work well with two replicas.

This PR makes us use maxUnavailable: 1 instead of minAvailable: 1. It also fixes a bug that made the helm chart config pdb.maxUnavailable be ignored.


I suspect this PR can cause upgrade issues, and it would be great to have an upgrade test of the Helm chart as well. This is represented by #1195. EDIT: rebased and we have now tested this to be upgradable without issues.

@consideRatio consideRatio added bug maintenance Under the hood improvements and fixes labels Oct 10, 2021
@consideRatio consideRatio mentioned this pull request Oct 10, 2021
23 tasks
@consideRatio consideRatio changed the title helm-chart: fix missing config maxUnavailable, and default to 1 helm-chart: fix missing PDB config maxUnavailable, and default to 1 Oct 10, 2021
@minrk minrk merged commit 674e79b into jupyterhub:master Oct 11, 2021
consideRatio pushed a commit to jupyterhub/helm-chart that referenced this pull request Oct 11, 2021
jupyterhub/binderhub#1418 Merge pull request #1418 from consideRatio/pr/fix-pdb-failure
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug maintenance Under the hood improvements and fixes
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants