Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

K8S: label value sanitizer #719

Merged
merged 2 commits into from
Oct 8, 2021

Conversation

oavdeev
Copy link
Collaborator

@oavdeev oavdeev commented Sep 24, 2021

This PR includes #712 just because stacked PRs in Github are hard. Please just ignore the first commit when reviewing.

@oavdeev oavdeev changed the title K8s label sanitizer K8S: label sanitizer Sep 24, 2021
@oavdeev oavdeev changed the title K8S: label sanitizer K8S: label value sanitizer Sep 24, 2021
@oavdeev oavdeev force-pushed the k8s-label-sanitizer branch 2 times, most recently from 4a24016 to 6bc8f6a Compare October 2, 2021 01:16
@savingoyal
Copy link
Collaborator

Lgtm! One comment - can't the label sanitisation method and job name sanitisation method be collapsed into a single method?

@oavdeev
Copy link
Collaborator Author

oavdeev commented Oct 7, 2021

I thought about it but actually the format is slightly different so I kept them separate in the end

@oavdeev oavdeev force-pushed the k8s-label-sanitizer branch from 6bc8f6a to afad98c Compare October 8, 2021 00:14
@savingoyal savingoyal merged commit 8ab1336 into Netflix:kubernetes-pr Oct 8, 2021
savingoyal added a commit that referenced this pull request Oct 15, 2021
* Refactor @resources decorator

@resources decorator is shared by all compute related decorators -
@Batch, @lambda, @K8s, @titus. This patch moves it out of
batch_decorator.py so that other decorators can cleanly reference
it.

* Update __init__.py

* Refactor @Batch decorator

* more change

* more changes

* more changes

* @kubernetes

* Kubernetes

* More changes

* More changes

* more changes

* some more changes

* more changes

* add disk space

* Add todos

* some fixes

* add k8s testing context

* more changes

* some more changes

* minor fixups

* better error handling for evicted pods (#711)

* fixes for pod/job metadata race conditions (#704)

* K8S: label value sanitizer (#719)

* rename name_space to namespace for k8s plugin (#750)

* fix k8s attribute handling bug (#753)

* tweak k8s test resources (to run on kind) (#754)

* add k8s api retries (#756)

* update done marker

* Use linux binaries in @conda when run in k8s (#758)

Conda environment should pack linux python binary when run on MacOS
to avoid an error

metaflow_PlayListFlow_osx-64_179c56284704ca8e53622f848a3df27cdd1f4327/bin/python: cannot execute binary file: Exec format error

* fix comment

* fix merge conflict

* update char

Co-authored-by: Oleg Avdeev <oleg.v.avdeev@gmail.com>
Co-authored-by: Roman Kindruk <36699371+sappier@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants