-
Notifications
You must be signed in to change notification settings - Fork 1.7k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Persist pod logs after they finish #93
Comments
close #439? |
Seems like Argo has an option to archive logs after the pod is done. @gaoning777 @Ark-kun can you guys take a look to see if this is easy to add in the compiler? |
It looks like a simple flag in the template spec And given the comment here, it will be overridden by the output artifact spec, which already exist |
Resolving in favor of #844 |
* Annotations need to be in metadata; this was preventing the static ip from being properly assigned. * Delete the prow env since we no longer use it. * Recreate the kubeflow-ci environment since the ip address changed. * Fix kubeflow#92
* add volumeop support workaround * add volumesnapshot workaround * update resourceop integration * add sorting to avoid randomness * fix bug * update sample * minor code cleanup
This is needed so that pods can be garbage collected after they've finished, and to remove the dependency on the cluster state.
Currently, we're already seeing issues when a cluster is resized where the frontend can't find pods started by some of the runs.
The text was updated successfully, but these errors were encountered: