Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
@lampajr and myself would like to propose this example. We hope this is interesting and useful! 👍 🚀
The goal and objectives of this example is listed in the README.md, included.
We have tested this using Kubeflow Pipelines 2.0.5 and KFP sdk 2.6.0.
Notes:
While building this example, we have noticed some limitations in the KF Pipelines/SDK as we were trying to make use of some of the KFP 2.x capabilities; we have found alternative ways and opted for those alternative in this example as it currently stand, but we believe these information could be helpful for the community, maybe could also be of support in prioritizing backlogs, etc.
Sharing our notes below:
In a tightened Enterprise environment, container don't run as root. We used alternative image for components. See also:
We couldn't use Artifacts due to permission errors. See also:
We couldn't use ParallelFor as mountPVC not supported. See also:
We coudln't use Collected for the downstream tasks due to error:
We had to force disable caching on each task due to permission errors. See also: