Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support Azure Cloud Provider (via Stow) #4328

Merged
merged 1 commit into from
Nov 21, 2023

Conversation

cgrass
Copy link
Contributor

@cgrass cgrass commented Oct 30, 2023

Describe your changes

  1. Update configmap and helper to support Azure cloud storage.
  2. Update values with sample config and regen helm doc readme.

Check all the applicable boxes

  • [X ] I updated the documentation accordingly.
  • [X ] All new and existing tests passed.
  • [X ] All commits are signed-off.

Screenshots

Note to reviewers

This will allow users of the flyte-binary chart to configure Azure storage accounts. The stow version bump is needed in order to use Workload Identity.

This PR does not include an implementation of RemoteURLInterface, which would be required before using signed URLs in Azure. A potential fix is being discussed in slack and should not be difficult, but I'm not confident that support for signed URLs is required.

A storage key or workload identity needs to be configured for this to work end-to-end with task pods and azure blob storage via Stow. A workflow identity can be defined in the PodTemplate like this example, and the service can be deployed using a values.yaml similar to here. Should that configuration be documented in some other way?

@welcome
Copy link

welcome bot commented Oct 30, 2023

Thank you for opening this pull request! 🙌

These tips will help get your PR across the finish line:

  • Most of the repos have a PR template; if not, fill it out to the best of your knowledge.
  • Sign off your commits (Reference: DCO Guide).

Signed-off-by: Chris Grass <chris.grass@mcg.com>
@eapolinario eapolinario merged commit aff9750 into flyteorg:bump-stow-to-0.3.8 Nov 21, 2023
3 of 4 checks passed
Copy link

welcome bot commented Nov 21, 2023

Congrats on merging your first pull request! 🎉

EngHabu added a commit that referenced this pull request Nov 28, 2023
* Bump flyteorg/stow to 0.3.8

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

* Update configmap and helper to support azure storage (#4328)

* go mod tidy

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Update stow in flytestdlib

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

---------

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>
Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>
Co-authored-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>
Co-authored-by: cgrass <2934572+cgrass@users.noreply.github.com>
Co-authored-by: Haytham Abuelfutuh <haytham@afutuh.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants