Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Doc] Example setting up access for google cloud storage #1073

Closed
2 tasks done
yc2984 opened this issue May 9, 2023 · 5 comments
Closed
2 tasks done

[Doc] Example setting up access for google cloud storage #1073

yc2984 opened this issue May 9, 2023 · 5 comments
Assignees
Labels
enhancement New feature or request good-first-issue Good for newcomers help-wanted Extra attention is needed

Comments

@yc2984
Copy link

yc2984 commented May 9, 2023

Search before asking

  • I had searched in the issues and found no similar feature requirement.

Description

Original question: https://discuss.ray.io/t/ray-cluster-google-cloud-storage-access/10568

I'm deploying ray on GKE, I'd like to access google cloud storage from the ray cluster. What it the best practice for this?

Related to: Google cloud storage access from worker, however the content seems outdated, since it uses serviceAccounts in the config.

I see in this PR serviceAccounts field is deprecated in helm chart values? #969

Also the new serviceAccountName is a Kubernetes service account and here it’s a service account in google cloud.

Is there an example for this using helm chart? I see in the helm template there is only serviceAccountName, but noserviceAccounts.

Use case

I'm deploying ray on GKE, I'd like to access google cloud storage from the ray cluster.

Related issues

#969

https://discuss.ray.io/t/ray-cluster-google-cloud-storage-access/10568

https://discuss.ray.io/t/google-cloud-storage-access-from-worker/1899

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!
@yc2984 yc2984 added the enhancement New feature or request label May 9, 2023
@kevin85421 kevin85421 added good-first-issue Good for newcomers help-wanted Extra attention is needed labels May 12, 2023
@kevin85421
Copy link
Member

@kevin85421 kevin85421 changed the title Example setting up access for google cloud storage [Doc] Example setting up access for google cloud storage May 24, 2023
@yc2984
Copy link
Author

yc2984 commented Jun 8, 2023

One way to do this is to use workload-identity, can be set up following the guide below. The service account name in the helm chart field is the kubernetes service account that can impersonate the google service account.
https://cloud.google.com/kubernetes-engine/docs/how-to/workload-identity

@yc2984
Copy link
Author

yc2984 commented Jun 8, 2023

@kevin85421 I can also help contribute to the documentation on this topic if needed :)

@kevin85421
Copy link
Member

This is very helpful! I reached out to the Google GKE team last week to contribute to the documentation. I guess that this issue is not currently prioritized. Hence, welcome to open the PR!

@kevin85421
Copy link
Member

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request good-first-issue Good for newcomers help-wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

2 participants