Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Check Globus tokens and endpoints before creating tarballs #172

Closed
lukaszlacinski opened this issue Dec 13, 2021 · 4 comments
Closed

Check Globus tokens and endpoints before creating tarballs #172

lukaszlacinski opened this issue Dec 13, 2021 · 4 comments
Assignees
Labels
Globus Globus priority: high High priority task

Comments

@lukaszlacinski
Copy link
Contributor

lukaszlacinski commented Dec 13, 2021

Currently, zstash creates a tarball first, and then tries to transfer it to a Globus endpoint, if --hpss option is set to a Globus URL. It usually takes several minutes to create a default-size tarball, and then zstash exits if Globus endpoints are not activated. Zstash should check if --hpss points to a Globus URL and tries to get a Globus token and verify if Globus endpoints are activated before it starts creating tarballs.

@lukaszlacinski lukaszlacinski self-assigned this Dec 13, 2021
@lukaszlacinski lukaszlacinski changed the title Check Globus tokens and endpoints before creating tarball Check Globus tokens and endpoints before creating tarballs Dec 13, 2021
@golaz
Copy link
Collaborator

golaz commented Dec 13, 2021

This would be nice to have at some point, but we can live with what we have for now.

For new users, we should tell them to first do a small test transfer for the initial configuration to take place. For subsequent transfers, they should make sure to activate nodes first before starting zstash.

@forsyth2 : are you planning to update the documentation?

@forsyth2
Copy link
Collaborator

@forsyth2 : are you planning to update the documentation?

@golaz Do you mean for this issue? @lukaszlacinski included documentation updates in #154. If you want to include your suggestion for new users now, it would probably be best to include that in #154 too.

@golaz
Copy link
Collaborator

golaz commented Dec 13, 2021

I added a comment in https://github.com/E3SM-Project/zstash/pull/154/files#diff-66e28562c85a1bb96f431f2dd52bbabab914359e4b06f58eb1e18eadc01f5c06

@forsyth2 forsyth2 added the Globus Globus label Dec 13, 2021
@lukaszlacinski lukaszlacinski linked a pull request Jan 17, 2022 that will close this issue
@forsyth2 forsyth2 added the priority: high High priority task label Aug 29, 2022
@forsyth2
Copy link
Collaborator

forsyth2 commented Nov 8, 2022

Resolved by #185/#214.

@forsyth2 forsyth2 closed this as completed Nov 8, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Globus Globus priority: high High priority task
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants