Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

read_hipscat from the url path, have an option to cache the results on the local disc #340

Closed
nevencaplar opened this issue May 31, 2024 · 1 comment
Assignees
Labels
enhancement New feature or request

Comments

@nevencaplar
Copy link
Member

When read_hipscat from the url path, have an option to cache the results on the local disc. Check if the data is on the local disk and load from local disc (not url) if the data is locally avaliable.

@nevencaplar nevencaplar added the enhancement New feature or request label May 31, 2024
@camposandro camposandro self-assigned this Jun 13, 2024
@camposandro camposandro moved this to In Progress in HATS / LSDB Jun 13, 2024
@delucchi-cmu
Copy link
Contributor

This can be accomplished by constructing the fsspec using some specific caching arguments. This can be done with the implementation for astronomy-commons/hats#307, which will allow passing the constructed fsspec object, instead of simply the storage_options.

@github-project-automation github-project-automation bot moved this from In Progress to Done in HATS / LSDB Aug 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
Status: Done
Development

No branches or pull requests

3 participants