Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

find_files_and_readers read unneeded files #1099

Closed
mraspaud opened this issue Mar 2, 2020 · 4 comments
Closed

find_files_and_readers read unneeded files #1099

mraspaud opened this issue Mar 2, 2020 · 4 comments

Comments

@mraspaud
Copy link
Member

mraspaud commented Mar 2, 2020

you might need to indicate a time also in find_files_and_readers to load just one set of files at the time.

I found it better to separate my favorite files in another directory, instead of indicating the time range. Because find_files_and_readers seems to read all the files, whether or not being indicated in the time range.

Originally posted by @anikfal in #1087 (comment)

@anikfal
Copy link

anikfal commented Mar 2, 2020

I do not think if find_files_and_readers ignores start and end times. Rather, it cannot efficiently apply the time range.
For example, suppose we have 100 files and we want to plot only 4 of them. Instead of reading and plotting exactly those 4 files, find_files_and_readers takes considerable time to read (not plot) all of the 100 files for plotting those 4 specific files. Therefore, it wastes time in reading 96 extra files.

@mraspaud
Copy link
Member Author

mraspaud commented Mar 2, 2020

Thanks for the clarification.

@mraspaud mraspaud changed the title find_files_and_readers seems to ignore start and end times directives find_files_and_readers read unneeded files Mar 2, 2020
@anikfal
Copy link

anikfal commented Dec 31, 2021

I no longer see this problem in Satpy version 0.33.1. find_files_and_readers exactly reads only those files in the time range.

@djhoese djhoese closed this as completed Jan 2, 2022
@djhoese
Copy link
Member

djhoese commented Jan 2, 2022

Thanks for the update @anikfal!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants