Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Enable to read for the Q4 coverage and the IQTI files for the fci l1c data #2843

Merged
merged 22 commits into from
Jul 29, 2024

Conversation

ClementLaplace
Copy link
Contributor

@ClementLaplace ClementLaplace commented Jun 28, 2024

  • Add support for RSS imagery (Q4 coverage)
  • test support for RSS imagery (Q4 coverage)
  • Add support for IQTI files
  • Test for IQTI files

Copy link
Member

@ameraner ameraner left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi Clement, thanks for this! Below the first comments.

Another thing: I believe we can get rid of these lines as well

# TODO remove this check when old versions of IDPF test data (<v4) are deprecated.
if coord == "x" and coord_radian.attrs["scale_factor"] > 0:
coord_radian.attrs["scale_factor"] *= -1
# TODO remove this check when old versions of IDPF test data (<v5) are deprecated.
if type(coord_radian.attrs["scale_factor"]) is np.float32:
coord_radian.attrs["scale_factor"] = coord_radian.attrs["scale_factor"].astype("float64")
if type(coord_radian.attrs["add_offset"]) is np.float32:
coord_radian.attrs["add_offset"] = coord_radian.attrs["add_offset"].astype("float64")

With that, please kindly also cleanup the according tests and fixtures for the test class `TestFCIL1cNCReaderBadDataFromIDPF´ that is not needed anymore.

Copy link

codecov bot commented Jul 8, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 95.97%. Comparing base (2bd607a) to head (a5c5022).
Report is 545 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #2843      +/-   ##
==========================================
+ Coverage   95.78%   95.97%   +0.18%     
==========================================
  Files         366      368       +2     
  Lines       53521    53973     +452     
==========================================
+ Hits        51267    51801     +534     
+ Misses       2254     2172      -82     
Flag Coverage Δ
behaviourtests 4.02% <0.00%> (-0.03%) ⬇️
unittests 96.07% <100.00%> (+0.18%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@ClementLaplace ClementLaplace requested a review from ameraner July 8, 2024 09:29
@coveralls
Copy link

coveralls commented Jul 8, 2024

Pull Request Test Coverage Report for Build 10112077539

Warning: This coverage report may be inaccurate.

This pull request's base commit is no longer the HEAD commit of its target branch. This means it includes changes from outside the original pull request, including, potentially, unrelated coverage changes.

Details

  • 129 of 129 (100.0%) changed or added relevant lines in 2 files are covered.
  • 137 unchanged lines in 10 files lost coverage.
  • Overall coverage increased (+0.03%) to 96.073%

Files with Coverage Reduction New Missed Lines %
satpy/tests/reader_tests/gms/test_gms5_vissr_navigation.py 1 97.18%
satpy/enhancements/init.py 1 99.07%
satpy/tests/enhancement_tests/test_enhancements.py 2 99.44%
satpy/readers/hrit_jma.py 2 98.64%
satpy/tests/reader_tests/test_ami_l1b.py 3 98.17%
satpy/readers/ami_l1b.py 4 97.32%
satpy/tests/utils.py 10 93.16%
satpy/readers/olci_nc.py 13 94.4%
satpy/resample.py 49 88.74%
satpy/writers/awips_tiled.py 52 83.97%
Totals Coverage Status
Change from base Build 9702977764: 0.03%
Covered Lines: 52030
Relevant Lines: 54157

💛 - Coveralls

Copy link
Member

@ameraner ameraner left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the updates. However, I think some tests and modifications are still missing, please check the inline comments.

@ClementLaplace ClementLaplace requested a review from ameraner July 10, 2024 10:02
…riod_min, change for the AF data the name from erranuous_count_in_repeat_cycle to count_in_repeat_cycle
…ycle_rc_period_min and test_count_in_repeat_cycle_rc_period_min_AF
Copy link
Member

@ameraner ameraner left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for the revisions, looks good! Just a couple of comments and a new small request on the sun_earth_distance calculation.

@ClementLaplace ClementLaplace requested a review from ameraner July 15, 2024 09:52
Copy link
Member

@ameraner ameraner left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks again! Looks good, some minor comments plus a CodeScene issue to address.

Please also update the documentation parts in the .yaml and the python docstring, specifying that we now support RSS scanning mode as well, and data from both IDPF-I and IQT-I processing facilities.

@ClementLaplace ClementLaplace requested a review from ameraner July 18, 2024 17:38
…ing mode as well, and data from both IDPF-I and IQT-I processing facilities.
Copy link
Member

@ameraner ameraner left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you very much for all the work Clement! LGTM, just two minor docstring fixes I just committed.

@ameraner ameraner marked this pull request as ready for review July 19, 2024 16:14
@mraspaud mraspaud added enhancement code enhancements, features, improvements component:readers labels Jul 26, 2024
Copy link
Member

@mraspaud mraspaud left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just a couple of comments/suggestions, but looks good overall!

Copy link
Member

@mraspaud mraspaud left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@mraspaud mraspaud merged commit 7d294c7 into pytroll:main Jul 29, 2024
19 of 20 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
component:readers enhancement code enhancements, features, improvements
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants