Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

GFSv16.1.5 - GSI update to include IASI Metop-C in operations #439

Closed
6 tasks done
KateFriedman-NOAA opened this issue Sep 7, 2021 · 20 comments
Closed
6 tasks done

GFSv16.1.5 - GSI update to include IASI Metop-C in operations #439

KateFriedman-NOAA opened this issue Sep 7, 2021 · 20 comments
Assignees
@KateFriedman-NOAA
Labels
production update Processing update in production

Comments

@KateFriedman-NOAA
Copy link
Member

KateFriedman-NOAA commented Sep 7, 2021 •
edited
Loading

Preparation for turning on CrIS NPP radiances and include IASI Metop-C in operational GFS system. Companion GSI issue #186.

New version: v16.1.5

  • Update new GSI tag in checkout: gfsda.v16.1.5
  • Add release notes for v16.1.5
  • Cut EMC-v16.1.5 tag for hand-off
  • GFSv16.1.5 implemented into operations
  • Test release branch against ops after implementation (sanity reproducibility check)
  • Merge release/gfs.v16.1.5 branch into operations branch
@KateFriedman-NOAA KateFriedman-NOAA added the production update Processing update in production label Sep 7, 2021
@KateFriedman-NOAA KateFriedman-NOAA self-assigned this Sep 7, 2021
@KateFriedman-NOAA
Copy link
Member Author

KateFriedman-NOAA commented Sep 7, 2021 •
edited
Loading

Created release branch for this work off of the operations branch: release/gfs.v16.1.5 [was release/gfsv16.1.4 at start of work]

Will sync branch with operations branch. Please update component tag versions as needed for this upgrade.

@KateFriedman-NOAA
Copy link
Member Author

Sync merged branch with operations branch after updating EMC_post repo name to UPP in operations branch. Committed to release branch at 82d537e.

@KateFriedman-NOAA KateFriedman-NOAA changed the title GFSv16.1.4 - GSI update to turn on CrIS NPP radiances and include IASI Metop-C in operations GFSv16.1.5 - GSI update to turn on CrIS NPP radiances and include IASI Metop-C in operations Sep 22, 2021
@KateFriedman-NOAA
Copy link
Member Author

The emergency change in ops this week became v16.1.3. Therefore, the prior v16.1.3 is going into ops as v16.1.4 next week and this change becomes v16.1.5. Will update the release branch name.

@lgannoaa
Copy link
Contributor

@KateFriedman-NOAA, I am in preparation for the v16iasicris2 parallel to switch to release/gfs.v16.1.5.
@HaixiaLiu-NOAA told us in an email on 9/24 that release/gfs.v16.1.5 should checkout release/gfsda.v16.1.5.
A check on this tag (release/gfs.v16.1.5), as of today (9/24 10:00a) it checkout git checkout gfsda.v16.1.1a.
Last commit was back in September 9th.

[Lin.Gan@m72z2 release_gfsv16.1.5]$ git branch -a
develop

  • release/gfs.v16.1.5
    remotes/origin/HEAD -> origin/develop
    [Lin.Gan@m72z2 release_gfsv16.1.5]$ git log
    commit 82d537e (HEAD -> release/gfs.v16.1.5, origin/release/gfs.v16.1.5, origin/operations)
    Author: Kate Friedman kate.friedman@noaa.gov
    Date: Thu Sep 9 11:52:37 2021 -0400

May I know when are you plan to have this tag ready?

KateFriedman-NOAA added a commit that referenced this issue Sep 24, 2021
@KateFriedman-NOAA
Update GSI tag to gfsda.v16.1.5
eabced1 
- GSI update to turn on CrIS NPP radiances and include IASI Metop-C in operations

Refs: #439
@KateFriedman-NOAA
Copy link
Member Author

@lgannoaa I have updated the GSI tag in the release/gfs.v16.1.5 branch to the new gfsda.v16.1.5 tag. Will add the release notes to the branch next.

@HaixiaLiu-NOAA HaixiaLiu-NOAA mentioned this issue Sep 24, 2021
Closed
9 tasks
@KateFriedman-NOAA
Copy link
Member Author

@lgannoaa Did you get approval to update the GLDAS package too? I don't remember where that was left off. The v1.13.0 package isn't mentioned in the release notes.

@lgannoaa
Copy link
Contributor

@RussTreadon-NOAA, @KateFriedman-NOAA
Let me take my comment out of this issue. The v16iasicris2 is NOT running with the gfs.v16.1.5 implementation tag. The different is locally modified GLDAS package and EMC verification package.

@RussTreadon-NOAA
Copy link
Contributor

The reason for using gldas_gfsv16_release.v1.13.0 in the v16iasicris2 has been explained in a separate email thread. The v16iasicris2 is using gldas_gfsv16_release.v1.13.0 because this tag contains logic in ush/gldas_forcing.sh that ensures the parallel uses the correct precipitation forcing file if it falls behind real time. The logic is an $RUN_ENVIR = "emc" block so this section of the script will not be executed in operations.

The v16iasicris2 is using verif_global_v2.3.0 whereas tag gfs.v16.1.5 checks out verif_global_v1.11.0. This was done for at least two reasons. Operational METplus stat files have moved onto a newer version. Plotting the v16iascris2 with operations requires v16iasicris2 METplus stat files be at a comparable version. The v16iascris2 monitoring page needs Fit2Obs and Scorecard plots. These are only generated by a newer version of verif-global.

Neither the newer gldas nor verif-global tags are from the DA team. Questions about the gldas tag should be directed to the land team. Questions about verif-global should be directed to the verification group.

GFS DA v16.1.5 does not require the newer gldas and verif-global tags. The v16iaiscris2 requires these changes to ensure that it runs correctly and that we have a full suite of monitoring and evaluation plots.

@lgannoaa
Copy link
Contributor

Thank you for your clarification, @RussTreadon-NOAA.

@KateFriedman-NOAA
Copy link
Member Author

@lgannoaa We'll be updating the GLDAS and verif-global packages during the transition to WCOSS2 so we won't have to make local modifications like we've done for much longer thankfully.

@KateFriedman-NOAA
Copy link
Member Author

Release notes provided by @HaixiaLiu-NOAA :

https://docs.google.com/document/d/19WSVMUh4hWS922isARpqgssZHpXKds-X8UaoJki9Fsc/edit

@KateFriedman-NOAA KateFriedman-NOAA changed the title GFSv16.1.5 - GSI update to turn on CrIS NPP radiances and include IASI Metop-C in operations GFSv16.1.5 - GSI update to include IASI Metop-C in operations Sep 29, 2021
@HaixiaLiu-NOAA
Copy link

@KateFriedman-NOAA Thank you for changing the title.

KateFriedman-NOAA added a commit that referenced this issue Sep 29, 2021
@KateFriedman-NOAA
Add release notes for v16.1.5
69795ea 
Refs: #439
KateFriedman-NOAA added a commit that referenced this issue Sep 30, 2021
@KateFriedman-NOAA
Merge operations v16.1.4 into release/gfs.v16.1.5
8e52726 
Refs: #439
@KateFriedman-NOAA
Copy link
Member Author

@HaixiaLiu-NOAA I just sync merged the operations branch update for v16.1.4 into the release/gfs.v16.1.5 branch. The main updates are to parm/config/config.anal and the addition of the release notes for v16.1.4. See the changes @ 8e52726

@HaixiaLiu-NOAA
Copy link

@KateFriedman-NOAA I looked at the change 8e52726 and noticed that all changes are to the gfsv16_historical fix files which will not affect the operation. The changes will affect retrospective runs.

@KateFriedman-NOAA
Copy link
Member Author

@HaixiaLiu-NOAA Yep, let me know if there are any similar config.anal updates needed for users running retrospective runs with the v16.1.5 updates. Thanks!

@KateFriedman-NOAA KateFriedman-NOAA pinned this issue Sep 30, 2021
@KateFriedman-NOAA
Copy link
Member Author

Cut hand-off tag EMC-v16.1.5.

KateFriedman-NOAA added a commit that referenced this issue Oct 18, 2021
@KateFriedman-NOAA
Add mpirun flag to prepend rank
b639ca0 
- added "-l" flag to mpirun command to prepend/insert the MPI process rank
at the beginning of all lines written to the standard output
- was tested in operations while investigating GFS ops failures
- include flag moving forward in operational system, starting with v16.1.5

Refs: #439
KateFriedman-NOAA added a commit that referenced this issue Oct 18, 2021
@KateFriedman-NOAA
Update release notes for v16.1.5 to include new CO2 fix files
fec53cb 
- new 2022 CO2 fix files are bundled with DA update
- new fix files do not impact model results
- update release notes to mention CO2 fix files

Refs: #439
KateFriedman-NOAA added a commit that referenced this issue Oct 18, 2021
@KateFriedman-NOAA
Adjust text for CO2 files in release notes
5d1fe62 
- move text in release notes for new 2022 CO2 fix files
to more appropriate section

Refs: #439
@KateFriedman-NOAA
Copy link
Member Author

Recut EMC-v16.1.5 tag @ 5d1fe62 after adding mpirun prepend rank flag and updating release notes for the 2022 CO2 fix file bundling.

KateFriedman-NOAA added a commit that referenced this issue Oct 19, 2021
@KateFriedman-NOAA
Final GFSv16.1.5 updates
0a5f1e9 
- release note updates to mention new FV3 model tag that now includes
traceback compilation flags by default
- update checkout to use new FV3 tag: GFS.v16.0.17

Refs: #439
@KateFriedman-NOAA
Copy link
Member Author

Recut EMC-v16.1.5 tag @ 0a5f1e9 after updating ufs-weather-model tag and updating the release notes to mention the new tag.

@KateFriedman-NOAA
Copy link
Member Author

From Oct 22nd 2021 RFC memo:

RFC 8823 - On WCOSS, update GFS to v16.1.5 which includes:
● Turn on the active assimilation of Metop-C IASI (Infrared Atmospheric
Sounding Interferometer) data with correlated observation errors
● Update correlated observation errors for Metop-B IASI, N20 CrIS
(Cross-track Infrared Sounder), and NPP CrIS
● Put in a minimum threshold for saturation specific humidity to avoid
potential minimization issues.
● Add the 2022 CO2 projection files.

To be implemented on October 26 at 1430Z.

From SDM log Oct 26th:

1s. 1431Z - SPA Simon Hsiao; Notification: RFC 8823 - WCOSS: Upgrade to GFS v16.1.5 for
GSI changes ... @ Tue Oct 26, 2021 10:30 - 15:30 (EDT),  Start to implement this RFC. 
1930Z - This RFC is completed.

ADCollard added a commit to ADCollard/global-workflow that referenced this issue Nov 3, 2021
@ADCollard
Update use of historical files in parm/config/config.anal
4fcc108 
Adding login in parm/config/config.anal reflecting the following
changes to observation use:
global_satinfo.txt.2020022012: Turn off MetOp-A MHS
global_satinfo.txt.2021052118: Turn off S-NPP CrIS
global_satinfo.txt.2021092206: Turn off Metop-A IASI
global_satinfo.txt.2021102612: Turn on MetOp-C IASI

Addresses issue NOAA-EMC#439
@ADCollard ADCollard mentioned this issue Nov 3, 2021
Merged
@KateFriedman-NOAA KateFriedman-NOAA mentioned this issue Nov 4, 2021
Merged
KateFriedman-NOAA added a commit that referenced this issue Nov 4, 2021
@KateFriedman-NOAA
Update v16.1.5 release notes for config.anal update
8d54b70 
- update the release notes to mention the change made to config.anal
- config.anal was updated to support correct global info files for
retrospective experiments

Refs: #439,#489
KateFriedman-NOAA added a commit that referenced this issue Nov 4, 2021
@KateFriedman-NOAA
GFSv16.1.5 - GSI update to include IASI Metop-C in operations (#439)
673368a 
RFC 8823 - On WCOSS, update GFS to v16.1.5 which includes:
* Turn on the active assimilation of Metop-C IASI (Infrared Atmospheric Sounding Interferometer) data with correlated observation errors
* Update correlated observation errors for Metop-B IASI, N20 CrIS (Cross-track Infrared Sounder), and NPP CrIS
* Put in a minimum threshold for saturation specific humidity to avoid potential minimization issues.
* Add the 2022 CO2 projection files.

Implemented on October 26 at 1430Z.
@KateFriedman-NOAA
Copy link
Member Author

Test against operations was successful and reproduced. Complete PR #489 and cut new tag/release NCO-v16.1.5. Thanks all!

@KateFriedman-NOAA KateFriedman-NOAA unpinned this issue Nov 4, 2021
KateFriedman-NOAA added a commit to KateFriedman-NOAA/global-workflow that referenced this issue Nov 30, 2021
@KateFriedman-NOAA
Sync merge with operations for GFSv16.1.5
98e5a1b 
- release note updates
- component versions in Externals.cfg updated
- WCOSS_DELL_P3 env update to add "-l" with mpirun
- config.anal updates for historical info file dates

Refs: NOAA-EMC#399

* origin/operations:
  GFSv16.1.5 - GSI update to include IASI Metop-C in operations (NOAA-EMC#439)
  GFSv16.1.4 - Operational Assimilation of Commercial GPS-RO in DO-3 (NOAA-EMC#451)
  Update GSI tag to gfsda.v16.1.3 (turn off IASI early) (NOAA-EMC#449)
  Update repository name for EMC_post component to UPP in operations branch (NOAA-EMC#442)
  Update repository name for EMC_post component to UPP in operations branch
lgannoaa pushed a commit to lgannoaa/global-workflow that referenced this issue Feb 9, 2022
@WenMeng-NOAA
Port UPP develop branch on wcoss2 (NOAA-EMC#439)
3cf3a37 
* Add changes for WCOSS2 Acorn.

* Add changes for Dogwood.

* Add changes for WCOSS2.

* Change modulefile on wcoss2 in LUA format based on Kate's comments.

* Add machine recognition for cactus and WCOSS1 P3.5 based on Eric's comments
zhanglikate pushed a commit to zhanglikate/global-workflow that referenced this issue Oct 6, 2022
@jiandewang
update MOM6 to GFDL 20210224 main branch commit (NOAA-EMC#439)
35d1897 
* pointing MOM6 to feature/update-MOM6-20210224 branch
modify mom6_files.cmake to reflect the files being added and removed in framework directory
* add MOM6_Extra_FORTRAN_FLAGS in CMakeLists.txt which is defined in configure_gaea.intel.cmake
* update RTPWD to 20210303
* remove datm_mx25_cfsr case on GAEA temporary
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@KateFriedman-NOAA KateFriedman-NOAA

Labels
production update Processing update in production
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@RussTreadon-NOAA @lgannoaa @KateFriedman-NOAA @HaixiaLiu-NOAA