Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

First version of Release Note for WAFS.v7.0.0 #55

Merged
merged 7 commits into from
Sep 17, 2024
Merged

First version of Release Note for WAFS.v7.0.0 #55

Changes from 1 commit
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
f551162
First version of Release Note for WAFS.v7.0.0
Sep 16, 2024
f694a73
Update docs/Release_Notes.md
YaliMao-NOAA Sep 16, 2024
b2fef57
Update docs/Release_Notes.md
YaliMao-NOAA Sep 16, 2024
bad17a6
Update docs/Release_Notes.md
YaliMao-NOAA Sep 16, 2024
f385915
Modified Release Notes from feedback from Rahual and Huiya
Sep 17, 2024
fe17720
Adjust a table in Release Notes
Sep 17, 2024
9254b7c
Update Release Notes according to the WAFS separation kickout slides
Sep 17, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
115 changes: 106 additions & 9 deletions docs/Release_Notes.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ WAFS v7.0.0 RELEASE NOTES
Prelude
-------

This implementation is a separation of the WAFS component from the GFS application.
This implementation is a separation of the WAFS component from the GFSv16 application, no science change.

Implementation Instructions
---------------------------
Expand All @@ -18,6 +18,12 @@ git clone --recursive -b wafs.v7.0.0 https://github.com/noaa-emc/wafs wafs.v7.0.
cd wafs.v7.0.0
```

The checkout procedure extracts the following WAFS components, while GTG is a subcomponent of UPP.:
| Component | Tag | POC |
| --------- | -------------------- | ----------------- |
| UPP | upp_wafs_v7.0.0 | Wen.Meng@noaa.gov |
| GTG | ncep_post_gtg.v2.1.0 | Yali.Mao@noaa.gov |

To build all the WAFS components, execute:
```bash
./sorc/build_all.sh
Expand All @@ -31,60 +37,151 @@ Lastly, link the `ecflow` scripts by executing:

Version File Changes
--------------------
New files: build.ver and run.ver


Sorc Changes
------------

No change from GFSv16

Job Changes
------------
-----------
Filename changes according to EE2 standards:
| wafs.v7 | GFSv16
| ------------------------- | ----------------------------------------------------|
| JWAFS_GCIP |<- JGFS_ATMOS_WAFS_GCIP |
| JWAFS_GRIB |<- JGFS_ATMOS_WAFS |
| JWAFS_GRIB2_0P25 |<- JGFS_ATMOS_WAFS_GRIB2_0P25 |
| JWAFS_GRIB2_0P25_BLENDING |<- JGFS_ATMOS_WAFS_BLENDING_0P25 |
| JWAFS_GRIB2_1P25 |<- JGFS_ATMOS_WAFS_GRIB2 |
| JWAFS_GFS_MANAGER (new) | JGFS_ATMOS_WAFS_BLENDING (removed after cleaning up) |
| JWAFS_UPP (new) | |


Parm Changes
------------

1. Remove parm/wafs/legend
2. parm/upp is created after system building. Per AWC request, WAFS UPP control files add 4 low levels for icing and 1 upper lower for turbulence:
- postxconfig-NT-GFS-WAFS.txt
- postcntrl_gfs_wafs.xml

Script Changes
--------------
First of all, filename changes according to EE2 standards:
| wafs.v7 | GFSv16
| ----------------------------- | ---------------------------------------------------------|
| exwafs_gcip.sh |<- exgfs_atmos_wafs_gcip.sh |
| exwafs_grib2_0p25_blending.sh |<- exgfs_atmos_wafs_blending_0p25.sh |
| exwafs_grib2_0p25.sh |<- exgfs_atmos_wafs_grib2_0p25.sh |
| exwafs_grib2_1p25.sh |<- exgfs_atmos_wafs_grib2.sh |
| exwafs_grib.sh |<- exgfs_atmos_wafs_grib.sh |
| exwafs_gfs_manager.sh (new) | exgfs_atmos_wafs_blending.sh (removed after cleaning up) |
| exwafs_upp.sh (new) | |

Additionally there are other changes:
1. In exwafs_grib2_0p25_blending.sh, extend the waiting time window for UK data from 15 to 25 minutes
2. In exwafs_grib2_0p25.sh, only include fields at the extra levels when forecast hour is between 06 and 36 per AWC request
3. In ush/mkwfsgbl.sh: change input dependency from GFS pgrb2.1p00 to master file.
4. Remove files under ush/ folder: wafs_blending.sh wafs_grib2.regrid.sh wafs_intdsk.sh


Fix Changes
-----------

1. Remove fix/wafs/legend folder
2. Remove files under fix/wafs:
- grib2_blended_wafs_wifs_fFF.0p25
- grib2_gfs_wafs_wifs_fFF.0p25
- grib_wafsgfs_intdsk
- grib_wafsgfs_intdskf00
3. Under fix/wafs, filenames are changed according to EE2 standards.
- faa_gfsmaster.grb2.list → grib2_gfs_awf_master.list
- gfs_master.grb2_0p25.list → grib2_0p25_gfs_master2d.list
- gfs_wafs.grb2_0p25.list → grib2_0p25_wafs_hazard.list
- grib2_gfs_awffFF.45 → grib2_gfs_awffFFF.45 (FF FFF - forecast hours)
- grib2_gfs_wafsfFF.45 → grib2_wafsfFFF.45 (FF FFF - forecast hours)
- wafs_0p25_admin_msg → wafs_blending_0p25_admin_msg
- wafs_gfsmaster.grb2.list → grib2_wafs.gfs_master.list
- wafs.namelist → grib_wafs.namelist

Module Changes
--------------

No change

Changes to File Sizes
---------------------

* UPP: increased by 40G (new, moved from GFS to WAFS)
* GRIB2_0P25: increased by 0.1G

Environment and Resource Changes
--------------------------------

1. Add ecFlow to WAFS package
2. Add UPP as a WAFS component
3. Get rid of MPMD, each forecast hour will be run in its own job card.
4. WAFS_GRIB job dependency is changed from GFS pgrb2.1p00 to GFS master file

Pre-implementation Testing Requirements
---------------------------------------
* Which production jobs should be tested as part of this implementation?
* The entire WAFS v7.0.0 package needs to be installed and tested on WCOSS-2
* Does this change require a 30-day evaluation?
* No


Product Changes
---------------
* Directory changes
* From com/gfs/v16.3/gfs.YYYYMMDD/CC/atmos to com/wafs/v7.0/wafs.YYYYMMDD/CC
* Inside WAFS, there are subfolders categoried by job names
* |-- upp
* |-- gcip
* |-- grib
* |-- grib2
* |----- 1p25
* |----- 0p25
* |-------- blending
* Files to be retired
* `gfs.tCCz.wafs_icao.grb2fFFF`
Comment on lines +147 to +148
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@KateFriedman-NOAA
Does this need to be captured in the GFS release notes from the wafs separation?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Probably. We'll need to list all WAFS files that will be removed from GFS COM in the release notes. I can note that this one file is being retired as well.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@YaliMao-NOAA
Can you provide a list of files that the GFS will not be producing and their equivalent WAFS files so @KateFriedman-NOAA can include it in the GFS release notes?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@KateFriedman-NOAA Here is the list of WAFS files which are going to be moved out of GFS.
https://docs.google.com/spreadsheets/d/1Nt343Z9x9UycweFik3HRFpXkqIjs7m20s15yGOhsgUY

* Filename changes
* Renamed according to EE2 implementation standards
* Exceptions: files sent to UK
* Refer to this document: https://docs.google.com/spreadsheets/d/1Nt343Z9x9UycweFik3HRFpXkqIjs7m20s15yGOhsgUY
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

IMO, the name changes should be summarized in the release notes. The google document can change, and will need access updated for anyone who looks at this release note.

* File content changes
* Add EDPARM CATEDR MWTURB on 127.7 mb, ICESEV on 875.1 908.1 942.1 977.2 mb to:
* wafs.tCCz.master.fFFF.grib2 when FFF<=048
* grib2/0p25/wafs.tCCz.awf.0p25.fFFF.grib2 when FFF<=036


Dissemination Information
-------------------------
* Filename changes and dbn_alert subtype changes
* Refer to this document: https://docs.google.com/spreadsheets/d/1Nt343Z9x9UycweFik3HRFpXkqIjs7m20s15yGOhsgUY
* Where should this output be sent?
* Same as current operations in GFS WAFS
Copy link
Contributor

@HuiyaChuang-NOAA HuiyaChuang-NOAA Sep 16, 2024 •
edited
Loading

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Same as current operations in GFS WAFS and refer to https://docs.google.com/spreadsheets/d/1Aq1d1uCr5RX9JvoR3B_pi21dY2ndvvHvmAdjYHAgAQg/edit?gid=0#gid=0

* Who are the users?
* Same as current operations WAFS users
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

AWC, UK Met Office, SPC, and ICAO subscribed users

* Which output files should be transferred from PROD WCOSS to DEV WCOSS?
* Same as current operations in GFS WAFS
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If the list is not too long, it would be good to document that here.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@aerorahul Are you talking about line 162, or line 162, 160 and 158? I can answer 162.
As to questions on line 158 and 160, @HuiyaChuang-NOAA, should NCO dataflow be the right contact to answer these questions?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I am referring to the whole section between lines 160-165

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I am referring to the whole section between lines 160-165

Shouldn't Dataflow be the one answering 160? Nevertheless, I added a link from Dataflow

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

All WAFS files should be transferred



HPSS Archive
------------
* Directory changes and filename changes, refer back to 'Product Changes'
* Add wafs.tCCz.0p25.anl.grib2


Job Dependencies and flow diagram
---------------------------------
* Refer to this document: https://docs.google.com/spreadsheets/d/1Nt343Z9x9UycweFik3HRFpXkqIjs7m20s15yGOhsgUY/edit?gid=1172497604#gid=1172497604
* Refer to page 6 in this document: https://docs.google.com/presentation/d/1yhdTfTHoBvV7K6jR2nfvkNAWn_eDJ2lTvDueRp9C89w/edit#slide=id.g2eeab8aa817_0_0


Documentation
-------------
* WAFS.V7 Implementation Kick-off Meeting Slides https://docs.google.com/presentation/d/1yhdTfTHoBvV7K6jR2nfvkNAWn_eDJ2lTvDueRp9C89w


Prepared By
-----------
yali.mao@noaa.gov
* yali.mao@noaa.gov
* rahul.mahajan@noaa.gov
* Hui-Ya.Chuang@noaa.gov