GFSv15.2.6 production changes and bug fix

[KateFriedman-NOAA]

RFC 6329 – gfs v15.2.6 - On WCOSS, fix the GFS visibility decoding bug in the GFS ncep_post module, which causes a negative impact on the visibility field where it's raining. To be implemented on December 16 at 1430Z.

• new UPP tags:
  -- for UPP with gtg: EMC_post_gtg: tag ncep_post_gtg.v1.1.10 at @aebdd1be
  -- for general UPP: EMC_post: tag ncep_post.v8.1..4 at @d81523b3

• new obsproc_global tag: OT-obsproc_global.v3.2.3-20191205

[KateFriedman-NOAA]

SDMLOG this morning contained:

1g. 1430Z - SPA Simon will start RFC 6329 - WCOSS GFS visibility decoding bug fix. 1634Z - Complete.

[KateFriedman-NOAA]

Installed new obsproc_global tag on Venus, Mars, Luna, Surge, and Hera. Set up symlink to use obsproc_global.vX.Y.Z path:

.../global/noscrub/emc.glopara/git/obsproc> ll | grep 3.2.3
lrwxrwxrwx  1 emc.glopara global    33 Dec 17 15:24 obsproc_global.v3.2.3 -> OT-obsproc_global.v3.2.3-20191205
drwxr-sr-x 10 emc.glopara global   512 Dec 17 15:23 OT-obsproc_global.v3.2.3-20191205

[KateFriedman-NOAA]

Made obsproc and EMC_post version updates in operations branch:

[Kate.Friedman@m72a2 CM_operations]$ git status
On branch operations
Your branch is up-to-date with 'origin/operations'.

Changes not staged for commit:
  (use "git add <file>..." to update what will be committed)
  (use "git checkout -- <file>..." to discard changes in working directory)

        modified:   parm/config/config.base.emc.dyn
        modified:   sorc/checkout.sh

no changes added to commit (use "git add" and/or "git commit -a")
[Kate.Friedman@m72a2 CM_operations]$ git diff parm/config/config.base.emc.dyn
diff --git a/parm/config/config.base.emc.dyn b/parm/config/config.base.emc.dyn
index 91c4758c..da5d7f6e 100755
--- a/parm/config/config.base.emc.dyn
+++ b/parm/config/config.base.emc.dyn
@@ -150,7 +150,7 @@ export FIXgsi="$HOMEgfs/fix/fix_gsi"
 export HOMEfv3gfs="$HOMEgfs/sorc/fv3gfs.fd"
 export HOMEpost="$HOMEgfs"
 export HOMEobsproc_prep="$BASE_GIT/obsproc/obsproc_prep_RB-5.2.0"
-export HOMEobsproc_network="$BASE_GIT/obsproc/obsproc_global_RB-3.2.2"
+export HOMEobsproc_network="$BASE_GIT/obsproc/obsproc_global.v3.2.3"
 export HOMEobsproc_global=$HOMEobsproc_network
 export BASE_VERIF="$BASE_SVN/verif/global/tags/vsdb"

[Kate.Friedman@m72a2 CM_operations]$ git diff sorc/checkout.sh
diff --git a/sorc/checkout.sh b/sorc/checkout.sh
index 3b2f4186..40372976 100755
--- a/sorc/checkout.sh
+++ b/sorc/checkout.sh
@@ -35,7 +35,7 @@ if [[ ! -d gfs_post.fd ]] ; then
     git clone --recursive gerrit:EMC_post_gtg gfs_post.fd >> ${topdir}/checkout-gfs_post.log 2>&1
     cd gfs_post.fd
     #git checkout ncep_post.v8.0.27e
-    git checkout ncep_post_gtg.v1.1.9
+    git checkout ncep_post_gtg.v1.1.10
     cd ${topdir}
 else
     echo 'Skip.  Directory gfs_post.fd already exists.'

[KateFriedman-NOAA]

Committed and pushed change to operations branch:

[Kate.Friedman@m72a2 CM_operations]$ git status
On branch operations
Your branch is up-to-date with 'origin/operations'.

Changes not staged for commit:
  (use "git add <file>..." to update what will be committed)
  (use "git checkout -- <file>..." to discard changes in working directory)

        modified:   parm/config/config.base.emc.dyn
        modified:   sorc/checkout.sh

no changes added to commit (use "git add" and/or "git commit -a")
[Kate.Friedman@m72a2 CM_operations]$ git add parm/config/config.base.emc.dyn sorc/checkout.sh
[Kate.Friedman@m72a2 CM_operations]$ git status
On branch operations
Your branch is up-to-date with 'origin/operations'.

Changes to be committed:
  (use "git reset HEAD <file>..." to unstage)

        modified:   parm/config/config.base.emc.dyn
        modified:   sorc/checkout.sh

[Kate.Friedman@m72a2 CM_operations]$ git commit -a -m "GitHub Issue #2 - GFSv15.2.6 changes"
[operations b1dcb4fc] GitHub Issue #2 - GFSv15.2.6 changes
 2 files changed, 2 insertions(+), 2 deletions(-)
[Kate.Friedman@m72a2 CM_operations]$ git push origin operations
Counting objects: 7, done.
Delta compression using up to 56 threads.
Compressing objects: 100% (7/7), done.
Writing objects: 100% (7/7), 593 bytes | 593.00 KiB/s, done.
Total 7 (delta 6), reused 0 (delta 0)
remote: Resolving deltas: 100% (6/6), completed with 6 local objects.
To https://github.com/NOAA-EMC/global-workflow.git
   2d555e09..b1dcb4fc  operations -> operations

[KateFriedman-NOAA]

New general UPP tag is still from VLab and doesn't support Hera so will not be updating checkout.sh in develop branch. Will be updating obsproc_global version in develop branch.

[KateFriedman-NOAA]

Made new tag off operations branch: NCO-v15.2.6

[Kate.Friedman@m72a2 CM_operations]$ git branch
  develop
* operations
[Kate.Friedman@m72a2 CM_operations]$ git log -1
commit b1dcb4fcaf68bfe1e491e3d79bba6fe830509746 (HEAD -> operations, origin/operations)
Author: kate.friedman <kate.friedman@noaa.gov>
Date:   Tue Dec 17 15:51:31 2019 +0000

    GitHub Issue #2 - GFSv15.2.6 changes
[Kate.Friedman@m72a2 CM_operations]$ git tag -a NCO-v15.2.6 -m "NCO GFSv15.2.6"
[Kate.Friedman@m72a2 CM_operations]$ git push origin NCO-v15.2.6
Counting objects: 1, done.
Writing objects: 100% (1/1), 169 bytes | 169.00 KiB/s, done.
Total 1 (delta 0), reused 0 (delta 0)
To https://github.com/NOAA-EMC/global-workflow.git
 * [new tag]           NCO-v15.2.6 -> NCO-v15.2.6

[KateFriedman-NOAA]

Pulling two additional changes into this commit:

1. bug fix to disable more earc jobs for first half cycle (CDATE=SDATE) to avoid unnecessary job failures when files aren't available (correctly) for archival
2. Update HOMEens_tracker path to include "tracker/" folder. Reorganized ../git/tracker copies on WCOSS-Dell and WCOSS-Cray to match new structure (already good on Hera). Using same version on all three platforms so have also compressed section to just two lines.

Changes incoming to develop branch:

[Kate.Friedman@m72a2 CM_develop]$ git status
On branch develop
Your branch is up-to-date with 'origin/develop'.

Changes to be committed:
  (use "git reset HEAD <file>..." to unstage)

        modified:   jobs/rocoto/earc.sh
        modified:   parm/config/config.base.emc.dyn
        modified:   parm/config/config.vrfy

[Kate.Friedman@m72a2 CM_develop]$ git diff --staged jobs/rocoto/earc.sh
diff --git a/jobs/rocoto/earc.sh b/jobs/rocoto/earc.sh
index 11f20804..3bc42fab 100755
--- a/jobs/rocoto/earc.sh
+++ b/jobs/rocoto/earc.sh
@@ -80,32 +80,34 @@ if [[ $ENSGRP -gt 0 ]] && [[ $HPSSARCH = "YES" ]]; then
        if [ $CDATE -eq $SDATE -a $cyc -eq $EARCICS_CYC ] ; then SAVEWARMICB="YES" ; fi
    fi

-   if [ $CDATE -gt $SDATE ]; then
-       htar -P -cvf $ATARDIR/$CDATE/enkf${CDUMP}_grp${ENSGRP}.tar `cat $ARCH_LIST/enkf${CDUMP}_grp${n}.txt`
-       status=$?
-       if [ $status -ne 0  -a $CDATE -ge $firstday ]; then
-           echo "HTAR $CDATE enkf${CDUMP}_grp${ENSGRP}.tar failed"
-           exit $status
-       fi
-   fi
+   if [ $CDATE -gt $SDATE ]; then # Don't run for first half cycle

-   if [ $SAVEWARMICA = "YES" -a $cyc -eq $EARCINC_CYC ]; then
+     htar -P -cvf $ATARDIR/$CDATE/enkf${CDUMP}_grp${ENSGRP}.tar `cat $ARCH_LIST/enkf${CDUMP}_grp${n}.txt`
+     status=$?
+     if [ $status -ne 0  -a $CDATE -ge $firstday ]; then
+         echo "HTAR $CDATE enkf${CDUMP}_grp${ENSGRP}.tar failed"
+         exit $status
+     fi
+
+     if [ $SAVEWARMICA = "YES" -a $cyc -eq $EARCINC_CYC ]; then
        htar -P -cvf $ATARDIR/$CDATE/enkf${CDUMP}_restarta_grp${ENSGRP}.tar `cat $ARCH_LIST/enkf${CDUMP}_restarta_grp${n}.txt`
        status=$?
        if [ $status -ne 0 ]; then
            echo "HTAR $CDATE enkf${CDUMP}_restarta_grp${ENSGRP}.tar failed"
            exit $status
        fi
-   fi
+     fi

-   if [ $SAVEWARMICB = "YES"  -a $cyc -eq $EARCICS_CYC ]; then
+     if [ $SAVEWARMICB = "YES"  -a $cyc -eq $EARCICS_CYC ]; then
        htar -P -cvf $ATARDIR/$CDATE/enkf${CDUMP}_restartb_grp${ENSGRP}.tar `cat $ARCH_LIST/enkf${CDUMP}_restartb_grp${n}.txt`
        status=$?
        if [ $status -ne 0 ]; then
            echo "HTAR $CDATE enkf${CDUMP}_restartb_grp${ENSGRP}.tar failed"
            exit $status
        fi
-   fi
+     fi
+
+   fi # CDATE>SDATE

 fi

[Kate.Friedman@m72a2 CM_develop]$ git diff --staged parm/config/config.base.emc.dyn
diff --git a/parm/config/config.base.emc.dyn b/parm/config/config.base.emc.dyn
index 6269653c..8c7274de 100755
--- a/parm/config/config.base.emc.dyn
+++ b/parm/config/config.base.emc.dyn
@@ -156,7 +156,7 @@ export FIXgsi="$HOMEgfs/fix/fix_gsi"
 export HOMEfv3gfs="$HOMEgfs/sorc/fv3gfs.fd"
 export HOMEpost="$HOMEgfs"
 export HOMEobsproc_prep="$BASE_GIT/obsproc/obsproc_prep_RB-5.2.0"
-export HOMEobsproc_network="$BASE_GIT/obsproc/obsproc_global_RB-3.2.2"
+export HOMEobsproc_network="$BASE_GIT/obsproc/obsproc_global.v3.2.3"
 export HOMEobsproc_global=$HOMEobsproc_network
 export BASE_VERIF="$BASE_SVN/verif/global/tags/vsdb"

[Kate.Friedman@m72a2 CM_develop]$ git diff --staged parm/config/config.vrfy
diff --git a/parm/config/config.vrfy b/parm/config/config.vrfy
index 88edf1d8..6bcc6e7f 100755
--- a/parm/config/config.vrfy
+++ b/parm/config/config.vrfy
@@ -191,20 +191,8 @@ fi
 # Cyclone genesis and cyclone track verification
 #-------------------------------------------------

-if [ $machine = "WCOSS_C" ] ; then
-    export ens_tracker_ver=v1.1.15.1
-    export HOMEens_tracker=$BASE_GIT/ens_tracker.${ens_tracker_ver}
-elif [ $machine = "WCOSS_DELL_P3" ] ; then
-    export ens_tracker_ver=v1.1.15.1
-    export HOMEens_tracker=$BASE_GIT/ens_tracker.${ens_tracker_ver}
-elif [ $machine = "THEIA" -o $machine = "HERA" ] ; then
-    export ens_tracker_ver=v1.1.15.1
-    export HOMEens_tracker=$BASE_GIT/tracker/ens_tracker.${ens_tracker_ver}
-else
-    echo "WARNING: Genesis and cyclone verifications are not enabled on $machine!"
-    export VRFYGENESIS="NO"
-    export VRFYTRAK="NO"
-fi
+export ens_tracker_ver=v1.1.15.1
+export HOMEens_tracker=$BASE_GIT/tracker/ens_tracker.${ens_tracker_ver}


 if [ "$VRFYTRAK" = "YES" ]; then

[KateFriedman-NOAA]

Committed changes to develop branch at 3fd4bcf. Announcing commit and closing ticket next.

[Kate.Friedman@m72a2 CM_develop]$ git status
On branch develop
Your branch is up-to-date with 'origin/develop'.

Changes to be committed:
  (use "git reset HEAD <file>..." to unstage)

        modified:   jobs/rocoto/earc.sh
        modified:   parm/config/config.base.emc.dyn
        modified:   parm/config/config.vrfy

[Kate.Friedman@m72a2 CM_develop]$ git commit -a -m "GitHub Issue #2 - GFSv15.2.6 obsproc version update, earc bug fix, and tracker path update"
[develop 3fd4bcfa] GitHub Issue #2 - GFSv15.2.6 obsproc version update, earc bug fix, and tracker path update
 3 files changed, 17 insertions(+), 27 deletions(-)
[Kate.Friedman@m72a2 CM_develop]$ git push origin develop
Counting objects: 9, done.
Delta compression using up to 56 threads.
Compressing objects: 100% (9/9), done.
Writing objects: 100% (9/9), 873 bytes | 873.00 KiB/s, done.
Total 9 (delta 8), reused 0 (delta 0)
remote: Resolving deltas: 100% (8/8), completed with 8 local objects.
To https://github.com/NOAA-EMC/global-workflow.git
   53079526..3fd4bcfa  develop -> develop