Skip to content

Commit

Permalink
Merged with 26Jun feature/gfsv16b branch
Browse files Browse the repository at this point in the history
Corrected setting of nwat for Thompson MP in config.fcst

Squashed commit of the following:

commit 28b1faf
Author: fanglin.yang <fanglin.yang@noaa.gov>
Date:   Fri Jun 26 02:31:18 2020 +0000

    modified:   config.vrfy to add
        elif [ $machine = "HERA" ] ; then
            export RUNGFSMOSSH="$HOMEgfs/scripts/run_gfsmos_master.sh.hera"

commit 61f4a52
Author: fanglin.yang <fanglin.yang@noaa.gov>
Date:   Fri Jun 26 02:21:33 2020 +0000

    corrected a typo in  hpssarch_gen.sh
    -     echo  "${dirname}${head}atma000.ensres${SUFFIX}  " >>gdas.txt
    +     echo  "${dirname}${head}atma009.ensres${SUFFIX}  " >>gdas.txt

commit b10a930
Author: fanglin.yang <fanglin.yang@noaa.gov>
Date:   Thu Jun 25 20:25:30 2020 +0000

    modified:   config.vrfy to point a different syndat directory on Hera
           export COMROOTp1="/scratch1/NCEPDEV/global/glopara/com"
           export COMINsyn=${COMINsyn:-${COMROOTp1}/gfs/prod/syndat}

commit b8192e5
Author: russ.treadon <Russ.Treadon@noaa.gov>
Date:   Thu Jun 25 18:20:01 2020 +0000

    Issue #1:  HPSS archive and MOS script changes

     * replace enkf member atmi*nc with ratmi*nc in HPSS enkf tarballs

     * add ensemble resolution analysis to HPSS gdas tarball

     * allow variable range to be externally set in run_gfsmos_master scripts

commit e599c36
Merge: 99277ae 1e56edd
Author: Kate Friedman <kate.friedman@noaa.gov>
Date:   Wed Jun 24 14:16:22 2020 -0400

    Merge pull request NOAA-EMC#93 from JessicaMeixner-NOAA/bugfix/exiterr

    fix for exiting properly with error for wave prep/init scripts

commit 1e56edd
Author: JessicaMeixner-NOAA <Jessica.Meixner@noaa.gov>
Date:   Wed Jun 24 12:36:53 2020 -0500

    fix for exiting properly with error for wave prep/init scripts

commit 99277ae
Merge: 14dd3c9 4f8d5a5
Author: fanglin.yang <fanglin.yang@noaa.gov>
Date:   Tue Jun 23 16:05:16 2020 +0000

    Merge branch 'feature/gfsv16b' of https://github.com/NOAA-EMC/global-workflow into feature/gfsv16b

commit 4f8d5a5
Author: Kate Friedman <kate.friedman@noaa.gov>
Date:   Tue Jun 23 11:57:26 2020 -0400

    Update README.md

    Remove use/mention of manage_externals until checkout.sh is retired.

commit 14dd3c9
Author: fanglin.yang <fanglin.yang@noaa.gov>
Date:   Tue Jun 23 15:53:11 2020 +0000

    modified:   Externals.cfg and  sorc/checkout.sh to check out model tag GFS.v16.0.7
       and UPP tag upp_gfsv16_release.v1.0.9.  Changes include:

    1) Inline POST Issues NOAA-EMC#136 and $142
       * Update ceiling height calculation for global FV3.
       * add low,middle,high instantaneous cloud fraction
       * add radar reflectivity at model layers 1 and 2 , and radar reflectivities at 1 and 4-km height.
       * fix a bug in initializing DBZI
       * output mixed layer CAPE/CIN
       * remove simulated GOES-12 brightness temperature.
       * change the names of time averaged low/mid/high cloud fractions in grib2 files
         from "TCDC" to "LCDC/MCDC/HCDC", respectively.

    2) Model Issue NOAA-EMC#152
       * update in-line post control files
       * upgrade post library to 8.0.9 for hera and wcoss_dell_p3

commit dd76002
Merge: df89cc8 dd599ea
Author: Kate Friedman <kate.friedman@noaa.gov>
Date:   Tue Jun 23 11:34:40 2020 -0400

    Merge pull request NOAA-EMC#91 from christopherwharrop-noaa/feature/fix_externals

    Update version of upp in Externals.cfg to be consistent with sorc/che…

commit dd599ea
Author: Christopher Harrop <Christopher.W.Harrop@noaa.gov>
Date:   Tue Jun 23 15:25:08 2020 +0000

    Update version of upp in Externals.cfg to be consistent with sorc/checkout.sh

commit df89cc8
Author: RussTreadon-NOAA <26926959+RussTreadon-NOAA@users.noreply.github.com>
Date:   Fri Jun 19 18:40:26 2020 -0400

    Update config.resources

    Generalize setting of echgres threads to be maximum permitted on given platform instead of explicitly setting echgres threads on every platform.

commit ff8cd28
Merge: 1dd83b8 965ff42
Author: russ.treadon <Russ.Treadon@noaa.gov>
Date:   Thu Jun 18 20:07:59 2020 +0000

    Issue #1:  merge branch 'feature/chgresfcst' at 965ff42 into feature/gfsv16b

commit 965ff42
Author: russ.treadon <Russ.Treadon@noaa.gov>
Date:   Thu Jun 18 20:02:23 2020 +0000

    Issue NOAA-EMC#85:  update DA checkout to point at release/gfsda.v16.0.0

commit 71d7141
Author: russ.treadon <Russ.Treadon@noaa.gov>
Date:   Tue Jun 16 20:11:33 2020 +0000

    Issue NOAA-EMC#85:  (1) rename "chgresfcst" as "echgres", (2) add chgres variables to env

commit 1dd83b8
Author: fanglin.yang <fanglin.yang@noaa.gov>
Date:   Tue Jun 16 16:07:45 2020 +0000

    modified:   run_gfsmos_master.sh.dell to still set range=both as the default for running the real-time parallel

commit eb0e3b4
Author: fanglin.yang <fanglin.yang@noaa.gov>
Date:   Tue Jun 16 14:43:29 2020 +0000

    update  checkout.sh to switch back to post version upp_gfsv16_release.v1.0.8.   1.0.9 still has issues.

commit dfc76f0
Author: Kate.Friedman <Kate.Friedman@noaa.gov>
Date:   Tue Jun 16 13:32:01 2020 +0000

    Issue #1 - sync Externals.cfg with checkout.sh update for FV3 GFSv16.0.6 tag

commit 7078bb5
Author: fanglin.yang <fanglin.yang@noaa.gov>
Date:   Tue Jun 16 13:22:43 2020 +0000

    modified:   scripts/run_gfsmos_master.sh.dell to set default verification type o short.
    modified:   sorc/checkout.sh  updated to model tag GFS.v16.0.6 to fix contrib issue on HERA

commit 15d5bed
Author: russ.treadon <Russ.Treadon@noaa.gov>
Date:   Mon Jun 15 20:47:47 2020 +0000

    Issue NOAA-EMC#85:  add cfp option to chgresfcst; enable threads with chgresfcst

commit d878269
Author: Kate.Friedman <Kate.Friedman@noaa.gov>
Date:   Mon Jun 15 16:00:35 2020 +0000

    Issue #1 - update Externals.cfg to match updates to checkout.sh

commit a2bd621
Merge: 22b735d 295cd05
Author: Kate Friedman <kate.friedman@noaa.gov>
Date:   Mon Jun 15 11:57:14 2020 -0400

    Merge pull request NOAA-EMC#84 from NOAA-EMC/feature/gfsv16b_herawavepost

    Adapting wavepostsbs for running on Hera

commit 295cd05
Author: Jose-Henrique Alves <47567389+ajhenrique@users.noreply.github.com>
Date:   Mon Jun 15 11:53:13 2020 -0400

    Update exwave_post_sbs.sh

    Removing obsolete nm variable entries

commit 22b735d
Author: fanglin.yang <fanglin.yang@noaa.gov>
Date:   Fri Jun 12 20:06:49 2020 +0000

    modified:   checkout.sh to check out upp_gfsv16_relaese.v1.0.9

    output cloud ceiling height and instant total cloud fraction.
    output instant cloud fraction at low/mid/high cloud layer.
    correct grib2 names of time averaged cloud fraction fraction at low/mid/high cloud layer from "TCDC" into "LCDC, MCDC, HCDC".
    output radar reflectivity at 1/4 km above ground and model layer 1/2.
    output mixed layer CAPE/CIN.
    Remove simulated GOES-12 brightness temperature from gfs product.
    Add the bug fix of initializing DBZI from Ruiyu.

commit 10ce1d4
Author: Kate.Friedman <Kate.Friedman@noaa.gov>
Date:   Thu Jun 11 18:42:22 2020 +0000

    Issue #1 - Hotfix to update anaconda module contrib path on Hera

commit 58d1139
Author: henrique.alves <Henrique.Alves@noaa.gov>
Date:   Thu Jun 11 02:44:41 2020 +0000

    Adapting wavepostsbs for running on Hera

commit c330e60
Author: CoryMartin-NOAA <cory.r.martin@noaa.gov>
Date:   Wed Jun 10 21:17:00 2020 +0000

    add checkout.sh to test on Dell

commit 201609b
Author: CoryMartin-NOAA <cory.r.martin@noaa.gov>
Date:   Wed Jun 10 20:51:51 2020 +0000

    Commit changes from debugging addition of chgresfcst on hera

commit 4405a2c
Author: russ.treadon <Russ.Treadon@noaa.gov>
Date:   Wed Jun 10 14:36:03 2020 +0000

    Issue #1:  update parm/config/config.base.emc.dyn to be consistent with GFS v16 real-time parallel config.base

commit fc3066c
Author: CoryMartin-NOAA <cory.r.martin@noaa.gov>
Date:   Wed Jun 10 14:19:07 2020 +0000

    First draft to add chgresfcst to rocoto workflow

commit 9f2e4ec
Author: russ.treadon <Russ.Treadon@noaa.gov>
Date:   Mon Jun 8 00:34:07 2020 +0000

    Issue #1:  correct typo in scripts/exwave_prep.sh

commit 5a8b8f2
Author: russ.treadon <Russ.Treadon@noaa.gov>
Date:   Mon Jun 8 00:15:31 2020 +0000

    Issue #1:  check for existence of 0p50 and 1p00 pgrb files before attempting to write to HPSS

commit a7306aa
Author: fanglin.yang <fanglin.yang@noaa.gov>
Date:   Sun Jun 7 23:22:53 2020 +0000

    modified:   jobs/rocoto/post.sh
       wait for 5 minutes if forecast history file does not exist before exit

    modified:   modulefiles/module_base.hera
       use GV's temporal build of  netcdfp/4.7.4 and esmflocal/8.0.1.08bs on HERA

    modified:   parm/config/config.base.emc.dyn
       add restart_interval_gfs=0 to config.base. It is used by config.fcst and config.wave

    modified:   parm/config/config.fcst
       -- fix a bug related to setting npe_wav for gfsfcst.
           if [ "$CDUMP" = "gfs" ]; then npe_wav=$npe_wav_gfs ; fi
       -- set  io_layout="4,4" for writing gfs restart files

    modified:   parm/config/config.wave
       set WAVE restart frequency based on restart_interval_gfs (by H. Alves).

commit 1082885
Merge: 968b986 bf5a5c4
Author: Fanglin Yang <fanglin.yang@noaa.gov>
Date:   Thu Jun 4 20:26:47 2020 -0400

    Merge pull request NOAA-EMC#83 from NOAA-EMC/feature/gfsv16b_restart

    revive GFS forecast break-point restart capability with IAU turned on

commit bf5a5c4
Merge: b27a01d 968b986
Author: fanglin.yang <fanglin.yang@noaa.gov>
Date:   Thu Jun 4 23:36:52 2020 +0000

    Merge branch 'feature/gfsv16b' of https://github.com/NOAA-EMC/global-workflow into feature/gfsv16b_restart

commit 968b986
Merge: 9b36cfd dc512dd
Author: Guang Ping Lou <guang.ping.lou@noaa.gov>
Date:   Thu Jun 4 19:20:53 2020 +0000

    Merge branch 'feature/gfsv16b' of https://github.com/NOAA-EMC/global-workflow into feature/gfsv16b

commit 9b36cfd
Author: Guang Ping Lou <guang.ping.lou@noaa.gov>
Date:   Thu Jun 4 19:12:56 2020 +0000

    Unify output path in gfs_bfr2gpk.sh

commit 7675368
Author: Guang Ping Lou <guang.ping.lou@noaa.gov>
Date:   Thu Jun 4 19:11:23 2020 +0000

    remove station elevation adjustment to T,Q and evaporation bug fix

commit dc512dd
Merge: a7b25a3 987c32a
Author: Fanglin Yang <fanglin.yang@noaa.gov>
Date:   Thu Jun 4 12:55:33 2020 -0400

    Merge pull request NOAA-EMC#82 from NOAA-EMC/feature/gfsv16b_wavehera

    Adjustment to wave workflow for running wave component on Hera

commit 987c32a
Author: Jose-Henrique Alves <47567389+ajhenrique@users.noreply.github.com>
Date:   Thu Jun 4 12:08:05 2020 -0400

    Updating checkout to ufs-weather-model GFS.v16.0.5

commit a7b25a3
Author: Mallory Row <mallory.row@noaa.gov>
Date:   Thu Jun 4 14:59:22 2020 +0000

    modified: checkout.sh to check out METplus verification tag verif_global_v1.8.0

commit 0acee67
Author: russ.treadon <Russ.Treadon@noaa.gov>
Date:   Wed Jun 3 20:10:09 2020 +0000

    Issue #1:  remove redundant entry from config.ediag; update checkout.sh to pull GFS v16 DA from github

commit b27a01d
Author: fanglin.yang <fanglin.yang@noaa.gov>
Date:   Wed Jun 3 16:58:29 2020 +0000

    modified:   parm/config/config.fcst
    modified:   scripts/exglobal_fcst_nemsfv3gfs.sh

    GFS forecast restrat capability from a breakpoint is no longer working
    with IAU turned on.  This function has been overhauled to make it more
    general and works for cases with and without IAU

commit ba89548
Author: Jose-Henrique Alves <47567389+ajhenrique@users.noreply.github.com>
Date:   Wed Jun 3 09:59:35 2020 -0400

    Update JWAVE_PREP

    Removing lines using for testing presence of files while debugging.

commit bb79d7a
Author: wx20ha <henrique.alves@noaa.gov>
Date:   Wed Jun 3 02:45:33 2020 +0000

    Fixing a few minor bugs in wave_tar.sh after testing on WCOSS

commit 8dc2e25
Author: fanglin.yang <fanglin.yang@noaa.gov>
Date:   Wed Jun 3 01:41:18 2020 +0000

    add new file:   run_gfsmos_master.sh.hera

commit 3393cac
Author: henrique.alves <Henrique.Alves@noaa.gov>
Date:   Thu May 28 00:01:51 2020 +0000

    Correcting minor bug in wave_prn_cur.sh Adjusting indents in exwave_prep.sh Adding defaults for current processing in conif.waveprep.

commit 32c5f29
Merge: 49abb90 e87b5a1
Author: henrique.alves <Henrique.Alves@noaa.gov>
Date:   Wed May 27 17:40:34 2020 +0000

    Merging latest feature/gfsv16b branch into feature/gfsv16b_wavehera

commit 49abb90
Author: henrique.alves <Henrique.Alves@noaa.gov>
Date:   Wed May 27 17:36:12 2020 +0000

    Adding comment indicating how to regenerate cdo interpolation weights.

commit e87b5a1
Author: wx20ha <henrique.alves@noaa.gov>
Date:   Wed May 27 02:01:57 2020 +0000

    JWAVE_PREP updated to use CDO_ROOT defined in config config.waveprep updated to default to WCOSS rtofs operational cdo if no module found wave_prnc_cur.sh bug fixed now provides proper fhr in temp file names exwave_prep.sh adjusted for WCOSS and Hera.

commit 70d7131
Author: russ.treadon <Russ.Treadon@noaa.gov>
Date:   Tue May 26 20:39:33 2020 +0000

    Issue #1:  remove "_break" from commented out lines in config.anal and config.prep.  "_break" will cause failue if line active

commit 914cb8d
Author: russ.treadon <Russ.Treadon@noaa.gov>
Date:   Tue May 26 20:37:27 2020 +0000

    Issue #1:  correct typo in parm/config/config.anal

commit 2e12e63
Author: russ.treadon <Russ.Treadon@noaa.gov>
Date:   Tue May 26 19:18:57 2020 +0000

    Issue #1:  update config.anal logic to point ABIBF at the correct GDA directory

commit 38cd821
Author: russ.treadon <Russ.Treadon@noaa.gov>
Date:   Tue May 26 18:04:59 2020 +0000

    Issue #1:  update config files

     * parm/config/config.anal - add logic to use correct global_convinfo.txt prior to GFS v15.3 implementation (2020052612)

     * parm/config/config.awips - set NAWIPSGRP to equal NPOSTGRP (config.post)

     * parm/config/config.fcst - add double quotes around CDUMP on levs test to prevent setup_workflow.py runtime error

commit 0dff61f
Author: fanglin.yang <fanglin.yang@noaa.gov>
Date:   Mon May 25 03:08:27 2020 +0000

    modified:   config.fv3 to reduce tasks assigned to the WAVE component.  70 tasks at C768 is adequate for wave.

commit 20ef779
Author: henrique.alves <Henrique.Alves@noaa.gov>
Date:   Fri May 22 19:52:55 2020 +0000

    Redefining mpmd command for working on Hera with slurm Adapting wave scripts to execute mpmd command on Hera Adjusting wave_prnc_cur.sh for properly catting files on Hera

commit e248236
Author: fanglin.yang <fanglin.yang@noaa.gov>
Date:   Fri May 22 15:23:59 2020 +0000

    modified:   config.fcst to set
    if [ $LEVS = "128" -a $CDUMP = "gdas" ]; then
    ...

    lheatstrg=".false."

commit 96460e6
Author: russ.treadon <Russ.Treadon@noaa.gov>
Date:   Fri May 22 13:02:06 2020 +0000

    Issue #1:  replace "nawips" with "gempak" in hpssarch_gen.sh path to gfs sfc and snd files

commit 7222f84
Author: fanglin.yang <fanglin.yang@noaa.gov>
Date:   Thu May 21 14:09:36 2020 +0000

    modified:   checkout.sh to check out modle tag GFS.v16.0.4. changes include:
           1.  Remove constraints on mixing length and background diffusitivity over inversion layers on land
           2.  Enhance mass flux for deep convection, hence to increase subsidzing warming to reduce
               cold bias in the lower tropospehre
           3. Fix a RRTMg solar radiaiton bug which has impact in SW abosrption in the UV region in
              the upper atmospehre.

commit 4fa08a7
Author: fanglin.yang <fanglin.yang@noaa.gov>
Date:   Wed May 20 01:20:21 2020 +0000

    modified:   HERA.env to add
        export CFP_MP="YES" # For analdiag with SLURM

commit 9f7df9d
Author: fanglin.yang <fanglin.yang@noaa.gov>
Date:   Mon May 18 15:06:19 2020 +0000

    modified:   checkout.sh to check out upp_gfsv16_release.v1.0.8
       1) Add configuration for Orion.
       2) Make fields at isobaric levels have 41 vertical levels for all forecast hours and analysis in pgrb2 dataset.
       3) Remove SPFH at isobaric levels from pgrb2b dataset.

commit 5e4a133
Author: Mallory Row <mallory.row@noaa.gov>
Date:   Fri May 15 13:08:25 2020 +0000

    modified: checkout.sh to check out METplus verification tag verif_global_v1.7.2

commit 4291349
Author: fanglin.yang <fanglin.yang@noaa.gov>
Date:   Tue May 12 03:05:17 2020 +0000

    modified:   checkout.sh to check out gldas_gfsv16_release.v1.2.0.

commit 0c0614c
Author: russ.treadon <Russ.Treadon@noaa.gov>
Date:   Fri May 8 18:29:07 2020 +0000

    Issue #1: change number of tasks for analdiag and ediag to 112 and 56, respectively in config.resources

commit a601acd
Author: emc.glopara <emc.glopara@noaa.gov>
Date:   Fri May 8 04:17:27 2020 +0000

     updated  config.vrfy to point to the fit2obs version that supports reading netcdf history files
        export fitdir="$BASE_GIT/verif/global/Fit2Obs/ncf-vqc/batrun"
        export PREPQFITSH="$fitdir/subfits_hera_slurm"

commit ad86a55
Author: Mallory Row <mallory.row@noaa.gov>
Date:   Wed May 6 15:28:49 2020 +0000

    modified: checkout.sh to check out METplus verification tag verif_global_v1.7.1

commit 20572b5
Author: russ.treadon <Russ.Treadon@noaa.gov>
Date:   Fri May 1 19:08:23 2020 +0000

    Issue #1:  update files written to enkf HPSS tarballs to be consistent with GFS v16 DA updates

commit 20baab7
Author: fanglin.yang <fanglin.yang@noaa.gov>
Date:   Wed Apr 29 18:49:05 2020 +0000

    modified:   checkout.sh to check out model tag GFS.v16.0.3
                In Sfc_diff.f, a bug was introduced when the surface layer scheme was
                updated last time to reduce 2-m temperature cold biases.   The bug only
                has impact over sea-ice points, where momentum and thermal roughness
                are nevertheless very small.

commit af63464
Author: fanglin.yang <fanglin.yang@noaa.gov>
Date:   Tue Apr 28 18:18:44 2020 +0000

    modified:   qctropcy.f by Qingfu Liu
                A bug was found that the history files (syndat_stmcat , syndat_stmcat.scr)
                save the first and last storm ID used. If the FORTRAN code finds that the
                storm ID has been used in the current hurricane season, the code will
                change the storm ID by adding 1 to the original storm ID. The fix is to
                skip the change of the storm ID.
                See also NOAA-EMC#63
  • Loading branch information
jkhender committed Jun 26, 2020
1 parent 45f282d commit 99b8105
Show file tree
Hide file tree
Showing 46 changed files with 1,452 additions and 532 deletions.
12 changes: 6 additions & 6 deletions Externals.cfg
Original file line number Diff line number Diff line change
@@ -1,28 +1,28 @@
# External sub-modules of global-workflow

[FV3GFS]
tag = GFS.v16.0.2
tag = GFS.v16.0.7
local_path = sorc/fv3gfs.fd
repo_url = https://github.com/ufs-community/ufs-weather-model.git
protocol = git
required = True

[GSI]
tag = feature/parallel_ncio
branch = release/gfsda.v16.0.0
local_path = sorc/gsi.fd
repo_url = ssh://vlab.ncep.noaa.gov:29418/ProdGSI
repo_url = https://github.com/NOAA-EMC/GSI.git
protocol = git
required = True

[GLDAS]
tag = gldas_gfsv16_release.v1.0.0
tag = gldas_gfsv16_release.v1.2.0
local_path = sorc/gldas.fd
repo_url = https://github.com/NOAA-EMC/GLDAS.git
protocol = git
required = True

[EMC_post]
tag = upp_gfsv16_release.v1.0.7
tag = upp_gfsv16_release.v1.0.9
local_path = sorc/gfs_post.fd
repo_url = https://github.com/NOAA-EMC/EMC_post.git
protocol = git
Expand All @@ -36,7 +36,7 @@ protocol = git
required = True

[EMC_verif-global]
tag = verif_global_v1.6.0
tag = verif_global_v1.8.0
local_path = sorc/verif-global.fd
repo_url = https://github.com/NOAA-EMC/EMC_verif-global.git
protocol = git
Expand Down
14 changes: 2 additions & 12 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,6 @@ The global-workflow depends on the following prerequisities to be available on t
* workload management platform / scheduler - LSF or SLURM
* workflow manager - ROCOTO (https://github.com/christopherwharrop/rocoto)
* modules - NCEPLIBS (various), esmf v8.0.0bs48, hdf5, intel/ips v18, impi v18, wgrib2, netcdf v4.7.0, hpss, gempak (see module files under /modulefiles for additional details)
* manage_externals - A utility from ESMCI to checkout external dependencies. Manage_externals can be obtained at the following address and should be in the users PATH: https://github.com/ESMCI/manage_externals

The global-workflow current supports the following machines:

Expand All @@ -18,20 +17,11 @@ The global-workflow current supports the following machines:

### 1. Check out components

The global-workflow uses the manage_externals utility to handle checking out its components. The manic-v1.1.8 manage_externals tag is supported. The manage_externals utility will be replacing the current checkout.sh script.

Run manage_externals (checkout_externals) while at top of clone:

While in /sorc folder:
```
$ checkout_externals -e Externals.cfg
$ sh checkout.sh
```

If checkout_externals is not in your $PATH then use full path to it:

* WCOSS-Dell: /gpfs/dell2/emc/modeling/noscrub/emc.glopara/git/manage_externals/manic-v1.1.8/checkout_externals
* WCOSS-Cray: /gpfs/hps3/emc/global/noscrub/emc.glopara/git/manage_externals/manic-v1.1.8/checkout_externals
* Hera: /scratch1/NCEPDEV/global/glopara/git/manage_externals/manic-v1.1.8/checkout_externals

### 2. Build components

While in /sorc folder:
Expand Down
12 changes: 11 additions & 1 deletion env/HERA.env
Original file line number Diff line number Diff line change
Expand Up @@ -29,6 +29,7 @@ export NTHSTACK=1024000000
export job=${PBS_JOBNAME:-$step}
export jobid=${job}.${PBS_JOBID:-$$}


if [ $step = "prep" -o $step = "prepbufr" ]; then

nth_max=$(($npe_node_max / $npe_node_prep))
Expand All @@ -37,6 +38,11 @@ if [ $step = "prep" -o $step = "prepbufr" ]; then
export BACK="NO"
export sys_tp="HERA"

elif [ $step = "waveinit" -o $step = "waveprep" -o $step = "wavepostsbs" ]; then

export mpmd="--multi-prog"
export CFP_MP="YES"

elif [ $step = "anal" ]; then

export MKL_NUM_THREADS=4
Expand All @@ -47,6 +53,7 @@ elif [ $step = "anal" ]; then
export NTHREADS_GSI=${nth_anal:-$nth_max}
[[ $NTHREADS_GSI -gt $nth_max ]] && export NTHREADS_GSI=$nth_max
export APRUN_GSI="$launcher"
export CFP_MP="YES"

export NTHREADS_CALCINC=${nth_calcinc:-1}
[[ $NTHREADS_CALCINC -gt $nth_max ]] && export NTHREADS_CALCINC=$nth_max
Expand All @@ -60,9 +67,12 @@ elif [ $step = "anal" ]; then

export NTHREADS_GAUSFCANL=1
npe_gausfcanl=${npe_gausfcanl:-1}

export APRUN_GAUSFCANL="$launcher -n $npe_gausfcanl"

export NTHREADS_CHGRES=${nth_echgres:-1}
[[ $NTHREADS_CHGRES -gt $npe_node_max ]] && export NTHREADS_CHGRES=$npe_node_max
export APRUN_CHGRES=""

export USE_CFP=${USE_CFP:-"YES"}
export APRUNCFP="$launcher"

Expand Down
4 changes: 4 additions & 0 deletions env/JET.env
Original file line number Diff line number Diff line change
Expand Up @@ -58,6 +58,10 @@ elif [ $step = "anal" ]; then
npe_gausfcanl=${npe_gausfcanl:-1}
export APRUN_GAUSFCANL="$launcher $npe_gausfcanl"

export NTHREADS_CHGRES=${nth_echgres:-1}
[[ $NTHREADS_CHGRES -gt $npe_node_max ]] && export NTHREADS_CHGRES=$npe_node_max
export APRUN_CHGRES=""

elif [ $step = "gldas" ]; then

nth_max=$(($npe_node_max / $npe_node_gldas))
Expand Down
4 changes: 4 additions & 0 deletions env/WCOSS_C.env
Original file line number Diff line number Diff line change
Expand Up @@ -66,6 +66,10 @@ elif [ $step = "anal" ]; then
[[ $npe_node_gausfcanl -gt $npe_gausfcanl ]] && npe_node_gausfcanl=$npe_gausfcanl
export APRUN_GAUSFCANL="$launcher -j 1 -n $npe_gausfcanl -N $npe_node_gausfcanl -d $NTHREADS_GAUSFCANL -cc depth"

export NTHREADS_CHGRES=${nth_echgres:-1}
[[ $NTHREADS_CHGRES -gt $npe_node_max ]] && export NTHREADS_CHGRES=$npe_node_max
export APRUN_CHGRES="$launcher -j 1 -n 1 -N 1 -d $NTHREADS_CHGRES -cc depth"

elif [ $step = "gldas" ]; then

nth_max=$(($npe_node_max / $npe_node_gldas))
Expand Down
4 changes: 4 additions & 0 deletions env/WCOSS_DELL_P3.env
Original file line number Diff line number Diff line change
Expand Up @@ -66,6 +66,10 @@ elif [ $step = "anal" ]; then
npe_gausfcanl=${npe_gausfcanl:-1}
export APRUN_GAUSFCANL="$launcher $npe_gausfcanl"

export NTHREADS_CHGRES=${nth_echgres:-14}
[[ $NTHREADS_CHGRES -gt $npe_node_max ]] && export NTHREADS_CHGRES=$npe_node_max
export APRUN_CHGRES=""

if [ ${USE_CFP:-"NO"} = "YES" ]; then
export APRUNCFP="$launcher \$ncmd $mpmd"
fi
Expand Down
7 changes: 4 additions & 3 deletions jobs/JWAVE_PREP
Original file line number Diff line number Diff line change
Expand Up @@ -60,8 +60,7 @@ export pgmout=OUTPUT.$$
export MP_PULSE=0

# CDO required for processing RTOFS currents
# export CDO=${COMROOTp2}/nwprod/rtofs_glo.v1.2.0/bin/cdo
export CDO=/gpfs/dell2/emc/verification/noscrub/Todd.Spindler/CDO/bin/cdo
export CDO=${CDO_ROOT}/bin/cdo

# Path to HOME Directory
export FIXwave=${FIXwave:-$HOMEwave/fix/fix_wave_${NET}}
Expand Down Expand Up @@ -92,7 +91,9 @@ else
if [ ! -L $ROTDIR/${WAVECUR_DID}.${RPDY} ]; then # Check if symlink already exists in ROTDIR
$NLN $DMPDIR/${WAVECUR_DID}.${RPDY} $ROTDIR/${WAVECUR_DID}.${RPDY}
fi
$NLN $DMPDIR/$CDUMP.${PDY}/$cyc/${WAVICEFILE} $ROTDIR/$CDUMP.${PDY}/$cyc/${WAVICEFILE}
if [ ! -L $ROTDIR/${CDUMP}.${PDY}/${cyc}/${WAVICEFILE} ]; then # Check if symlink already exists in ROTDIR
$NLN $DMPDIR/$CDUMP.${PDY}/$cyc/${WAVICEFILE} $ROTDIR/$CDUMP.${PDY}/$cyc/${WAVICEFILE}
fi
export COMIN_OBS=${COMIN_OBS:-$ROTDIR/$RUN.$PDY/$cyc}
export COMIN_WAV_ICE=${COMIN_OBS}
export COMIN_WAV_WND=${COMIN_OBS}
Expand Down
13 changes: 13 additions & 0 deletions jobs/rocoto/echgres.sh
Original file line number Diff line number Diff line change
@@ -0,0 +1,13 @@
#!/bin/ksh -x

###############################################################
# Source FV3GFS workflow modules
. $HOMEgfs/ush/load_fv3gfs_modules.sh
status=$?
[[ $status -ne 0 ]] && exit $status

###############################################################
# Execute the JJOB
$HOMEgfs/jobs/JGDAS_ENKF_CHGRES
status=$?
exit $status
6 changes: 5 additions & 1 deletion jobs/rocoto/post.sh
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,11 @@ fi
for fhr in $fhrlst; do

if [ ! -f $restart_file${fhr}.nemsio -a ! -f $restart_file${fhr}.nc -a ! -f $restart_file${fhr}.txt ]; then
echo "Nothing to process for FHR = $fhr, cycle"
echo "Nothing to process for FHR = $fhr, cycle, wait for 5 minutes"
sleep 300
fi
if [ ! -f $restart_file${fhr}.nemsio -a ! -f $restart_file${fhr}.nc -a ! -f $restart_file${fhr}.txt ]; then
echo "Nothing to process for FHR = $fhr, cycle, skip"
continue
fi

Expand Down
17 changes: 12 additions & 5 deletions modulefiles/module_base.hera
Original file line number Diff line number Diff line change
Expand Up @@ -10,18 +10,25 @@ module load hpss/hpss
module load nco/4.7.0
module load gempak/7.4.2

module use -a /scratch1/NCEPDEV/nems/emc.nemspara/soft/modulefiles
module load hdf5_parallel/1.10.6
module load netcdf_parallel/4.7.4
module load esmf/8.0.1bs08

#Load from official NCEPLIBS
module use -a /scratch2/NCEPDEV/nwprod/NCEPLIBS/modulefiles
module load hdf5_parallel/1.10.6
#module load netcdf_parallel/4.7.4
module load g2tmpl/1.6.0
module load grib_util/1.1.1
module load crtm/2.3.0
module load prod_util/1.1.0

module use -a /scratch1/NCEPDEV/global/gwv/lp/lib/modulefiles
module load netcdfp/4.7.4
module load esmflocal/8.0.1.08bs

#module use -a /scratch1/NCEPDEV/nems/emc.nemspara/soft/modulefiles
#module load esmf/8.0.1bs08

# python
module use -a /contrib/anaconda/modulefiles
module load anaconda/2.3.0

# waveprep
module load cdo/1.9.5
22 changes: 12 additions & 10 deletions parm/config/config.anal
Original file line number Diff line number Diff line change
Expand Up @@ -48,7 +48,7 @@ export AMSR2BF=${AMSR2BF:-/dev/null}
export ABIBF="/dev/null"
if [[ "$CDATE" -ge "2019022800" ]] ; then
export ABIBF="$DMPDIR/${CDUMP}x.${PDY}/${cyc}/${CDUMP}.t${cyc}z.gsrcsr.tm00.bufr_d"
if [[ "$CDATE" -ge "2019111000" ]]; then
if [[ "$CDATE" -ge "2019111000" && "$CDATE" -le "2020052612" ]]; then
export ABIBF="$DMPDIR/${CDUMP}y.${PDY}/${cyc}/${CDUMP}.t${cyc}z.gsrcsr.tm00.bufr_d"
fi
fi
Expand Down Expand Up @@ -82,16 +82,18 @@ if [[ "$CDATE" -ge "2019110706" && "$CDATE" -lt "2020040718" ]]; then
export OBERROR=$FIXgsi/gfsv16_historical/prepobs_errtable.global.2019110706
fi

# Assimilate 135 (T) & 235 (uv) Canadian AMDAR observations
if [[ "$CDATE" -ge "2020040718" && "$CDATE" -lt "2020052612" ]]; then
export CONVINFO=$FIXgsi/gfsv16_historical/global_convinfo.txt.2020040718
fi

# NOTE:
# As of 2020040718, gfsv16_historical/global_convinfo.txt.2020040718 is
# As of 2020052612, gfsv16_historical/global_convinfo.txt.2020052612 is
# identical to ../global_convinfo.txt. Thus, the logic below is not
# needed at this time. A similar comment applies to ../prepobs_errtable.global
# and gfsv16_historical/prepobs_errtable.global.2019110706

# Assimilate 135 (T) & 235 (uv) Canadian AMDAR observations
##if [[ "$CDATE" -ge "2020040718" && "$CDATE" -lt "YYYYMMDDHH" ]]; then_break
## export CONVINFO=$FIXgsi/gfsv16_historical/global_convinfo.txt.2020040718
## export OBERROR=$FIXgsi/gfsv16_historical/prepobs_errtable.global.2020040718
# needed at this time.
# Assimilate COSMIC-2 GPS
##if [[ "$CDATE" -ge "2020052612" && "$CDATE" -lt "YYYYMMDDHH" ]]; then
## export CONVINFO=$FIXgsi/gfsv16_historical/global_convinfo.txt.2020052612
##fi


Expand All @@ -117,7 +119,7 @@ fi
# needed at this time
#
# Turn off assmilation of all Metop-A MHS
## if [[ "$CDATE" -ge "2020022012" && "$CDATE" -lt "YYYYMMDDHH" ]]; then_break
## if [[ "$CDATE" -ge "2020022012" && "$CDATE" -lt "YYYYMMDDHH" ]]; then
## export SATINFO=$FIXgsi/gfsv16_historical/global_satinfo.txt.2020022012
## fi

Expand Down
2 changes: 1 addition & 1 deletion parm/config/config.awips
Original file line number Diff line number Diff line change
Expand Up @@ -12,6 +12,6 @@ export AWIPS20SH=$HOMEgfs/jobs/JGFS_AWIPS_20KM_1P0DEG
export AWIPSG2SH=$HOMEgfs/jobs/JGFS_AWIPS_G2

# No. of concurrent awips jobs
export NAWIPSGRP=21
export NAWIPSGRP=42

echo "END: config.awips"
25 changes: 20 additions & 5 deletions parm/config/config.base.emc.dyn
Original file line number Diff line number Diff line change
Expand Up @@ -55,7 +55,10 @@ export DO_GEMPAK="NO"
export DO_AWIPS="NO"

# NO for retrospective parallel; YES for real-time parallel
export REALTIME="NO"
# arch.sh uses REALTIME for MOS. Need to set REALTIME=YES
# if want MOS written to HPSS. Should update arch.sh to
# use RUNMOS flag (currently in config.vrfy)
export REALTIME="YES"


####################################################
Expand All @@ -69,8 +72,8 @@ export HOMEgsi="$HOMEgfs"
export FIXgsi="$HOMEgfs/fix/fix_gsi"
export HOMEfv3gfs="$HOMEgfs/sorc/fv3gfs.fd"
export HOMEpost="$HOMEgfs"
export HOMEobsproc_prep="$BASE_GIT/obsproc/gfsv16/obsproc_prep.iss70457.netcdfhistory_new"
export HOMEobsproc_network="$BASE_GIT/obsproc/gfsv16/obsproc_global.iss71402.supportGFSv16"
export HOMEobsproc_prep="$BASE_GIT/obsproc/gfsv16b/obsproc_prep.iss70457.netcdfhistory"
export HOMEobsproc_network="$BASE_GIT/obsproc/gfsv16b/obsproc_global.iss71402.supportGFSv16"
export HOMEobsproc_global=$HOMEobsproc_network
export BASE_VERIF="$BASE_SVN/verif/global/tags/vsdb"

Expand All @@ -82,6 +85,8 @@ export VERBOSE="YES"
export KEEPDATA="NO"
export CHGRP_CMD="chgrp rstprod"
export NEMSIOGET="$HOMEgfs/exec/nemsio_get"
export NCDUMP="$NETCDF/bin/ncdump"
export NCLEN="$HOMEgfs/ush/getncdimlen"

# Machine environment, jobs, and other utility scripts
export BASE_ENV="$HOMEgfs/env"
Expand All @@ -96,6 +101,9 @@ export EXPDIR="@EXPDIR@/$PSLOT"
export ROTDIR="@ROTDIR@/$PSLOT"
export ROTDIR_DUMP="YES" #Note: A value of "NO" does not currently work
export DUMP_SUFFIX=""
if [[ "$CDATE" -ge "2019092100" && "$CDATE" -le "2019110700" ]]; then
export DUMP_SUFFIX="p" # Use dumps from NCO GFS v15.3 parallel
fi
export RUNDIR="$STMP/RUNDIRS/$PSLOT"
export DATAROOT="$RUNDIR/$CDATE/$CDUMP"
export ARCDIR="$NOSCRUB/archive/$PSLOT"
Expand Down Expand Up @@ -159,6 +167,11 @@ export FHMAX_GFS=$(eval echo \${FHMAX_GFS_$cyc})
export FHOUT_GFS=3
export FHMAX_HF_GFS=0
export FHOUT_HF_GFS=1
export ILPOST=1 # gempak output frequency up to F120

# GFS restart interval in hours
export restart_interval_gfs=0


# I/O QUILTING, true--use Write Component; false--use GFDL FMS
# if quilting=true, choose OUTPUT_GRID as cubed_sphere_grid in netcdf or gaussian_grid
Expand Down Expand Up @@ -203,7 +216,7 @@ export gldas_cyc=00

# run wave component
export DO_WAVE=YES
export WAVE_CDUMP="gdas"
export WAVE_CDUMP="both"

# Microphysics Options: 99-ZhaoCarr, 8-Thompson; 6-WSM6, 10-MG, 11-GFDL
if [[ "$CCPP_SUITE" == "FV3_GSD_v0" || "$CCPP_SUITE" == "FV3_GSD_noah" ]] ; then
Expand Down Expand Up @@ -261,9 +274,11 @@ export binary_diag=".false."
export DO_METP="YES" # Run MET+ jobs

# Archiving options
export HPSSARCH="NO" # save data to HPSS archive
export HPSSARCH="YES" # save data to HPSS archive
export ARCH_CYC=00 # Archive data at this cycle for warm_start capability
export ARCH_WARMICFREQ=4 # Archive frequency in days for warm_start capability
export ARCH_FCSTICFREQ=1 # Archive frequency in days for gdas and gfs forecast-only capability

export DELETE_COM_IN_ARCHIVE_JOB="YES" # NO=retain ROTDIR. YES default in arch.sh and earc.sh.

echo "END: config.base"
13 changes: 13 additions & 0 deletions parm/config/config.echgres
Original file line number Diff line number Diff line change
@@ -0,0 +1,13 @@
#!/bin/ksh -x

########## config.echgres ##########
# regrid full-res forecast for use in ensemble-res analysis generation

echo "BEGIN: config.echgres"

# Get task specific resources
. $EXPDIR/config.resources echgres

export CHGRESFCSTSH=$HOMEgfs/scripts/exglobal_enkf_chgres_fv3gfs.sh.ecf

echo "END: config.echgres"
2 changes: 0 additions & 2 deletions parm/config/config.ediag
Original file line number Diff line number Diff line change
Expand Up @@ -8,6 +8,4 @@ echo "BEGIN: config.ediag"
# Get task specific resources
. $EXPDIR/config.resources ediag

export ANALDIAGSH="$HOMEgfs/scripts/exglobal_analdiag_fv3gfs.sh.ecf"

echo "END: config.ediag"
Loading

0 comments on commit 99b8105

Please sign in to comment.