Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

wcoss2 cycled ecflow archive and verification JJobs #724

Closed

Conversation

lgannoaa
Copy link
Contributor

@lgannoaa lgannoaa commented Apr 9, 2022

Description

In this PR it will contain:
ecflow workflow verification and archive job scripts.
ecflow verification configuration file.
ecf/scripts/workflow_manager/cycled/enkfgdas/.gitignore - git ignore file for earc jobs
ecf/scripts/workflow_manager/cycled/enkfgdas/jenkfgdas_emc_earc_master.ecf - Master earc file
ecf/scripts/workflow_manager/cycled/gdas/atmos/jgdas_emc_vrfy.ecf - gdas verification ecflow job script
ecf/scripts/workflow_manager/cycled/gdas/jgdas_emc_arch.ecf - gdas archive ecflow job script
ecf/scripts/workflow_manager/cycled/gfs/atmos/jgfs_emc_vrfy.ecf - gfs verification ecflow job script
ecf/scripts/workflow_manager/cycled/gfs/jgfs_emc_arch.ecf - gfs archive ecflow job script
ecf/setup_ecf_links.sh - linking earc jobs
parm/config/config.ecfvrfy - verification configuration file for ecflow workflow GDAS/GFS vrfy jobs

closes: #720

Type of change

Please delete options that are not relevant.

  • New feature (non-breaking change which adds functionality)

How Has This Been Tested?

Tested with both rocoto workflow and ecflow workflow.

Checklist

  • My code follows the style guidelines of this project
  • I have performed a self-review of my own code
  • I have commented my code, particularly in hard-to-understand areas
  • My changes need updates to the documentation. I have made corresponding changes to the documentation
  • My changes generate no new warnings

@lgannoaa lgannoaa self-assigned this Apr 9, 2022
New archive JJobs
config.vrfy update for wcoss2
Three rocoto jobs modified to call new JJobs

Ref: 720
This branch is now ecflow change only
Ref :720
@lgannoaa lgannoaa marked this pull request as ready for review April 15, 2022 02:14
tmpl=$1 # Name of the master template
grps=$2 # Array of forecast hours
for grp in ${grps[@]}; do
master=${tmpl}_master.ecf
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is the same for every loop and could be moved before the loop.

# Cyclone genesis and cyclone track verification
#-------------------------------------------------

export ens_tracker_ver=v1.1.15.5
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we standardize the installations for the TC tracker so we don't need this confusing definition @KateFriedman-NOAA ? Different versions, different paths; it's a mess.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

My test version of config.vrfy for this branch on WCOSS2 consolidated the HOMEens_tracker (and ens_tracker_ver) settings to this:

export HOMEens_tracker=$BASE_GIT/TC_tracker/${tracker_ver}

I have been installing the newer copy of TC_tracker on each supported platform in a folder called TC_tracker with a subfolder (with the install) based on the version (tracker_ver). This matches how NCO installs packages on WCOSS2 (application/version). I also added export tracker_ver=v1.1.15.5 to my $target.ver files.

See this on Cactus: /lfs/h2/emc/global/save/emc.global/git/TC_tracker/v1.1.15.5

My testing of this piece was put on hold to attend to WCOSS2 ops tasks so I haven't committed this back yet.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

On Cactus, see /lfs/h2/emc/global/noscrub/Kate.Friedman/expdir/devv16_192/config.vrfy (tracker section) for the consolidation I did.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

At time this PR/issue created, the information in question was not available. We can modify it when now solution is tested.

@aerorahul
Copy link
Contributor

Closing after discussions w/ @lgannoaa

@aerorahul aerorahul closed this Jul 7, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants