Update dev/gdasapp with JCB policies and g-w develop #2702
Closed
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…-NOAA/global-workflow into feature/stage_from_yaml
* upsteam/develop: Archiving cleanup (NOAA-EMC#2621) Switch to Rocky 9 built external packages on Hercules (NOAA-EMC#2608) Add the capability to use slurm reservation nodes (NOAA-EMC#2627) Update forecast job to use COMIN/COMOUT (NOAA-EMC#2622) Update to add 1-deg global wave grid (NOAA-EMC#2619) Add C384mx025_3DVarAOWCDA yamls (NOAA-EMC#2625) Script to keep Jenkins Agent persistent from cron (NOAA-EMC#2634)
* upsteam/develop: Update ufs-weather-model (NOAA-EMC#2646) Update wmo parm files to fix WMO header (NOAA-EMC#2652) Add IAU to snow DA (and its test) (NOAA-EMC#2610)
This PR moves JCB into GDASapp. The PR also bumps up the hash of GDASapp to what is in `feature/move_jcb`, which at time of writing is develop plus the absorption of JCB into GDASapp. Note that I also took the changes from NOAA-EMC#2641 to follow the testing @RussTreadon-NOAA has done.
…-NOAA/global-workflow into feature/stage_from_yaml
Optimize the gfswavepostpnt, gfswavepostbndpntbll, and gfswavepostbndpnt jobs
This is done by
1) reducing the number of calls to `sed`, `awk`, `grep`, and `cat` by
- performing operations on all files at once instead of looping over
each file
- removing piped `cat` calls (e.g. `cat <file> | sed 'something'`)
- combining `sed` and `grep` calls when possible
- adding logic to `awk` calls instead of handling that logic in bash
2) minimizing as much as possible the amount of data on disk that has to
be read in (e.g. limiting sed to read only the line numbers it needs)
---------
Co-authored-by: Walter Kolczynski - NOAA <Walter.Kolczynski@noaa.gov>
Turns on high-frequency (hourly) output in the extended products test to exercise that aspect of the code. This test only runs on WCOSS. Also adds the hooks to optionally turn on the metplus jobs, but that is deferred as they are not currently working correctly.
NCO has requested that each COM variable specify whether it is an input or an output. This completes that process for the global-workflow archive task. Refs NOAA-EMC#2451 --------- Co-authored-by: Walter Kolczynski - NOAA <Walter.Kolczynski@noaa.gov> Co-authored-by: Rahul Mahajan <aerorahul@users.noreply.github.com> Co-authored-by: David Huber <69919478+DavidHuber-NOAA@users.noreply.github.com>
This PR is a hotfix for an incorrectly named (e.g., non-existent) `COM/` template. Resolves NOAA-EMC#2696 Refs NOAA-EMC#2451
…lobal-workflow into feature/rename_atm
…put files (NOAA-EMC#2688) This PR addresses issue NOAA-EMC#1252. The following is accomplished: - Prior to removing files, the existence of a file is checked prior to attempting to remove; this is performed as noted [here](NOAA-EMC#1252 (comment)); this PR only addresses the the `chgrp` issue. Refs NOAA-EMC#1252 --------- Co-authored-by: David Huber <69919478+DavidHuber-NOAA@users.noreply.github.com>
Eliminates the post groups used for upp and products jobs so that each task only processes one forecast hour. This is more efficient and greatly simplifies downstream dependencies that depend on a specific forecast hour. Resolves NOAA-EMC#2666 Refs NOAA-EMC#2642
2 tasks
|
This PR is not needed given PR #2700. Close this PR to avoid confusion. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
This PR is a companion to PR #2700. This PR differs in that it merges into
dev/gdasappResolves #2699
Type of change
gdas.cdhash)Change characteristics
How has this been tested?
Checklist