From 83d76cde40e2c96398b4066412d0c392ea7b7cea Mon Sep 17 00:00:00 2001 From: David Huber Date: Tue, 3 Dec 2024 12:02:31 -0600 Subject: [PATCH 01/19] Update the supported platform list --- README.md | 44 +++++++++++++++++++++++++++++++++++++------- 1 file changed, 37 insertions(+), 7 deletions(-) diff --git a/README.md b/README.md index 289e74933b..8999604604 100644 --- a/README.md +++ b/README.md @@ -14,15 +14,45 @@ The `global-workflow` depends on the following prerequisities to be available on * Compiler - Intel Compiler Suite * Software - NCEPLIBS (various), ESMF, HDF5, NetCDF, and a host of other softwares (see module files under /modulefiles for additional details) -The `global-workflow` current supports the following tier-1 machines: +The `global-workflow` currently supports the following machines at the indicated tier. -* NOAA RDHPCS - Hera -* MSU HPC - Orion -* MSU HPC - Hercules -* NOAA's operational HPC - WCOSS2 ++----------------+------+--------------------------------------------+ +| HPC | Tier | Notes | ++================+======+============================================+ +| WCOSS2 | 1 | GEFS testing is not regularly performed. | +| NCO | | GFS weakly coupled DA is not currently | +| | | supported. | ++----------------+------+--------------------------------------------+ +| Hera | 1 | | +| NOAA RDHPCS | | | ++----------------+------+--------------------------------------------+ +| Hercules | 1 | Currently does not support the TC Tracker. | +| MSU | | | ++----------------+------+--------------------------------------------+ +| Orion | 2 | The GSI runs very slowly on Orion. | +| MSU | | | ++----------------+------+--------------------------------------------+ +| Gaea C5/C6 | 3 | Currently non-operational following an OS | +| RDHPCS | | upgrade. Supported by EPIC. | ++----------------+------+--------------------------------------------+ +| Jet | 3 | Supported by NESDIS. Supports GSI-based | +| RDHPCS | | DA only. | ++----------------+------+--------------------------------------------+ +| S4 | 3 | Currently non-operational following an OS | +| U of Wisc/SSEC | | upgrade. Supported by NESDIS. Supports | +| | | GSI-based DA only. | ++----------------+------+--------------------------------------------+ +| AWS, GCP, Azure| 3 | Supported by EPIC. | +| NOAA Parallel | | | +| Works | | | ++----------------+------+--------------------------------------------+ -Additionally, the following tier-2 machine is supported: -* SSEC at Univ. of Wisconsin - S4 (Note that S2S+ experiments are not fully supported) +Tier Definitions +---------------- + +1. Fully supported by the EMC global workflow team. CI testing is regularly performed on these systems, the majority of the global workflow features are supported, and the team will address any platform-specific features, bugs, upgrades, and requests for data. +2. Supported by the global workflow team on an ad-hoc basis. CI tests are supported on these systems, but not regularly performed. +3. No official support by the global workflow team, but may be supported by other entities (e.g. EPIC). Documentation (in progress) is available [here](https://global-workflow.readthedocs.io/en/latest/). From 1f1bcce6b633dd4e1d272cde26f16dfde058454c Mon Sep 17 00:00:00 2001 From: David Huber Date: Tue, 3 Dec 2024 12:08:33 -0600 Subject: [PATCH 02/19] Reformat the table --- README.md | 19 +++++++++---------- 1 file changed, 9 insertions(+), 10 deletions(-) diff --git a/README.md b/README.md index 8999604604..c569c2f1d0 100644 --- a/README.md +++ b/README.md @@ -16,36 +16,35 @@ The `global-workflow` depends on the following prerequisities to be available on The `global-workflow` currently supports the following machines at the indicated tier. -+----------------+------+--------------------------------------------+ | HPC | Tier | Notes | -+================+======+============================================+ +| -------------- |:----:|:------------------------------------------:| | WCOSS2 | 1 | GEFS testing is not regularly performed. | | NCO | | GFS weakly coupled DA is not currently | | | | supported. | -+----------------+------+--------------------------------------------+ +| -------------- |:----:|:------------------------------------------:| | Hera | 1 | | | NOAA RDHPCS | | | -+----------------+------+--------------------------------------------+ +| -------------- |:----:|:------------------------------------------:| | Hercules | 1 | Currently does not support the TC Tracker. | | MSU | | | -+----------------+------+--------------------------------------------+ +| -------------- |:----:|:------------------------------------------:| | Orion | 2 | The GSI runs very slowly on Orion. | | MSU | | | -+----------------+------+--------------------------------------------+ +| -------------- |:----:|:------------------------------------------:| | Gaea C5/C6 | 3 | Currently non-operational following an OS | | RDHPCS | | upgrade. Supported by EPIC. | -+----------------+------+--------------------------------------------+ +| -------------- |:----:|:------------------------------------------:| | Jet | 3 | Supported by NESDIS. Supports GSI-based | | RDHPCS | | DA only. | -+----------------+------+--------------------------------------------+ +| -------------- |:----:|:------------------------------------------:| | S4 | 3 | Currently non-operational following an OS | | U of Wisc/SSEC | | upgrade. Supported by NESDIS. Supports | | | | GSI-based DA only. | -+----------------+------+--------------------------------------------+ +| -------------- |:----:|:------------------------------------------:| | AWS, GCP, Azure| 3 | Supported by EPIC. | | NOAA Parallel | | | | Works | | | -+----------------+------+--------------------------------------------+ +| -------------- |:----:|:------------------------------------------:| Tier Definitions ---------------- From d9b7ca9238adf89ba61dd63bd8cca839850129cb Mon Sep 17 00:00:00 2001 From: David Huber Date: Tue, 3 Dec 2024 12:17:18 -0600 Subject: [PATCH 03/19] Reformat table again --- README.md | 39 ++++++++++----------------------------- 1 file changed, 10 insertions(+), 29 deletions(-) diff --git a/README.md b/README.md index c569c2f1d0..d81a70e5a8 100644 --- a/README.md +++ b/README.md @@ -16,35 +16,16 @@ The `global-workflow` depends on the following prerequisities to be available on The `global-workflow` currently supports the following machines at the indicated tier. -| HPC | Tier | Notes | -| -------------- |:----:|:------------------------------------------:| -| WCOSS2 | 1 | GEFS testing is not regularly performed. | -| NCO | | GFS weakly coupled DA is not currently | -| | | supported. | -| -------------- |:----:|:------------------------------------------:| -| Hera | 1 | | -| NOAA RDHPCS | | | -| -------------- |:----:|:------------------------------------------:| -| Hercules | 1 | Currently does not support the TC Tracker. | -| MSU | | | -| -------------- |:----:|:------------------------------------------:| -| Orion | 2 | The GSI runs very slowly on Orion. | -| MSU | | | -| -------------- |:----:|:------------------------------------------:| -| Gaea C5/C6 | 3 | Currently non-operational following an OS | -| RDHPCS | | upgrade. Supported by EPIC. | -| -------------- |:----:|:------------------------------------------:| -| Jet | 3 | Supported by NESDIS. Supports GSI-based | -| RDHPCS | | DA only. | -| -------------- |:----:|:------------------------------------------:| -| S4 | 3 | Currently non-operational following an OS | -| U of Wisc/SSEC | | upgrade. Supported by NESDIS. Supports | -| | | GSI-based DA only. | -| -------------- |:----:|:------------------------------------------:| -| AWS, GCP, Azure| 3 | Supported by EPIC. | -| NOAA Parallel | | | -| Works | | | -| -------------- |:----:|:------------------------------------------:| +| HPC | Tier | Notes | +| --------------------------------------- |:----:|:-----------------------------------------------------------------------:| +| WCOSS2
NCO | 1 | GEFS testing is not regularly performed. | +| Hera
NOAA RDHPCS | 1 | | +| Hercules
MSU | 1 | Currently does not support the TC Tracker. | +| Orion
MSU | 2 | The GSI runs very slowly on Orion. | +| Gaea C5/C6
RDHPCS | 3 | Currently non-operational following an OS. Supported by EPIC. | +| Jet
RDHPCS | 3 | Supported by NESDIS. Supports GSI-based DA only. | +| S4
SSEC | 3 | Currently non-operational following an OS upgrade. Supported by NESDIS. | +| AWS, GCP, Azure
NOAA Parallel Works | 3 | Supported by EPIC. | Tier Definitions ---------------- From 14f30df5555f1b5e1efc48e00dd1e006dba31594 Mon Sep 17 00:00:00 2001 From: David Huber Date: Tue, 3 Dec 2024 12:28:50 -0600 Subject: [PATCH 04/19] More formatting changes --- README.md | 31 +++++++++++++++---------------- 1 file changed, 15 insertions(+), 16 deletions(-) diff --git a/README.md b/README.md index d81a70e5a8..6522b10b8e 100644 --- a/README.md +++ b/README.md @@ -5,29 +5,28 @@ ![Custom badge](https://img.shields.io/endpoint?url=https://gist.githubusercontent.com/emcbot/e35aa2904a54deae6bbb1fdc2d960c71/raw/hera.json) ![Custom badge](https://img.shields.io/endpoint?url=https://gist.githubusercontent.com/emcbot/e35aa2904a54deae6bbb1fdc2d960c71/raw/orion.json) -# global-workflow -Global Workflow currently supporting the Global Forecast System (GFS) with the [UFS-weather-model](https://github.com/ufs-community/ufs-weather-model) and [GSI](https://github.com/NOAA-EMC/GSI)-based Data Assimilation System. +The Global Workflow supporting the Global Forecast System (GFS) and Global Ensemble Forecasting System (GEFS) with the [UFS-weather-model](https://github.com/ufs-community/ufs-weather-model) and both [GSI](https://github.com/NOAA-EMC/GSI)- and [GDASApp (JEDI)](https://github.com/NOAA-EMC/GDASApp)-based Data Assimilation systems. The `global-workflow` depends on the following prerequisities to be available on the system: -* Workflow Engine - [Rocoto](https://github.com/christopherwharrop/rocoto) and [ecFlow](https://github.com/ecmwf/ecflow) (for NWS Operations) -* Compiler - Intel Compiler Suite +* Workflow Engines - [Rocoto](https://github.com/christopherwharrop/rocoto) and [ecFlow](https://github.com/ecmwf/ecflow) (for NWS Operations) +* Compiler - Intel classic compiler suite version 2021.x * Software - NCEPLIBS (various), ESMF, HDF5, NetCDF, and a host of other softwares (see module files under /modulefiles for additional details) The `global-workflow` currently supports the following machines at the indicated tier. -| HPC | Tier | Notes | -| --------------------------------------- |:----:|:-----------------------------------------------------------------------:| -| WCOSS2
NCO | 1 | GEFS testing is not regularly performed. | -| Hera
NOAA RDHPCS | 1 | | -| Hercules
MSU | 1 | Currently does not support the TC Tracker. | -| Orion
MSU | 2 | The GSI runs very slowly on Orion. | -| Gaea C5/C6
RDHPCS | 3 | Currently non-operational following an OS. Supported by EPIC. | -| Jet
RDHPCS | 3 | Supported by NESDIS. Supports GSI-based DA only. | -| S4
SSEC | 3 | Currently non-operational following an OS upgrade. Supported by NESDIS. | -| AWS, GCP, Azure
NOAA Parallel Works | 3 | Supported by EPIC. | - -Tier Definitions +| HPC | Tier | Notes | +| --------------------------------------- |:----:|:--------------------------------------------------------------------------:| +| WCOSS2
NCO | 1 | GEFS testing is not regularly performed. | +| Hera
NOAA RDHPCS | 1 | | +| Hercules
MSU | 1 | Currently does not support the TC Tracker. | +| Orion
MSU | 2 | The GSI runs very slowly on Orion. | +| Gaea C5/C6
RDHPCS | 3 | Currently non-operational following an OS upgrade.
Supported by EPIC. | +| AWS, GCP, Azure
NOAA Parallel Works | 3 | Supported by EPIC. | +| Jet
RDHPCS | 3 | Supported by NESDIS. | +| S4
SSEC | 3 | Currently non-operational following an OS upgrade.
Supported by NESDIS. | + +## Tier Definitions ---------------- 1. Fully supported by the EMC global workflow team. CI testing is regularly performed on these systems, the majority of the global workflow features are supported, and the team will address any platform-specific features, bugs, upgrades, and requests for data. From 385c039301698899d7cbf9e5c29c4822b0ac592d Mon Sep 17 00:00:00 2001 From: David Huber Date: Tue, 3 Dec 2024 12:36:18 -0600 Subject: [PATCH 05/19] More formatting and content --- README.md | 8 ++++---- 1 file changed, 4 insertions(+), 4 deletions(-) diff --git a/README.md b/README.md index 6522b10b8e..fe307e4e5e 100644 --- a/README.md +++ b/README.md @@ -7,11 +7,12 @@ The Global Workflow supporting the Global Forecast System (GFS) and Global Ensemble Forecasting System (GEFS) with the [UFS-weather-model](https://github.com/ufs-community/ufs-weather-model) and both [GSI](https://github.com/NOAA-EMC/GSI)- and [GDASApp (JEDI)](https://github.com/NOAA-EMC/GDASApp)-based Data Assimilation systems. -The `global-workflow` depends on the following prerequisities to be available on the system: +The Global Workflow depends on the following prerequisities to be available on the system: * Workflow Engines - [Rocoto](https://github.com/christopherwharrop/rocoto) and [ecFlow](https://github.com/ecmwf/ecflow) (for NWS Operations) * Compiler - Intel classic compiler suite version 2021.x -* Software - NCEPLIBS (various), ESMF, HDF5, NetCDF, and a host of other softwares (see module files under /modulefiles for additional details) +* Software - NCEPLIBS (various), ESMF, HDF5, NetCDF, and a host of other softwares (see module files under /modulefiles for additional details). + - [Spack-stack](https://github.com/JCSDA/spack-stack) is recommended for the installation of dependent libraries. The `global-workflow` currently supports the following machines at the indicated tier. @@ -26,8 +27,7 @@ The `global-workflow` currently supports the following machines at the indicated | Jet
RDHPCS | 3 | Supported by NESDIS. | | S4
SSEC | 3 | Currently non-operational following an OS upgrade.
Supported by NESDIS. | -## Tier Definitions ----------------- +**Tier Definitions** 1. Fully supported by the EMC global workflow team. CI testing is regularly performed on these systems, the majority of the global workflow features are supported, and the team will address any platform-specific features, bugs, upgrades, and requests for data. 2. Supported by the global workflow team on an ad-hoc basis. CI tests are supported on these systems, but not regularly performed. From 4a9df1e45d7e4d5c15cbfacf10008ad9594c56fb Mon Sep 17 00:00:00 2001 From: David Huber Date: Tue, 3 Dec 2024 12:39:28 -0600 Subject: [PATCH 06/19] Rearrange --- README.md | 6 ++++-- 1 file changed, 4 insertions(+), 2 deletions(-) diff --git a/README.md b/README.md index fe307e4e5e..481e63343f 100644 --- a/README.md +++ b/README.md @@ -7,6 +7,8 @@ The Global Workflow supporting the Global Forecast System (GFS) and Global Ensemble Forecasting System (GEFS) with the [UFS-weather-model](https://github.com/ufs-community/ufs-weather-model) and both [GSI](https://github.com/NOAA-EMC/GSI)- and [GDASApp (JEDI)](https://github.com/NOAA-EMC/GDASApp)-based Data Assimilation systems. +In progress [documentation](https://global-workflow.readthedocs.io/en/latest/) is available. + The Global Workflow depends on the following prerequisities to be available on the system: * Workflow Engines - [Rocoto](https://github.com/christopherwharrop/rocoto) and [ecFlow](https://github.com/ecmwf/ecflow) (for NWS Operations) @@ -14,6 +16,8 @@ The Global Workflow depends on the following prerequisities to be available on t * Software - NCEPLIBS (various), ESMF, HDF5, NetCDF, and a host of other softwares (see module files under /modulefiles for additional details). - [Spack-stack](https://github.com/JCSDA/spack-stack) is recommended for the installation of dependent libraries. +# Supported platforms + The `global-workflow` currently supports the following machines at the indicated tier. | HPC | Tier | Notes | @@ -33,8 +37,6 @@ The `global-workflow` currently supports the following machines at the indicated 2. Supported by the global workflow team on an ad-hoc basis. CI tests are supported on these systems, but not regularly performed. 3. No official support by the global workflow team, but may be supported by other entities (e.g. EPIC). -Documentation (in progress) is available [here](https://global-workflow.readthedocs.io/en/latest/). - # Disclaimer The United States Department of Commerce (DOC) GitHub project code is provided From 18d92f10ef830d330646b3bef77e853a87377b58 Mon Sep 17 00:00:00 2001 From: David Huber Date: Tue, 3 Dec 2024 12:45:12 -0600 Subject: [PATCH 07/19] More rearrangements. Update badges. --- README.md | 10 ++++++---- 1 file changed, 6 insertions(+), 4 deletions(-) diff --git a/README.md b/README.md index 481e63343f..4f55d17713 100644 --- a/README.md +++ b/README.md @@ -3,12 +3,14 @@ [![pynorms](https://github.com/NOAA-EMC/global-workflow/actions/workflows/pynorms.yaml/badge.svg)](https://github.com/NOAA-EMC/global-workflow/actions/workflows/pynorms.yaml) ![Custom badge](https://img.shields.io/endpoint?url=https://gist.githubusercontent.com/emcbot/e35aa2904a54deae6bbb1fdc2d960c71/raw/hera.json) -![Custom badge](https://img.shields.io/endpoint?url=https://gist.githubusercontent.com/emcbot/e35aa2904a54deae6bbb1fdc2d960c71/raw/orion.json) +![Custom badge](https://img.shields.io/endpoint?url=https://gist.githubusercontent.com/emcbot/e35aa2904a54deae6bbb1fdc2d960c71/raw/hercules.json) -The Global Workflow supporting the Global Forecast System (GFS) and Global Ensemble Forecasting System (GEFS) with the [UFS-weather-model](https://github.com/ufs-community/ufs-weather-model) and both [GSI](https://github.com/NOAA-EMC/GSI)- and [GDASApp (JEDI)](https://github.com/NOAA-EMC/GDASApp)-based Data Assimilation systems. +The Global Workflow supporting the Global Forecast System (GFS) and the Global Ensemble Forecasting System (GEFS) with the [UFS-weather-model](https://github.com/ufs-community/ufs-weather-model). Data assimilation, currently only available for the GFS, is provide by both the [GSI](https://github.com/NOAA-EMC/GSI)- and [GDASApp (JEDI)](https://github.com/NOAA-EMC/GDASApp)-based Data Assimilation systems. In progress [documentation](https://global-workflow.readthedocs.io/en/latest/) is available. +# Prerequisites + The Global Workflow depends on the following prerequisities to be available on the system: * Workflow Engines - [Rocoto](https://github.com/christopherwharrop/rocoto) and [ecFlow](https://github.com/ecmwf/ecflow) (for NWS Operations) @@ -16,9 +18,9 @@ The Global Workflow depends on the following prerequisities to be available on t * Software - NCEPLIBS (various), ESMF, HDF5, NetCDF, and a host of other softwares (see module files under /modulefiles for additional details). - [Spack-stack](https://github.com/JCSDA/spack-stack) is recommended for the installation of dependent libraries. -# Supported platforms +## Supported platforms -The `global-workflow` currently supports the following machines at the indicated tier. +The Global Workflow currently supports the following machines at the indicated tier. | HPC | Tier | Notes | | --------------------------------------- |:----:|:--------------------------------------------------------------------------:| From ac1a69e4026c87be6f630109a112b70e59a1eb83 Mon Sep 17 00:00:00 2001 From: David Huber Date: Tue, 3 Dec 2024 13:17:59 -0600 Subject: [PATCH 08/19] Add more badges --- README.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/README.md b/README.md index 4f55d17713..387a54f2cf 100644 --- a/README.md +++ b/README.md @@ -3,7 +3,9 @@ [![pynorms](https://github.com/NOAA-EMC/global-workflow/actions/workflows/pynorms.yaml/badge.svg)](https://github.com/NOAA-EMC/global-workflow/actions/workflows/pynorms.yaml) ![Custom badge](https://img.shields.io/endpoint?url=https://gist.githubusercontent.com/emcbot/e35aa2904a54deae6bbb1fdc2d960c71/raw/hera.json) +![Custom badge](https://img.shields.io/endpoint?url=https://gist.githubusercontent.com/emcbot/e35aa2904a54deae6bbb1fdc2d960c71/raw/orion.json) ![Custom badge](https://img.shields.io/endpoint?url=https://gist.githubusercontent.com/emcbot/e35aa2904a54deae6bbb1fdc2d960c71/raw/hercules.json) +![Custom badge](https://img.shields.io/endpoint?url=https://gist.githubusercontent.com/emcbot/e35aa2904a54deae6bbb1fdc2d960c71/raw/wcoss2.json) The Global Workflow supporting the Global Forecast System (GFS) and the Global Ensemble Forecasting System (GEFS) with the [UFS-weather-model](https://github.com/ufs-community/ufs-weather-model). Data assimilation, currently only available for the GFS, is provide by both the [GSI](https://github.com/NOAA-EMC/GSI)- and [GDASApp (JEDI)](https://github.com/NOAA-EMC/GDASApp)-based Data Assimilation systems. From ff54a88bd2805746abdf5e9c97318c7e1be0a218 Mon Sep 17 00:00:00 2001 From: David Huber Date: Tue, 3 Dec 2024 13:20:08 -0600 Subject: [PATCH 09/19] Add workflows to get Hercules and WCOSS2 status --- .github/workflows/hercules.yaml | 81 +++++++++++++++++++++++++++++++++ .github/workflows/wcoss2.yaml | 81 +++++++++++++++++++++++++++++++++ 2 files changed, 162 insertions(+) create mode 100644 .github/workflows/hercules.yaml create mode 100644 .github/workflows/wcoss2.yaml diff --git a/.github/workflows/hercules.yaml b/.github/workflows/hercules.yaml new file mode 100644 index 0000000000..a08ec867b6 --- /dev/null +++ b/.github/workflows/hercules.yaml @@ -0,0 +1,81 @@ +name: Hercules + +on: + pull_request_target: + branches: + - develop + types: [closed] + +jobs: + + getlabels: + runs-on: ubuntu-22.04 + outputs: + labels: ${{ steps.id.outputs.labels }} + steps: + - name: Get Label Steps + id: id + env: + GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }} + OWNER: ${{ github.repository_owner }} + REPO_NAME: ${{ github.event.repository.name }} + PULL_REQUEST_NUMBER: ${{ github.event.pull_request.number }} + run: | + LABELS1="$(gh api repos/$OWNER/$REPO_NAME/pulls/$PULL_REQUEST_NUMBER --jq '.labels.[].name')" + LABELS=$(echo "$LABELS1" | tr '\n' ' ') + echo "labels=$LABELS" >> $GITHUB_OUTPUT + + passed: + if: contains( needs.getlabels.outputs.labels, 'CI-Hercules-Passed') && github.event.pull_request.merged + runs-on: ubuntu-22.04 + needs: + - getlabels + + steps: + - name: Passed + uses: schneegans/dynamic-badges-action@v1.6.0 + with: + forceUpdate: true + auth: ${{ secrets.CLI_DYNAMIC_BADGES }} + gistID: e35aa2904a54deae6bbb1fdc2d960c71 + filename: hercules.json + label: hercules + message: passing + color: green + + failed: + if: contains( needs.getlabels.outputs.labels, 'CI-Hercules-Failed') && github.event.pull_request.merged + runs-on: ubuntu-latest + needs: + - getlabels + + steps: + - name: Failed + uses: schneegans/dynamic-badges-action@v1.6.0 + with: + forceUpdate: true + auth: ${{ secrets.CLI_DYNAMIC_BADGES }} + gistID: e35aa2904a54deae6bbb1fdc2d960c71 + filename: hercules.json + label: hercules + message: failing + color: red + + + pending: + if: "!contains( needs.getlabels.outputs.labels, 'CI-Hercules-Passed') && !contains( needs.getlabels.outputs.labels, 'CI-Hercules-Failed')" + runs-on: ubuntu-latest + needs: + - getlabels + + steps: + - name: Pending + uses: schneegans/dynamic-badges-action@v1.6.0 + with: + forceUpdate: true + auth: ${{ secrets.CLI_DYNAMIC_BADGES }} + gistID: e35aa2904a54deae6bbb1fdc2d960c71 + filename: hercules.json + label: hercules + message: pending + color: orange diff --git a/.github/workflows/wcoss2.yaml b/.github/workflows/wcoss2.yaml new file mode 100644 index 0000000000..489ae58406 --- /dev/null +++ b/.github/workflows/wcoss2.yaml @@ -0,0 +1,81 @@ +name: WCOSS2 + +on: + pull_request_target: + branches: + - develop + types: [closed] + +jobs: + + getlabels: + runs-on: ubuntu-22.04 + outputs: + labels: ${{ steps.id.outputs.labels }} + steps: + - name: Get Label Steps + id: id + env: + GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }} + OWNER: ${{ github.repository_owner }} + REPO_NAME: ${{ github.event.repository.name }} + PULL_REQUEST_NUMBER: ${{ github.event.pull_request.number }} + run: | + LABELS1="$(gh api repos/$OWNER/$REPO_NAME/pulls/$PULL_REQUEST_NUMBER --jq '.labels.[].name')" + LABELS=$(echo "$LABELS1" | tr '\n' ' ') + echo "labels=$LABELS" >> $GITHUB_OUTPUT + + passed: + if: contains( needs.getlabels.outputs.labels, 'CI-Wcoss2-Passed') && github.event.pull_request.merged + runs-on: ubuntu-latest + needs: + - getlabels + + steps: + - name: Passed + uses: schneegans/dynamic-badges-action@v1.6.0 + with: + forceUpdate: true + auth: ${{ secrets.CLI_DYNAMIC_BADGES }} + gistID: e35aa2904a54deae6bbb1fdc2d960c71 + filename: wcoss2.json + label: wcoss2 + message: passing + color: green + + failed: + if: contains( needs.getlabels.outputs.labels, 'CI-Wcoss2-Failed') && github.event.pull_request.merged + runs-on: ubuntu-latest + needs: + - getlabels + + steps: + - name: Failed + uses: schneegans/dynamic-badges-action@v1.6.0 + with: + forceUpdate: true + auth: ${{ secrets.CLI_DYNAMIC_BADGES }} + gistID: e35aa2904a54deae6bbb1fdc2d960c71 + filename: wcoss2.json + label: wcoss2 + message: failing + color: red + + + pending: + if: "!contains( needs.getlabels.outputs.labels, 'CI-Wcoss2-Passed') && !contains( needs.getlabels.outputs.labels, 'CI-Wcoss2-Failed')" + runs-on: ubuntu-latest + needs: + - getlabels + + steps: + - name: Pending + uses: schneegans/dynamic-badges-action@v1.6.0 + with: + forceUpdate: true + auth: ${{ secrets.CLI_DYNAMIC_BADGES }} + gistID: e35aa2904a54deae6bbb1fdc2d960c71 + filename: wcoss2.json + label: wcoss2 + message: pending + color: orange From 4e8434f116a4c51359b3562a26124e7e6bd11ab7 Mon Sep 17 00:00:00 2001 From: David Huber <69919478+DavidHuber-NOAA@users.noreply.github.com> Date: Tue, 3 Dec 2024 19:38:51 +0000 Subject: [PATCH 10/19] Update README.md Co-authored-by: Kate Friedman --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 387a54f2cf..9c13d13ead 100644 --- a/README.md +++ b/README.md @@ -7,7 +7,7 @@ ![Custom badge](https://img.shields.io/endpoint?url=https://gist.githubusercontent.com/emcbot/e35aa2904a54deae6bbb1fdc2d960c71/raw/hercules.json) ![Custom badge](https://img.shields.io/endpoint?url=https://gist.githubusercontent.com/emcbot/e35aa2904a54deae6bbb1fdc2d960c71/raw/wcoss2.json) -The Global Workflow supporting the Global Forecast System (GFS) and the Global Ensemble Forecasting System (GEFS) with the [UFS-weather-model](https://github.com/ufs-community/ufs-weather-model). Data assimilation, currently only available for the GFS, is provide by both the [GSI](https://github.com/NOAA-EMC/GSI)- and [GDASApp (JEDI)](https://github.com/NOAA-EMC/GDASApp)-based Data Assimilation systems. +The Global Workflow supporting the Global Forecast System (GFS), the Global Ensemble Forecasting System (GEFS), and the Seasonal Forecast System (SFS) with the [UFS-weather-model](https://github.com/ufs-community/ufs-weather-model). Data assimilation, currently only available for the GFS, is provide by both the [GSI](https://github.com/NOAA-EMC/GSI)- and [GDASApp (JEDI)](https://github.com/NOAA-EMC/GDASApp)-based Data Assimilation systems. In progress [documentation](https://global-workflow.readthedocs.io/en/latest/) is available. From cdbd1eaf13ad9d7d077adf0c4c46884ee1b49cbb Mon Sep 17 00:00:00 2001 From: David Huber Date: Tue, 3 Dec 2024 14:14:38 -0600 Subject: [PATCH 11/19] Typo --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 387a54f2cf..25759ed130 100644 --- a/README.md +++ b/README.md @@ -7,7 +7,7 @@ ![Custom badge](https://img.shields.io/endpoint?url=https://gist.githubusercontent.com/emcbot/e35aa2904a54deae6bbb1fdc2d960c71/raw/hercules.json) ![Custom badge](https://img.shields.io/endpoint?url=https://gist.githubusercontent.com/emcbot/e35aa2904a54deae6bbb1fdc2d960c71/raw/wcoss2.json) -The Global Workflow supporting the Global Forecast System (GFS) and the Global Ensemble Forecasting System (GEFS) with the [UFS-weather-model](https://github.com/ufs-community/ufs-weather-model). Data assimilation, currently only available for the GFS, is provide by both the [GSI](https://github.com/NOAA-EMC/GSI)- and [GDASApp (JEDI)](https://github.com/NOAA-EMC/GDASApp)-based Data Assimilation systems. +The Global Workflow supporting the Global Forecast System (GFS) and the Global Ensemble Forecasting System (GEFS) with the [UFS-weather-model](https://github.com/ufs-community/ufs-weather-model). Data assimilation, currently only available for the GFS, is provided by both the [GSI](https://github.com/NOAA-EMC/GSI)- and [GDASApp (JEDI)](https://github.com/NOAA-EMC/GDASApp)-based Data Assimilation systems. In progress [documentation](https://global-workflow.readthedocs.io/en/latest/) is available. From dfc11b5b076ea829544b81c967f4f479226a4542 Mon Sep 17 00:00:00 2001 From: David Huber Date: Tue, 3 Dec 2024 14:48:29 -0600 Subject: [PATCH 12/19] Add capabilities table --- docs/source/hpc.rst | 33 +++++++++++++++++++++++++++++++++ 1 file changed, 33 insertions(+) diff --git a/docs/source/hpc.rst b/docs/source/hpc.rst index e83851b1a2..b585dfe8ac 100644 --- a/docs/source/hpc.rst +++ b/docs/source/hpc.rst @@ -44,6 +44,39 @@ The following system software requirements are the minimum for any new or existi | | | WCOSS2 | +--------------+-------------+---------------------------------------+ +=========================== +Feature availability by HPC +=========================== + +The Global Workflow provides capabilities for deterministic and ensemble forecasts along with data assimilation on multiple platforms. However, not all features are currently supported on all platforms. The following table lists the features by platform and states their level of support. + ++----------+------+---------+---------+-----+---------+---------+------------+-------+-----+---------+--------------+-----------+ +| HPC | Tier | Coupled | Coupled | GSI | GDASApp | Coupled | TC Tracker | AWIPS | MOS | Fit2Obs | MET/METplus | HPSS | +| | | GFS | GEFS | DA | DA | DA | | | | | Verification | Archiving | ++==========+======+=========+=========+=====+=========+=========+============+=======+=====+=========+==============+===========+ +| WCOSS2 | 1 | X | X | X | X | | X | X | X | X | X | X | ++----------+------+---------+---------+-----+---------+---------+------------+-------+-----+---------+--------------+-----------+ +| Hera | 1 | X | X | X | X | X | X | X | | X | X | X | ++----------+------+---------+---------+-----+---------+---------+------------+-------+-----+---------+--------------+-----------+ +| Hercules | 1 | X | X | X | X | X | | | | X | X | | ++----------+------+---------+---------+-----+---------+---------+------------+-------+-----+---------+--------------+-----------+ +| Orion | 2 | X | X | X | X | | X | | | X | X | | ++----------+------+---------+---------+-----+---------+---------+------------+-------+-----+---------+--------------+-----------+ +| Gaea C5 | 3 | X | X | X | X | | | | | | | X | ++----------+------+---------+---------+-----+---------+---------+------------+-------+-----+---------+--------------+-----------+ +| Gaea C6 | 3 | X | X | X | X | | | | | | | X | ++----------+------+---------+---------+-----+---------+---------+------------+-------+-----+---------+--------------+-----------+ +| AWS (PW) | 3 | X | X | X | | | | | | | | | ++----------+------+---------+---------+-----+---------+---------+------------+-------+-----+---------+--------------+-----------+ +| GCP (PW) | 3 | X | X | | | | | | | | | | ++----------+------+---------+---------+-----+---------+---------+------------+-------+-----+---------+--------------+-----------+ +| Azure | 3 | X | X | | | | | | | | | | ++----------+------+---------+---------+-----+---------+---------+------------+-------+-----+---------+--------------+-----------+ +| Jet | 3 | X | | X | | | X | | | X | X | X | ++----------+------+---------+---------+-----+---------+---------+------------+-------+-----+---------+--------------+-----------+ +| S4 | 3 | | | X | | | X | | | X | X | | ++----------+------+---------+---------+-----+---------+---------+------------+-------+-----+---------+--------------+-----------+ + ================================ Experiment troubleshooting help ================================ From 1c660a15447bad84f764fd98ea1918e4bd64b82a Mon Sep 17 00:00:00 2001 From: David Huber Date: Tue, 3 Dec 2024 14:49:19 -0600 Subject: [PATCH 13/19] Remove Orion badge --- .github/workflows/orion.yaml | 81 ------------------------------------ README.md | 1 - 2 files changed, 82 deletions(-) delete mode 100644 .github/workflows/orion.yaml diff --git a/.github/workflows/orion.yaml b/.github/workflows/orion.yaml deleted file mode 100644 index aaf1e28370..0000000000 --- a/.github/workflows/orion.yaml +++ /dev/null @@ -1,81 +0,0 @@ -name: Orion - -on: - pull_request_target: - branches: - - develop - types: [closed] - -jobs: - - getlabels: - runs-on: ubuntu-22.04 - outputs: - labels: ${{ steps.id.outputs.labels }} - steps: - - name: Get Label Steps - id: id - env: - GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }} - OWNER: ${{ github.repository_owner }} - REPO_NAME: ${{ github.event.repository.name }} - PULL_REQUEST_NUMBER: ${{ github.event.pull_request.number }} - run: | - LABELS1="$(gh api repos/$OWNER/$REPO_NAME/pulls/$PULL_REQUEST_NUMBER --jq '.labels.[].name')" - LABELS=$(echo "$LABELS1" | tr '\n' ' ') - echo "labels=$LABELS" >> $GITHUB_OUTPUT - - passed: - if: contains( needs.getlabels.outputs.labels, 'CI-Orion-Passed') && github.event.pull_request.merged - runs-on: ubuntu-22.04 - needs: - - getlabels - - steps: - - name: Passed - uses: schneegans/dynamic-badges-action@v1.6.0 - with: - forceUpdate: true - auth: ${{ secrets.CLI_DYNAMIC_BADGES }} - gistID: e35aa2904a54deae6bbb1fdc2d960c71 - filename: orion.json - label: orion - message: passing - color: green - - failed: - if: contains( needs.getlabels.outputs.labels, 'CI-Orion-Failed') && github.event.pull_request.merged - runs-on: ubuntu-latest - needs: - - getlabels - - steps: - - name: Failed - uses: schneegans/dynamic-badges-action@v1.6.0 - with: - forceUpdate: true - auth: ${{ secrets.CLI_DYNAMIC_BADGES }} - gistID: e35aa2904a54deae6bbb1fdc2d960c71 - filename: orion.json - label: orion - message: failing - color: red - - - pending: - if: "!contains( needs.getlabels.outputs.labels, 'CI-Orion-Passed') && !contains( needs.getlabels.outputs.labels, 'CI-Orion-Failed')" - runs-on: ubuntu-latest - needs: - - getlabels - - steps: - - name: Pending - uses: schneegans/dynamic-badges-action@v1.6.0 - with: - forceUpdate: true - auth: ${{ secrets.CLI_DYNAMIC_BADGES }} - gistID: e35aa2904a54deae6bbb1fdc2d960c71 - filename: orion.json - label: orion - message: pending - color: orange diff --git a/README.md b/README.md index 25759ed130..f08c0d7e68 100644 --- a/README.md +++ b/README.md @@ -3,7 +3,6 @@ [![pynorms](https://github.com/NOAA-EMC/global-workflow/actions/workflows/pynorms.yaml/badge.svg)](https://github.com/NOAA-EMC/global-workflow/actions/workflows/pynorms.yaml) ![Custom badge](https://img.shields.io/endpoint?url=https://gist.githubusercontent.com/emcbot/e35aa2904a54deae6bbb1fdc2d960c71/raw/hera.json) -![Custom badge](https://img.shields.io/endpoint?url=https://gist.githubusercontent.com/emcbot/e35aa2904a54deae6bbb1fdc2d960c71/raw/orion.json) ![Custom badge](https://img.shields.io/endpoint?url=https://gist.githubusercontent.com/emcbot/e35aa2904a54deae6bbb1fdc2d960c71/raw/hercules.json) ![Custom badge](https://img.shields.io/endpoint?url=https://gist.githubusercontent.com/emcbot/e35aa2904a54deae6bbb1fdc2d960c71/raw/wcoss2.json) From 723f7777c5a3a78e942e7ac7aef76e14afba6989 Mon Sep 17 00:00:00 2001 From: David Huber Date: Wed, 4 Dec 2024 20:42:24 +0000 Subject: [PATCH 14/19] Try reformatting again --- docs/source/hpc.rst | 1 + 1 file changed, 1 insertion(+) diff --git a/docs/source/hpc.rst b/docs/source/hpc.rst index b585dfe8ac..a87f38d9b8 100644 --- a/docs/source/hpc.rst +++ b/docs/source/hpc.rst @@ -52,6 +52,7 @@ The Global Workflow provides capabilities for deterministic and ensemble forecas +----------+------+---------+---------+-----+---------+---------+------------+-------+-----+---------+--------------+-----------+ | HPC | Tier | Coupled | Coupled | GSI | GDASApp | Coupled | TC Tracker | AWIPS | MOS | Fit2Obs | MET/METplus | HPSS | +| | | | | | | | | | | | | | | | | GFS | GEFS | DA | DA | DA | | | | | Verification | Archiving | +==========+======+=========+=========+=====+=========+=========+============+=======+=====+=========+==============+===========+ | WCOSS2 | 1 | X | X | X | X | | X | X | X | X | X | X | From 341be8744e3515e520a3b69bd0bc7e5057e367df Mon Sep 17 00:00:00 2001 From: David Huber Date: Wed, 4 Dec 2024 20:53:28 +0000 Subject: [PATCH 15/19] Try reformatting again --- docs/source/components.rst | 1 + docs/source/hpc.rst | 53 +++++++++++++++++++------------------- docs/source/index.rst | 1 + 3 files changed, 28 insertions(+), 27 deletions(-) diff --git a/docs/source/components.rst b/docs/source/components.rst index f5a60a96af..98803c96c7 100644 --- a/docs/source/components.rst +++ b/docs/source/components.rst @@ -12,6 +12,7 @@ The major components of the system are: * Forecast * Post-processing * Verification +* Archiving The Global Workflow repository contains the workflow and script layers. External components will be checked out as git submodules. All of the submodules of the system reside in their respective repositories on GitHub. diff --git a/docs/source/hpc.rst b/docs/source/hpc.rst index a87f38d9b8..105a1d91cd 100644 --- a/docs/source/hpc.rst +++ b/docs/source/hpc.rst @@ -50,33 +50,32 @@ Feature availability by HPC The Global Workflow provides capabilities for deterministic and ensemble forecasts along with data assimilation on multiple platforms. However, not all features are currently supported on all platforms. The following table lists the features by platform and states their level of support. -+----------+------+---------+---------+-----+---------+---------+------------+-------+-----+---------+--------------+-----------+ -| HPC | Tier | Coupled | Coupled | GSI | GDASApp | Coupled | TC Tracker | AWIPS | MOS | Fit2Obs | MET/METplus | HPSS | -| | | | | | | | | | | | | | -| | | GFS | GEFS | DA | DA | DA | | | | | Verification | Archiving | -+==========+======+=========+=========+=====+=========+=========+============+=======+=====+=========+==============+===========+ -| WCOSS2 | 1 | X | X | X | X | | X | X | X | X | X | X | -+----------+------+---------+---------+-----+---------+---------+------------+-------+-----+---------+--------------+-----------+ -| Hera | 1 | X | X | X | X | X | X | X | | X | X | X | -+----------+------+---------+---------+-----+---------+---------+------------+-------+-----+---------+--------------+-----------+ -| Hercules | 1 | X | X | X | X | X | | | | X | X | | -+----------+------+---------+---------+-----+---------+---------+------------+-------+-----+---------+--------------+-----------+ -| Orion | 2 | X | X | X | X | | X | | | X | X | | -+----------+------+---------+---------+-----+---------+---------+------------+-------+-----+---------+--------------+-----------+ -| Gaea C5 | 3 | X | X | X | X | | | | | | | X | -+----------+------+---------+---------+-----+---------+---------+------------+-------+-----+---------+--------------+-----------+ -| Gaea C6 | 3 | X | X | X | X | | | | | | | X | -+----------+------+---------+---------+-----+---------+---------+------------+-------+-----+---------+--------------+-----------+ -| AWS (PW) | 3 | X | X | X | | | | | | | | | -+----------+------+---------+---------+-----+---------+---------+------------+-------+-----+---------+--------------+-----------+ -| GCP (PW) | 3 | X | X | | | | | | | | | | -+----------+------+---------+---------+-----+---------+---------+------------+-------+-----+---------+--------------+-----------+ -| Azure | 3 | X | X | | | | | | | | | | -+----------+------+---------+---------+-----+---------+---------+------------+-------+-----+---------+--------------+-----------+ -| Jet | 3 | X | | X | | | X | | | X | X | X | -+----------+------+---------+---------+-----+---------+---------+------------+-------+-----+---------+--------------+-----------+ -| S4 | 3 | | | X | | | X | | | X | X | | -+----------+------+---------+---------+-----+---------+---------+------------+-------+-----+---------+--------------+-----------+ ++----------+------+---------+---------+------+---------+---------+------------+-------+-----+---------+----------------+-------------+ +| HPC | Tier | Coupled | Coupled | GSI | GDASApp | Coupled | TC Tracker | AWIPS | MOS | Fit2Obs | MET/METplus | HPSS | +| | | | GFS | | GEFS | | DA | | DA | | DA | | | | | | Verification | | Archiving | ++==========+======+=========+=========+======+=========+=========+============+=======+=====+=========+================+=============+ +| WCOSS2 | 1 | X | X | X | X | | X | X | X | X | X | X | ++----------+------+---------+---------+------+---------+---------+------------+-------+-----+---------+----------------+-------------+ +| Hera | 1 | X | X | X | X | X | X | X | | X | X | X | ++----------+------+---------+---------+------+---------+---------+------------+-------+-----+---------+----------------+-------------+ +| Hercules | 1 | X | X | X | X | X | | | | X | X | | ++----------+------+---------+---------+------+---------+---------+------------+-------+-----+---------+----------------+-------------+ +| Orion | 2 | X | X | X | X | | X | | | X | X | | ++----------+------+---------+---------+------+---------+---------+------------+-------+-----+---------+----------------+-------------+ +| Gaea C5 | 3 | X | X | X | X | | | | | | | X | ++----------+------+---------+---------+------+---------+---------+------------+-------+-----+---------+----------------+-------------+ +| Gaea C6 | 3 | X | X | X | X | | | | | | | X | ++----------+------+---------+---------+------+---------+---------+------------+-------+-----+---------+----------------+-------------+ +| AWS (PW) | 3 | X | X | X | | | | | | | | | ++----------+------+---------+---------+------+---------+---------+------------+-------+-----+---------+----------------+-------------+ +| GCP (PW) | 3 | X | X | | | | | | | | | | ++----------+------+---------+---------+------+---------+---------+------------+-------+-----+---------+----------------+-------------+ +| Azure | 3 | X | X | | | | | | | | | | ++----------+------+---------+---------+------+---------+---------+------------+-------+-----+---------+----------------+-------------+ +| Jet | 3 | X | | X | | | X | | | X | X | X | ++----------+------+---------+---------+------+---------+---------+------------+-------+-----+---------+----------------+-------------+ +| S4 | 3 | | | X | | | X | | | X | X | | ++----------+------+---------+---------+------+---------+---------+------------+-------+-----+---------+----------------+-------------+ ================================ Experiment troubleshooting help diff --git a/docs/source/index.rst b/docs/source/index.rst index e6513b743a..aefec10676 100644 --- a/docs/source/index.rst +++ b/docs/source/index.rst @@ -18,6 +18,7 @@ Code managers * Kate Friedman - @KateFriedman-NOAA / kate.friedman@noaa.gov * Walter Kolczynski - @WalterKolczynski-NOAA / walter.kolczynski@noaa.gov +* David Huber - @DavidHuber-NOAA / david.huber@noaa.gov ============= Announcements From d55a75d8ea929123355a1b16f0d99e874b1f3034 Mon Sep 17 00:00:00 2001 From: David Huber Date: Thu, 5 Dec 2024 14:16:37 +0000 Subject: [PATCH 16/19] Reformat table again --- docs/source/hpc.rst | 52 ++++++++++++++++++++++----------------------- 1 file changed, 26 insertions(+), 26 deletions(-) diff --git a/docs/source/hpc.rst b/docs/source/hpc.rst index 105a1d91cd..4c77db45b5 100644 --- a/docs/source/hpc.rst +++ b/docs/source/hpc.rst @@ -50,32 +50,32 @@ Feature availability by HPC The Global Workflow provides capabilities for deterministic and ensemble forecasts along with data assimilation on multiple platforms. However, not all features are currently supported on all platforms. The following table lists the features by platform and states their level of support. -+----------+------+---------+---------+------+---------+---------+------------+-------+-----+---------+----------------+-------------+ -| HPC | Tier | Coupled | Coupled | GSI | GDASApp | Coupled | TC Tracker | AWIPS | MOS | Fit2Obs | MET/METplus | HPSS | -| | | | GFS | | GEFS | | DA | | DA | | DA | | | | | | Verification | | Archiving | -+==========+======+=========+=========+======+=========+=========+============+=======+=====+=========+================+=============+ -| WCOSS2 | 1 | X | X | X | X | | X | X | X | X | X | X | -+----------+------+---------+---------+------+---------+---------+------------+-------+-----+---------+----------------+-------------+ -| Hera | 1 | X | X | X | X | X | X | X | | X | X | X | -+----------+------+---------+---------+------+---------+---------+------------+-------+-----+---------+----------------+-------------+ -| Hercules | 1 | X | X | X | X | X | | | | X | X | | -+----------+------+---------+---------+------+---------+---------+------------+-------+-----+---------+----------------+-------------+ -| Orion | 2 | X | X | X | X | | X | | | X | X | | -+----------+------+---------+---------+------+---------+---------+------------+-------+-----+---------+----------------+-------------+ -| Gaea C5 | 3 | X | X | X | X | | | | | | | X | -+----------+------+---------+---------+------+---------+---------+------------+-------+-----+---------+----------------+-------------+ -| Gaea C6 | 3 | X | X | X | X | | | | | | | X | -+----------+------+---------+---------+------+---------+---------+------------+-------+-----+---------+----------------+-------------+ -| AWS (PW) | 3 | X | X | X | | | | | | | | | -+----------+------+---------+---------+------+---------+---------+------------+-------+-----+---------+----------------+-------------+ -| GCP (PW) | 3 | X | X | | | | | | | | | | -+----------+------+---------+---------+------+---------+---------+------------+-------+-----+---------+----------------+-------------+ -| Azure | 3 | X | X | | | | | | | | | | -+----------+------+---------+---------+------+---------+---------+------------+-------+-----+---------+----------------+-------------+ -| Jet | 3 | X | | X | | | X | | | X | X | X | -+----------+------+---------+---------+------+---------+---------+------------+-------+-----+---------+----------------+-------------+ -| S4 | 3 | | | X | | | X | | | X | X | | -+----------+------+---------+---------+------+---------+---------+------------+-------+-----+---------+----------------+-------------+ ++----------+------+-----------+-----------+--------+-----------+-----------+------------+-------+-----+---------+------------------+-------------+ +| HPC | Tier | | Coupled | | Coupled | | GSI | | GDASApp | | Coupled | TC Tracker | AWIPS | MOS | Fit2Obs | | MET/METplus | | HPSS | +| | | | GFS | | GEFS | | DA | | DA | | DA | | | | | | Verification | | Archiving | ++==========+======+===========+===========+========+===========+===========+============+=======+=====+=========+==================+=============+ +| WCOSS2 | 1 | X | X | X | X | | X | X | X | X | X | X | ++----------+------+-----------+-----------+--------+-----------+-----------+------------+-------+-----+---------+------------------+-------------+ +| Hera | 1 | X | X | X | X | X | X | X | | X | X | X | ++----------+------+-----------+-----------+--------+-----------+-----------+------------+-------+-----+---------+------------------+-------------+ +| Hercules | 1 | X | X | X | X | X | | | | X | X | | ++----------+------+-----------+-----------+--------+-----------+-----------+------------+-------+-----+---------+------------------+-------------+ +| Orion | 2 | X | X | X | X | | X | | | X | X | | ++----------+------+-----------+-----------+--------+-----------+-----------+------------+-------+-----+---------+------------------+-------------+ +| Gaea C5 | 3 | X | X | X | X | | | | | | | X | ++----------+------+-----------+-----------+--------+-----------+-----------+------------+-------+-----+---------+------------------+-------------+ +| Gaea C6 | 3 | X | X | X | X | | | | | | | X | ++----------+------+-----------+-----------+--------+-----------+-----------+------------+-------+-----+---------+------------------+-------------+ +| AWS (PW) | 3 | X | X | X | | | | | | | | | ++----------+------+-----------+-----------+--------+-----------+-----------+------------+-------+-----+---------+------------------+-------------+ +| GCP (PW) | 3 | X | X | | | | | | | | | | ++----------+------+-----------+-----------+--------+-----------+-----------+------------+-------+-----+---------+------------------+-------------+ +| Azure | 3 | X | X | | | | | | | | | | ++----------+------+-----------+-----------+--------+-----------+-----------+------------+-------+-----+---------+------------------+-------------+ +| Jet | 3 | X | | X | | | X | | | X | X | X | ++----------+------+-----------+-----------+--------+-----------+-----------+------------+-------+-----+---------+------------------+-------------+ +| S4 | 3 | | | X | | | X | | | X | X | | ++----------+------+-----------+-----------+--------+-----------+-----------+------------+-------+-----+---------+------------------+-------------+ ================================ Experiment troubleshooting help From 39ea5f19e2f9e69cb0b07926ab10f52916e750c9 Mon Sep 17 00:00:00 2001 From: David Huber Date: Thu, 5 Dec 2024 13:37:11 -0600 Subject: [PATCH 17/19] Try a list table --- docs/source/hpc.rst | 185 +++++++++++++++++++++++++++++++++++++------- 1 file changed, 159 insertions(+), 26 deletions(-) diff --git a/docs/source/hpc.rst b/docs/source/hpc.rst index 4c77db45b5..2464eb8f5e 100644 --- a/docs/source/hpc.rst +++ b/docs/source/hpc.rst @@ -50,32 +50,165 @@ Feature availability by HPC The Global Workflow provides capabilities for deterministic and ensemble forecasts along with data assimilation on multiple platforms. However, not all features are currently supported on all platforms. The following table lists the features by platform and states their level of support. -+----------+------+-----------+-----------+--------+-----------+-----------+------------+-------+-----+---------+------------------+-------------+ -| HPC | Tier | | Coupled | | Coupled | | GSI | | GDASApp | | Coupled | TC Tracker | AWIPS | MOS | Fit2Obs | | MET/METplus | | HPSS | -| | | | GFS | | GEFS | | DA | | DA | | DA | | | | | | Verification | | Archiving | -+==========+======+===========+===========+========+===========+===========+============+=======+=====+=========+==================+=============+ -| WCOSS2 | 1 | X | X | X | X | | X | X | X | X | X | X | -+----------+------+-----------+-----------+--------+-----------+-----------+------------+-------+-----+---------+------------------+-------------+ -| Hera | 1 | X | X | X | X | X | X | X | | X | X | X | -+----------+------+-----------+-----------+--------+-----------+-----------+------------+-------+-----+---------+------------------+-------------+ -| Hercules | 1 | X | X | X | X | X | | | | X | X | | -+----------+------+-----------+-----------+--------+-----------+-----------+------------+-------+-----+---------+------------------+-------------+ -| Orion | 2 | X | X | X | X | | X | | | X | X | | -+----------+------+-----------+-----------+--------+-----------+-----------+------------+-------+-----+---------+------------------+-------------+ -| Gaea C5 | 3 | X | X | X | X | | | | | | | X | -+----------+------+-----------+-----------+--------+-----------+-----------+------------+-------+-----+---------+------------------+-------------+ -| Gaea C6 | 3 | X | X | X | X | | | | | | | X | -+----------+------+-----------+-----------+--------+-----------+-----------+------------+-------+-----+---------+------------------+-------------+ -| AWS (PW) | 3 | X | X | X | | | | | | | | | -+----------+------+-----------+-----------+--------+-----------+-----------+------------+-------+-----+---------+------------------+-------------+ -| GCP (PW) | 3 | X | X | | | | | | | | | | -+----------+------+-----------+-----------+--------+-----------+-----------+------------+-------+-----+---------+------------------+-------------+ -| Azure | 3 | X | X | | | | | | | | | | -+----------+------+-----------+-----------+--------+-----------+-----------+------------+-------+-----+---------+------------------+-------------+ -| Jet | 3 | X | | X | | | X | | | X | X | X | -+----------+------+-----------+-----------+--------+-----------+-----------+------------+-------+-----+---------+------------------+-------------+ -| S4 | 3 | | | X | | | X | | | X | X | | -+----------+------+-----------+-----------+--------+-----------+-----------+------------+-------+-----+---------+------------------+-------------+ +.. list-table:: Capabilities matrix by HPC + :header-rows: 1 + + * - HPC + - Tier + - Coupled GFS + - Coupled GEFS + - GSI DA + - GDASApp DA + - Coupled DA + - TC Tracker + - AWIPS + - MOS + - Fit2Obs + - METplus Verification + - HPSS Archiving + * - WCOSS2 + - 1 + - X + - X + - X + - X + - + - X + - X + - X + - X + - X + - X | + * - Hera + - 1 + - X + - X + - X + - X + - X + - X + - X + - + - X + - X + - X | + * - Hercules + - 1 + - X + - X + - X + - X + - X + - + - + - + - X + - X + - | + * - Orion + - 2 + - X + - X + - X + - X + - + - X + - + - + - X + - X + - | + * - Gaea C5 + - 3 + - X + - X + - X + - X + - + - + - + - + - + - + - X | + * - Gaea C6 + - 3 + - X + - X + - X + - X + - + - + - + - + - + - + - X | + * - AWS (PW) + - 3 + - X + - X + - X + - + - + - + - + - + - + - + - | + * - GCP (PW) + - 3 + - X + - X + - + - + - + - + - + - + - + - + - | + * - Azure + - 3 + - X + - X + - + - + - + - + - + - + - + - + - | + * - Jet + - 3 + - X + - + - X + - + - + - X + - + - + - X + - X + - X | + * - S4 + - 3 + - + - + - X + - + - + - X + - + - + - X + - X + - | ================================ Experiment troubleshooting help From 7ba61d16046ac36b7c82370a25d4b2948371a3ad Mon Sep 17 00:00:00 2001 From: David Huber Date: Thu, 5 Dec 2024 13:44:35 -0600 Subject: [PATCH 18/19] Narrow the table a bit --- docs/source/hpc.rst | 44 ++++++++++++++++++++++++++------------------ 1 file changed, 26 insertions(+), 18 deletions(-) diff --git a/docs/source/hpc.rst b/docs/source/hpc.rst index 2464eb8f5e..8337f61886 100644 --- a/docs/source/hpc.rst +++ b/docs/source/hpc.rst @@ -52,20 +52,28 @@ The Global Workflow provides capabilities for deterministic and ensemble forecas .. list-table:: Capabilities matrix by HPC :header-rows: 1 + :align: center * - HPC - Tier - - Coupled GFS - - Coupled GEFS - - GSI DA - - GDASApp DA - - Coupled DA + - Coupled + GFS + - Coupled + GEFS + - GSI + DA + - GDASApp + DA + - Coupled + DA - TC Tracker - AWIPS - MOS - Fit2Obs - - METplus Verification - - HPSS Archiving + - METplus + Verification + - HPSS + Archiving * - WCOSS2 - 1 - X @@ -78,7 +86,7 @@ The Global Workflow provides capabilities for deterministic and ensemble forecas - X - X - X - - X | + - X * - Hera - 1 - X @@ -91,7 +99,7 @@ The Global Workflow provides capabilities for deterministic and ensemble forecas - - X - X - - X | + - X * - Hercules - 1 - X @@ -104,7 +112,7 @@ The Global Workflow provides capabilities for deterministic and ensemble forecas - - X - X - - | + - * - Orion - 2 - X @@ -117,7 +125,7 @@ The Global Workflow provides capabilities for deterministic and ensemble forecas - - X - X - - | + - * - Gaea C5 - 3 - X @@ -130,7 +138,7 @@ The Global Workflow provides capabilities for deterministic and ensemble forecas - - - - - X | + - X * - Gaea C6 - 3 - X @@ -143,7 +151,7 @@ The Global Workflow provides capabilities for deterministic and ensemble forecas - - - - - X | + - X * - AWS (PW) - 3 - X @@ -156,7 +164,7 @@ The Global Workflow provides capabilities for deterministic and ensemble forecas - - - - - | + - * - GCP (PW) - 3 - X @@ -169,7 +177,7 @@ The Global Workflow provides capabilities for deterministic and ensemble forecas - - - - - | + - * - Azure - 3 - X @@ -182,7 +190,7 @@ The Global Workflow provides capabilities for deterministic and ensemble forecas - - - - - | + - * - Jet - 3 - X @@ -195,7 +203,7 @@ The Global Workflow provides capabilities for deterministic and ensemble forecas - - X - X - - X | + - X * - S4 - 3 - @@ -208,7 +216,7 @@ The Global Workflow provides capabilities for deterministic and ensemble forecas - - X - X - - | + - ================================ Experiment troubleshooting help From 8c662a57c2f99397da43b92816c7d8510b361b7c Mon Sep 17 00:00:00 2001 From: David Huber Date: Fri, 6 Dec 2024 13:05:15 -0600 Subject: [PATCH 19/19] Update Orion TC tracker support info --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index b0edd64a9d..3311f540a5 100644 --- a/README.md +++ b/README.md @@ -28,7 +28,7 @@ The Global Workflow currently supports the following machines at the indicated t | WCOSS2
NCO | 1 | GEFS testing is not regularly performed. | | Hera
NOAA RDHPCS | 1 | | | Hercules
MSU | 1 | Currently does not support the TC Tracker. | -| Orion
MSU | 2 | The GSI runs very slowly on Orion. | +| Orion
MSU | 2 | The GSI runs very slowly on Orion and the TC tracker is not supported. | | Gaea C5/C6
RDHPCS | 3 | Currently non-operational following an OS upgrade.
Supported by EPIC. | | AWS, GCP, Azure
NOAA Parallel Works | 3 | Supported by EPIC. | | Jet
RDHPCS | 3 | Supported by NESDIS. |