Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Port to S4 #177

Closed
DavidHuber-NOAA opened this issue Jun 25, 2021 · 2 comments · Fixed by #195
Closed

Port to S4 #177

DavidHuber-NOAA opened this issue Jun 25, 2021 · 2 comments · Fixed by #195
Assignees

Comments

@DavidHuber-NOAA
Copy link
Collaborator

The GSI should be ported to SSEC's S4 cluster to support UFS and DA research efforts on that system.

DavidHuber-NOAA referenced this issue in DavidHuber-NOAA/GSI_old Aug 4, 2021
Changes include:
1) Updating to the S4 cmake module cmake/Modules/platforms/S4.cmake
2) Updating the S4 section of cmake/Modules/setHOST.cmake to not build the core libraries
3) Updating modulefiles/modulefile.ProdGSI.s4 to use the hpc-stack suite of modules
4) Updating ush/build_all_cmake.sh to work on S4
@DavidHuber-NOAA
Copy link
Collaborator Author

I have committed a set of changes to update support for the GSI on S4, based on 9c1fc15d These changes have been tested on S4 by running the global workflow for a test case running from 2020073118 through 2020081000 @192/96 resolution. The logs and data are available on Orion:
logs - /work/noaa/nesdis-rdo2/dhuber/s4_logs/test_dev
comrot (for 2020081000 only) - /work/noaa/nesdis-rdo2/dhuber/s4_data/comrot/test_dev
archive - /work/noaa/nesdis-rdo2/dhuber/s4_data/archive/test_dev

A 4-day test run from 2020073118 through 2020080400 at 384/192 resolution has started.

@MichaelLueken-NOAA Before proceeding with a PR, are there any data you would like to have attached for this issue or any other test cases you would like to see? I can upload the 384/192 data and logs when the test run is complete if needed. S4 is not capable of running the 768/384 resolution workflow.

Note that I am unable to run the regression tests on S4 as the CASES contain restricted data, which are not allowed on S4. If there is a non-restricted version of these test cases, could you please forward a location to me? If not, then I can remove S4 from the regression test scripts, either under this issue or another, whichever you prefer.

Once these tests are complete, I will merge in the current NOAA-EMC master branch and perform a test build. I'm not sure if the global-workflow can support this version of the GSI, but I can try running a short test case if you think that's needed.

@MichaelLueken
Copy link
Contributor

@DavidHuber-NOAA There are no special data or test cases that I need to see uploaded to this issue before creating a PR for this work.

Unfortunately, there are no non-restricted versions of the regression test canned cases. If restricted isn't allowed on S4, it will probably be fine to remove S4 from the regression test scripts.

DavidHuber-NOAA referenced this issue in DavidHuber-NOAA/GSI_old Aug 9, 2021
S4 may not host restricted data, which is required for regression testing.
DavidHuber-NOAA referenced this issue in DavidHuber-NOAA/GSI_old Aug 11, 2021
Changes include:
1) Updating to the S4 cmake module cmake/Modules/platforms/S4.cmake
2) Updating the S4 section of cmake/Modules/setHOST.cmake to not build the core libraries
3) Updating modulefiles/modulefile.ProdGSI.s4 to use the hpc-stack suite of modules
4) Updating ush/build_all_cmake.sh to work on S4
5) Removing S4 from the regression test scripts
MichaelLueken added a commit that referenced this issue Aug 11, 2021
GitHub Issue #177 Update build/run scripts and disable regression tests for S4
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
2 participants