need library g2tmpl version 1.12.0 to use latest UPP with ufs-weather-model #2322
Comments
|
Pinging @WenMeng-NOAA @RatkoVasic-NOAA @jkbk2004 |
|
@DomHeinzeller what is the approach when user need additional version of the certain library (like in this case) to already installed spack-stack? |
It is not just one user. Eventually, the UPP version in FV3 will have to update. Once it does, ufs-weather-model will need a newer g2tmpl. |
|
@RatkoVasic-NOAA Since this library doesn't have any downstream dependencies, it should be easy.
|
|
I'm wary of opening a spack stack PR myself since that is typically maintained by EPIC. Also, this wasn't an accident; somebody went to the trouble of adding a UPP set of libraries to Spack Stack. Surely they would have thought through the consequences of that. It is obvious that other Spack Stack environments would need that new library version to compile with UPP If so, there is probably someone working on this problem already. Do you know who it is? |
|
I see on Hera new environment /scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/upp-addon-env from April 24th. Many people have access to that directory. |
|
Yes, this was something I implemented after discussion with @WenMeng-NOAA over email. See JCSDA/spack-stack#1087 |
|
You didn't implement it on Hera, though. I tried upp-addon-env with ufs-weather-model and the latest UPP. ufs_hera.intel.luahelp([[
loads UFS Model prerequisites for Hera/Intel
]])
prepend_path("MODULEPATH", "/scratch1/NCEPDEV/nems/role.epic/spack-stack/spack-stack-1.6.0/envs/upp-addon-env/install/modulefiles/Core")
stack_intel_ver=os.getenv("stack_intel_ver") or "2021.5.0"
load(pathJoin("stack-intel", stack_intel_ver))
stack_impi_ver=os.getenv("stack_impi_ver") or "2021.5.1"
load(pathJoin("stack-intel-oneapi-mpi", stack_impi_ver))
cmake_ver=os.getenv("cmake_ver") or "3.23.1"
load(pathJoin("cmake", cmake_ver))
load("ufs_common")
nccmp_ver=os.getenv("nccmp_ver") or "1.9.0.1"
load(pathJoin("nccmp", nccmp_ver))
setenv("CC", "mpiicc")
setenv("CXX", "mpiicpc")
setenv("FC", "mpiifort")
setenv("CMAKE_Platform", "hera.intel")
whatis("Description: UFS build environment")ufs_common.luawhatis("Description: UFS build environment common libraries")
help([[Load UFS Model common libraries]])
local ufs_modules = {
{["jasper"] = "2.0.32"},
{["zlib"] = "1.2.13"},
{["libpng"] = "1.6.37"},
{["hdf5"] = "1.14.0"},
{["netcdf-c"] = "4.9.2"},
{["netcdf-fortran"] = "4.6.1"},
{["parallelio"] = "2.5.10"},
{["esmf"] = "8.6.0"},
{["fms"] = "2023.04"},
{["bacio"] = "2.4.1"},
{["crtm"] = "2.4.0"},
{["g2"] = "3.4.5"},
{["g2tmpl"] = "1.12.0"},
{["ip"] = "4.3.0"},
{["sp"] = "2.5.0"},
{["w3emc"] = "2.10.0"},
{["gftl-shared"] = "1.6.1"},
{["mapl"] = "2.40.3-esmf-8.6.0"},
{["scotch"] = "7.0.4"},
}
for i = 1, #ufs_modules do
for name, default_version in pairs(ufs_modules[i]) do
local env_version_name = string.gsub(name, "-", "_") .. "_ver"
load(pathJoin(name, os.getenv(env_version_name) or default_version))
end
endSome libraries are missing because you only installed the UPP requirements: |
|
Sorry, I didn't read all of the previous exchange here; I meant only that the updated g2tmpl was there as part of those upp-addon-env's. On Hera, I've added the rest of the UFS-related modules to upp-addon-env so you should be able to build UFS WM with g2tmpl@1.12.0. |
The modules load. I'll try compiling and running momentarily. |
|
The compilation fails due to incompatibilities between UPP and the current version of FV3/io/post_fv3.F90. This is unrelated to the Spack Stack libraries. Someone needs to update the inline post to work with the latest UPP. |
|
I've documented the inline post code problem here: And I am testing a fix for it. |
|
The gnu version of g2tmpl 1.12.0 is still missing. It's not here at all:
And this directory is still using gnu 9.2.0 (!?) instead of 13.3.0:
|
|
@AlexanderRichert-NOAA - You didn't update the gcc 13.3.0 spack stack to have g2tmpl 1.12.0. Both compilers must have g2tmpl 1.12.0 to run the ufs-weather-model. |
|
Okay. I can add another modified environment with g2tmpl@1.12.0 based on gcc13. |
|
Please try /scratch2/NCEPDEV/stmp1/role.epic/spack-stack/spack-stack-1.6.0_gnu13/envs/g2tmpl-addon-env/install/modulefiles/Core |
|
@AlexanderRichert-NOAA - Most of my group's resources are on GAEA C5, not Hera. Can you install updated modules on GAEA? Or if not, can you tell me how you're building Spack Stack 1.6.0 with the newer g2tmpl? I have my own setup to build Spack Stack on GAEA, and I can modify it if needed. |
|
Just added /autofs/ncrc-svm1_proj/epic/spack-stack/spack-stack-1.6.0/envs/g2tmpl-addon-env/install/modulefiles/Core, please check it out |
I'm testing that in a model workflow and in the regression tests. When I have something to report, you'll know. |
|
@AlexanderRichert-NOAA - Can you add prod-util to your GAEA g2tmpl-addon-env? The workflow needs it for date manipulation. |
|
Sure, please try again now |
|
@AlexanderRichert-NOAA - A later phase of the workflow wants |
|
Done |
|
My understanding is that @RatkoVasic-NOAA will deploy g2tmpl-addon-env on the remaining systems. |
|
@AlexanderRichert-NOAA I see you did it on Hera and Gaea. I'll do it on Jet, Hercules, Orion and Derecho. |
|
The g2tmpl/1.12.0 is available at upp-addon-env of the spack-stack-1.6.0 on Jet, Hercules and Orion as: |
|
Thanks @WenMeng-NOAA , I'll check Derecho then. |
|
Here are installations of new g2tmpl under upp addon on 6 machines: |
Description
The UPP, found in FV3/upp, now requires version 1.12.0 of the g2tmpl library. Spack Stack 1.6.0 only has version 1.10.2 in the set of modules accessible to ufs-weather-model. Until that is updated, we won't be able to update the inline post (FV3/upp).
Solution
Add that library version to systems that don't already have it. Most (all?) of them should already have it because UPP needs it. It's in a separate directory, though: upp-addon-env
Alternatives
None come to mind.
Related to
The text was updated successfully, but these errors were encountered: