Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create S/M/L load-balanced PE-layouts for high-res physgrid (ne120np4.pg2) WC-cases on Cori-KNL #4568

Closed
amametjanov opened this issue Sep 29, 2021 · 1 comment · Fixed by #4696

Comments

@amametjanov
Copy link
Member

Physgrid (pg2) is now default in low-resolution WC runs. High-resolution WC-compset was recently added in #4551. Previous PE-layouts for ne120np4 need to be adjusted to account for pg2: e.g. for V1-vs-V2 benchmarking comparison.

@ndkeen
Copy link
Contributor

ndkeen commented Dec 10, 2021

Finally getting to this. I have ndk/machinefiles/cori-knl-pe-layouts-ne120pg2

I decided to keep 2 different sets for MPASSI and CICE. I kept the same node counts, but needed to use fewer MPI's per node for the MPASSI layouts as it requires more memory.

Using simple 5-day SMS test which doesn't include IO, here are estimated SYPD:

      Nodes   CICE   MPASSI
T     43      .32    .29
S     85      .55    .52
M    169     1.0     .84
L    338     1.6     1.4
X   1024     2.4     2.2

For the X size, recall there is 50% discount on cori for jobs with node counts at or above 1024.

Example test:

  SMS.ne120pg2_r0125_oRRS18to6v3.F2010.cori-knl_intel
  SMS.ne120pg2_r0125_oRRS18to6v3.F2010-CICE.cori-knl_intel

We could slightly improve the MPASSI layouts if we generated more MPAS ICE partition files.

ndkeen added a commit that referenced this issue Dec 11, 2021
…t (PR #4696)

Add S,M,L,X,T for MPASSI
and update S,M,L,X,T for CICE

Fixes #4568

[bfb]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants