Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

reduce memory required by MERRA2 data #757

Merged
merged 4 commits into from
Oct 29, 2021
Merged

reduce memory required by MERRA2 data #757

merged 4 commits into from
Oct 29, 2021

Conversation

DeniseWorthen
Copy link
Collaborator

@DeniseWorthen DeniseWorthen commented Oct 11, 2021

MERRA2 data is stored as float (r4) in the source files. When read in it is immediately promoted to double precision before being interpolated in time and space to the ATM model grid and timestep. The size of the associated (x,y,z,t,ntra) arrays in double precision causes the coupled model at C384mx025 to fail on Cheyenne.intel.

If the ingested arrays are retained as single precision until they are interpolated in aerinterpol, there is no change in model forecast file fields but all tests are able to run on Cheyenne.intel.

Associated ufs-weather-model issue #698
Required for ufs-weather-model PR #866

DeniseWorthen and others added 2 commits October 9, 2021 08:05
* switch aerin and aer_pres to r*4. time and space
bilinear interp will be done on r*4 variables and type
promotion to r*8 will occur there
Copy link
Collaborator

@climbfuji climbfuji left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @DeniseWorthen for this simple yet powerful change. If I understand you correctly, then the regression tests using MERRA2 will not change results, correct (Intel/GNU in Prod/Debug)?

@DeniseWorthen
Copy link
Collaborator Author

The regression tests baselines will change, but only because I'd like to correct the diag_table used by the P7 tests to include the AOD variables at the same time. I didn't update them correctly when I committed the P7 tests. All common fields in the forecast files are B4B when I tested on hera.intel and hera.gnu.

@AnningCheng-NOAA
Copy link
Collaborator

It is good to know the results are the same with improved the speed. Approved.
How much gain is it?

@DeniseWorthen
Copy link
Collaborator Author

@AnningCheng-NOAA This change is not expected to impact the speed of the model.

climbfuji added a commit that referenced this pull request Oct 29, 2021
…ompson

Remove Noah-WRFv4, bug fix in Thompson MP inner loop, contains "reduce memory required by MERRA2 data" (#757)
@climbfuji climbfuji merged commit 56cb648 into NCAR:main Oct 29, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants