Update cori_atmnbfb testing to use new e3sm_simple environment #6
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Need to unload the python module that comes from `cork-knl_setup.sh` then activate the `e3sm_simple` environment
jhkennedy
commented
Aug 4, 2019
|
I'm assuming my input isn't needed on this but let me know. |
jgfouca
approved these changes
Aug 4, 2019
jgfouca
added a commit
to E3SM-Project/E3SM
that referenced
this pull request
Aug 16, 2019
Update climate reproducibility tests (MVK, PGN, TSC) Updates the MVK, PGN, and TSC climate reproducibility tests to all be production ready. They will all generate an appropriate baseline, run the comparison and produce a pass-fail result, and through EVV provide a portable website with in-depth test details to analyze why these tests pass/fail. An example of the output websites produced for both a failing case and a bit-for-bit case can be seen here: https://livvkit.github.io/evv4esm/index.html This will allow the e3sm_atm_nbfb test suite, under E3SM_Custom_Tests on the test dashboard, to pass and be operationally effective for climate reproducibility testing (tests' motivation discussed here ). These tests add external python dependencies to CIME (but only when one of these tests are run) and as such require a python environment with some of the scientific python stack. An e3sm_simple environment has been deployed to cori in the same manner as the e3sm_unified environment and will provide the necessary dependencies; see E3SM-Project/e3sm-unified#53. Additionally, the jenkins job which runs these test on cori-knl will be updated to use the e3sm_simple environment through E3SM-Project/E3SM_test_scripts#6. New baselines will need to be generated for these tests. [B4B] * origin/jhkennedy/cime/climate-repo-update: Add MVK test to e3sm_atm_nbfb test suite Refactor climate reproducibility ests for e3sm_simple env and EVV release Remove unneeded requirements.txt b/c of conda package Finished PGN refactor Partial refactor of PGN system test Minor updates for MVK system tests PEP8 and string formatting updates for PNG test Update MVK for E3SM atmosphere component directory name changes
jgfouca
added a commit
to E3SM-Project/E3SM
that referenced
this pull request
Aug 16, 2019
Update climate reproducibility tests (MVK, PGN, TSC) Updates the MVK, PGN, and TSC climate reproducibility tests to all be production ready. They will all generate an appropriate baseline, run the comparison and produce a pass-fail result, and through EVV provide a portable website with in-depth test details to analyze why these tests pass/fail. An example of the output websites produced for both a failing case and a bit-for-bit case can be seen here: https://livvkit.github.io/evv4esm/index.html This will allow the e3sm_atm_nbfb test suite, under E3SM_Custom_Tests on the test dashboard, to pass and be operationally effective for climate reproducibility testing (tests' motivation discussed here ). These tests add external python dependencies to CIME (but only when one of these tests are run) and as such require a python environment with some of the scientific python stack. An e3sm_simple environment has been deployed to cori in the same manner as the e3sm_unified environment and will provide the necessary dependencies; see E3SM-Project/e3sm-unified#53. Additionally, the jenkins job which runs these test on cori-knl will be updated to use the e3sm_simple environment through E3SM-Project/E3SM_test_scripts#6. New baselines will need to be generated for these tests. [B4B] * origin/jhkennedy/cime/climate-repo-update: Add MVK test to e3sm_atm_nbfb test suite Refactor climate reproducibility ests for e3sm_simple env and EVV release Remove unneeded requirements.txt b/c of conda package Finished PGN refactor Partial refactor of PGN system test Minor updates for MVK system tests PEP8 and string formatting updates for PNG test Update MVK for E3SM atmosphere component directory name changes
|
@jgfouca I think this one's ready now |
jgfouca
added a commit
to ESMCI/cime
that referenced
this pull request
Aug 20, 2019
Update climate reproducibility tests (MVK, PGN, TSC) Updates the MVK, PGN, and TSC climate reproducibility tests to all be production ready. They will all generate an appropriate baseline, run the comparison and produce a pass-fail result, and through EVV provide a portable website with in-depth test details to analyze why these tests pass/fail. An example of the output websites produced for both a failing case and a bit-for-bit case can be seen here: https://livvkit.github.io/evv4esm/index.html This will allow the e3sm_atm_nbfb test suite, under E3SM_Custom_Tests on the test dashboard, to pass and be operationally effective for climate reproducibility testing (tests' motivation discussed here ). These tests add external python dependencies to CIME (but only when one of these tests are run) and as such require a python environment with some of the scientific python stack. An e3sm_simple environment has been deployed to cori in the same manner as the e3sm_unified environment and will provide the necessary dependencies; see E3SM-Project/e3sm-unified#53. Additionally, the jenkins job which runs these test on cori-knl will be updated to use the e3sm_simple environment through E3SM-Project/E3SM_test_scripts#6. New baselines will need to be generated for these tests. [B4B] * origin/jhkennedy/cime/climate-repo-update: Add MVK test to e3sm_atm_nbfb test suite Refactor climate reproducibility ests for e3sm_simple env and EVV release Remove unneeded requirements.txt b/c of conda package Finished PGN refactor Partial refactor of PGN system test Minor updates for MVK system tests PEP8 and string formatting updates for PNG test Update MVK for E3SM atmosphere component directory name changes
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
The climate reproducibility tests being run in the
cori_atmnbfbtest suite are being refactored in [Forthcoming CIME PR] to use the EVV conda package, which is installed in the newe3sm_simpleconda environment. This updates thecori_atmnbfbjenkins job to usee3sm_simple.I also updated the README a bit to use more of the available code markdown syntax.
Still TODOThis is marked as a WIP because these things are required first:
e3sm_simpletocori-knl; follow progress at Add a cime_env environment e3sm-unified#53Note: The current version of the PGN test being run in the
cori_atmnbfbtest suite requires the Scikit Learn conda package but the refactored PGN will not need it (same things accomplished in numpy). So:e3sm_simpleenvironment because of the missingscikit-learnpackagepython/2.7-anaconda-5.2environment currently used oncori-knlbecause of the missingevv4esmpackage.