Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Module and threading updates for Theta #1817

Merged
merged 6 commits into from
Oct 6, 2017
Merged

Conversation

amametjanov
Copy link
Member

Module and threading updates for Theta:

  • Add a default 64x1 PE layout
  • Update Depends.intel file
  • Update Theta modules
  • Add option to use pre-built MPAS tools
  • Reload env for tests with multiple case-dirs

[BFB]

@amametjanov amametjanov added BFB PR leaves answers BFB CIME Machine Files labels Oct 3, 2017
@amametjanov amametjanov self-assigned this Oct 3, 2017
@amametjanov amametjanov requested a review from jgfouca October 3, 2017 19:02
if not self._is_env_loaded:
def load_env(self, reset=False):
if not self._is_env_loaded or reset:
os.environ["OMP_NUM_THREADS"] = str(self.thread_count)
Copy link
Member Author

@amametjanov amametjanov Oct 3, 2017

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@jgfouca OMP_NUM_THREADS is not being properly reset when switching between runs of tests with multiple case-dirs. For example, with PET test OMP_NUM_THREADS remains at 1 at first run's case.submit.

Also, this moves the 4-line block's assignment at https://github.com/ACME-Climate/ACME/blob/master/cime/scripts/lib/CIME/case_run.py#L86 to happen earlier (so that it can be captured in logs/run_environment.txt).

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good catch.

amametjanov added a commit that referenced this pull request Oct 3, 2017
Module and threading updates for Theta:
* Add a default 64x1 PE layout
* Update Depends.intel file
* Update Theta modules
* Add option to use pre-built MPAS tools
* Reload env for tests with multiple case-dirs

[BFB]
jgfouca pushed a commit that referenced this pull request Oct 3, 2017
Fix SEQ test on skybridge.
Without this change, skybridge was trying to run this on a single node:
mpiexec --np 16 ppr=5 ...

With the PPR lowered to 5 due to the ROOTPE changes, but the --np not adjusted, the node could not accomodate this request.

After this change, it runs:
mpiexec --np 9 ppr=5 ...

Test suite: ./create_test SEQ_Ln9.f19_g16_rx1.A
Test baseline:
Test namelist changes:
Test status: bit for bit

Fixes [CIME Github issue #]

User interface changes?: N

Update gh-pages html (Y/N)?:

Code review: @jedwards4b
amametjanov added a commit that referenced this pull request Oct 6, 2017
Re-merge the PR to bring the new commit.
[BFB]
@amametjanov amametjanov merged commit 06487e4 into master Oct 6, 2017
amametjanov added a commit that referenced this pull request Oct 6, 2017
Module and threading updates for Theta:
* Add a default 64x1 PE layout
* Update Depends.intel file
* Update Theta modules
* Add option to use pre-built MPAS tools
* Reload env for tests with multiple case-dirs

[BFB]
@amametjanov amametjanov deleted the azamat/theta/mach-updates branch October 6, 2017 16:46
jgfouca pushed a commit that referenced this pull request Oct 25, 2017
Module and threading updates for Theta:
* Add a default 64x1 PE layout
* Update Depends.intel file
* Update Theta modules
* Add option to use pre-built MPAS tools
* Reload env for tests with multiple case-dirs

[BFB]
jgfouca pushed a commit that referenced this pull request Feb 27, 2018
Module and threading updates for Theta:
* Add a default 64x1 PE layout
* Update Depends.intel file
* Update Theta modules
* Add option to use pre-built MPAS tools
* Reload env for tests with multiple case-dirs

[BFB]
jgfouca pushed a commit that referenced this pull request Mar 14, 2018
Module and threading updates for Theta:
* Add a default 64x1 PE layout
* Update Depends.intel file
* Update Theta modules
* Add option to use pre-built MPAS tools
* Reload env for tests with multiple case-dirs

[BFB]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
BFB PR leaves answers BFB CIME Machine Files
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants