Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Missing some user functionality from CIME5.1 case dir taskmaker script. #1263

Closed
rljacob opened this issue Mar 18, 2017 · 2 comments
Closed
Assignees

Comments

@rljacob
Copy link
Member

rljacob commented Mar 18, 2017

CIME5.1 had a "taskmaker" script in every case directory with a bunch of useful options (see below) that don't seem to exist in the latest 5.3

ACME especially needs "taskmaker --aprun" function to be available somehow. "--mpriun" and "--pbsrs" look useful.

blogin2[134]: ./taskmaker --help
usage: 
taskmaker [--task-geom|-thread-geom|--sum-pes|--sum-tasks|--max-threads|--aprun|--mpirun|--pbsrs (wes|san|ivy|has) [--verbose]
OR
taskmaker --help
OR
taskmaker --test

EXAMPLES:
    #  
    > taskmaker -taskgeom

Get task-level information for a case.

positional arguments:
  caseroot              Case directory to analyze (default: /lcrc/group/earths
                        cience/jacob/ACME3/cime/scripts/Wcycl5.1)

optional arguments:
  -h, --help            show this help message and exit
  -d, --debug           Print debug information (very verbose) to file /lcrc/g
                        roup/earthscience/jacob/ACME3/cime/scripts/Wcycl5.1/ta
                        skmaker.log (default: False)
  -v, --verbose         Add additional context (time and file) to log messages
                        (default: False)
  -s, --silent          Print only warnings and error messages (default:
                        False)
  --sum-pes             report total number of pes: (mpi tasks)x(threads)
                        (default: False)
  --sum-tasks           report total number of mpi tasks (default: False)
  --max-threads         report max threads over all mpi tasks (default: False)
  --task-geom           report task geometry string for IBM (default: False)
  --thread-geom         report thread geometry string for IBM (default: False)
  --aprun               report aprun options for Cray XT (default: False)
  --pbsrs {None,wes,san,ivy,has}
                        report PBS resources option for the given NAS node
                        type name (default: None)
  --all                 report everything (default: False)
  --mpirun              report mpirun command per model (default: False)
@rljacob rljacob changed the title Missing some functionality from CIME5.1 taskmaker script. Missing some user functionality from CIME5.1 case dir taskmaker script. Mar 23, 2017
@rljacob rljacob added the ready label Mar 23, 2017
@rljacob
Copy link
Member Author

rljacob commented Apr 10, 2017

@jgfouca Got another request for this from ACME users at OLCF.

@jgfouca
Copy link
Contributor

jgfouca commented Apr 10, 2017

OK, I should be able to get to it this week.

@ghost ghost added in progress and removed ready labels Apr 14, 2017
@ghost ghost removed the in progress label Apr 27, 2017
jgfouca added a commit that referenced this issue Apr 27, 2017
Give users more info and control over key run commands

Adds new tool 'preview_run' to give users a preview of what their batch submissions and mpirun will look like.

Adds new override XML variables so users can exercise direct control over there batch and mpirun cmds if they want (advanced users only).

Test suite: scripts_regression_tests --fast
Test baseline:
Test namelist changes:
Test status: bit for bit

Fixes #1263

User interface changes?: Signficant: new preview_run tool and new XML variables

Code review: Many
jgfouca added a commit that referenced this issue Jun 2, 2017
Upstream merge to resolve conflicts.

* master: (93 commits)
  Adds the --force-move option and implies --copy-only when --last-date is specified without --force-move
  added spunup A_WCYCL options (1850S and 2000S) for v0atm
  Updates land initial conditions for ne120_oRRS18v3
  Fix jenkins_generic_job when user selects specific machines.
  Fix small problems with MPAS components from debug tests
  Adds a warning when using the --last-date option and to its help
  Implement the copy_only option for short term archiving. This copies files rather than moving them
  Implemented most of the machinery for testing with "incomplete" log files
  Fix code format issue - replace unused variable with _
  Update template.st_archive
  Adds options to the st_archive to specify the last date (--last-date) to archive, and whether to disable archiving incomplete log files (--no-incomplete-logs)
  Turn off salinity restoring by default until it passes exact restart
  This is a fix to a PR #1501 (github issue #1263). I allocated the tmp_array to be too large and GNU compiler stopped with an array mismatch. Change this to be state%ncol in size, not pcol
  Fix a floating invalid that we found with certain PE's (and with intel v17.02)
  bug fix
  Revert mpas-o commit with new threaded vector reconstruction consistency changes
  Changing jobmin to 1 for batch q on blues
  Modifies SMS_D_Ln5_P8x4 to SMS_Ln5 to avoid cetus and melvin issues
  Point at corrected salinity restoring files for oEC60to30v3 and oRRS18to6v3
  Make sure clean clm cleans up obj dir
  ...
jgfouca added a commit that referenced this issue Feb 23, 2018
Upstream merge to resolve conflicts.

* master: (93 commits)
  Adds the --force-move option and implies --copy-only when --last-date is specified without --force-move
  added spunup A_WCYCL options (1850S and 2000S) for v0atm
  Updates land initial conditions for ne120_oRRS18v3
  Fix jenkins_generic_job when user selects specific machines.
  Fix small problems with MPAS components from debug tests
  Adds a warning when using the --last-date option and to its help
  Implement the copy_only option for short term archiving. This copies files rather than moving them
  Implemented most of the machinery for testing with "incomplete" log files
  Fix code format issue - replace unused variable with _
  Update template.st_archive
  Adds options to the st_archive to specify the last date (--last-date) to archive, and whether to disable archiving incomplete log files (--no-incomplete-logs)
  Turn off salinity restoring by default until it passes exact restart
  This is a fix to a PR #1501 (github issue #1263). I allocated the tmp_array to be too large and GNU compiler stopped with an array mismatch. Change this to be state%ncol in size, not pcol
  Fix a floating invalid that we found with certain PE's (and with intel v17.02)
  bug fix
  Revert mpas-o commit with new threaded vector reconstruction consistency changes
  Changing jobmin to 1 for batch q on blues
  Modifies SMS_D_Ln5_P8x4 to SMS_Ln5 to avoid cetus and melvin issues
  Point at corrected salinity restoring files for oEC60to30v3 and oRRS18to6v3
  Make sure clean clm cleans up obj dir
  ...
jgfouca added a commit that referenced this issue Mar 13, 2018
Upstream merge to resolve conflicts.

* master: (93 commits)
  Adds the --force-move option and implies --copy-only when --last-date is specified without --force-move
  added spunup A_WCYCL options (1850S and 2000S) for v0atm
  Updates land initial conditions for ne120_oRRS18v3
  Fix jenkins_generic_job when user selects specific machines.
  Fix small problems with MPAS components from debug tests
  Adds a warning when using the --last-date option and to its help
  Implement the copy_only option for short term archiving. This copies files rather than moving them
  Implemented most of the machinery for testing with "incomplete" log files
  Fix code format issue - replace unused variable with _
  Update template.st_archive
  Adds options to the st_archive to specify the last date (--last-date) to archive, and whether to disable archiving incomplete log files (--no-incomplete-logs)
  Turn off salinity restoring by default until it passes exact restart
  This is a fix to a PR #1501 (github issue #1263). I allocated the tmp_array to be too large and GNU compiler stopped with an array mismatch. Change this to be state%ncol in size, not pcol
  Fix a floating invalid that we found with certain PE's (and with intel v17.02)
  bug fix
  Revert mpas-o commit with new threaded vector reconstruction consistency changes
  Changing jobmin to 1 for batch q on blues
  Modifies SMS_D_Ln5_P8x4 to SMS_Ln5 to avoid cetus and melvin issues
  Point at corrected salinity restoring files for oEC60to30v3 and oRRS18to6v3
  Make sure clean clm cleans up obj dir
  ...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants