Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Changing jobmin to 1 for batch q on blues #1511

Merged
merged 1 commit into from
May 12, 2017

Conversation

jayeshkrishna
Copy link
Contributor

Setting jobmin to 1 for blues+batch queue so that longer jobs
that don't fit in the shared/debug queue fit the batch queue.

Fixes #1484
[BFB]

The jobmin for the "batch" queue on blues was set to 64 before
and hence jobs that required more than 1 hr (> walltimemax for
shared/debug queue) and less than 64 procs (jobmin for batch
queue on blues is 64) did not fit in any available queue.

Setting jobmin to 1 for blues+batch queue so that longer jobs
that don't fit in the shared/debug queue fit the batch queue.

Fixes #1484
[BFB]
@jayeshkrishna jayeshkrishna self-assigned this May 9, 2017
@jayeshkrishna jayeshkrishna requested a review from jgfouca May 9, 2017 19:57
jayeshkrishna added a commit that referenced this pull request May 9, 2017
…1511)

Setting jobmin to 1 for blues+batch queue so that longer jobs
that don't fit in the shared/debug queue fit the batch queue.

Fixes #1484
[BFB]
Copy link
Member

@jgfouca jgfouca left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Might be better to make the shared queue the default. That way, the system will try to put the job in the faster queue first, and only use the slower one if it has to.

@jayeshkrishna
Copy link
Contributor Author

The NERSC machines and titan take the alternative approach right now - use the larger queue as default

@jayeshkrishna
Copy link
Contributor Author

The default queue should probably work (OOB) for all cases created by the user

@jgfouca
Copy link
Member

jgfouca commented May 9, 2017

@jayeshkrishna but we now have robust code to ensure that the larger queue will be used if needed. I'm worried about slow throughput if everything goes into the larger queue by default.

@jayeshkrishna
Copy link
Contributor Author

The "regular" queue to submit the jobs on blues is the batch queue. If someone needs to debug their runs they need to submit to the "shared"/debug queue.
Let me see if the batch system pushes a small job by default to the "shared" queue (if so, making it the default should be ok).

@jayeshkrishna
Copy link
Contributor Author

I just tried a simple job with 2 nodes on blues and it was by default submitted to the batch queue. I think we should leave the batch queue as the default and the user can explicitly choose the debug/shared queue if needed (./create_newcase ... --queue=shared).

@rljacob
Copy link
Member

rljacob commented May 10, 2017

On blues, the logic is "submit directly to the shared queue if the job is small enough and I want it to start immediately and I don't care if its a little slow" else don't specify a queue at all and you'll get in the batch queue. It to hard to separate the tests between shared and batch so submit everything to batch.

@jayeshkrishna jayeshkrishna merged commit 25d10a6 into master May 12, 2017
jayeshkrishna added a commit that referenced this pull request May 12, 2017
Setting jobmin to 1 for blues+batch queue so that longer jobs
that don't fit in the shared/debug queue fit the batch queue.

Fixes #1484
[BFB]

* jayeshkrishna/fix_blues_batchq_settings:
  Changing jobmin to 1 for batch q on blues
jgfouca added a commit that referenced this pull request Jun 2, 2017
do not make dirs unless needed

Only create rest directories if they are going to be populated

Test suite: scripts_regression_tests.py and hand testing
Test baseline:
Test namelist changes:
Test status: bit for bit

Fixes #1449

User interface changes?:

Code review:
jgfouca pushed a commit that referenced this pull request Jun 2, 2017
Setting jobmin to 1 for blues+batch queue so that longer jobs
that don't fit in the shared/debug queue fit the batch queue.

Fixes #1484
[BFB]

* jayeshkrishna/fix_blues_batchq_settings:
  Changing jobmin to 1 for batch q on blues
@jayeshkrishna jayeshkrishna deleted the jayeshkrishna/fix_blues_batchq_settings branch January 26, 2018 19:07
jgfouca pushed a commit that referenced this pull request Feb 27, 2018
Setting jobmin to 1 for blues+batch queue so that longer jobs
that don't fit in the shared/debug queue fit the batch queue.

Fixes #1484
[BFB]

* jayeshkrishna/fix_blues_batchq_settings:
  Changing jobmin to 1 for batch q on blues
jgfouca pushed a commit that referenced this pull request Mar 14, 2018
Setting jobmin to 1 for blues+batch queue so that longer jobs
that don't fit in the shared/debug queue fit the batch queue.

Fixes #1484
[BFB]

* jayeshkrishna/fix_blues_batchq_settings:
  Changing jobmin to 1 for batch q on blues
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants