-
Notifications
You must be signed in to change notification settings - Fork 383
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Changing jobmin to 1 for batch q on blues #1511
Conversation
The jobmin for the "batch" queue on blues was set to 64 before and hence jobs that required more than 1 hr (> walltimemax for shared/debug queue) and less than 64 procs (jobmin for batch queue on blues is 64) did not fit in any available queue. Setting jobmin to 1 for blues+batch queue so that longer jobs that don't fit in the shared/debug queue fit the batch queue. Fixes #1484 [BFB]
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Might be better to make the shared queue the default. That way, the system will try to put the job in the faster queue first, and only use the slower one if it has to.
The NERSC machines and titan take the alternative approach right now - use the larger queue as default |
The default queue should probably work (OOB) for all cases created by the user |
@jayeshkrishna but we now have robust code to ensure that the larger queue will be used if needed. I'm worried about slow throughput if everything goes into the larger queue by default. |
The "regular" queue to submit the jobs on blues is the batch queue. If someone needs to debug their runs they need to submit to the "shared"/debug queue. |
I just tried a simple job with 2 nodes on blues and it was by default submitted to the batch queue. I think we should leave the batch queue as the default and the user can explicitly choose the debug/shared queue if needed (./create_newcase ... --queue=shared). |
On blues, the logic is "submit directly to the shared queue if the job is small enough and I want it to start immediately and I don't care if its a little slow" else don't specify a queue at all and you'll get in the batch queue. It to hard to separate the tests between shared and batch so submit everything to batch. |
Setting jobmin to 1 for blues+batch queue so that longer jobs that don't fit in the shared/debug queue fit the batch queue. Fixes #1484 [BFB] * jayeshkrishna/fix_blues_batchq_settings: Changing jobmin to 1 for batch q on blues
do not make dirs unless needed Only create rest directories if they are going to be populated Test suite: scripts_regression_tests.py and hand testing Test baseline: Test namelist changes: Test status: bit for bit Fixes #1449 User interface changes?: Code review:
Setting jobmin to 1 for blues+batch queue so that longer jobs that don't fit in the shared/debug queue fit the batch queue. Fixes #1484 [BFB] * jayeshkrishna/fix_blues_batchq_settings: Changing jobmin to 1 for batch q on blues
Setting jobmin to 1 for blues+batch queue so that longer jobs that don't fit in the shared/debug queue fit the batch queue. Fixes #1484 [BFB] * jayeshkrishna/fix_blues_batchq_settings: Changing jobmin to 1 for batch q on blues
Setting jobmin to 1 for blues+batch queue so that longer jobs that don't fit in the shared/debug queue fit the batch queue. Fixes #1484 [BFB] * jayeshkrishna/fix_blues_batchq_settings: Changing jobmin to 1 for batch q on blues
Setting jobmin to 1 for blues+batch queue so that longer jobs
that don't fit in the shared/debug queue fit the batch queue.
Fixes #1484
[BFB]