Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fixed platforms subsequent cycles on localhost. #4169

Merged
merged 5 commits into from
Apr 13, 2021

Conversation

wxtim
Copy link
Member

@wxtim wxtim commented Apr 12, 2021

Discovered a bug where host ⇒ plaform upgrade only worked on first cycle.
Cause: becuase Python passes refs rather than creating objects the upgrader
function popped the required info for the first instance of a task.
Fix: have platform_from_job_info put popped information back when it's
finished.

These changes close #4167
Requirements check-list

  • I have read CONTRIBUTING.md and added my name as a Code Contributor.
  • Contains logically grouped changes (else tidy your branch by rebase).
  • Does not contain off-topic changes (use other PRs for other changes).
  • Appropriate tests are included (unit and/or functional).
  • Appropriate change log entry included.
  • No documentation update required.
  • No dependency changes.

@wxtim wxtim self-assigned this Apr 12, 2021
@wxtim wxtim added bug Something is wrong :( platforms-follow-up labels Apr 12, 2021
@wxtim wxtim added this to the cylc-8.0b1 milestone Apr 12, 2021
@wxtim wxtim force-pushed the platforms.fix-popping-host-info branch 2 times, most recently from 86fde66 to cdc064b Compare April 12, 2021 11:42
@wxtim wxtim requested review from datamel and MetRonnie April 12, 2021 11:42
Discovered a bug where host ⇒ plaform upgrade only worked on first cycle.
Cause: becuase Python passes refs rather than creating objects the upgrader
    function popped the required info for the first instance of a task.
Fix: have `platform_from_job_info` put popped information back when it's
    finished.
@wxtim wxtim force-pushed the platforms.fix-popping-host-info branch from cdc064b to 2460e69 Compare April 12, 2021 11:49
@wxtim wxtim marked this pull request as draft April 12, 2021 21:01
@wxtim wxtim requested a review from MetRonnie April 13, 2021 07:46
@wxtim wxtim marked this pull request as ready for review April 13, 2021 08:00
@wxtim wxtim closed this Apr 13, 2021
@wxtim wxtim reopened this Apr 13, 2021
@wxtim wxtim closed this Apr 13, 2021
@wxtim wxtim reopened this Apr 13, 2021
@wxtim wxtim closed this Apr 13, 2021
@wxtim wxtim reopened this Apr 13, 2021
Copy link
Member

@MetRonnie MetRonnie left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, with one small suggestion. I've run the fast tests locally, and tests/f/platforms/02-host-to-platform-upgrade. Keeping an eye on the running func tests here https://github.com/cylc/cylc-flow/actions/runs/743942309

It may be necessary to take any that fail on Actions due to DNS and run them locally

Co-authored-by: Ronnie Dutta <61982285+MetRonnie@users.noreply.github.com>
Copy link
Member

@oliver-sanders oliver-sanders left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ran the "fast tests" locally, all passed (GH failures due to DNS issues):

cylc.flow.exceptions.ClientTimeout: Timeout waiting for server response. This could be due to network or server issues. Check the suite log.

Can ignore for now (with local testing).

Looks good.

Tested locally with:

[remote]
  [[t1]]
    [[[job]]]
      batch system = background
  [[t2]]
    [[[remote]]]
      host = myremote
  [[t3]]
    platform = myremote

Over multiple cycles and submission batches, all good.

@oliver-sanders oliver-sanders removed the request for review from datamel April 13, 2021 12:22
@oliver-sanders oliver-sanders merged commit 5836224 into cylc:master Apr 13, 2021
@wxtim wxtim deleted the platforms.fix-popping-host-info branch April 13, 2021 13:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something is wrong :(
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Platforms not selected from host on Cycle > 1
3 participants