Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

MacOS CI repeated fails #2462

Closed
thomas-bc opened this issue Jan 2, 2024 · 1 comment · Fixed by #2466
Closed

MacOS CI repeated fails #2462

thomas-bc opened this issue Jan 2, 2024 · 1 comment · Fixed by #2466
Labels

Comments

@thomas-bc
Copy link
Collaborator

thomas-bc commented Jan 2, 2024

F´ Version
Affected Component

Problem Description

MacOS CI has been failing repeatedly for no apparent reason, timing out after 6 hours. See for example
https://github.com/nasa/fprime/actions/runs/7302456221/job/19901093748?pr=2454
https://github.com/nasa/fprime/actions/runs/7294730948/job/19901273821?pr=2451

@thomas-bc thomas-bc added the bug label Jan 2, 2024
@LeStarch
Copy link
Collaborator

LeStarch commented Jan 4, 2024

This problem started around the time we corrected fprime-util to build with parallelism properly. This implies that the higher number of parallel jobs causes the issue.

As noted by @thomas-bc: actions/runner#1326 seems to be related. There is a lot of speculation that it could be an OOM or large memory usage that causes the issue. We know FPP (Jav)a uses much memory, as does gcc/g++ so running many parallel jobs could strain the memory usage.

I would recommend we do the following:

  1. Specifically limit macOS jobs to a single job or small number of jobs
  2. Add a timeout as suggested there to something more normal

Looking for build-parallelism issues with random numbers of jobs could be restricted to Ubuntu as a matter of practicality.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants