Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[3.2] improve CICD build time via faster artifact upload & parallel leap-dev creation #78

Merged
merged 1 commit into from
Aug 31, 2022

Conversation

spoonincode
Copy link
Member

This improves CICD build time by about 20% (reducing the build stage from ~5m to ~4m) by two improvements:

  • Use new upload-artifact-large-chunks-action which substantially increases the artifact upload performance for large files (like the builddir each build uploads). The improvement approaches 5x for these large 150MB files.
  • Build the leap-dev package in parallel while the tests run. It's not unusual for building the packages to take 30 seconds, so kicking that task over to a slow GitHub runner to be done in parallel while tests are running saves some time.

Some slight whitespace adjustments came along for the ride.

In retrospect I should have called "All Required Tests Passed" something like "All Required Jobs Passed" -- we want to make sure leap-dev builds, but it's not really a 'test'. Not willing to monkey with that any more at the moment. Then again, at some point in the future we'll want to test building contracts too after the leap-dev job.

@spoonincode spoonincode added the CICD Anything dealing with the CI workflow behavior label Aug 30, 2022
@heifner heifner changed the title improve CICD build time via faster artifact upload & parallel leap-dev creation [3.2] improve CICD build time via faster artifact upload & parallel leap-dev creation Aug 31, 2022
@spoonincode spoonincode merged commit bebc33d into main Aug 31, 2022
@spoonincode spoonincode deleted the minor_build_speed_improvement branch August 31, 2022 12:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CICD Anything dealing with the CI workflow behavior
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants