Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CI][Testing] Add BuildJet CI runners for unit tests, integration tests; cache Docker images #4906

Merged
merged 89 commits into from
Nov 10, 2023
Merged
Changes from 1 commit
Commits
Show all changes
89 commits
Select commit Hold shift + click to select a range
bc5e7ef
unit tests, integration tests using buildjet-4vcpu runner
gomisha Oct 30, 2023
fb69048
listTargetPackages() returns map of CI runners
gomisha Nov 1, 2023
291e71d
test for custom runners
gomisha Nov 1, 2023
e7a7f7e
generateTestMatrix() stores CI runner
gomisha Nov 1, 2023
371e4b3
more testing with custom CI runners
gomisha Nov 1, 2023
00117a4
CI test - 2 unit tests running buildjet runners
gomisha Nov 1, 2023
6a25c05
increase engine unit tests to 8 vCPUs
gomisha Nov 1, 2023
0a3854b
resource manager full load test (8 vCPUs)
gomisha Nov 2, 2023
983e488
network/test tests unquarantined, increased runners
gomisha Nov 2, 2023
0b422d5
Merge branch 'master' into misha/6894-buildjet-ci-test
gomisha Nov 2, 2023
6048198
increased to 16 vCPUs
gomisha Nov 2, 2023
eb81e79
increased engine tests to 16 vCPUs
gomisha Nov 3, 2023
d496e7f
insecure module uses buildjet 4 vcpu runner
gomisha Nov 3, 2023
d320b6b
bft framework integration test using buildjet
gomisha Nov 3, 2023
620d6a1
engine tests split up to 6 jobs with default runners
gomisha Nov 3, 2023
daeac5f
added back all integration tests
gomisha Nov 3, 2023
98c5197
upgraded runners for some integration tests, engine/execution
gomisha Nov 3, 2023
1259067
dummy commit to kick off CI
gomisha Nov 3, 2023
959bf17
split up TestScriptExecutionAndGetAccounts into 3 tests
gomisha Nov 3, 2023
027513c
updated runners for Epoch Cohort2, Access Integration Tests
gomisha Nov 6, 2023
e6a5ef3
AN integration tests split up into 3 cohorts (skip unit, other integr…
gomisha Nov 6, 2023
10c9edd
docker build using GitHub cache
gomisha Nov 6, 2023
c589487
remove saving Docker image locally
gomisha Nov 6, 2023
5998a0d
cache v3, saving local tar before caching, 8vcpu
gomisha Nov 6, 2023
9f86a31
add 11 docker images to docker-images.tar, 16 vcpu
gomisha Nov 6, 2023
ba1b00f
docker save multiline fix; skip localnet-test
gomisha Nov 6, 2023
544b877
docker build increase to 32 vcpu
gomisha Nov 6, 2023
99a9b9e
buildjet cache instead of GitHub cache
gomisha Nov 6, 2023
0e4d303
lint fix
gomisha Nov 6, 2023
94192f6
activate more integration tests with default runners, using cached Do…
gomisha Nov 6, 2023
c1f10f1
docker-build downsized to 16 vcpu
gomisha Nov 6, 2023
5ebfaa0
integration test without relic build
gomisha Nov 6, 2023
6ca0231
put back relic build for integration tests
gomisha Nov 6, 2023
8766f2a
put back all remaining integration tests using BuildJet runners
gomisha Nov 6, 2023
d637a60
Merge branch 'master' into misha/6894-buildjet-ci-test
gomisha Nov 6, 2023
deab1b1
Merge branch 'misha/6894-buildjet-ci-test' of https://github.com/onfl…
gomisha Nov 6, 2023
a9b3441
integration tests reverted to ubuntu-latest runners
gomisha Nov 7, 2023
034942d
re-activated unit-test, unit-test-modules jobs
gomisha Nov 7, 2023
3037af2
added (failing) test for sub-sub packages
gomisha Nov 7, 2023
35f4706
sub-sub packages support
gomisha Nov 7, 2023
1520df6
sub-sub package test enhanced
gomisha Nov 7, 2023
357d9c5
updated other tests to support new sub-sub packages
gomisha Nov 7, 2023
1591a60
split up engine/execution unit tests into 3 jobs
gomisha Nov 7, 2023
645fc0b
engine/execution/ingestion upgraded to 4 vcpu
gomisha Nov 7, 2023
37ecc81
engine/execution/ingestion:buildjet-8vcpu
gomisha Nov 8, 2023
f52d044
network/test, network/p2p increased to 8 vcpu; added remaining networ…
gomisha Nov 8, 2023
a4bfe9c
BFT Framework, Epoch Cohort 2 - increased to 4 vcpu
gomisha Nov 8, 2023
abc6048
upgraded runners for Access Cohort 1, Epoch Cohort 1, 2
gomisha Nov 8, 2023
91a5adf
epoch cohort2 upgraded to 16 vcpu
gomisha Nov 8, 2023
d0b29ce
BFT Framework upgrade to 8 vcpu, epoch cohort2 removed flaky test, do…
gomisha Nov 8, 2023
655cf1c
quarantined flaky test - TestEpochJoinAndLeaveVN
gomisha Nov 8, 2023
14e0019
quarantined flaky test - TestSealingAndVerificationPassThrough
gomisha Nov 8, 2023
b98a39d
Merge branch 'master' into misha/6894-buildjet-ci-test
gomisha Nov 8, 2023
e2b0cdc
lint fix
gomisha Nov 8, 2023
457ae50
network/test split up into network/test/cohort1, network/test/cohort2
gomisha Nov 8, 2023
1554902
network/p2p split up into 4 subpackages
gomisha Nov 8, 2023
7944c28
extracted network/alsp into separate job
gomisha Nov 8, 2023
6e03881
extracted module/dkg into separate job
gomisha Nov 8, 2023
52bd044
engine/execution/ingestion dowgraded to stock runner
gomisha Nov 8, 2023
32afbca
added engine parent package as separate job
gomisha Nov 8, 2023
d8df732
added storage parent package as separate job
gomisha Nov 8, 2023
ec2d6c5
added state package as separate job
gomisha Nov 8, 2023
43c862e
removed localnet-test job
gomisha Nov 8, 2023
d7c598d
engine/execution/ingestion upgraded to 2 vcpu
gomisha Nov 8, 2023
56a4a17
network/p2p/p2pnode upgraded to 2 vcpu
gomisha Nov 8, 2023
60c281e
module, engine upgraded to 2 vcpu
gomisha Nov 8, 2023
1423ee2
network/p2p/p2pnode upgraded to 4 vcpu
gomisha Nov 8, 2023
de74efb
network/test/cohort2 upgraded to 4 vcpu
gomisha Nov 8, 2023
4884166
engine upgraded to 4 vcpu
gomisha Nov 8, 2023
4ad3fa4
engine/execution/ingestion upgraded to 4 vcpu, network/test/cohort1 u…
gomisha Nov 8, 2023
acdb459
network/test/cohort1 upgraded to 4 vcpu
gomisha Nov 8, 2023
3ed7c01
engine/execution/ingestion upgraded to 8 vcpu
gomisha Nov 8, 2023
b540d8f
network/test/cohort1 upgraded to 8 vcpu
gomisha Nov 8, 2023
14b8c6c
BFT (Protocol) upgraded to 4 vcpu
gomisha Nov 8, 2023
ab7cd72
network/test/cohort1 upgraded to 16 vcpu
gomisha Nov 8, 2023
aa60cab
BFT (Protocol), Epoch Cohort1 upgraded to 8 vcpu
gomisha Nov 8, 2023
c1826f9
noop push to kick off CI
gomisha Nov 9, 2023
7c96928
Module (integration) upgraded to 4 vcpu
gomisha Nov 9, 2023
ac432e2
TestUnicastRateLimit_Messages flaky test quarantined
gomisha Nov 9, 2023
7c922cb
noop push to kick off CI
gomisha Nov 9, 2023
ced2ce9
buildjet/cache@v3 => actions/cache@v3
gomisha Nov 9, 2023
76e2f53
test retries increased to 5, timeout increased to 35 mins
gomisha Nov 9, 2023
47e71f9
module job increased to 4 vcpu
gomisha Nov 9, 2023
9f889cc
Merge branch 'master' into misha/6894-buildjet-ci-test
gomisha Nov 9, 2023
b60901b
unquarantined epoch flaky test after it was fixed
gomisha Nov 9, 2023
6761410
unlink flaky test monitor workflow from running when ci changes
gomisha Nov 9, 2023
131490c
Merge branch 'misha/6894-buildjet-ci-test' of https://github.com/onfl…
gomisha Nov 9, 2023
8d6dfe4
clean up
gomisha Nov 9, 2023
d9d1b42
lint fix
gomisha Nov 9, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Module (integration) upgraded to 4 vcpu
  • Loading branch information
gomisha committed Nov 9, 2023
commit 7c969288067ab40567fd028c09a98599c1db4286
3 changes: 1 addition & 2 deletions .github/workflows/ci.yml
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,6 @@ on:
branches:
- master


env:
GO_VERSION: "1.20"

Expand Down Expand Up @@ -161,7 +160,7 @@ jobs:
make2: test
retries: 3
race: 0
runner: ubuntu-latest
runner: buildjet-4vcpu-ubuntu-2204
runs-on: ${{ matrix.runner }}
steps:
- name: Checkout repo
Expand Down
Loading