Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix CI Build: what happens if we get rid of nrwl packages and replace with nx equiv… #736

Closed
wants to merge 11 commits into from

Conversation

glitch003
Copy link
Collaborator

…ilant? the build issue seems to be related to conflicting nx versions

Ref: nrwl/nx#26517

The error in our CI:

[4/4] Building fresh packages...
error /home/runner/work/js-sdk/js-sdk/node_modules/@nrwl/eslint-plugin-nx/node_modules/@nrwl/tao/node_modules/nx, /home/runner/work/js-sdk/js-sdk/node_modules/@nrwl/eslint-plugin-nx/node_modules/@nx/workspace/node_modules/nx: Command failed.
Exit code: 135
Command: node ./bin/post-install
Arguments: 
Directory: /home/runner/work/js-sdk/js-sdk/node_modules/@nrwl/eslint-plugin-nx/node_modules/@nrwl/tao/node_modules/nx
Output:
Bus error (core dumped)
info Visit https://yarnpkg.com/en/docs/cli/install for documentation about this command.

…ilant? the build issue seems to be related to conflicting nx versions
@glitch003
Copy link
Collaborator Author

this seemed to work to get around the dependency installation error i saw here: https://github.com/LIT-Protocol/js-sdk/actions/runs/12204989808/job/34051291211

but a new error appeared. maybe the docker container is dying? i can use the warpbuild "ssh into a runner" thingy to debug.

[𐬺🧪 Tinny Environment𐬺] Failed to init() tinny request to http://127.0.0.1:8000/test/get/testnets failed, reason: connect ECONNREFUSED 127.0.0.1:8000
FetchError: request to http://127.0.0.1:8000/test/get/testnets failed, reason: connect ECONNREFUSED 127.0.0.1:8000
    at ClientRequest.<anonymous> (/home/runner/work/js-sdk/js-sdk/node_modules/node-fetch/lib/index.js:1501:11)
    at ClientRequest.emit (node:events:518:28)
    at emitErrorEvent (node:_http_client:101:11)
    at Socket.socketErrorListener (node:_http_client:504:5)
    at Socket.emit (node:events:518:28)
    at emitErrorNT (node:internal/streams/destroy:169:8)
    at emitErrorCloseNT (node:internal/streams/destroy:128:3)
    at process.processTicksAndRejections (node:internal/process/task_queues:82:21)
Command failed with exit code 1: /tmp/yarn--1733877129009-0.1[63](https://github.com/LIT-Protocol/js-sdk/actions/runs/12267166068/job/34226745514?pr=736#step:15:64)87183850458453/node ./local-tests/build/test.mjs --filter=testUseEoaSessionSigsToExecuteJsSigning,testUseEoaSessionSigsToPkpSign,testUsePkpSessionSigsToExecuteJsSigning,testUsePkpSessionSigsToPkpSign,testUseValidLitActionCodeGeneratedSessionSigsToPkpSign,testUseValidLitActionCodeGeneratedSessionSigsToExecuteJsSigning,testDelegatingCapacityCreditsNFTToAnotherWalletToExecuteJs,testEthAuthSigToEncryptDecryptString,testExecuteJsSignAndCombineEcdsa,testExecutJsDecryptAndCombine,testExecuteJsBroadcastAndCollect --exclude=Parallel
error Command failed with exit code 1.
info Visit https://yarnpkg.com/en/docs/cli/run for documentation about this command.

@glitch003 glitch003 changed the title what happens if we get rid of nrwl packages and replace with nx equiv… Fix CI Build: what happens if we get rid of nrwl packages and replace with nx equiv… Dec 11, 2024
@glitch003
Copy link
Collaborator Author

some progress - i was able to SSH in and get these logs from Shiva

up to date, audited 838 packages in 4s

146 packages are looking for funding
  run `npm fund` for details

37 vulnerabilities (25 low, 3 moderate, 9 high)

To address issues that do not require attention, run:
  npm audit fix

To address all issues possible (including breaking changes), run:
  npm audit fix --force

Some issues need review, and may require choosing
a different dependency.

Run `npm audit` for details.
npm notice
npm notice New minor version of npm available! 10.7.0 -> 10.9.2
npm notice Changelog: https://github.com/npm/cli/releases/tag/v10.9.2
npm notice To update run: npm install -g npm@10.9.2
npm notice
Directory does not exists. Creating temp directory
Downloading builds at hash: ae3c20e07eb933b61073689b95f56867c03de252
Downloading manifest at hash: ae3c20e07eb933b61073689b95f56867c03de252
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100   834  100   834    0     0   5919      0 --:--:-- --:--:-- --:--:--  5957
Downloading binary from archive url: https://api.github.com/repos/LIT-Protocol/lit-assets/actions/artifacts/1843726982/zip
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100   153  100   153    0     0   1180      0 --:--:-- --:--:-- --:--:--  1176
Archive:  archive.zip
  End-of-central-directory signature not found.  Either this file is not
  a zipfile, or it constitutes one disk of a multi-part archive.  In the
  latter case the central directory and zipfile comment will be found on
  the last disk(s) of this archive.
unzip:  cannot find zipfile directory in one of archive.zip or
        archive.zip.zip, and cannot find archive.zip.ZIP, period.
chmod: cannot access '/data/rust/lit-node/target/debug/lit_node_ae3c20e07eb933b61073689b95f56867c03de252/lit-node/common/target/debug/shiva': No such file or directory
cp: cannot stat '/data/rust/lit-node/target/debug/lit_node_ae3c20e07eb933b61073689b95f56867c03de252/lit-node/common/target/debug/shiva': No such file or directory
cp: cannot stat '/data/rust/lit-node/target/debug/lit_node_ae3c20e07eb933b61073689b95f56867c03de252/lit-node/target/debug/lit_node': No such file or directory
cp: cannot stat '/data/rust/lit-node/target/debug/lit_node_ae3c20e07eb933b61073689b95f56867c03de252/lit-actions/target/debug/lit_actions': No such file or directory
chmod: cannot access '/usr/bin/lit_node': No such file or directory
chmod: cannot access '/usr/bin/lit_actions': No such file or directory
chmod: cannot access 'shiva': No such file or directory
/app/start_shiva.sh: 65: ./shiva: not found

@glitch003
Copy link
Collaborator Author

Now seeing that libc6 is missing. Going to add to lit-assets and re-run here with that commit hash.

Run `npm audit` for details.
Directory does not exists. Creating temp directory
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100   835  100   835    0     0   2922      0 --:--:-- --:--:-- --:--:--  2919
100   835  100   835    0     0   2922      0 --:--:-- --:--:-- --:--:--  2919
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0

  0  748M    0  [31](https://github.com/LIT-Protocol/js-sdk/actions/runs/12284460181/job/34280269165#step:16:32)9k    0     0   341k      0  0:37:22 --:--:--  0:37:22  341k
  2  748M    2 20.0M    0     0  10.1M      0  0:01:13  0:00:01  0:01:12 19.0M
  6  748M    6 52.0M    0     0  17.4M      0  0:00:42  0:00:02  0:00:40 25.3M
 11  748M   11 82.9M    0     0  21.1M      0  0:00:35  0:00:03  0:00:[32](https://github.com/LIT-Protocol/js-sdk/actions/runs/12284460181/job/34280269165#step:16:33) 27.6M
 15  748M   15  114M    0     0  23.3M      0  0:00:32  0:00:04  0:00:28 28.7M
 19  748M   19  146M    0     0  24.7M      0  0:00:30  0:00:05  0:00:25 29.3M
 23  748M   23  178M    0     0  25.8M      0  0:00:28  0:00:06  0:00:22 32.0M
 28  748M   28  210M    0     0  26.6M      0  0:00:28  0:00:07  0:00:21 32.1M
 32  748M   32  242M    0     0  27.2M      0  0:00:27  0:00:08  0:00:19 31.9M
 36  748M   36  274M    0     0  27.6M      0  0:00:27  0:00:09  0:00:18 31.9M
 40  748M   40  306M    0     0  28.0M      0  0:00:26  0:00:10  0:00:16 31.9M
 44  748M   44  [33](https://github.com/LIT-Protocol/js-sdk/actions/runs/12284460181/job/34280269165#step:16:34)5M    0     0  28.1M      0  0:00:26  0:00:11  0:00:15 31.3M
 48  748M   48  366M    0     0  28.3M      0  0:00:26  0:00:12  0:00:14 30.9M
 53  748M   53  398M    0     0  28.5M      0  0:00:26  0:00:13  0:00:13 30.8M
 57  748M   57  428M    0     0  28.7M      0  0:00:26  0:00:14  0:00:12 30.8M
 61  748M   61  458M    0     0  28.7M      0  0:00:25  0:00:15  0:00:10 30.4M
 65  748M   65  490M    0     0  28.9M      0  0:00:25  0:00:16  0:00:09 30.9M
 69  748M   69  522M    0     0  29.1M      0  0:00:25  0:00:17  0:00:08 31.2M
 74  748M   74  554M    0     0  29.2M      0  0:00:25  0:00:18  0:00:07 31.3M
 78  748M   78  586M    0     0  29.3M      0  0:00:25  0:00:19  0:00:06 31.3M
 82  748M   82  618M    0     0  29.5M      0  0:00:25  0:00:20  0:00:05 31.8M
 85  748M   85  641M    0     0  29.2M      0  0:00:25  0:00:21  0:00:04 30.3M
 88  748M   88  664M    0     0  28.9M      0  0:00:25  0:00:22  0:00:03 28.2M
 91  748M   91  687M    0     0  28.7M      0  0:00:26  0:00:23  0:00:03 26.6M
 95  748M   95  711M    0     0  28.5M      0  0:00:26  0:00:24  0:00:02 25.2M
 98  748M   98  740M    0     0  28.5M      0  0:00:26  0:00:25  0:00:01 24.3M
100  748M  100  748M    0     0  28.5M      0  0:00:26  0:00:26 --:--:-- 25.0M
./shiva: /lib/x86_64-linux-gnu/libm.so.6: version `GLIBC_2.38' not found (required by ./shiva)
./shiva: /lib/x86_64-linux-gnu/libc.so.6: version `GLIBC_2.39' not found (required by ./shiva)
Downloading builds at hash: 2f38a85e7b72c1f[35](https://github.com/LIT-Protocol/js-sdk/actions/runs/12284460181/job/34280269165#step:16:36)2ec51b05768db7971697b2c
Downloading manifest at hash: 2f38a85e7b72c1f352ec51b05768db7971697b2c
Downloading binary from archive url: https://api.github.com/repos/LIT-Protocol/lit-assets/actions/artifacts/2306858232/zip
Archive:  archive.zip
  inflating: rust/lit-node/target/debug/lit_node_2f[38](https://github.com/LIT-Protocol/js-sdk/actions/runs/12284460181/job/34280269165#step:16:39)a85e7b72c1f352ec51b05768db7971697b2c/lit-node/target/debug/lit_node  
  inflating: rust/lit-node/target/debug/lit_node_2f38a85e7b72c1f352ec51b05768db7971697b2c/lit-actions/target/debug/lit_actions  
  inflating: rust/lit-node/target/debug/lit_node_2f38a85e7b72c1f352ec51b05768db7971697b2c/lit-node/common/target/debug/shiva

@glitch003
Copy link
Collaborator Author

ok i think i figured out the actual issue! i believe that we were using "latest" for making the build, which uses ubuntu 24 on warpbuild, but then docker uses ubuntu 22, which causes the "missing glibc" issue, because the build happened on a different version of ubuntu with a diff libc. i'm testing changing the build to happen using ubuntu 22, so that it should work out of the box with docker ubuntu 22.

@glitch003 glitch003 marked this pull request as ready for review December 12, 2024 02:37
@glitch003 glitch003 requested a review from Ansonhkg as a code owner December 12, 2024 02:37
@glitch003
Copy link
Collaborator Author

this seems to work - but i want to see if we can dynamically get the latest datil release commit hash so that we don't have to fix this every 30 days when the github artifact expires lol. that PR is an extension of this one here #737

@glitch003
Copy link
Collaborator Author

Closing in favor of #736 which includes everything in this PR but also dynamically gets the latest datil build commit hash.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant