Feat/lit 1815 pull dynamic node urls

[joshLong145]

Usage

• yarn gen:internal-dev

note: the above command is added to the yarn build pipeline

• API: https://lit-general-worker.getlit.dev/internal-dev-contract-addresses

To review

Scripts

• package.json
• tools/scripts/gen-internal-dev.mjs

Output

• packages/constants/src/lib/constants/autogen_internal.ts

Integrations

• packages/constants/src/lib/constants/constants.ts
• packages/core/src/lib/lit-core.ts

Additionally

• lit-general-worker PR: https://github.com/LIT-Protocol/lit-apps/pull/8/files

Test

1. Run yarn build
2. Run yarn test:e2e:node --filter=test-connection-internal-dev

• e2e-nodejs/group-connection/test-connection-internal-dev.mjs

[Lit-JS-SDK v3.0.16] handshakeWithSgx http://199.115.117.113:443/web/handshake
[Lit-JS-SDK v3.0.16] sendCommandToNode with url http://199.115.117.113:443/web/handshake and data { clientPublicKey: 'test' }
[Lit-JS-SDK v3.0.16] handshakeWithSgx http://199.115.117.114:443/web/handshake
[Lit-JS-SDK v3.0.16] sendCommandToNode with url http://199.115.117.114:443/web/handshake and data { clientPublicKey: 'test' }
[Lit-JS-SDK v3.0.16] handshakeWithSgx http://108.62.0.105:443/web/handshake
[Lit-JS-SDK v3.0.16] sendCommandToNode with url http://108.62.0.105:443/web/handshake and data { clientPublicKey: 'test' }
[Lit-JS-SDK v3.0.16] handshakeWithSgx http://64.131.85.106:443/web/handshake
[Lit-JS-SDK v3.0.16] sendCommandToNode with url http://64.131.85.106:443/web/handshake and data { clientPublicKey: 'test' }
[Lit-JS-SDK v3.0.16] handshakeWithSgx http://64.131.85.108:443/web/handshake
[Lit-JS-SDK v3.0.16] sendCommandToNode with url http://64.131.85.108:443/web/handshake and data { clientPublicKey: 'test' }
[Lit-JS-SDK v3.0.16] handshakeWithSgx http://167.114.17.201:443/web/handshake
[Lit-JS-SDK v3.0.16] sendCommandToNode with url http://167.114.17.201:443/web/handshake and data { clientPublicKey: 'test' }
[Lit-JS-SDK v3.0.16] handshakeWithSgx http://167.114.17.202:443/web/handshake
[Lit-JS-SDK v3.0.16] sendCommandToNode with url http://167.114.17.202:443/web/handshake and data { clientPublicKey: 'test' }
[Lit-JS-SDK v3.0.16] handshakeWithSgx http://167.114.17.203:443/web/handshake
[Lit-JS-SDK v3.0.16] sendCommandToNode with url http://167.114.17.203:443/web/handshake and data { clientPublicKey: 'test' }
[Lit-JS-SDK v3.0.16] handshakeWithSgx http://167.114.17.204:443/web/handshake
[Lit-JS-SDK v3.0.16] sendCommandToNode with url http://167.114.17.204:443/web/handshake and data { clientPublicKey: 'test' }
[Lit-JS-SDK v3.0.16] handshakeWithSgx http://167.114.17.205:443/web/handshake
[Lit-JS-SDK v3.0.16] sendCommandToNode with url http://167.114.17.205:443/web/handshake and data { clientPublicKey: 'test' }
[Lit-JS-SDK v3.0.16] ✅ [BLS SDK] wasmExports loaded. 12 functions available. Run 'wasmExports' in the console to see them.
[Lit-JS-SDK v3.0.16] ✅ [ECDSA SDK NodeJS] wasmECDSA loaded. 6 functions available. Run 'wasmECDSA' in the console to see them.
Something went wrong, internal id for request: lit_c043c891323d1. Please provide this identifier with any support requests. Error is request to http://199.115.117.113:443/web/handshake failed, reason: socket hang up - undefined
[Lit-JS-SDK v3.0.16] Error connecting to node  http://199.115.117.113:443 FetchError: request to http://199.115.117.113:443/web/handshake failed, reason: socket hang up

Implementations

Implementation for calculating the validator set which takes the current active set and removes kicked validators

public static getValidators = async (network: "cayenne" | "internalDev"): Promise<string[]> => {

    const contract = await LitContracts.getStakingContract(network);

    // Fetch contract data
    const [activeValidators, currentValidatorsCount, kickedValidators] =
      await Promise.all([
        contract['getValidatorsStructsInCurrentEpoch'](),
        contract['currentValidatorCountForConsensus'](),
        contract['getKickedValidators'](),
      ]);

    const validators = [];

    // Check if active validator set meets the threshold
    if (
      activeValidators.length - kickedValidators.length >=
      currentValidatorsCount
    ) {
      // Process each validator
      for (const validator of activeValidators) {
        validators.push(validator);
      }
    } else {
      console.log('❌ Active validator set does not meet the threshold');
    }

    // remove kicked validators in active validators
    const cleanedActiveValidators = activeValidators.filter(
      (av: any) => !kickedValidators.some((kv: any) => kv.nodeAddress === av.nodeAddress)
    );

    const networks = cleanedActiveValidators.map((item: any) => {
      let proto = "https://";
      if (item.port !== 443) {
        proto = "http://";
      }
      return `${proto}${intToIP(item.ip)}:${item.port}`;
    });

    return networks;
  };

We calc the threshold or minNodeCount with the implementation below:

  public static getMinNodeCount = async (network: "cayenne" | "internalDev") => {

    const contract = await LitContracts.getStakingContract(network);

    const configs = await contract['config']();
    const minNodeCount = configs.minimumValidatorCount.toString();

    if (!minNodeCount) {
      throw new Error('❌ Minimum validator count is not set');
    }
    return minNodeCount;
  }

After connection we listen to StateChanged events on the Staking contract to reload network urls / threshold

[CLAassistant]

Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.
5 out of 7 committers have signed the CLA.

✅ joshLong145
✅ Ansonhkg
✅ glitch003
✅ ericlewis
✅ vmc-crossmint
❌ VoR0220
❌ Adarsh-Kumar28
_{You have signed the CLA already but the status is still pending? Let us recheck it.}

[glitch003]

this looks good to me! will try to get manzano up to test with, too