Code

rewrite sync manager#4599

Code

Merged

Kubuxu merged 26 commits intomasterfilecoin-project/lotus:masterfrom feat/sync-manager-reduxfilecoin-project/lotus:feat/sync-manager-reduxCopy head branch name to clipboardNov 6, 2020

+564-326

Commits

Commits on Oct 26, 2020

• rewrite sync manager

  vyzo

  committed
  5d34b7d

  Copy full SHA for 5d34b7d

• fix typo

  vyzo

  committed
  af53b72

  Copy full SHA for af53b72

• use weight as the sync target selector

  vyzo

  committed
  f26385d

  Copy full SHA for f26385d

• fix logging

  vyzo

  committed
  c0a039e

  Copy full SHA for c0a039e

• fix test

  vyzo

  committed
  f055681

  Copy full SHA for f055681

• set BootstrapPeerThreshold to 1, to mimic old code

  Show description for 2fd0d43
  vyzo

  committed
  2fd0d43

  Copy full SHA for 2fd0d43

Commits on Oct 27, 2020

• Add flag to coalesce Tipsets in pending queue

  Show description for 16d2cb6
  

  Jakub Sztandera

  committed
  16d2cb6

  Copy full SHA for 16d2cb6

• Fix tipset coalescing in case of repeated blocks

  Show description for 2b82e5a
  

  Jakub Sztandera

  committed
  2b82e5a

  Copy full SHA for 2b82e5a

• track recently synced tipsets to avoid unnecessary worker spawning

  vyzo

  committed
  ab7a66b

  Copy full SHA for ab7a66b

• simplify circular buffer code

  Show description for fc1ac3e
  vyzo

  committed
  fc1ac3e

  Copy full SHA for fc1ac3e

Commits on Oct 28, 2020

• limit max active sync workers

  vyzo

  committed
  469666d

  Copy full SHA for 469666d

• better handling of initial sync

  vyzo

  committed
  9ddf7bb

  Copy full SHA for 9ddf7bb

• stop the ticker when done with it

  vyzo

  committed
  188d164

  Copy full SHA for 188d164

• log worker spawning from initial sync deferrals

  vyzo

  committed
  6266bae

  Copy full SHA for 6266bae

• track last few worker states for debug purposes

  vyzo

  committed
  ba25126

  Copy full SHA for ba25126

• Add error if weights are the same

  Show description for e575b5f
  

  Jakub Sztandera

  committed
  e575b5f

  Copy full SHA for e575b5f

• Expose WorkerID

  Show description for ad905fc
  

  Jakub Sztandera

  committed
  ad905fc

  Copy full SHA for ad905fc

Commits on Oct 29, 2020

• add missing return for deferrals during initial sync

  vyzo

  committed
  a26420f

  Copy full SHA for a26420f

• rename initialSync to initialSyncDone

  vyzo

  committed
  8702ff8

  Copy full SHA for 8702ff8

• transition out of initial sync only if sync finishes within 15min

  vyzo

  committed
  a650641

  Copy full SHA for a650641

• set BootstrapPeerThreshold to 4, add env variable to override

  vyzo

  committed
  47830ef

  Copy full SHA for 47830ef

• fix spelling in comment to satisfy linter

  Show description for 57234d8
  vyzo

  committed
  57234d8

  Copy full SHA for 57234d8

• set BootstrapPeerThreshold to 1 for tests

  vyzo

  committed
  8d25fd3

  Copy full SHA for 8d25fd3

Commits on Oct 30, 2020

• check recent syncs in selectSyncTarget/selectDeferredSyncTarget

  vyzo

  committed
  f6ecff0

  Copy full SHA for f6ecff0

• fix sync wait cli

  vyzo

  committed
  5dcf339

  Copy full SHA for 5dcf339

• if noone is working pick the last worker in sync wait

  vyzo

  committed
  d6e2c80

  Copy full SHA for d6e2c80