Code

Add --X-trie-log subcommand#6303

Code

Merged

gfukushima merged 27 commits intohyperledger:mainhyperledger/besu:mainfrom gfukushima:x-trie-log-subcommand-2gfukushima/besu:x-trie-log-subcommand-2Copy head branch name to clipboardJan 8, 2024

+814-15

Commits

Commits on Dec 15, 2023

• Add x-trie-log subcommand for one-off backlog prune

  Show description for 16c0a49
  

  siladu

  authored and

  gfukushima

  committed
  16c0a49

  Copy full SHA for 16c0a49

• long -> int

  Show description for 7dd4928
  

  siladu

  authored and

  gfukushima

  committed
  7dd4928

  Copy full SHA for 7dd4928

• Removed banned method

  Show description for bf2b098
  gfukushima

  committed
  bf2b098

  Copy full SHA for bf2b098

• Preload process stream in parallel

  Show description for e67ae51
  gfukushima

  committed
  e67ae51

  Copy full SHA for e67ae51

• Drop unwanted trielogs and keep reatain layers only

  Show description for 9b4e0c9
  gfukushima

  committed
  9b4e0c9

  Copy full SHA for 9b4e0c9

• Add output to user and cleanup refactor

  Show description for 0b9fe83
  gfukushima

  committed
  0b9fe83

  Copy full SHA for 0b9fe83

• small tweak to display cf that had reference dropped by RocksDbSegmentIdentifier.reset()

  Show description for 426848e
  gfukushima

  committed
  426848e

  Copy full SHA for 426848e

• spotless

  Show description for 7401b59
  gfukushima

  committed
  7401b59

  Copy full SHA for 7401b59

• Fix classes that changed package

  Show description for 1b7fb72
  gfukushima

  committed
  1b7fb72

  Copy full SHA for 1b7fb72

• spotless

  Show description for 11e6b05
  gfukushima

  committed
  11e6b05

  Copy full SHA for 11e6b05

• Code review

  Show description for f2d01e2
  gfukushima

  committed
  f2d01e2

  Copy full SHA for f2d01e2

• Only clear DB when we have the exact amount of trie logs we want in memory

  Show description for 04f1aaa
  gfukushima

  committed
  04f1aaa

  Copy full SHA for 04f1aaa

Commits on Dec 18, 2023

• Trielogs stream to and from file to avoid possibly OOM

  Show description for 2f01c5a
  gfukushima

  committed
  2f01c5a

  Copy full SHA for 2f01c5a

• Process trie logs in chunks to avoid OOM

  Show description for 56e4c8e
  gfukushima

  committed
  56e4c8e

  Copy full SHA for 56e4c8e

Commits on Dec 19, 2023

• save and read in batches to handle edge cases

  Show description for 78561b0
  gfukushima

  committed
  78561b0

  Copy full SHA for 78561b0

Commits on Dec 20, 2023

• save and read files to/from database dir

  Show description for 42c72cf
  gfukushima

  committed
  42c72cf

  Copy full SHA for 42c72cf

• Merge branch 'main' into x-trie-log-subcommand-2

  gfukushima

  committed
  9961fc2

  Copy full SHA for 9961fc2

Commits on Dec 21, 2023

• add unit tests and PR review fixes

  Show description for 9389540
  gfukushima

  committed
  9389540

  Copy full SHA for 9389540

• Merge branch 'main' into x-trie-log-subcommand-2

  gfukushima

  committed
  e3d4fbc

  Copy full SHA for e3d4fbc

• spdx

  Show description for c7144fe
  gfukushima

  committed
  c7144fe

  Copy full SHA for c7144fe

• Fix unit tests directory creation and deletion

  Show description for 20b0ba5
  gfukushima

  committed
  20b0ba5

  Copy full SHA for 20b0ba5

Commits on Jan 3, 2024

• Merge branch 'main' into x-trie-log-subcommand-2

  gfukushima

  authored
  e7d175c

  Copy full SHA for e7d175c

Commits on Jan 4, 2024

• PR review

  Show description for b214bf2
  gfukushima

  committed
  b214bf2

  Copy full SHA for b214bf2

• Merge branch 'main' into x-trie-log-subcommand-2

  gfukushima

  committed
  aa75348

  Copy full SHA for aa75348

• Merge remote-tracking branch 'origin/x-trie-log-subcommand-2' into x-trie-log-subcommand-2

  gfukushima

  committed
  2bc0732

  Copy full SHA for 2bc0732

Commits on Jan 8, 2024

• Merge branch 'main' into x-trie-log-subcommand-2

  gfukushima

  authored
  deec021

  Copy full SHA for deec021

• Merge branch 'main' into x-trie-log-subcommand-2

  gfukushima

  authored
  5d7b68e

  Copy full SHA for 5d7b68e