Chain Tip Estimate Test: Log chain progress while Zebra is syncing

[teor2345]

Motivation

1. This PR helps test if the chain tip estimate is accurate when it's used in zebrad. It will help diagnose problems during full sync tests.

2. On PR Estimate network chain tip height based on local node time and current best tip #3492, Janito asked:

I'd especially like to know if the solution I've implemented is too generic and complicated, and if I should change it to a simpler one.

Solution

I added a very simple chain tip progress log to Zebra.

This helped me answer the questions above:

1. I ran Zebra, the chain tip estimate seems to be accurate enough for both the full sync tests and lightwalletd.
2. The external ChainTip API is very easy to use. (The internals are much less important, because we don't have any plans to use them directly, or change them.)

This PR contains diagnostics for:

• Run full sync tests on Mainnet #1592

It implements part of the zebrad side of:

• Add a zebrad acceptance test that does a full sync to tip #3493

Review

@jvff can review this PR.

It depends on PR #3492.

Reviewer Checklist

• Code implements Specs and Designs
• Tests for Expected Behaviour
• Tests for Errors

Follow Up Work

• Log an info-level message when Zebra reaches each network upgrade #970
• log progress, remaining blocks, and remaining time to the next network upgrade

[codecov]

Codecov Report

Merging #3495 (b5e0670) into main (499ae89) will increase coverage by 0.31%.
The diff coverage is 79.41%.

@@            Coverage Diff             @@
##             main    #3495      +/-   ##
==========================================
+ Coverage   78.34%   78.65%   +0.31%     
==========================================
  Files         267      274       +7     
  Lines       31526    32500     +974     
==========================================
+ Hits        24698    25562     +864     
- Misses       6828     6938     +110     

[conradoplg]

Haven't reviewed the code but I tested it and already love it

Feb 09 10:55:39.297  INFO {zebrad="2e70b4f" net="Main"}:sync: zebrad::components::sync: extending tips tips.len=1 in_flight=127 lookahead_limit=2000 state_tip=Some(Height(1559584))
Feb 09 10:55:39.843  INFO {zebrad="2e70b4f" net="Main"}:sync: zebrad::components::sync: exhausted prospective tip set
Feb 09 10:55:39.843  INFO {zebrad="2e70b4f" net="Main"}:sync: zebrad::components::sync: waiting to restart sync timeout=67s state_tip=Some(Height(1559589))
Feb 09 10:56:17.237  INFO {zebrad="2e70b4f" net="Main"}:crawl_and_dial: zebra_network::peer_set::inventory_registry: dropped lagged inventory advertisements count=35
Feb 09 10:56:17.299  INFO {zebrad="2e70b4f" net="Main"}: zebrad::commands::start: estimated progress to chain tip sync_percent=99.992 remaining_sync_blocks=117

[teor2345]

It's even more fun on my local testnet sync, where the estimate each minute jumps by 2% 🎉

[jvff]

Looks good! This is very useful :D

The base branch was changed.