waiting_close_channels does not close

[MykelSIlver]

Background

Describe your issue here.
Funds are stuck forever because confirmations never occur after a force closechannel command

Your environment

• version of lnd
  0.10.0-beta commit=v0.10.0-beta

• which operating system (uname -a on *Nix)
  Linux 4.19.97-v7l+ lnwallet/channel: set add heights based on the locked in commits #1294 SMP Thu Jan 30 13:21:14 GMT 2020 armv7l GNU/Linux

• version of bitcoind
  v0.19.1

• any other relevant environment details

Steps to reproduce

lncli closechannel --force 7eefdd051e3d1473862d6ec6f2a4d0bcc8f57737305dee6fd52145e43109bbe4
{
        "closing_txid": "f4623e8cd85f54d13c5a04cae4d881ff1988f79ef6f3fb343b299132bfa2149a"
}

Journalctl returns the following message:

May 29 10:40:52 m2 lnd[3013]: 2020-05-29 10:40:52.450 [INF] CNCT: Attempting to force close ChannelPoint(7eefdd051e3d1473862d6ec6f2a4d0bcc8f57737305dee6fd52145e43109bbe4:0)                                                                                          
May 29 10:40:52 m2 lnd[3013]: 2020-05-29 10:40:52.451 [WRN] CNCT: Unable to disable channel 7eefdd051e3d1473862d6ec6f2a4d0bcc8f57737305dee6fd52145e43109bbe4:0 on close: edge not found                                                                               
May 29 10:40:52 m2 lnd[3013]: yeee: *bdb.db
May 29 10:40:52 m2 lnd[3013]: 2020-05-29 10:40:52.462 [INF] CNCT: ChannelArbitrator(7eefdd051e3d1473862d6ec6f2a4d0bcc8f57737305dee6fd52145e43109bbe4:0): force closing chan                                                                                           
May 29 10:40:52 m2 lnd[3013]: 2020-05-29 10:40:52.466 [INF] HSWC: Removing channel link with ChannelID(e4bb0931e44521d56fee5d303777f5c8bcd0a4f2c66e2d8673143d1e05ddef7e)                                                                                              
May 29 10:40:52 m2 lnd[3013]: 2020-05-29 10:40:52.554 [INF] CNCT: Broadcasting force close transaction f4623e8cd85f54d13c5a04cae4d881ff1988f79ef6f3fb343b299132bfa2149a, ChannelPoint(7eefdd051e3d1473862d6ec6f2a4d0bcc8f57737305dee6fd52145e43109bbe4:0): (*wire.MsgTx
)(0x5c52900)({                                                                                                                                                                                                                                                        
May 29 10:40:52 m2 lnd[3013]:  Version: (int32) 2,                                                                                                                                                                                                                    
May 29 10:40:52 m2 lnd[3013]:  TxIn: ([]*wire.TxIn) (len=1 cap=1) {                                                                                                                                                                                                   
May 29 10:40:52 m2 lnd[3013]:   (*wire.TxIn)(0x5a280c0)({
May 29 10:40:52 m2 lnd[3013]:    PreviousOutPoint: (wire.OutPoint) 7eefdd051e3d1473862d6ec6f2a4d0bcc8f57737305dee6fd52145e43109bbe4:0,
May 29 10:40:52 m2 lnd[3013]:    SignatureScript: ([]uint8) <nil>,
May 29 10:40:52 m2 lnd[3013]:    Witness: (wire.TxWitness) (len=4 cap=4) {
May 29 10:40:52 m2 lnd[3013]:     ([]uint8) <nil>,
May 29 10:40:52 m2 lnd[3013]:     ([]uint8) (len=72 cap=144) {
May 29 10:40:52 m2 lnd[3013]:      00000000  30 45 02 21 00 da 25 1c  33 3a 0b 13 a7 c4 c8 a0  |0E.!..%.3:......|
May 29 10:40:52 m2 lnd[3013]:      00000010  cb 8c 8b 8c c4 c5 77 5e  9f 8c 2e 02 23 d6 5d 22  |......w^....#.]"|
May 29 10:40:52 m2 lnd[3013]:      00000020  e2 87 ab 29 7c 02 20 64  d5 a3 a9 93 20 33 d0 d1  |...)|. d.... 3..|
May 29 10:40:52 m2 lnd[3013]:      00000030  3d 58 7d 2f 9f 58 9c 98  eb ec 8e 08 5e 2c 57 95  |=X}/.X......^,W.|
May 29 10:40:52 m2 lnd[3013]:      00000040  5e dc 17 85 a4 7a a1 01                           |^....z..|
May 29 10:40:52 m2 lnd[3013]:     },
May 29 10:40:52 m2 lnd[3013]:     ([]uint8) (len=71 cap=144) {
May 29 10:40:52 m2 lnd[3013]:      00000000  30 44 02 20 3a 5c 9f 4f  13 b8 8d eb d2 fa 64 bc  |0D. :\.O......d.|
May 29 10:40:52 m2 lnd[3013]:      00000010  3c 6a 94 8a 36 3e 04 6d  92 d8 b4 c5 1d e4 f1 7c  |<j..6>.m.......||
May 29 10:40:52 m2 lnd[3013]:      00000020  8f c5 db 0b 02 20 78 58  f2 29 75 48 41 36 41 25  |..... xX.)uHA6A%|
May 29 10:40:52 m2 lnd[3013]:      00000030  b9 b0 8e 87 95 d3 34 10  51 d0 24 d1 7c 85 c4 a9  |......4.Q.$.|...|
May 29 10:40:52 m2 lnd[3013]:      00000040  fa da 9d db 41 4a 01                              |....AJ.|
May 29 10:40:52 m2 lnd[3013]:     },
May 29 10:40:52 m2 lnd[3013]:     ([]uint8) (len=71 cap=500) {
May 29 10:40:52 m2 lnd[3013]:      00000000  52 21 02 17 b4 25 19 c5  6e f4 e4 a2 c3 fe f8 3a  |R!...%..n......:|
May 29 10:40:52 m2 lnd[3013]:      00000010  84 25 a0 49 c7 b3 2a a5  52 c3 f5 60 c9 0a a4 62  |.%.I..*.R..`...b|
May 29 10:40:52 m2 lnd[3013]:      00000020  06 54 ac 21 02 54 05 6f  b9 69 37 e8 79 14 39 f9  |.T.!.T.o.i7.y.9.|
May 29 10:40:52 m2 lnd[3013]:      00000030  cf b5 b8 f8 c7 17 34 55  92 4f 55 31 e7 c7 8f d6  |......4U.OU1....|
May 29 10:40:52 m2 lnd[3013]:      00000040  c6 d8 18 bd 92 52 ae                              |.....R.|
May 29 10:40:52 m2 lnd[3013]:     }
May 29 10:40:52 m2 lnd[3013]:    },
May 29 10:40:52 m2 lnd[3013]:    Sequence: (uint32) 2151299135
May 29 10:40:52 m2 lnd[3013]:   })
May 29 10:40:52 m2 lnd[3013]:  },
May 29 10:40:52 m2 lnd[3013]:  TxOut: ([]*wire.TxOut) (len=1 cap=1) {
May 29 10:40:52 m2 lnd[3013]:   (*wire.TxOut)(0x5c52920)({
May 29 10:40:52 m2 lnd[3013]:    Value: (int64) 99817,
May 29 10:40:52 m2 lnd[3013]:    PkScript: ([]uint8) (len=34 cap=34) {
May 29 10:40:52 m2 lnd[3013]:     00000000  00 20 02 7f a7 76 55 78  e7 d1 37 87 21 7e b0 f4  |. ...vUx..7.!~..|
May 29 10:40:52 m2 lnd[3013]:     00000010  d4 2a c5 35 b5 98 98 3e  ae 9c 6b 19 16 fc 49 3a  |.*.5...>..k...I:|
May 29 10:40:52 m2 lnd[3013]:     00000020  30 ef                                             |0.|
May 29 10:40:52 m2 lnd[3013]:    }
May 29 10:40:52 m2 lnd[3013]:   })                                                                                                                                                                                                                                    
May 29 10:40:52 m2 lnd[3013]:  },                                                                                                                                                                                                                                     
May 29 10:40:52 m2 lnd[3013]:  LockTime: (uint32) 541394286                                                                                                                                                                                                           
May 29 10:40:52 m2 lnd[3013]: })                                                                                                                                                                                                                                      
May 29 10:40:52 m2 lnd[3013]: 2020-05-29 10:40:52.554 [INF] LNWL: Inserting unconfirmed transaction f4623e8cd85f54d13c5a04cae4d881ff1988f79ef6f3fb343b299132bfa2149a                                                                                                  
May 29 10:40:52 m2 lnd[3013]: yeee: *bdb.db                                                                                                                                                                                                                           
May 29 10:40:52 m2 lnd[3013]: 2020-05-29 10:40:52.601 [INF] CNCT: ChannelArbitrator(7eefdd051e3d1473862d6ec6f2a4d0bcc8f57737305dee6fd52145e43109bbe4:0): trigger userTrigger moving from state StateCommitmentBroadcasted to StateCommitmentBroadcasted               
May 29 10:40:52 m2 lnd[3013]: 2020-05-29 10:40:52.601 [INF] PEER: Waiting for confirmation of cooperative close of ChannelPoint(7eefdd051e3d1473862d6ec6f2a4d0bcc8f57737305dee6fd52145e43109bbe4:0) with txid: f4623e8cd85f54d13c5a04cae4d881ff1988f79ef6f3fb343b299132
bfa2149a
May 29 10:40:52 m2 lnd[3013]: 2020-05-29 10:40:52.601 [INF] NTFN: New confirmation subscription: conf_id=2, txid=f4623e8cd85f54d13c5a04cae4d881ff1988f79ef6f3fb343b299132bfa2149a, num_confs=1 height_hint=632155    

lncli pendingchannels gives

{
    "total_limbo_balance": "99817",
    "pending_open_channels": [
    ],
    "pending_closing_channels": [
    ],
    "pending_force_closing_channels": [
    ],
    "waiting_close_channels": [
        {
            "channel": {
                "remote_node_pub": "028a8e53d70bc0eb7b5660943582f10b7fd6c727a78ad819ba8d45d6a638432c49",
                "channel_point": "7eefdd051e3d1473862d6ec6f2a4d0bcc8f57737305dee6fd52145e43109bbe4:0",
                "capacity": "100000",
                "local_balance": "99817",
                "remote_balance": "0",
                "local_chan_reserve_sat": "1000",
                "remote_chan_reserve_sat": "1000",
                "initiator": "INITIATOR_LOCAL",
                "commitment_type": "STATIC_REMOTE_KEY"
            },
            "limbo_balance": "99817",
            "commitments": {
                "local_txid": "f4623e8cd85f54d13c5a04cae4d881ff1988f79ef6f3fb343b299132bfa2149a",
                "remote_txid": "0d7914452b823328a0679882e6a40f64587a62824ce5db9b066f60b5db13d823",
                "remote_pending_txid": "",
                "local_commit_fee_sat": "183",
                "remote_commit_fee_sat": "183",
                "remote_pending_commit_fee_sat": "0"
            }
        }
    ]
}

After 65 new blocks found the lncli listchaintxns command still reports ZERO confirmations!
Here is the output of 'lncli listchaintxns'

lncli listchaintxns
{
    "transactions": [
        {
            "tx_hash": "f4623e8cd85f54d13c5a04cae4d881ff1988f79ef6f3fb343b299132bfa2149a",
            "amount": "0",
            "num_confirmations": 0,
            "block_hash": "",
            "block_height": 0,
            "time_stamp": "1590741652",
            "total_fees": "0",
            "dest_addresses": [
                "bc1qqfl6waj40rnazdu8y9ltpax59tzntdvcnql2a8rtryt0cjf6xrhszd8cm6"
            ],
            "raw_tx_hex": "02000000000101e4bb0931e44521d56fee5d303777f5c8bcd0a4f2c66e2d8673143d1e05ddef7e00000000003f383a8001e985010000000000220020027fa7765578e7d13787217eb0f4d42ac535b598983eae9c6b1916fc493a30ef0400483045022100da251c333a0b13a7c4c8a0cb8c8b8cc4c5775e9f8c2e0223d65d22e287ab297c022064d5a3a9932033d0d13d587d2f9f589c98ebec8e085e2c57955edc1785a47aa10147304402203a5c9f4f13b88debd2fa64bc3c6a948a363e046d92d8b4c51de4f17c8fc5db0b02207858f229754841364125b9b08e8795d3341051d024d17c85c4a9fada9ddb414a014752210217b42519c56ef4e4a2c3fef83a8425a049c7b32aa552c3f560c90aa4620654ac210254056fb96937e8791439f9cfb5b8f8c7173455924f5531e7c78fd6c6d818bd9252ae6e054520"
        },
        {
            "tx_hash": "7eefdd051e3d1473862d6ec6f2a4d0bcc8f57737305dee6fd52145e43109bbe4",
            "amount": "-100177",
            "num_confirmations": 0,
            "block_hash": "",
            "block_height": 0,
            "time_stamp": "1590652515",
            "total_fees": "177",
            "dest_addresses": [
                "bc1qkemwrnxy4cvs76dj4568fd2wj0ahjmsgyh48es0fgs8kce938rdqfkmw02",
                "bc1q7rdt65hyw0wr8mgj4vt8qftpf62x9d5gpr827e"
            ],
            "raw_tx_hex": "02000000000101f69a4500208650a12e6c9f9ddbfa0ddb57f6e4b533932e15d7778cae4d0ef6090100000017160014b134a0ec12376a7baed253bd83e4aa3fa3326cf10000000002a086010000000000220020b676e1ccc4ae190f69b2ad3474b54e93fb796e0825ea7cc1e9440f6c64b138da2873100000000000160014f0dabd52e473dc33ed12ab167025614e9462b6880247304402203dc9a49ed801dc77dc795c95f29569c3eefb712aeac726fd069aebf39659e98c022001cebe5e34d295e24e5b00c0565f8e046447b24eb018fc494d6170ebb9cf275701210397247fe4e052334a52bd177675f985fe852b83eaf334dc22b44ed4ada13b019700000000"
        }
    ]
}

As a result lncli walletbalance has no confirmed balance so i can not do anything anymore because no confirmed funds are left to do anything.
Output of lncli walletbalance

lncli walletbalance
{
    "total_balance": "1078056",
    "confirmed_balance": "0",
    "unconfirmed_balance": "1078056"
}

live.blockcypher.com shows the transaction keeps stuck in unconfirmed state:

Restarting the lnd daemon
When i restart the lnd daemon the output in the journalctl gives the following message:
[WRN] PEER: ChannelPoint(7eefdd051e3d1473862d6ec6f2a4d0bcc8f57737305dee6fd52145e43109bbe4:0) has status ChanStatusBorked|ChanStatusCommitBroadcasted|ChanStatusLocalCloseInitiator, won't start.

For me this looks like a quite serious WRN message!

How can i make the waiting_close_channels to go on with closing the channel or at least some confirmation will appear in the listchaintxns command when new blocks are found and my funds are available again in my wallet.

Any help is appreciated! Thanks.

[MykelSIlver]

Fees were very/too low. Confirmations have started from now on. I close this call!