Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

CheckProvable Sector FAULT: cache an/or sealed paths not found #3577

Closed
long568 opened this issue Sep 5, 2020 · 1 comment
Closed

CheckProvable Sector FAULT: cache an/or sealed paths not found #3577

long568 opened this issue Sep 5, 2020 · 1 comment

Comments

@long568
Copy link

long568 commented Sep 5, 2020 •
edited
Loading

Please provide all the information requested here to help us troubleshoot "commit failed" issues.
If the information requested is missing, we will probably have to just ask you to provide it anyway,
before we can help debug.

Describe the problem
Failed to declare SECTORS. I lost all sectors.

Sectors status
lotus-miner sectors list:

0: Proving     sSet: YES active: NO tktH: 28680 seedH: 31300 deals: [0]  toUpgrade:false
1: Proving     sSet: YES active: NO tktH: 28764 seedH: 31374 deals: [0]  toUpgrade:false
2: Proving     sSet: YES active: NO tktH: 28764 seedH: 31376 deals: [0]  toUpgrade:false
3: Proving     sSet: YES active: NO tktH: 28764 seedH: 31378 deals: [0]  toUpgrade:false
4: Proving     sSet: YES active: NO tktH: 28823 seedH: 31763 deals: [0]  toUpgrade:false
5: Committing  sSet: NO  active: NO tktH: 28823 seedH: 31723 deals: [0]  toUpgrade:false
6: Proving     sSet: YES active: NO tktH: 28823 seedH: 31765 deals: [0]  toUpgrade:false
7: Proving     sSet: YES active: NO tktH: 28823 seedH: 31756 deals: [0]  toUpgrade:false
8: PreCommit1  sSet: NO  active: NO tktH: 31188 seedH: 0     deals: [0]  toUpgrade:false
9: PreCommit2  sSet: NO  active: NO tktH: 30986 seedH: 0     deals: [0]  toUpgrade:false
10: Proving    sSet: YES active: NO tktH: 29405 seedH: 32056 deals: [0]  toUpgrade:false
11: Proving    sSet: YES active: NO tktH: 29405 seedH: 32056 deals: [0]  toUpgrade:false
12: PreCommit2 sSet: NO  active: NO tktH: 31185 seedH: 0     deals: [0]  toUpgrade:false

Lotus miner logs

Sep 05 10:28:00 m001 lotus-miner[104284]: 2020-09-05T10:28:00.378Z        INFO        storageminer        storage/wdpost_sched.go:198        not starting windowPost yet, waiting for startconfidence33172 33176 33176
Sep 05 10:28:00 m001 lotus-miner[104284]: 2020-09-05T10:28:00.416Z        INFO        storageminer        storage/wdpost_sched.go:198        not starting windowPost yet, waiting for startconfidence33172 33176 33176
Sep 05 10:28:00 m001 lotus-miner[104284]: 2020-09-05T10:28:00.491Z        INFO        storageminer        storage/wdpost_sched.go:198        not starting windowPost yet, waiting for startconfidence33172 33176 33176
Sep 05 10:28:00 m001 lotus-miner[104284]: 2020-09-05T10:28:00.636Z        INFO        storageminer        storage/wdpost_sched.go:198        not starting windowPost yet, waiting for startconfidence33172 33176 33176
Sep 05 10:28:03 m001 lotus-miner[104284]: 2020-09-05T10:28:03.737Z        WARN        nat        go-libp2p-nat@v0.0.6/nat.go:186        failed to establish port mapping: goupnp: SOAP request got HTTP 500 Internal Server Error
Sep 05 10:28:19 m001 lotus-miner[104284]: 2020-09-05T10:28:19.538Z        WARN        nat        go-libp2p-nat@v0.0.6/nat.go:186        failed to establish port mapping: goupnp: SOAP request got HTTP 500 Internal Server Error
Sep 05 10:28:23 m001 lotus-miner[104284]: 2020-09-05T10:28:23.802Z        WARN        nat        go-libp2p-nat@v0.0.6/nat.go:186        failed to establish port mapping: goupnp: SOAP request got HTTP 500 Internal Server Error
Sep 05 10:28:30 m001 lotus-miner[104284]: 2020-09-05T10:28:30.191Z        INFO        storageminer        storage/wdpost_sched.go:208        at 33177, doPost for P 30412, dd 46
Sep 05 10:28:30 m001 lotus-miner[104284]: 2020-09-05T10:28:30.203Z        WARN        advmgr        sector-storage/faults.go:54        CheckProvable Sector FAULT: cache an/or sealed paths not found        {"sector": {"Miner":15233,"Number":0}, "sealed": "", "cache": ""}
Sep 05 10:28:30 m001 lotus-miner[104284]: 2020-09-05T10:28:30.203Z        WARN        advmgr        sector-storage/faults.go:54        CheckProvable Sector FAULT: cache an/or sealed paths not found        {"sector": {"Miner":15233,"Number":1}, "sealed": "", "cache": ""}
Sep 05 10:28:30 m001 lotus-miner[104284]: 2020-09-05T10:28:30.204Z        WARN        advmgr        sector-storage/faults.go:54        CheckProvable Sector FAULT: cache an/or sealed paths not found        {"sector": {"Miner":15233,"Number":2}, "sealed": "", "cache": ""}
Sep 05 10:28:30 m001 lotus-miner[104284]: 2020-09-05T10:28:30.204Z        WARN        advmgr        sector-storage/faults.go:54        CheckProvable Sector FAULT: cache an/or sealed paths not found        {"sector": {"Miner":15233,"Number":3}, "sealed": "", "cache": ""}
Sep 05 10:28:30 m001 lotus-miner[104284]: 2020-09-05T10:28:30.204Z        WARN        advmgr        sector-storage/faults.go:54        CheckProvable Sector FAULT: cache an/or sealed paths not found        {"sector": {"Miner":15233,"Number":4}, "sealed": "", "cache": ""}
Sep 05 10:28:30 m001 lotus-miner[104284]: 2020-09-05T10:28:30.204Z        WARN        advmgr        sector-storage/faults.go:54        CheckProvable Sector FAULT: cache an/or sealed paths not found        {"sector": {"Miner":15233,"Number":6}, "sealed": "", "cache": ""}
Sep 05 10:28:30 m001 lotus-miner[104284]: 2020-09-05T10:28:30.204Z        WARN        advmgr        sector-storage/faults.go:54        CheckProvable Sector FAULT: cache an/or sealed paths not found        {"sector": {"Miner":15233,"Number":7}, "sealed": "", "cache": ""}
Sep 05 10:28:30 m001 lotus-miner[104284]: 2020-09-05T10:28:30.204Z        WARN        advmgr        sector-storage/faults.go:54        CheckProvable Sector FAULT: cache an/or sealed paths not found        {"sector": {"Miner":15233,"Number":10}, "sealed": "", "cache": ""}
Sep 05 10:28:30 m001 lotus-miner[104284]: 2020-09-05T10:28:30.204Z        WARN        advmgr        sector-storage/faults.go:54        CheckProvable Sector FAULT: cache an/or sealed paths not found        {"sector": {"Miner":15233,"Number":11}, "sealed": "", "cache": ""}
Sep 05 10:28:30 m001 lotus-miner[104284]: 2020-09-05T10:28:30.204Z        WARN        storageminer        storage/wdpost_run.go:102        Checked sectors        {"checked": 9, "good": 0}
Sep 05 10:28:30 m001 lotus-miner[104284]: 2020-09-05T10:28:30.204Z        ERROR        storageminer        storage/wdpost_run.go:251        DETECTED FAULTY SECTORS, declaring faults        {"count": 9}
Sep 05 10:28:36 m001 lotus-miner[104284]: 2020-09-05T10:28:36.751Z        WARN        storageminer        storage/wdpost_run.go:273        declare faults Message CID        {"cid": "bafy2bzaced3yu6edtiqgx3lf76wbj3tq54h4pt2tm7vzzcfynrtilw55kxwxk"}

lotus-miner storage list :

d1e80fb7-f5a0-4ea4-b6b7-c325927fc099:
        [##                                                ] 9.015 TiB/174 TiB 5%
        Unsealed: 0; Sealed: 9; Caches: 9; Reserved: 0 B
        Weight: 10; Use: Store
        URL: http://192.168.1.11:3456/remote (latency: 1.2ms)

The storage is online, and the sectors is all good in remote device.

Lotus miner diagnostic info
http://www.mados.net/res/log/allinfo_20200905

** Code modifications **
NONE

Version
lotus version 0.5.10+git.0a620514
@jennijuju
Copy link
Member

should be fixed in #3839

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@long568 @jennijuju