Skip to content
This repository has been archived by the owner on Oct 4, 2019. It is now read-only.

Issue 300 oom #341

Merged
merged 4 commits into from
Sep 7, 2017
Merged

Issue 300 oom #341

merged 4 commits into from
Sep 7, 2017

Conversation

sudachen
Copy link
Contributor

@sudachen sudachen commented Sep 5, 2017

I have implemented dump in two different ways: the first is the unsorted dump, in this way accounts are not sorted so is not required to load all of them to memory. This way consumes memory near to constant value with regarding to Go memory nature. The second way uses compact packing for storing accounts data to memory. It should dramatically reduce memory usage, however it will still take a lot space.

revised use: $ geth dump [unsorted] [hash|num],[hash|num],...,[hash|num] [address],[address],...,[address]

@splix
Copy link
Contributor

splix commented Sep 7, 2017

It works! Took some time too, but exported a correct json

real	77m34.312s
user	25m12.260s
sys	12m46.284s

Sorted dump didn't finish in 2 hours, so I've cancelled it. And I think unsorted dump is enough, will cover most of the cases

@whilei whilei merged commit d066651 into ethereumproject:master Sep 7, 2017
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants