Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Exploit unplotted plot space as extra caching space #2399

Closed
nazar-pc opened this issue Jan 7, 2024 · 1 comment · Fixed by #2550
Closed

Exploit unplotted plot space as extra caching space #2399

nazar-pc opened this issue Jan 7, 2024 · 1 comment · Fixed by #2550
Labels
farmer Farming library/app good first issue Good for newcomers improvement it is already working, but can be better performance Related to performance measurement or improvement

Comments

@nazar-pc
Copy link
Member

nazar-pc commented Jan 7, 2024

Many farmers are creating smaller farms (1T or less) and with default cache size of just 1% most of the pieces are being downloaded from the network.

We can improve this dramatically by filling up the space that wasn't plotted yet with cache of pieces and storing the pieces that were previously downloaded in there instead of requesting them from the network.

It will be a bit messy implementation-wise with things crossing areas of responsibility and I don't think we want to do that for regular piece cache, but it will improve bandwidth usage dramatically and as such is likely worth doing to improve user experience.

Related to #2398

@nazar-pc nazar-pc added farmer Farming library/app improvement it is already working, but can be better performance Related to performance measurement or improvement labels Jan 7, 2024
@nazar-pc nazar-pc added this to the Protocol UX Improvements milestone Jan 7, 2024
@nazar-pc
Copy link
Member Author

nazar-pc commented Jan 9, 2024

This can be implemented as a separate complementary caching layer that would transparently parasite on top of plots for as long as possible in addition to regular caching mechanism.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
farmer Farming library/app good first issue Good for newcomers improvement it is already working, but can be better performance Related to performance measurement or improvement
Projects
Development

Successfully merging a pull request may close this issue.

1 participant