Skip to content
This repository has been archived by the owner on Jul 18, 2024. It is now read-only.

[DataCap Application] <Hepta> - <OpenNeuro> #1731

Closed
1 of 2 tasks
yhkp opened this issue Mar 6, 2023 · 50 comments
Closed
1 of 2 tasks

[DataCap Application] <Hepta> - <OpenNeuro> #1731

yhkp opened this issue Mar 6, 2023 · 50 comments

Comments

@yhkp
Copy link

yhkp commented Mar 6, 2023

Data Owner Name

Hepta

Data Owner Country/Region

Korea, Republic of

Data Owner Industry

Life Science / Healthcare

Website

https://openneuro.org

Social Media

N/A

Total amount of DataCap being requested

5PiB

Weekly allocation of DataCap requested

500TiB

On-chain address for first allocation

f1opjqkoajys7fr4yajwcpj2bhuf4akh4s4ppdjwq

Custom multisig

  • Use Custom Multisig

Identifier

No response

Share a brief history of your project and organization

Hepta Labs joined Filecoin as an SP starting in 2021. In order to comply with Filecoin's plan to store the most important data of humanity, we transformed our business. We have gone through the preparatory phase and contacted nearly 20 SPs. Most expressed willingness to collaborate on our important data storage plan.
I decided to bring OpenNeuro's public datasets to the network. OpenNeuro is a free and open platform for validating and sharing BIDS-compliant MRI, PET, MEG, EEG, and iEEG data.

Is this project associated with other projects/ecosystem stakeholders?

No

If answered yes, what are the other projects/ecosystem stakeholders

No response

Describe the data being stored onto Filecoin

OpenNeuro is a free and open platform for validating and sharing BIDS-compliant MRI, PET, MEG, EEG, and iEEG data. Those four types data in total of 795 public datasets. All those data will be backup for 10x to different SPs.

Where was the data currently stored in this dataset sourced from

Other

If you answered "Other" in the previous question, enter the details here

OpenNeuro

How do you plan to prepare the dataset

IPFS, lotus, singularity

If you answered "other/custom tool" in the previous question, enter the details here

No response

Please share a sample of the data

https://openneuro.org/datasets/ds004466/versions/1.0.0
https://openneuro.org/datasets/ds004299/versions/1.0.0
https://openneuro.org/datasets/ds002898/versions/1.3.1
https://openneuro.org/datasets/ds004078/versions/1.0.4
https://openneuro.org/datasets/ds004356/versions/1.0.0

Confirm that this is a public dataset that can be retrieved by anyone on the Network

  • I confirm

If you chose not to confirm, what was the reason

No response

What is the expected retrieval frequency for this data

Yearly

For how long do you plan to keep this dataset stored on Filecoin

1.5 to 2 years

In which geographies do you plan on making storage deals

Greater China, Asia other than Greater China, North America, Europe

How will you be distributing your data to storage providers

Cloud storage (i.e. S3), HTTP or FTP server, IPFS, Shipping hard drives, Lotus built-in data transfer

How do you plan to choose storage providers

Slack, Partners

If you answered "Others" in the previous question, what is the tool or platform you plan to use

No response

If you already have a list of storage providers to work with, fill out their names and provider IDs below

f01225882 US
f01959735 US
f01854080 US
f01543586 HK
f02033219 HK
f01985611 US
f01579009 KR
f01386984 CN
f01690643 KR
f02012175 KR
f01402814 HK
f01893023 US

How do you plan to make deals to your storage providers

Boost client, Lotus client, Singularity

If you answered "Others/custom tool" in the previous question, enter the details here

No response

Can you confirm that you will follow the Fil+ guideline

Yes

@large-datacap-requests
Copy link

Thanks for your request!

Heads up, you’re requesting more than the typical weekly onboarding rate of DataCap!

@large-datacap-requests
Copy link

Thanks for your request!
Everything looks good. 👌

A Governance Team member will review the information provided and contact you back pretty soon.

@yhkp
Copy link
Author

yhkp commented Mar 6, 2023

1
Here is the business license.

@Sunnyiscoming
Copy link
Collaborator

Datacap Request Trigger

Total DataCap requested

5PiB

Expected weekly DataCap usage rate

500TiB

Client address

f1opjqkoajys7fr4yajwcpj2bhuf4akh4s4ppdjwq

@large-datacap-requests
Copy link

DataCap Allocation requested

Multisig Notary address

f02049625

Client address

f1opjqkoajys7fr4yajwcpj2bhuf4akh4s4ppdjwq

DataCap allocation requested

250TiB

Id

7200acca-7d85-4def-b157-b3cfa46bbcde

@SuperChaiChai
Copy link

Associate in # 1693

I will pay attention to the future retrieval.

Copy link

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacebeac3u5joupll6sufapltr6tfnymkkgxj67xuwxue7sam3urdcu2

Address

f1opjqkoajys7fr4yajwcpj2bhuf4akh4s4ppdjwq

Datacap Allocated

250.00TiB

Signer Address

f12mckci3omexgzoeosjvstcfxfe4vqw7owdia3da

Id

7200acca-7d85-4def-b157-b3cfa46bbcde

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebeac3u5joupll6sufapltr6tfnymkkgxj67xuwxue7sam3urdcu2

@Bitrise0111
Copy link

#1693 (comment) same here.

Copy link

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacebrv2f5nivpb7cfspn2rnbxlrfh2nokjvm4hwmps2k6z3bhbftjd6

Address

f1opjqkoajys7fr4yajwcpj2bhuf4akh4s4ppdjwq

Datacap Allocated

250.00TiB

Signer Address

f1nknj7ayq4o43czrtdoauggtwl43fbqatmqis3yy

Id

7200acca-7d85-4def-b157-b3cfa46bbcde

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebrv2f5nivpb7cfspn2rnbxlrfh2nokjvm4hwmps2k6z3bhbftjd6

@large-datacap-requests
Copy link

DataCap Allocation requested

Request number 2

Multisig Notary address

f02049625

Client address

f1opjqkoajys7fr4yajwcpj2bhuf4akh4s4ppdjwq

DataCap allocation requested

500TiB

Id

ca6517a9-0dff-4ad9-9adf-7f6b33b4221d

@kevzak
Copy link
Collaborator

kevzak commented Jul 3, 2023

checker:manualTrigger

@filplus-checker-app
Copy link

DataCap and CID Checker Report Summary1

Retrieval Statistics

⚠️ All retrieval success ratios are below 1%.

  • Overall Graphsync retrieval success rate: 0.38%
  • Overall HTTP retrieval success rate: 0.00%
  • Overall Bitswap retrieval success rate: 0.00%

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 93.67% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients2

⚠️ CID sharing has been observed. (Top 3)

Full report

Click here to view the CID Checker report.
Click here to view the Retrieval report.

Footnotes

  1. To manually trigger this report, add a comment with text checker:manualTrigger

  2. To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

@kevzak
Copy link
Collaborator

kevzak commented Jul 3, 2023

Hi @yhkp you are lead SP, correct? Where are you located?
Can you explain data storage report? 74% with one SP in USA. Is that VPN?
What is plan to spread more geographically?
Are you working to improve retrievability of this open, public dataset?

@kevzak
Copy link
Collaborator

kevzak commented Jul 3, 2023

Also we have a new, optional KYC ID check available on filplus.storage. If you want to add additional layer of trust you can complete an ID check and verify this GitHub account. See details: LINK

@yhkp
Copy link
Author

yhkp commented Jul 11, 2023

Hello @kevzak , thank you for your attention.
I'm not sure if I'm a leadsp or not, I just prepared the data for my application and distributed it to the storage providers in other regions I work with. My base is in South Korea, and I am currently running some nodes and providing operation and maintenance services for some nodes in South Korea.
The sps I work with are distributed in the United States, Singapore, Thailand, Vietnam, South Korea, China and other regions. Those with close distances will transfer the data to them in the form of hard drives. Since they are still accepting dc from other clients, there is no guarantee that the speed will be the same, I think this is a common phenomenon. We are also thinking about solutions.
About a month ago, we stopped making deals and carried out inspections of cooperative sps and rectification of retrieval methods. So far, it has been repaired and can start again. Also, HTTP retrieval will be supported soon.
Looking for notaries' support. Thx.

@yhkp
Copy link
Author

yhkp commented Jul 17, 2023

checker:manualTrigger

@filplus-checker-app
Copy link

DataCap and CID Checker Report Summary1

Retrieval Statistics

⚠️ All retrieval success ratios are below 1%.

  • Overall Graphsync retrieval success rate: 0.94%
  • Overall HTTP retrieval success rate: 0.00%
  • Overall Bitswap retrieval success rate: 0.00%

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 93.59% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients2

⚠️ CID sharing has been observed. (Top 3)

Full report

Click here to view the CID Checker report.
Click here to view the Retrieval report.

Footnotes

  1. To manually trigger this report, add a comment with text checker:manualTrigger

  2. To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

@github-actions
Copy link

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

@github-actions github-actions bot added the Stale label Jul 28, 2023
@yhkp
Copy link
Author

yhkp commented Aug 1, 2023

checker:manualTrigger

@filplus-checker-app
Copy link

DataCap and CID Checker Report Summary1

Retrieval Statistics

  • Overall Graphsync retrieval success rate: 0.93%
  • Overall HTTP retrieval success rate: 1.27%
  • Overall Bitswap retrieval success rate: 0.00%

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 93.59% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients2

⚠️ CID sharing has been observed. (Top 3)

Full report

Click here to view the CID Checker report.
Click here to view the Retrieval Dashboard.
Click here to view the Retrieval report.

Footnotes

  1. To manually trigger this report, add a comment with text checker:manualTrigger

  2. To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

@github-actions github-actions bot removed the Stale label Aug 2, 2023
@spaceT9
Copy link

spaceT9 commented Aug 10, 2023

checker:manualTrigger

@filplus-checker-app
Copy link

DataCap and CID Checker Report Summary1

Retrieval Statistics

  • Overall Graphsync retrieval success rate: 1.09%
  • Overall HTTP retrieval success rate: 2.65%
  • Overall Bitswap retrieval success rate: 0.00%

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 93.59% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients2

⚠️ CID sharing has been observed. (Top 3)

Full report

Click here to view the CID Checker report.
Click here to view the Retrieval Dashboard.
Click here to view the Retrieval report.

Footnotes

  1. To manually trigger this report, add a comment with text checker:manualTrigger

  2. To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

@spaceT9
Copy link

spaceT9 commented Aug 10, 2023

Please increase the retrieval rate before next tranche. And also increase the number of copy to make it more decentralized.

@github-actions
Copy link

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

@github-actions github-actions bot added the Stale label Aug 25, 2023
@github-actions
Copy link

This application has not seen any responses in the last 14 days, so for now it is being closed. Please feel free to contact the Fil+ Gov team to re-open the application if it is still being processed. Thank you!

@github-actions github-actions bot closed this as not planned Won't fix, can't repro, duplicate, stale Aug 25, 2023
@clriesco clriesco removed the Stale label Aug 28, 2023
@clriesco
Copy link
Collaborator

Removed stale label and reopened issue :)

@clriesco clriesco reopened this Aug 28, 2023
@github-actions
Copy link

github-actions bot commented Sep 8, 2023

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

--
Commented by Stale Bot.

@github-actions
Copy link

This application has not seen any responses in the last 14 days, so for now it is being closed. Please feel free to contact the Fil+ Gov team to re-open the application if it is still being processed. Thank you!

--
Commented by Stale Bot.

Client f02057959 does not follow the datacap usage rules. More info here.
This application has been failing the requirements for 7 days.
Please take appropiate action to fix the following DataCap usage problems.

Criteria Treshold Reason
Cid Checker score > 25% The client has a CID checker score of 17%. This should be greater than 25%. To find out more about CID checker score please look at this issue: filecoin-project/notary-governance#986

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.