Skip to content
This repository has been archived by the owner on Jul 18, 2024. It is now read-only.

[DataCap Application] <Hepta> - <opendatalab> #1693

Closed
1 of 2 tasks
yhkp opened this issue Feb 28, 2023 · 59 comments
Closed
1 of 2 tasks

[DataCap Application] <Hepta> - <opendatalab> #1693

yhkp opened this issue Feb 28, 2023 · 59 comments

Comments

@yhkp
Copy link

yhkp commented Feb 28, 2023

Data Owner Name

Hepta

Data Owner Country/Region

Korea, Republic of

Data Owner Industry

Education & Training

Website

https://opendatalab.org.cn/home

Social Media

N/A

Total amount of DataCap being requested

5PiB

Weekly allocation of DataCap requested

500TiB

On-chain address for first allocation

f1fi32zvoljht7ekcepglk7hleg2d3trf7wd7zvdi

Custom multisig

  • Use Custom Multisig

Identifier

No response

Share a brief history of your project and organization

Hepta Labs joined Filecoin as an SP starting in 2021. In order to comply with Filecoin's plan to store the most important data of humanity, we transformed our business. We have gone through the preparatory phase and contacted nearly 20 SPs. Most expressed willingness to collaborate on our important data storage plan.

Is this project associated with other projects/ecosystem stakeholders?

No

If answered yes, what are the other projects/ecosystem stakeholders

No response

Describe the data being stored onto Filecoin

Dataset content includes: automatic driving, openmmlab, classic benchmark, smart remote sensing, smart medical care, virtual reality, multimodality, openxdlab, smart education raw data and trained data sets will be backed up to 10 copies.
The types of data sets include: text, image, video, audio, etc.

Where was the data currently stored in this dataset sourced from

My Own Storage Infra

If you answered "Other" in the previous question, enter the details here

No response

How do you plan to prepare the dataset

IPFS, lotus, singularity

If you answered "other/custom tool" in the previous question, enter the details here

No response

Please share a sample of the data

https://drive.google.com/file/d/1iiHAbqgDlveO3i9TfcZoJwDcpClZM1fB/view?usp=share_link

Confirm that this is a public dataset that can be retrieved by anyone on the Network

  • I confirm

If you chose not to confirm, what was the reason

No response

What is the expected retrieval frequency for this data

Yearly

For how long do you plan to keep this dataset stored on Filecoin

1.5 to 2 years

In which geographies do you plan on making storage deals

Greater China, Asia other than Greater China, North America, Europe

How will you be distributing your data to storage providers

HTTP or FTP server, IPFS, Shipping hard drives, Lotus built-in data transfer

How do you plan to choose storage providers

Slack, Partners

If you answered "Others" in the previous question, what is the tool or platform you plan to use

No response

If you already have a list of storage providers to work with, fill out their names and provider IDs below

f01225882 US
f01959735 US
f01854080 US
f01543586 HK
f02033219 HK
f01985611 US
f01579009 KR
f01386984 CN
f01690643 KR
f02012175 KR
f01402814 HK
f01893023 US

How do you plan to make deals to your storage providers

Boost client, Lotus client, Singularity

If you answered "Others/custom tool" in the previous question, enter the details here

No response

Can you confirm that you will follow the Fil+ guideline

Yes

@large-datacap-requests
Copy link

Thanks for your request!

Heads up, you’re requesting more than the typical weekly onboarding rate of DataCap!

@large-datacap-requests
Copy link

Thanks for your request!
Everything looks good. 👌

A Governance Team member will review the information provided and contact you back pretty soon.

@yhkp
Copy link
Author

yhkp commented Feb 28, 2023

@Sunnyiscoming
Copy link
Collaborator

Where is your organization? China or Korea?
https://whois.whoisxmlapi.com/lookup-report/MK54nYeMRo
Domain's registrant
Name: 上海人工智能创新中心
Email: pjpublic@pjlab.org.cn

Waht's the relationship between you and the organization?

Can you provide more data samples? I try to download data samples you provided. But I can't open it.

@yhkp
Copy link
Author

yhkp commented Mar 3, 2023

Hi, @Sunnyiscoming thank you for your prompt reply.
This website is a public dataset website, not our official website.
We will download the dataset from this website and store it in the Filecoin network.

We are a storage provider in the Korea, so I guess we don't need an official website. The business license that can verify my identity is already in the previous comment.

LMK if there is anything you confused.

@cryptowhizzard
Copy link

Dear applicant,

Thank you for applying for datacap. As Filecoin FIL+ notary i am screening your application and conducting due diligence.

Can you fill out this form to provide us with the necessary information to make a educated decision on your LDN request if we would like to support it.

Thanks!

@large-datacap-requests
Copy link

Thanks for your request!

Heads up, you’re requesting more than the typical weekly onboarding rate of DataCap!

@large-datacap-requests
Copy link

Thanks for your request!
Everything looks good. 👌

A Governance Team member will review the information provided and contact you back pretty soon.

@Sunnyiscoming
Copy link
Collaborator

Datacap Request Trigger

Total DataCap requested

5PiB

Expected weekly DataCap usage rate

500TiB

Client address

f1fi32zvoljht7ekcepglk7hleg2d3trf7wd7zvdi

@large-datacap-requests
Copy link

DataCap Allocation requested

Multisig Notary address

f02049625

Client address

f1fi32zvoljht7ekcepglk7hleg2d3trf7wd7zvdi

DataCap allocation requested

250TiB

Id

6483e815-f5af-4926-a3ce-5f4352ebd263

@SuperChaiChai
Copy link

See that the applicant has uploaded KYC certification

After sealing, a CID list can be shared for retrieval ?

@yhkp
Copy link
Author

yhkp commented Mar 7, 2023

See that the applicant has uploaded KYC certification

After sealing, a CID list can be shared for retrieval ?

@SuperChaiChai yes, it is our business license. Thanks for you attention.
Of course, we will make sure the data can be retrieved and SPs are reachable.

Copy link

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacebunn65b4d4kow53uqyrahjiw2w3m4ad7sz2zup5fllciipjcotfg

Address

f1fi32zvoljht7ekcepglk7hleg2d3trf7wd7zvdi

Datacap Allocated

250.00TiB

Signer Address

f12mckci3omexgzoeosjvstcfxfe4vqw7owdia3da

Id

6483e815-f5af-4926-a3ce-5f4352ebd263

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebunn65b4d4kow53uqyrahjiw2w3m4ad7sz2zup5fllciipjcotfg

@large-datacap-requests
Copy link

DataCap Allocation requested

Request number 4

Multisig Notary address

f02049625

Client address

f1fi32zvoljht7ekcepglk7hleg2d3trf7wd7zvdi

DataCap allocation requested

1.95PiB

Id

cdc0c9c8-6524-46b2-8163-bae49e243ffe

@large-datacap-requests
Copy link

Stats & Info for DataCap Allocation

Multisig Notary address

f02049625

Client address

f1fi32zvoljht7ekcepglk7hleg2d3trf7wd7zvdi

Rule to calculate the allocation request amount

400% of weekly dc amount requested

DataCap allocation requested

1.95PiB

Total DataCap granted for client so far

909494701772928712704.0YiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

909494701772928712704.0YiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
40110 17 1000.0TiB 18.23 226.31TiB

@yhkp
Copy link
Author

yhkp commented Jul 11, 2023

Hi all notaries,
I'm looking forward to your support.
Issues in the checker have been fixed.
There may be no retrieval rate since we haven't onboarded data a few months ago.
Q from another application disclose here:
#1731 (comment)

@cryptowhizzard
Copy link

checker:manualTrigger

@filplus-checker-app
Copy link

DataCap and CID Checker Report Summary1

Retrieval Statistics

⚠️ All retrieval success ratios are below 1%.

  • Overall Graphsync retrieval success rate: 0.39%
  • Overall HTTP retrieval success rate: 0.00%
  • Overall Bitswap retrieval success rate: 0.00%

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 98.69% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients2

⚠️ CID sharing has been observed. (Top 3)

Full report

Click here to view the CID Checker report.
Click here to view the Retrieval report.

Footnotes

  1. To manually trigger this report, add a comment with text checker:manualTrigger

  2. To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

@herrehesse
Copy link

Retrieval Statistics
⚠️ All retrieval success ratios are below 1%.

Requesting notaries not to sign.

@yhkp
Copy link
Author

yhkp commented Jul 12, 2023

Hi @cryptowhizzard
Thanks for your attention.
However, How can I improve the retrieval rate if notaries do not sign?
I already said that we haven't sent deals since a few months ago. It should be restarted now, provided that notaries sign this round for us.

@yhkp
Copy link
Author

yhkp commented Jul 17, 2023

checker:manualTrigger

@filplus-checker-app
Copy link

DataCap and CID Checker Report Summary1

Retrieval Statistics

⚠️ All retrieval success ratios are below 1%.

  • Overall Graphsync retrieval success rate: 0.54%
  • Overall HTTP retrieval success rate: 0.00%
  • Overall Bitswap retrieval success rate: 0.00%

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 98.69% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients2

⚠️ CID sharing has been observed. (Top 3)

Full report

Click here to view the CID Checker report.
Click here to view the Retrieval report.

Footnotes

  1. To manually trigger this report, add a comment with text checker:manualTrigger

  2. To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

@github-actions
Copy link

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

@github-actions github-actions bot added the Stale label Jul 28, 2023
@yhkp
Copy link
Author

yhkp commented Aug 1, 2023

checker:manualTrigger

@filplus-checker-app
Copy link

DataCap and CID Checker Report Summary1

Retrieval Statistics

⚠️ All retrieval success ratios are below 1%.

  • Overall Graphsync retrieval success rate: 0.85%
  • Overall HTTP retrieval success rate: 0.23%
  • Overall Bitswap retrieval success rate: 0.00%

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 98.69% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients2

⚠️ CID sharing has been observed. (Top 3)

Full report

Click here to view the CID Checker report.
Click here to view the Retrieval Dashboard.
Click here to view the Retrieval report.

Footnotes

  1. To manually trigger this report, add a comment with text checker:manualTrigger

  2. To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

@cryptowhizzard
Copy link

I guess this won't end well. The SP's used are not OK. Everything is red is involved in CID sharing fairly recent and does not have retrieval enabled.

Scherm­afbeelding 2023-08-01 om 08 54 07

@github-actions github-actions bot removed the Stale label Aug 2, 2023
@cryptowhizzard
Copy link

Tried again, it seems that there is some movement. I have been able to download something but it is not readable. All other methods of retrieval failed until now.

@github-actions
Copy link

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

@github-actions github-actions bot added the Stale label Aug 13, 2023
@github-actions
Copy link

This application has not seen any responses in the last 14 days, so for now it is being closed. Please feel free to contact the Fil+ Gov team to re-open the application if it is still being processed. Thank you!

@github-actions github-actions bot closed this as not planned Won't fix, can't repro, duplicate, stale Aug 18, 2023

Client f02057953 does not follow the datacap usage rules. More info here.
This application has been failing the requirements for 7 days.
Please take appropiate action to fix the following DataCap usage problems.

Criteria Treshold Reason
Cid Checker score > 25% The client has a CID checker score of 5%. This should be greater than 25%. To find out more about CID checker score please look at this issue: filecoin-project/notary-governance#986

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests