Skip to content
This repository has been archived by the owner on Jul 18, 2024. It is now read-only.

[DataCap Application] NREL National Solar Radiation Database #1584

Closed
1 of 2 tasks
Lennon00 opened this issue Feb 6, 2023 · 57 comments
Closed
1 of 2 tasks

[DataCap Application] NREL National Solar Radiation Database #1584

Lennon00 opened this issue Feb 6, 2023 · 57 comments

Comments

@Lennon00
Copy link

Lennon00 commented Feb 6, 2023

Data Owner Name

National Renewable Energy Laboratory

Data Owner Country/Region

United States

Data Owner Industry

Environment

Website

https://nsrdb.nrel.gov/

Social Media

https://twitter.com/nrel/
https://www.facebook.com/nationalrenewableenergylab
https://www.youtube.com/user/NRELPR

Total amount of DataCap being requested

5PiB

Weekly allocation of DataCap requested

400TiB

On-chain address for first allocation

f1kmjnrme567khnfq5fhuz34bzklpxdt6ry3glgeq

Custom multisig

  • Use Custom Multisig

Identifier

No response

Share a brief history of your project and organization

At the National Renewable Energy Laboratory (NREL), they focus on creative answers to today's energy challenges. From breakthroughs in fundamental science to new clean technologies to integrated energy systems that power our lives, NREL researchers are transforming the way the nation and the world use energy.
We are participants in filecoin community and I want to make filecoin network better by storing public data that is good for humanity.

Is this project associated with other projects/ecosystem stakeholders?

No

If answered yes, what are the other projects/ecosystem stakeholders

No response

Describe the data being stored onto Filecoin

The National Solar Radiation Database (NSRDB) is a serially complete collection of hourly and half-hourly values of the three most common measurements of solar radiation – global horizontal, direct normal, and diffuse horizontal irradiance — and meteorological data. These data have been collected at a sufficient number of locations and temporal and spatial scales to accurately represent regional solar radiation climates.

Where was the data currently stored in this dataset sourced from

AWS Cloud

If you answered "Other" in the previous question, enter the details here

No response

How do you plan to prepare the dataset

lotus, singularity

If you answered "other/custom tool" in the previous question, enter the details here

No response

Please share a sample of the data

https://registry.opendata.aws/nrel-pds-nsrdb/

Confirm that this is a public dataset that can be retrieved by anyone on the Network

  • I confirm

If you chose not to confirm, what was the reason

No response

What is the expected retrieval frequency for this data

Yearly

For how long do you plan to keep this dataset stored on Filecoin

1.5 to 2 years

In which geographies do you plan on making storage deals

Asia other than Greater China, North America, Europe

How will you be distributing your data to storage providers

IPFS, Shipping hard drives

How do you plan to choose storage providers

Slack, Big data exchange

If you answered "Others" in the previous question, what is the tool or platform you plan to use

No response

If you already have a list of storage providers to work with, fill out their names and provider IDs below

No response

How do you plan to make deals to your storage providers

Boost client, Lotus client

If you answered "Others/custom tool" in the previous question, enter the details here

No response

Can you confirm that you will follow the Fil+ guideline

Yes

@large-datacap-requests
Copy link

Thanks for your request!

Heads up, you’re requesting more than the typical weekly onboarding rate of DataCap!

@large-datacap-requests
Copy link

Thanks for your request!
Everything looks good. 👌

A Governance Team member will review the information provided and contact you back pretty soon.

@cryptowhizzard
Copy link

Dear applicant,

Thank you for applying for datacap. As Filecoin FIL+ notary i am screening your application and conducting due diligence.

Looking at your application i have some questions:
As you are brand new on Github and have no history of past applications it seems to me that applying for 5PB of datacap is a lot. One needs comprehensive knowledge of Filecoin, packing of data, distribution of data and all it's requirements coming with it. Are you brand new in the Filecoin space or have you applied for datacap in the past on different Github account names?

Can you show us visible proof of the size of your data and the storage systems you have there?

As last question i would like you to fill out this form to provide us with the necessary information to make a educated decision on your LDN request if we would like to support it.

Thanks!

@Sunnyiscoming
Copy link
Collaborator

Can you provide more detailed informations about SPs you will cooperate with?

@simonkim0515 simonkim0515 self-assigned this Feb 13, 2023
@simonkim0515
Copy link
Collaborator

Datacap Request Trigger

Total DataCap requested

5PiB

Expected weekly DataCap usage rate

400TiB

Client address

f1kmjnrme567khnfq5fhuz34bzklpxdt6ry3glgeq

@large-datacap-requests
Copy link

DataCap Allocation requested

Multisig Notary address

f01858410

Client address

f1kmjnrme567khnfq5fhuz34bzklpxdt6ry3glgeq

DataCap allocation requested

200TiB

Id

6c68e1bd-63a0-4829-b62a-c5dba0a63227

@Lennon00
Copy link
Author

@Sunnyiscoming I have contacted with some SPs, but we are just at the first step of communication. I will add more information in the future and do some distribute under the community rules.

@BlockMakeronline
Copy link

@Lennon00
I'm the notary from Blockmaker.
I want to know how many backups you want to store. Are you ready if you get Datacap?

@cryptowhizzard
Copy link

Dear applicant / @Lennon00

Thank you for applying for datacap. As Filecoin FIL+ notary i am screening your application and conducting due diligence.

Looking at your application i have some questions:
As you are brand new on Github and have no history of past applications it seems to me that applying for 5PB of datacap is a lot. One needs comprehensive knowledge of Filecoin, packing of data, distribution of data and all it's requirements coming with it. Are you brand new in the Filecoin space or have you applied for datacap in the past on different Github account names?

Can you show us visible proof of the size of your data and the storage systems you have there?

As last question i would like you to fill out this form to provide us with the necessary information to make a educated decision on your LDN request if we would like to support it.

Thanks!

@Lennon00
Copy link
Author

@BlockMakeronline Hello notary, I plan store 10 backups for this application. Yes, we are ready to start deals after we get Datacap. Look forward to your approval!

@Lennon00
Copy link
Author

@cryptowhizzard Thank you for your comments. For privacy, I am worried to fill out the form. Thank again.

@BlockMakeronline
Copy link

I will approve it and track the process.

@MatrixStorage
Copy link

Your project is good, but I would like to ask if your SPs is ready? Would you like to show us? If you can show it to us, I can also provide a signature for your project.In addition, I hope that even if you do get Datacap, you will be able to store it in accordance with community regulations to avoid confusing your future applications.

@Lennon00
Copy link
Author

Lennon00 commented Mar 1, 2023

@MatrixStorage Welcome! We are now looking for SP. I will add more information in the future and do some distribute under the community rules! Welcome to your attention!

@MatrixStorage
Copy link

I will sign it for you this time, and I will keep an eye on it. If you have any problems using datacap, I will blacklist your project.
It is also hoped that you will cooperate with the community to retrieve the stored data later.

@AthSmith
Copy link

AthSmith commented Aug 4, 2023

Overall HTTP retrieval success rate: 7.67%, willing to sign.

Copy link

AthSmith commented Aug 4, 2023

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacecfgyofqvuu34xt4afhvu34trwt7nn3dmc2uymt2lmgjtqzbk2yfu

Address

f1kmjnrme567khnfq5fhuz34bzklpxdt6ry3glgeq

Datacap Allocated

1.56PiB

Signer Address

f1vxbqrf7rfum3n6m5u6eb4re6xj7amvsaqnzu64y

Id

f1b457e2-ed79-4d0f-9b3d-27381ec63f1b

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacecfgyofqvuu34xt4afhvu34trwt7nn3dmc2uymt2lmgjtqzbk2yfu

@github-actions
Copy link

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

@github-actions github-actions bot added Stale and removed Stale labels Aug 14, 2023
@herrehesse
Copy link

@Wengeding & @AthSmith known abusive notaries signing of an LDN where selfdealing is clearly visible on the CID report. Can we please remove/hold the DC from closed applications asap and remove notaries from multisig?

@Filplus-govteam @Kevin-FF-USA @raghavrmadya

@cryptowhizzard
Copy link

This client is actively stalling http retrievals and blocked http ranged requests with a reverse proxy to prevent it's data being investigated.

It works as follows:

One set's a bandwidth limit with NGINX on the HTTP retrieval. After a random certain amount the limit is set to zero. This makes the transfer timeout. Because range retrieval is disabled in NGINX one cannot pick up where he left and needs to start all over again.

Log can be found at http://datasetcreators.com/downloadedcarfiles/logs/1584.log

@ghost
Copy link

ghost commented Aug 16, 2023

Hello @Lennon00 per the new guidelines filecoin-project/notary-governance#922 for Open Dataset applicants, please complete the following Fil+ registration form to identify yourself as the applicant and also please add the contact information of the SP entities you are working with to store copies of the data.

This information will be reviewed by Fil+ Governance team to confirm validity toward the Fil+ guideline of a distributed storage plan and SPs posted in the comments here. Let us know if you have any questions.

@Lennon00
Copy link
Author

@herrehesse Please provide clear evidence about what you say. Selfdealing is clearly visible in the CID report if there is. Do not slander the others so blindly.

@cryptowhizzard Don't use any NGINX. Wrong comments.

@large-datacap-requests
Copy link

DataCap Allocation requested

Request number 6

Multisig Notary address

f02049625

Client address

f1kmjnrme567khnfq5fhuz34bzklpxdt6ry3glgeq

DataCap allocation requested

525.11TiB

Id

c8b3dea5-11d5-451d-b4f5-e9ea644ffb73

@large-datacap-requests
Copy link

Stats & Info for DataCap Allocation

Multisig Notary address

f02049625

Client address

f1kmjnrme567khnfq5fhuz34bzklpxdt6ry3glgeq

Rule to calculate the allocation request amount

400% of weekly dc amount requested

DataCap allocation requested

525.11TiB

Total DataCap granted for client so far

1.452863216400147e+52YiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

1.452863216400147e+52YiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
95302 16 1.56PiB 15 406.34TiB

@github-actions
Copy link

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

--
Commented by Stale Bot.

@github-actions
Copy link

github-actions bot commented Sep 5, 2023

This application has not seen any responses in the last 14 days, so for now it is being closed. Please feel free to contact the Fil+ Gov team to re-open the application if it is still being processed. Thank you!

--
Commented by Stale Bot.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.