-
Notifications
You must be signed in to change notification settings - Fork 0
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Test app 1083 #1085
Comments
Notary Allocator Pathway Name: (StorSwift) Manual Organization: StorSwift Allocator's On-chain addresss: f1id4vdnfmhic5lgf33jpwdugqphso7kmauc2w4va Country of Operation: Singapore Region(s) of operation: Africa ,Asia minus GCR,Greater China,Europe,Oceania,Japan,North America,South America,Other Type of allocator: Manual Amount of DataCap Requested for allocator for 12 months: 100PiB Is your allocator providing a unique, new, or diverse pathway to DataCap? How does this allocator differentiate itself from other applicants, new or existing? As a V4 notary, we deeply engaged in Fil+ program and almost attended every governance call last year. We witnessed the chaos going on through all the year. The urgent task is to make the Fil+ more permissionless, but complete automizing process is hard to implement for the current phase. So we plan to combine manual due diligence and automized tooling to make the allocation process as objective as possible. The rules will get tighter to reduce fraud and cheating. The critical changes are listed as below:
As a member in the Filecoin Community, I acknowledge that I must adhere to the Community Code of Conduct, as well other End User License Agreements for accessing various tools and services, such as GitHub and Slack. Acknowledgment: Acknowledge Cient Diligence Section: This section pertains to client diligence processes. Who are your target clients? Enterprise Data Clients,Small-scale developers or data owners Describe in as much detail as possible how you will perform due diligence on clients.
Please specify how many questions you'll ask, and provide a brief overview of the questions. Because the basic information is included in application template, we list 12 very practical questions for clients below:
Will you use a 3rd-party "Know your client" (KYC) service? Toggle and Veriff are good choices because they have operations globally. Hopefully those two providers can cover all countries. Client can choose one from them. But if not, business license, entity number or utility bills are also good ways to prove the identity of an organization. Clients also can provide KYC proof from other 3rd party provider, like Qichacha or Tianyancha for Chinese businesses. Other allocators from the same region will help evaluate the effectiveness of the proof. Can any client apply to your pathway, or will you be closed to only your own internal clients? (eg: bizdev or self-referral) Any client can apply. We can offer help and guides on how to apply dataCap where necessary. How do you plan to track the rate at which DataCap is being distributed to your clients? We will track the rate and performance with the help of CID checker, SA bot and A/C bot in real time. When remaining dataCap is less than 25%, SA bot will trigger the request for next allocation. In this way, the rate at which dataCap is being distributed is scientific. In the past year, some applicants are granted dataCap but reluctant to use it for a long time. To avoid this kind of dataCap waste, we recommended to set a duration like 40 days for client to use the dataCap. When the deadline is due, the dataCap will be removed by A/C bot without excuse. Data Diligence This section will cover the types of data that you expect to notarize. As a reminder: The Filecoin Plus program defines quality data is all content that meets local regulatory requirements AND As an operating entity in the Filecoin Community, you are required to follow all local & regional regulations relating to any data, digital and otherwise. This may include PII and data deletion requirements, as well as the storing, transmitting, or accessing of data. Acknowledgement: Acknowledge What type(s) of data would be applicable for your pathway? Public Open Dataset (Research/Non-Profit),Public Open Commercial/Enterprise How will you verify a client's data ownership? Will you use 3rd-party KYB (know your business) service to verify enterprise clients? We put focus on public datasets. It’s less sensitive generally. How will you ensure the data meets local & regional legal requirements? First, we have years of experience in Filecoin storage since 2020. We know the rules and guidelines clearly and never involved in a dispute before as a v4 notary. What’s more, we have legal&compliance staff for all legal affairs. For any behaviors or actions that may breach the law or regulations, we will consult him first to avoid unnecessary trouble. What types of data preparation will you support or require? CAR files should be prepared for encapsulation for technical clients. 32/64G are perfect file sizes. If clients are non-technical, he can seek help from sealing as a service. Also we can provide training and educational materials for clients if necessary. What tools or methodology will you use to sample and verify the data aligns with your pathway? One-off retrieval is used to confirm if or not the dataset stored is the same as described in application. the retrieval test should be done at regular basis. And the dataset should be greater than 60% of sector size to reduce sector abuse. Data Distribution This section covers deal-making and data distribution. As a reminder, the Filecoin Plus program currently defines distributed onboarding as multiple physical locations AND multiple storage provider entities to serve client requirements. Recommended Minimum: 3 locations, 4 to 5 storage providers, 5 copies How many replicas will you require to meet programmatic requirements for distribution? 5+ What geographic or regional distribution will you require? 3 continents at least How many Storage Provider owner/operators will you require to meet programmatic requirements for distribution? 5+ Do you require equal percentage distribution for your clients to their chosen SPs? Will you require preliminary SP distribution plans from the client before allocating any DataCap? SP template will be used to ensure a smooth sealing process and also compliance. Clients have the right to distribute the dataCap to their own SPs at their own discretion as long as they follow the guidelines issued by Fil+ governance team. But single SP will not take over 25% of total deal. SP distribution plans are required from client. SP IDs, SP location, SP organization, total amount of dataCap received, retrieval rate, VPN usage are important metrics to determine correctly the reasonable percentage to specific SPs. The template link is https://docs.google.com/spreadsheets/d/1F5NfzLm1JP59VMe_hKh7jDDY3wySaQwo/edit#gid=1300337083 After signing off the dataCap, we will keep monitoring if or not the storage is carried out as planned. If not, we will ask them to make modifications. What tooling will you use to verify client deal-making distribution? datacapstats.io and CID checker will be used to help clients verify SP performance. We can offer necessary help for clients on how to use CID checker and read relevant metrics. Additionally, datacapstats.io is very useful for clients to track their SPs. Apart from the basic information provided on the website, but there is still room for improvement. It’s advised that different roles including clients, SPs and allocators can log in with their addresses, they can see the deal-making details against their own addresses just like a wallet. datacapstats.io should be an all-in-one website that every role can manage their businesses. And the statistics could be more graphical and intuitive. The data displayed on website should be in real time. How will clients meet SP distribution requirements? It’s a manual process. When submitting application on GitHub, the SP distribution plan and SP details are required. Clients determine the distribution plan completely. When it comes to new clients, we can offer a list of reputable SPs or provide websites or channels for finding qualified SPs like Filswan or by Slack channels. In addition, as a technical infrastructure provider, we always seek an innovative way to solve the distribution and allocation dilemma. If there is other tooling or API available, we are very supportive to adopt those tools. We can even help develop and optimize the tooling to make it a better fit. As an allocator, do you support clients that engage in deal-making with SPs utilizing a VPN? A few countries have blocking issue from government. It is inevitable to use VPN to carry out blockchain business. Most of the participants of Filecoin system are from Asia. If VPN is banned, that may harm the growth of entire ecosystem. So VPN can not be banned completely. We support reasonable usage of VPN. But it is found that some SPs fake locations, that is not allowed as well. There is no effective way to detect VPN fraud as far as I know. If any, we are supportive to use that tool. In SP distribution plan, client is required to fill out the information about SP VPN usage. If SP is found cheating on VPN usage, he will be removed from Filecoin system. DataCap Allocation Strategy In this section, you will explain your client DataCap allocation strategy. Keep in mind the program principle over Limited Trust Over Time. Parties, such as clients, start with a limited amount of trust and power. Will you use standardized DataCap allocations to clients? Yes, standardized Allocation Tranche Schedule to clients: • First: 5% of the total requested DataCap (50TiB at most for new client) Will you use programmatic or software based allocations? No, manually calculated & determined What tooling will you use to construct messages and send allocations to clients? Notary registry is preferred to construct messages and send allocations. And the registry can be optimized to offer an API as tracker for every allocator. That can integrate the statistics from Notary leaderboard and dataset.io/notary. So that allocator can clearly see history and manage the progress of every application signed. Describe the process for granting additional DataCap to previously verified clients. SA bot is used to monitor the usage of dataCap, when the remaining dataCap is below 25%, then trigger the next tranche. At the same time, A/C bot will automatically check the metrics. According to A/C bot proposal, it is a great idea to allocate subsequent allocation automatically if CID report and retrieval performance meet requirements. If the report fails the requirements, then manual due diligence and signing process will take over. And detailed improvement plan is required before signing the additional dataCap. Only one chance offered to client with bad history, otherwise, the application will be closed. Tooling & Bookkeeping This program relies on many software tools in order to function. The Filecoin Foundation and PL have invested in many different elements of this end-to-end process, and will continue to make those tools open-sourced. Our goal is to increase adoption, and we will balance customization with efficiency. This section will cover the various UX/UI tools for your pathway. You should think high-level (GitHub repo architecture) as well as tactical (specific bots and API endoints). Describe in as much detail as possible the tools used for: Client discoverability & Applications: Slack is the most popular way to interact with each other. Client will apply for dataCap on Github as before. Will you use open-source tooling from the Fil+ team? We will use all tools from Fil+ team. gitHub Repo, CID checker, retrieval bot. SA bot. datacapstats.io and notary registry and A/C bot. Where will you keep your records for bookkeeping? How will you maintain transparency in your allocation decisions? All our allocation decisions and proofs will be recorded in a public github repo. That will include application link, address, the amount of dataCap signed, the date of signing, tranche number, the reason why signing it. The sensitive information about the client sent privately will be saved separately in case any of dispute arising from allocation process. Contact us on Slack for more info, contacts are disclosed the last part. Risk Mitigation, Auditing, Compliance This framework ensures the responsible allocation of DataCap by conducting regular audits, enforcing strict compliance checks, and requiring allocators to maintain transparency and engage with the community. This approach safeguards the ecosystem, deters misuse, and upholds the commitment to a fair and accountable storage marketplace. In addition to setting their own rules, each notary allocator will be responsible for managing compliance within their own pathway. You will need to audit your own clients, manage interventions (such as removing DataCap from clients and keeping records), and respond to disputes. Describe your proposed compliance check mechanisms for your own clients. We will create a tracker for every details about the application we signed, such as application link, organization, tranche number, the date of signing the application, the date of running out of dataCap(expected),the reason why signing this application. Describe your process for handling disputes. Highlight response times, transparency, and accountability mechanisms. The current dispute online tracker turns out not a good way to solve disputes. Submit a dispute on GitHub is not efficient and it takes a long time and efforts to process the dispute. Sometimes, dispute just ends without conclusion. Detail how you will announce updates to tooling, pathway guidelines, parameters, and process alterations. For now, every moderator releases their own updates in respective channel on Slack and people are allowed to chat as well, it is hard to find useful updates timely and easily. So #annoucement channel on Slack will be created. All important updates will be shared in this channel on weekly basis. Community members are not allowed to talk in this channel. All updates no matter small or critical will be released in this channel. Speaking of critical changes about allocation process, a detailed proposal shall be drafted, governance team and community members will evaluate its feasibility together. Once the proposal is approved by the community, we will discuss it in governance call and then share the meeting minutes in #annoucement channel. How long will you allow the community to provide feedback before implementing changes? Two weeks for small changes and a month for critical ones (holidays not included)for collecting feedbacks. Regarding security, how will you structure and secure the on-chain notary address? If you will utilize a multisig, how will it be structured? Who will have administrative & signatory rights? Ledger is used to protect the address as before. Allocator team is a group of 4, 3 are responsible for due diligence and writing comments in our own tracker explaining why signing a specific application. The only one will do the final verification and sign the application. The truth is only one of 4 has the administrative & signatory rights to ensure the security of the address. The fewer people know, the lower the risk. Will you deploy smart contracts for program or policy procedures? If so, how will you track and fund them? As an infrastructure technical provider, we have been considering writing smart contract to end the disordered circumstance for long. We have a professional technical team and also we deeply engaged in Fil+ since the beginning. If there is a need from Fil+ team, we can book a meeting to nail the cooperation details. Power Voting is built by our team, the reviewer can take a look for reference. Monetization While the Filecoin Foundation and PL will continue to make investments into developing the program and open-sourcing tools, we are also striving to expand and encourage high levels of service and professionalism through these new Notary Allocator pathways. These pathways require increasingly complex tooling and auditing platforms, and we understand that Notaries (and the teams and organizations responsible) are making investments into building effective systems. It is reasonable for teams building services in this marketplace to include monetization structures. Our primary guiding principles in this regard are transparency and equity. We require these monetization pathways to be clear, consistent, and auditable. Outline your monetization models for the services you provide as a notary allocator pathway. We are not going to adopt staking & slashing system for clients, SPs and allocators. Because fees can not reduce collusion, but increasing the possibility of bribery and self-dealing. Describe your organization's structure, such as the legal entity and other business & market ventures. StorSwift is a Singapore-based technology company that specializes in Web3 infrastructure solution with its branch offices in Shanghai & Wuhan. It provides technical services globally. StorSwift has tons of experience in developing, deploying and maintaining large-scale storage and computing systems. We actively bring in enterprise storage, devops and security technology to Web3 industry. Since 2018, StorSwift has made enormous contributions to the ecosystem of IPFS & Filecoin, involving hardware & software solutions, security enhancement, implementing patches and dedicated software modules. Where will accounting for fees be maintained? No staking& burning mechanism is included in our plan. The only fees are about KYC and allocator incentive program. Those fees are fixed prices. So traditional accounting is sufficient. In the future, if smart contract is implemented to go through the allocation process, everything will be maintained on chain. If you've received DataCap allocation privileges before, please link to prior notary applications. Notary Application: StorSwift · Issue #663 · filecoin-project/notary-governance (github.com) How are you connected to the Filecoin ecosystem? Describe your (or your organization's) Filecoin relationships, investments, or ownership. Firstly,StorSwift, as a Web3 technical team, has provided multiple patches to Filecoin projects, including: filecoin-project/lotus#6658 filecoin-project/lotus#8751 filecoin-project/lotus#8854 filecoin-project/lotus#8787 filecoin-project/lotus#8696 filecoin-project/lotus#8545 filecoin-project/lotus#7310 filecoin-project/lotus#7027 Besides, StorSwift has also developed related Filecoin modules, and successfully got the dev-grants. Please note the following examples and links. 1. Multi-Sector Memory Pool Support for the Sealing Precommit Phase1 This module seeks to largely reduce memory consumption for PreCommit Phase. Hence, more tasks can run on the same machine, which effectively cuts costs. Code: https://github.com/storswiftlabs/rust-fil-proofs-mpool Documents: https://github.com/storswiftlabs/rust-fil-proofs-mpool/blob/master/storage-proofs-porep/src/stacked/vanilla/create_label/mem_pool_arch.md 2. Lotus offline signature solution This module makes Filecoin accounts more secure. That means there is no need to keep the owner keys and other keys on the servers. Code: https://github.com/storswift/lotus-offline-sign 3. Decentralized voting tool https://github.com/black-domain/power-voting How are you estimating your client demand and pathway usage? Do you have existing clients and an onboarding funnel? As far as we know, research institutions have huge demand for training data for large language models, such as LAION-5B which has 800T. AI & machine learning are trending projects both in web2 and web3. And we have years of experience and huge customer base in traditional storage. We will see booming growth in 2024. |
No description provided.
The text was updated successfully, but these errors were encountered: