Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Retrieval Bot - Add support for multiple challenges per level #34

Closed
Tracked by #46
jcace opened this issue Oct 13, 2023 · 3 comments
Closed
Tracked by #46

Retrieval Bot - Add support for multiple challenges per level #34

jcace opened this issue Oct 13, 2023 · 3 comments
Assignees

Comments

@jcace
Copy link

jcace commented Oct 13, 2023

  • Currently the Spade Retrieval bot just does one challenge (link) per level of the tree
  • modify it so we can parameterize # of challenges to do per level, to get more coverage of the tree with each retrieval test
  • for example, with a MaxDepth of 3, we could do 4 cids at the top level, then 2 cids for each of those at the intermediate level, then 1 cid at the bottom level, resulting in 8 data CIDs tested total (with 16 total bitswap retrievals performed)
@stephen-pl
Copy link

Do you envision this as a env variable? or something that randomly picked for each run, say a number between 0-10 @jcace

@jcace
Copy link
Author

jcace commented Nov 6, 2023

@stephen-pl

Technically, longer term this will be controlled by the specific Tenant and how "stringent" they want to be about their retrieval testing. But, for now let's make this an environment variable that applies to all tests since we don't have that Tenant side built out yet.

@stephen-pl stephen-pl moved this from 🍇 Backlog to 👨‍💻 In Progress in ActionArena Nov 7, 2023
@stephen-pl
Copy link

@stephen-pl stephen-pl moved this from 👨‍💻 In Progress to 🚢 Done in ActionArena Dec 10, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: 🚢 Done
Development

No branches or pull requests

2 participants