Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Try to improve corpus pruning preprocess time. #4645

Merged
merged 9 commits into from
Jan 31, 2025
Merged

Conversation

jonathanmetzman
Copy link
Collaborator

  1. Limit corpus signing to 50,000 URLs.
  2. Treat a lack of successful corpus pruning as a semi-failure and force removal of corpus files in this case.
  3. Only fetch the names of files when only the names are used, to improve speed.

@vitorguidi
Copy link
Collaborator

  1. Limit corpus signing to 50,000 URLs.
  2. Treat a lack of successful corpus pruning as a semi-failure and force removal of corpus files in this case.
  3. Only fetch the names of files when only the names are used, to improve speed.

This ultimately intends to bump up our fuzzing hours for oss fuzz, right?
Would be nice to see the profiling results that motivated this change, if you still have that 👀

@jonathanmetzman
Copy link
Collaborator Author

  1. Limit corpus signing to 50,000 URLs.
  2. Treat a lack of successful corpus pruning as a semi-failure and force removal of corpus files in this case.
  3. Only fetch the names of files when only the names are used, to improve speed.

This ultimately intends to bump up our fuzzing hours for oss fuzz, right? Would be nice to see the profiling results that motivated this change, if you still have that 👀

This is a good point, but I don't have profiling results because the scale here was so absurd I gave up waiting. cjson_read_fuzzer had 4.5 million testcases

@jonathanmetzman jonathanmetzman merged commit 5c87249 into oss-fuzz Jan 31, 2025
3 checks passed
@jonathanmetzman jonathanmetzman deleted the hht branch January 31, 2025 02:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants