Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Issues on benchmark ci #68

Closed
rjbou opened this issue Aug 25, 2023 · 4 comments
Closed

Issues on benchmark ci #68

rjbou opened this issue Aug 25, 2023 · 4 comments
Assignees

Comments

@rjbou
Copy link

rjbou commented Aug 25, 2023

These days, I've seen several buggy behaviour with benchmarks on opam:

  • Failing with no log
  • Docker issues, see here & here
  • No bench job associated to a PR
@shakthimaan
Copy link
Contributor

Thanks for raising an issue. A recent system upgrade is causing these behaviors.. We are currently troubleshooting the Docker and benchmark failures, and we will keep you posted on any further updates.

@avsm
Copy link
Member

avsm commented Oct 12, 2023

How's this troubleshooting going?

@punchagan
Copy link
Contributor

I've not yet had a chance to look into this in detail, but I've created an issue for it that we will track on the current-bench repo.

The docker issues were because of the disk running out of inodes and we have mitigated the issue by switching to a larger disk, though we haven't yet figured out the reason for the docker overlay2 layers not being garbage collected, even when they seem to be no longer used.

  • No bench job associated to a PR

Some of the missed PRs were because the service was unstable due to the disk space (inode) issues. This should be resolved now.

@tmattio
Copy link
Collaborator

tmattio commented Jan 29, 2024

My understanding is that the issue has been addressed. Closing now, but please re-open if that's not the case.

@tmattio tmattio closed this as completed Jan 29, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants