Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Benchmarking the jest script #2793

Closed
wants to merge 3 commits into from

Conversation

elicwhite
Copy link
Contributor

@elicwhite elicwhite commented Feb 3, 2017

The goal is to benchmark the jest script to monitor and analyze the test suite run time over time using https://github.com/TheSavior/timing-stats.

At the end of the build, there will be a file called build_times.json. This is specified in the package.json file. It will append the current results to whatever the content of that file is. If CI pushes back to master this is trivial. In order to push to a different branch, we'll need to check out the other branch before running add-temp-timing-to-json and then pushing.

@thymikee
Copy link
Collaborator

thymikee commented Feb 3, 2017

These benchmark times will be heavily affected by the load on Travis servers, so I'm worried this will be unreliable

@elicwhite
Copy link
Contributor Author

Sorry, I don't think I added enough context since I've been talking to @cpojer for a while about this. Here is a blog post draft that walks through part of the goal for this type of data.

I think part of this will be an exploration of the data. While travis load surely changes, we may still be able detect trends or bigger problems. I think it could be reasonable to explore this and decide if we get anything valuable out of it.

@cpojer
Copy link
Member

cpojer commented Mar 2, 2017

Thanks!

We'll probably try to see if the new benchmarking feature inside of Jest may work for this: #3026 and then come back to your PR. I'm super interested to see if CI is stable enough to track this long-term.

@cpojer cpojer closed this Mar 2, 2017
@github-actions
Copy link

This pull request has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.
Please note this issue tracker is not a help forum. We recommend using StackOverflow or our discord channel for questions.

@github-actions github-actions bot locked as resolved and limited conversation to collaborators May 13, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants