-
Notifications
You must be signed in to change notification settings - Fork 2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Group tests by language on Travis-CI #1029
Comments
Awesome idea. I'm worried we may need to setup a cache first--I think |
First test build Python and second test re-use it. Download cache is already used for Python. |
Sorry, I should have been more clear. I meant we should setup a cache for building the dependencies on travis. I've got an initial example working. The idea is that we only run a build of python, or perl, etc, one time on travis. We then tar the resulting |
FYI to all - travis-ci has asked us to implement this because we occasionally generate quite a load on their system. It’s my intention to do this once R10 is done, and frankly I think it will reduce the frequency of seeing unexpected travis problems (tricky-to-debug network failure issues, mainly) if we’re not creating thousands of jobs across 10s of queues |
Ok, so I fully implemented this in #1446 . However, you cannot put all frameworks for a language into one travis job because of the 50 minute limit. I split it as much as necessary, but the end result is terrible (many mixed logs, hard to know where a framework is, hard to maintain). Travis-CI contacted us and offered to increase our limits to better support maintaining the existing system with one job per framework, so for now this idea is shelved. To avoid the massive re-compilations, my current idea is to start using #1479 , which I have implemented here and appears to be workin ok for fixing the mono installation (which now completes in ~5 minutes) |
After #995 , tests using same language can re-use many things.
(Language toolchain, download cache for libraries, etc...)
Grouping tests by language may make CI very faster.
The text was updated successfully, but these errors were encountered: