Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CI] fix 'no matches found within 10000' #21466

Merged
merged 7 commits into from
Oct 5, 2020
Merged

[CI] fix 'no matches found within 10000' #21466

Changes from all commits
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
27fad54
[CI] debug what stage causes 'no matches found within 10000'
v1v Oct 2, 2020
301f037
Delete ve and vendor folders to avoid 10000
v1v Oct 2, 2020
ef26081
Merge remote-tracking branch 'upstream/master' into feature/ci-fix-no…
v1v Oct 5, 2020
1ea9752
Remove folders with find
v1v Oct 5, 2020
d92bbba
Fix groovy syntax
v1v Oct 5, 2020
20c4e87
Avoid debug traces
v1v Oct 5, 2020
0684a38
Tar and archive rather than archive only
v1v Oct 5, 2020
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 7 additions & 2 deletions Jenkinsfile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -74,7 +74,7 @@ pipeline {
}
steps {
withGithubNotify(context: 'Lint') {
withBeatsEnv(archive: true) {
withBeatsEnv(archive: true, id: 'lint') {
dumpVariables()
cmd(label: 'make check', script: 'make check')
}
Expand Down Expand Up @@ -345,8 +345,13 @@ def archiveTestOutput(Map args = [:]) {
}
cmd(label: 'Prepare test output', script: 'python .ci/scripts/pre_archive_test.py')
dir('build') {
if (isUnix()) {
cmd(label: 'Delete folders that are causing exceptions (See JENKINS-58421)',
returnStatus: true,
script: 'rm -rf ve || true; find . -type d -name vendor -exec rm -r {} \\;')
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I've no clue where the ve folder is defined, but it's there for the libbeat

[2020-10-05T11:59:25.997Z] + echo libbeat-build
[2020-10-05T11:59:25.998Z] libbeat-build
[2020-10-05T11:59:25.998Z] + ls -ltrah
[2020-10-05T11:59:25.998Z] total 20K
[2020-10-05T11:59:25.998Z] drwxr-xr-x 258 jenkins jenkins 4.0K Oct  5 11:51 docker-gocache
[2020-10-05T11:59:25.998Z] drwxr-xr-x   3 jenkins jenkins 4.0K Oct  5 11:56 ve
[2020-10-05T11:59:25.998Z] drwxr-xr-x   3 jenkins jenkins 4.0K Oct  5 11:59 libbeat
[2020-10-05T11:59:25.998Z] drwxr-xr-x   5 jenkins jenkins 4.0K Oct  5 11:59 .
[2020-10-05T11:59:25.998Z] drwxr-xr-x  26 jenkins jenkins 4.0K Oct  5 11:59 ..
[2020-10-05T11:59:25.998Z] + find . -name build -ls
[2020-10-05T11:59:25.998Z]   5167709      4 drwxr-xr-x   3 jenkins  jenkins      4096 Oct  5 11:59 ./libbeat/build
[2020-10-05T11:59:25.998Z]   5430897      4 drwxr-xr-x   3 jenkins  jenkins      4096 Oct  5 11:57 ./ve/docker/lib/python3.7/site-packages/pip/_internal/operations/build
``

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

IIRC it's created for the integration tests and is created by a Makefile target. It's a Python virtual environment. Should be safe to delete.

} else { log(level: 'INFO', text: 'Delete folders that are causing exceptions (See JENKINS-58421) is disabled for Windows.') }
Comment on lines +348 to +352
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Clean the build artifacts when the folder is too big!

junitAndStore(allowEmptyResults: true, keepLongStdio: true, testResults: args.testResults, stashedTestReports: stashedTestReports, id: args.id)
archiveArtifacts(allowEmptyArchive: true, artifacts: args.artifacts)
tar(file: "test-build-artifacts-${args.id}.tgz", dir: '.', archive: true, allowMissing: true)
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This might help us to avoid the interruption error even when the cleanup defined above happened:

[2020-10-05T12:09:17.924Z] drwxr-xr-x  26 jenkins jenkins 4.0K Oct  5 12:09 ..
[2020-10-05T12:09:17.924Z] + find . -name build -ls
[2020-10-05T12:09:17.924Z]   5170689      4 drwxr-xr-x   4 jenkins  jenkins      4096 Oct  5 12:09 ./metricbeat/build
[2020-10-05T12:09:17.924Z]   5168179      4 drwxr-xr-x   3 jenkins  jenkins      4096 Oct  5 11:39 ./ve/docker/lib/python3.7/site-packages/pip/_internal/operations/build
[2020-10-05T12:09:17.934Z] [Pipeline] isUnix
[2020-10-05T12:09:17.937Z] [Pipeline] sh
[2020-10-05T12:09:18.224Z] + rm -rf ve
[2020-10-05T12:09:18.224Z] + find . -type d -name vendor -exec rm -r {} ;
[2020-10-05T12:09:18.239Z] [Pipeline] junit
[2020-10-05T12:09:18.239Z] WARNING: Unknown parameter(s) found for class type 'hudson.tasks.junit.pipeline.JUnitResultsStep': id,stashedTestReports
[2020-10-05T12:09:18.242Z] Recording test results
[2020-10-05T12:09:19.975Z] [Pipeline] stash
[2020-10-05T12:09:20.208Z] Stashed 1 file(s)
[2020-10-05T12:09:20.213Z] [Pipeline] archiveArtifacts
[2020-10-05T12:09:20.219Z] Archiving artifacts
[2020-10-05T12:09:20.450Z] java.lang.InterruptedException: no matches found within 10000
[2020-10-05T12:09:20.450Z] 	at hudson.FilePath$ValidateAntFileMask.hasMatch(FilePath.java:2865)
[2020-10-05T12:09:20.450Z] 	at hudson.FilePath$ValidateAntFileMask.invoke(FilePath.java:2744)
[2020-10-05T12:09:20.450Z] 	at hudson.FilePath$ValidateAntFileMask.invoke(FilePath.java:2725)
[2020-10-05T12:09:20.450Z] 	at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3112)
[2020-10-05T12:09:20.450Z] Also:   hudson.remoting.Channel$CallSiteStackTrace: Remote call to JNLP4-connect connection from beats-ci-immutable-ubuntu-1804-1601897573326600637.c.elastic-ci-prod.internal/10.224.1.213:57106

}
catchError(buildResult: 'SUCCESS', message: 'Failed to archive the build test results', stageResult: 'SUCCESS') {
def folder = cmd(label: 'Find system-tests', returnStdout: true, script: 'python .ci/scripts/search_system_tests.py').trim()
Expand Down