Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Zoom] updating ECS version and adding event.original options #1111

Closed
wants to merge 1 commit into from

Conversation

P1llus
Copy link
Member

@P1llus P1llus commented Jun 9, 2021

What does this PR do?

Updates package ECS version to 1.10.
Sync module changes to packages if any.
Adds Preserve Raw event functionality if not already exists.
Adds pipeline tests if missing.
Adds missing tags + moving tags to advanced settings.
Adds possibility to add custom processors.

Checklist

  • I have reviewed tips for building integrations and this pull request is aligned with them.
  • I have verified that all data streams collect metrics or logs.
  • I have added an entry to my package's changelog.yml file.
  • If I'm introducing a new feature, I have modified the Kibana version constraint in my package's manifest.yml file to point to the latest Elastic stack release (e.g. ^7.13.0).

Related issues

@elasticmachine
Copy link

elasticmachine commented Jun 9, 2021

💔 Build Failed

the below badges are clickable and redirect to their specific view in the CI or DOCS
Pipeline View Test View Changes Artifacts preview preview

Expand to view the summary

Build stats

  • Start Time: 2021-08-04T09:30:05.188+0000

  • Duration: 8 min 49 sec

  • Commit: 48077ea

Trends 🧪

Image of Build Times

Steps errors 2

Expand to view the steps failures

Check integration: zoom
  • Took 0 min 0 sec . View more details on here
  • Description: ../../build/elastic-package check -v
Google Storage Download
  • Took 0 min 0 sec . View more details on here

Log output

Expand to view the last 100 lines of log output

[2021-08-04T09:36:59.796Z] go: downloading golang.org/x/time v0.0.0-20210220033141-f8bda1e9f3ba
[2021-08-04T09:36:59.796Z] go: downloading github.com/modern-go/concurrent v0.0.0-20180306012644-bacd9c7ef1dd
[2021-08-04T09:36:59.796Z] go: downloading google.golang.org/protobuf v1.26.0
[2021-08-04T09:37:00.055Z] go: downloading gopkg.in/inf.v0 v0.9.1
[2021-08-04T09:37:00.055Z] go: downloading github.com/hashicorp/golang-lru v0.5.1
[2021-08-04T09:37:00.055Z] go: downloading github.com/go-openapi/spec v0.19.5
[2021-08-04T09:37:00.055Z] go: downloading github.com/exponent-io/jsonpath v0.0.0-20151013193312-d6023ce2651d
[2021-08-04T09:37:00.055Z] go: downloading k8s.io/component-base v0.21.0
[2021-08-04T09:37:00.055Z] go: downloading github.com/google/shlex v0.0.0-20191202100458-e7afc7fbc510
[2021-08-04T09:37:00.055Z] go: downloading github.com/go-errors/errors v1.0.1
[2021-08-04T09:37:00.055Z] go: downloading github.com/MakeNowJust/heredoc v0.0.0-20170808103936-bb23615498cd
[2021-08-04T09:37:00.055Z] go: downloading github.com/russross/blackfriday v1.5.2
[2021-08-04T09:37:00.055Z] go: downloading github.com/go-stack/stack v1.8.0
[2021-08-04T09:37:00.055Z] go: downloading github.com/monochromegane/go-gitignore v0.0.0-20200626010858-205db1a8cc00
[2021-08-04T09:37:00.055Z] go: downloading github.com/stretchr/testify v1.7.0
[2021-08-04T09:37:00.055Z] go: downloading github.com/xlab/treeprint v0.0.0-20181112141820-a009c3971eca
[2021-08-04T09:37:00.055Z] go: downloading github.com/mitchellh/go-wordwrap v1.0.0
[2021-08-04T09:37:00.055Z] go: downloading github.com/moby/term v0.0.0-20201216013528-df9cb8a40635
[2021-08-04T09:37:00.055Z] go: downloading go.starlark.net v0.0.0-20200306205701-8dd3e2ee1dd5
[2021-08-04T09:37:00.055Z] go: downloading github.com/moby/spdystream v0.2.0
[2021-08-04T09:37:00.055Z] go: downloading github.com/pmezard/go-difflib v1.0.0
[2021-08-04T09:37:00.055Z] go: downloading github.com/go-openapi/swag v0.19.5
[2021-08-04T09:37:00.055Z] go: downloading github.com/go-openapi/jsonreference v0.19.3
[2021-08-04T09:37:00.055Z] go: downloading github.com/go-openapi/jsonpointer v0.19.3
[2021-08-04T09:37:00.055Z] go: downloading github.com/PuerkitoBio/purell v1.1.1
[2021-08-04T09:37:00.055Z] go: downloading github.com/PuerkitoBio/urlesc v0.0.0-20170810143723-de5bf2ad4578
[2021-08-04T09:37:00.055Z] go: downloading github.com/mailru/easyjson v0.7.0
[2021-08-04T09:37:46.864Z] Running in /var/lib/jenkins/workspace/est-manager_integrations_PR-1111/src/github.com/elastic/integrations/packages/zoom
[2021-08-04T09:37:47.154Z] + ../../build/elastic-package check -v
[2021-08-04T09:37:47.154Z] elastic-package has been installed.
[2021-08-04T09:37:47.154Z] 2021/08/04 09:37:46 DEBUG Enable verbose logging
[2021-08-04T09:37:47.154Z] 2021/08/04 09:37:46 DEBUG Distribution built without a version tag, can't determine release chronology. Please consider using official releases at https://github.com/elastic/elastic-package/releases
[2021-08-04T09:37:47.154Z] Format the package
[2021-08-04T09:37:47.154Z] Error: checking package failed: formatting the integration failed (path: /var/lib/jenkins/workspace/est-manager_integrations_PR-1111/src/github.com/elastic/integrations/packages/zoom, failFast: true): walking through the integration files failed: formatting file failed (path: /var/lib/jenkins/workspace/est-manager_integrations_PR-1111/src/github.com/elastic/integrations/packages/zoom/data_stream/webhook/_dev/test/pipeline/test-common-config.yml): file is not formatted (path: /var/lib/jenkins/workspace/est-manager_integrations_PR-1111/src/github.com/elastic/integrations/packages/zoom/data_stream/webhook/_dev/test/pipeline/test-common-config.yml)
[2021-08-04T09:37:47.189Z] Running in /var/lib/jenkins/workspace/est-manager_integrations_PR-1111/src/github.com/elastic/integrations
[2021-08-04T09:37:47.211Z] Archiving artifacts
[2021-08-04T09:37:47.544Z] ‘build/test-results/*.xml’ doesn’t match anything: ‘build’ exists but not ‘build/test-results/*.xml’
[2021-08-04T09:37:47.544Z] No artifacts found that match the file pattern "build/test-results/*.xml". Configuration error?
[2021-08-04T09:37:47.558Z] Recording test results
[2021-08-04T09:37:47.765Z] None of the test reports contained any result
[2021-08-04T09:37:47.765Z] [Checks API] No suitable checks publisher found.
[2021-08-04T09:37:48.072Z] + build/elastic-package stack dump -v --output build/elastic-stack-dump/latest/zoom
[2021-08-04T09:37:48.072Z] 2021/08/04 09:37:47  WARN CommitHash is undefined, in both /var/lib/jenkins/workspace/est-manager_integrations_PR-1111/.elastic-package/version and the compiled binary, config may be out of date.
[2021-08-04T09:37:48.072Z] 2021/08/04 09:37:47 DEBUG Enable verbose logging
[2021-08-04T09:37:48.072Z] 2021/08/04 09:37:47 DEBUG Distribution built without a version tag, can't determine release chronology. Please consider using official releases at https://github.com/elastic/elastic-package/releases
[2021-08-04T09:37:48.072Z] 2021/08/04 09:37:47 DEBUG Dump Elastic stack data
[2021-08-04T09:37:48.072Z] 2021/08/04 09:37:47 DEBUG Dump stack logs
[2021-08-04T09:37:48.072Z] 2021/08/04 09:37:47 DEBUG Recreate the output location (path: build/elastic-stack-dump/latest/zoom)
[2021-08-04T09:37:48.072Z] 2021/08/04 09:37:47 DEBUG Dump stack logs for elasticsearch
[2021-08-04T09:37:48.072Z] 2021/08/04 09:37:47 DEBUG running command: /usr/local/bin/docker-compose -f /var/lib/jenkins/workspace/est-manager_integrations_PR-1111/.elastic-package/profiles/default/stack/snapshot.yml -p elastic-package-stack logs elasticsearch
[2021-08-04T09:37:49.008Z] 2021/08/04 09:37:48 DEBUG Dump stack logs for elastic-agent
[2021-08-04T09:37:49.008Z] 2021/08/04 09:37:48 DEBUG running command: /usr/local/bin/docker-compose -f /var/lib/jenkins/workspace/est-manager_integrations_PR-1111/.elastic-package/profiles/default/stack/snapshot.yml -p elastic-package-stack logs elastic-agent
[2021-08-04T09:37:49.577Z] 2021/08/04 09:37:49 DEBUG Dump stack logs for fleet-server
[2021-08-04T09:37:49.577Z] 2021/08/04 09:37:49 DEBUG running command: /usr/local/bin/docker-compose -f /var/lib/jenkins/workspace/est-manager_integrations_PR-1111/.elastic-package/profiles/default/stack/snapshot.yml -p elastic-package-stack logs fleet-server
[2021-08-04T09:37:50.146Z] 2021/08/04 09:37:50 DEBUG Dump stack logs for kibana
[2021-08-04T09:37:50.146Z] 2021/08/04 09:37:50 DEBUG running command: /usr/local/bin/docker-compose -f /var/lib/jenkins/workspace/est-manager_integrations_PR-1111/.elastic-package/profiles/default/stack/snapshot.yml -p elastic-package-stack logs kibana
[2021-08-04T09:37:51.082Z] 2021/08/04 09:37:50 DEBUG Dump stack logs for package-registry
[2021-08-04T09:37:51.082Z] 2021/08/04 09:37:50 DEBUG running command: /usr/local/bin/docker-compose -f /var/lib/jenkins/workspace/est-manager_integrations_PR-1111/.elastic-package/profiles/default/stack/snapshot.yml -p elastic-package-stack logs package-registry
[2021-08-04T09:37:51.650Z] Path to stack dump: build/elastic-stack-dump/latest/zoom
[2021-08-04T09:37:51.650Z] Done
[2021-08-04T09:37:51.672Z] Archiving artifacts
[2021-08-04T09:37:52.045Z] + build/elastic-package stack down -v
[2021-08-04T09:37:52.045Z] 2021/08/04 09:37:51  WARN CommitHash is undefined, in both /var/lib/jenkins/workspace/est-manager_integrations_PR-1111/.elastic-package/version and the compiled binary, config may be out of date.
[2021-08-04T09:37:52.045Z] 2021/08/04 09:37:51 DEBUG Enable verbose logging
[2021-08-04T09:37:52.045Z] 2021/08/04 09:37:51 DEBUG Distribution built without a version tag, can't determine release chronology. Please consider using official releases at https://github.com/elastic/elastic-package/releases
[2021-08-04T09:37:52.045Z] Take down the Elastic stack
[2021-08-04T09:37:52.045Z] 2021/08/04 09:37:51 DEBUG running command: /usr/local/bin/docker-compose -f /var/lib/jenkins/workspace/est-manager_integrations_PR-1111/.elastic-package/profiles/default/stack/snapshot.yml -p elastic-package-stack down --volumes
[2021-08-04T09:37:52.613Z] Removing network elastic-package-stack_default
[2021-08-04T09:37:52.613Z] Network elastic-package-stack_default not found.
[2021-08-04T09:37:52.613Z] Done
[2021-08-04T09:37:52.903Z] + ls build/test-coverage/*.xml
[2021-08-04T09:37:52.903Z] ls: cannot access 'build/test-coverage/*.xml': No such file or directory
[2021-08-04T09:37:52.915Z] isCoverageReportPresent: coverage files not found, report won't be stashed
[2021-08-04T09:37:52.945Z] Failed in branch zoom
[2021-08-04T09:37:53.013Z] Terminated
[2021-08-04T09:37:53.017Z] Running in /var/lib/jenkins/workspace/est-manager_integrations_PR-1111/src/github.com/elastic/integrations
[2021-08-04T09:37:53.040Z] Terminated
[2021-08-04T09:37:53.123Z] Error when executing always post condition:
[2021-08-04T09:37:53.123Z] java.lang.NullPointerException
[2021-08-04T09:37:53.123Z] 	at com.google.jenkins.plugins.storage.DownloadStep.resolveBucketPath(DownloadStep.java:445)
[2021-08-04T09:37:53.123Z] 	at com.google.jenkins.plugins.storage.DownloadStep.perform(DownloadStep.java:210)
[2021-08-04T09:37:53.123Z] 	at jenkins.tasks.SimpleBuildStep.perform(SimpleBuildStep.java:123)
[2021-08-04T09:37:53.123Z] 	at org.jenkinsci.plugins.workflow.steps.CoreStep$Execution.run(CoreStep.java:99)
[2021-08-04T09:37:53.123Z] 	at org.jenkinsci.plugins.workflow.steps.CoreStep$Execution.run(CoreStep.java:69)
[2021-08-04T09:37:53.123Z] 	at org.jenkinsci.plugins.workflow.steps.SynchronousNonBlockingStepExecution.lambda$start$0(SynchronousNonBlockingStepExecution.java:47)
[2021-08-04T09:37:53.123Z] 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[2021-08-04T09:37:53.123Z] 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[2021-08-04T09:37:53.123Z] 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[2021-08-04T09:37:53.123Z] 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[2021-08-04T09:37:53.123Z] 	at java.lang.Thread.run(Thread.java:748)
[2021-08-04T09:37:53.123Z] 
[2021-08-04T09:37:53.406Z] Running on Jenkins in /var/lib/jenkins/workspace/est-manager_integrations_PR-1111
[2021-08-04T09:37:53.506Z] [INFO] getVaultSecret: Getting secrets
[2021-08-04T09:37:53.543Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2021-08-04T09:37:54.204Z] + chmod 755 generate-build-data.sh
[2021-08-04T09:37:54.204Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Ingest-manager/integrations/PR-1111/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Ingest-manager/integrations/PR-1111/runs/19 FAILURE 468753
[2021-08-04T09:37:54.204Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Ingest-manager/integrations/PR-1111/runs/19/steps/?limit=10000 -o steps-info.json
[2021-08-04T09:37:54.755Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Ingest-manager/integrations/PR-1111/runs/19/tests/?status=FAILED -o tests-errors.json
[2021-08-04T09:37:54.755Z] Retry 1/3 exited 22, retrying in 1 seconds...
[2021-08-04T09:37:56.100Z] Retry 2/3 exited 22, retrying in 2 seconds...

@P1llus P1llus closed this Aug 30, 2021
@elastic-vault-github-plugin-prod

Package microsoft_exchange_online_message_trace - 1.25.1 containing this change is available at https://epr.elastic.co/package/microsoft_exchange_online_message_trace/1.25.1/

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants