[Fortinet] updating fortinet ecs version and add event.original options #1043

P1llus · 2021-06-01T10:06:30Z

What does this PR do?

Updates package ECS version to 1.10.
Sync module changes to packages if any.
Adds Preserve Raw event functionality if not already exists.
Adds pipeline tests if missing.

Checklist

I have reviewed tips for building integrations and this pull request is aligned with them.
I have verified that all data streams collect metrics or logs.
I have added an entry to my package's changelog.yml file.
If I'm introducing a new feature, I have modified the Kibana version constraint in my package's manifest.yml file to point to the latest Elastic stack release (e.g. ^7.13.0).

Related issues

Relates [Meta] 7.14 Planned changes to all packages #994

elasticmachine · 2021-06-01T10:14:58Z

💔 Build Failed

the below badges are clickable and redirect to their specific view in the CI or DOCS

Expand to view the summary

Build stats

Build Cause: Pull request #1043 updated
Start Time: 2021-06-07T10:06:56.645+0000
Duration: 7 min 22 sec
Commit: 490582e

Trends 🧪

Steps errors

Expand to view the steps failures

`Check integration: fortinet`

Took 0 min 0 sec . View more details on here
Description: ../../build/elastic-package check -v

Log output

Expand to view the last 100 lines of log output

[2021-06-07T10:13:39.517Z] go: downloading github.com/xanzy/ssh-agent v0.2.1
[2021-06-07T10:13:39.517Z] go: downloading github.com/google/gofuzz v1.1.0
[2021-06-07T10:13:39.517Z] go: downloading github.com/go-openapi/errors v0.19.2
[2021-06-07T10:13:39.517Z] go: downloading github.com/modern-go/concurrent v0.0.0-20180306012644-bacd9c7ef1dd
[2021-06-07T10:13:39.517Z] go: downloading github.com/davecgh/go-spew v1.1.1
[2021-06-07T10:13:39.517Z] go: downloading github.com/googleapis/gnostic v0.4.1
[2021-06-07T10:13:39.517Z] go: downloading sigs.k8s.io/yaml v1.2.0
[2021-06-07T10:13:39.517Z] go: downloading golang.org/x/time v0.0.0-20200630173020-3af7569d3a1e
[2021-06-07T10:13:39.517Z] go: downloading github.com/go-stack/stack v1.8.0
[2021-06-07T10:13:39.517Z] go: downloading github.com/modern-go/reflect2 v1.0.1
[2021-06-07T10:13:39.517Z] go: downloading github.com/peterbourgon/diskv v2.0.1+incompatible
[2021-06-07T10:13:39.517Z] go: downloading github.com/golang/protobuf v1.4.3
[2021-06-07T10:13:39.517Z] go: downloading github.com/PaesslerAG/jsonpath v0.1.1
[2021-06-07T10:13:39.517Z] go: downloading google.golang.org/protobuf v1.25.0
[2021-06-07T10:13:39.517Z] go: downloading github.com/joeshaw/multierror v0.0.0-20140124173710-69b34d4ec901
[2021-06-07T10:13:39.776Z] go: downloading k8s.io/utils v0.0.0-20201110183641-67b214c5f920
[2021-06-07T10:13:39.776Z] go: downloading k8s.io/apiextensions-apiserver v0.20.1
[2021-06-07T10:13:40.036Z] go: downloading github.com/google/btree v1.0.0
[2021-06-07T10:13:40.036Z] go: downloading github.com/gregjones/httpcache v0.0.0-20180305231024-9cad4c3443a7
[2021-06-07T10:13:40.036Z] go: downloading sigs.k8s.io/structured-merge-diff/v4 v4.0.2
[2021-06-07T10:13:40.036Z] go: downloading github.com/PaesslerAG/gval v1.0.0
[2021-06-07T10:13:40.036Z] go: downloading k8s.io/kube-openapi v0.0.0-20201113171705-d219536bb9fd
[2021-06-07T10:13:40.036Z] go: downloading k8s.io/kubectl v0.20.1
[2021-06-07T10:13:40.036Z] go: downloading k8s.io/klog/v2 v2.4.0
[2021-06-07T10:13:40.036Z] go: downloading github.com/google/go-cmp v0.5.2
[2021-06-07T10:13:40.036Z] go: downloading github.com/hashicorp/golang-lru v0.5.1
[2021-06-07T10:13:40.036Z] go: downloading github.com/liggitt/tabwriter v0.0.0-20181228230101-89fcab3d43de
[2021-06-07T10:13:40.036Z] go: downloading github.com/go-logr/logr v0.2.0
[2021-06-07T10:13:40.036Z] go: downloading github.com/ghodss/yaml v1.0.0
[2021-06-07T10:13:40.036Z] go: downloading gopkg.in/inf.v0 v0.9.1
[2021-06-07T10:13:40.036Z] go: downloading github.com/go-openapi/spec v0.19.3
[2021-06-07T10:13:40.036Z] go: downloading github.com/go-openapi/jsonpointer v0.19.3
[2021-06-07T10:13:40.036Z] go: downloading github.com/go-openapi/swag v0.19.5
[2021-06-07T10:13:40.296Z] go: downloading github.com/emicklei/go-restful v2.9.5+incompatible
[2021-06-07T10:13:40.296Z] go: downloading github.com/mailru/easyjson v0.7.0
[2021-06-07T10:13:40.296Z] go: downloading github.com/go-openapi/jsonreference v0.19.3
[2021-06-07T10:13:40.296Z] go: downloading github.com/PuerkitoBio/purell v1.1.1
[2021-06-07T10:13:40.296Z] go: downloading github.com/PuerkitoBio/urlesc v0.0.0-20170810143723-de5bf2ad4578
[2021-06-07T10:13:40.297Z] go: downloading github.com/exponent-io/jsonpath v0.0.0-20151013193312-d6023ce2651d
[2021-06-07T10:13:40.297Z] go: downloading k8s.io/component-base v0.20.1
[2021-06-07T10:13:40.297Z] go: downloading github.com/russross/blackfriday v1.5.2
[2021-06-07T10:13:40.297Z] go: downloading github.com/MakeNowJust/heredoc v0.0.0-20170808103936-bb23615498cd
[2021-06-07T10:13:40.297Z] go: downloading github.com/moby/term v0.0.0-20200312100748-672ec06f55cd
[2021-06-07T10:13:40.297Z] go: downloading github.com/mitchellh/go-wordwrap v1.0.0
[2021-06-07T10:13:40.297Z] go: downloading github.com/docker/spdystream v0.0.0-20160310174837-449fdfce4d96
[2021-06-07T10:14:12.488Z] Running in /var/lib/jenkins/workspace/est-manager_integrations_PR-1043/src/github.com/elastic/integrations/packages/fortinet
[2021-06-07T10:14:12.776Z] + ../../build/elastic-package check -v
[2021-06-07T10:14:12.776Z] elastic-package has been installed.
[2021-06-07T10:14:12.776Z] 2021/06/07 10:14:12 DEBUG Enable verbose logging
[2021-06-07T10:14:12.776Z] Format the package
[2021-06-07T10:14:12.776Z] Error: checking package failed: formatting the integration failed (path: /var/lib/jenkins/workspace/est-manager_integrations_PR-1043/src/github.com/elastic/integrations/packages/fortinet, failFast: true): walking through the integration files failed: formatting file failed (path: /var/lib/jenkins/workspace/est-manager_integrations_PR-1043/src/github.com/elastic/integrations/packages/fortinet/data_stream/clientendpoint/_dev/test/pipeline/test-generated.log-expected.json): formatting file content failed: unmarshalling JSON file failed: invalid character '<' looking for beginning of object key string
[2021-06-07T10:14:12.800Z] Running in /var/lib/jenkins/workspace/est-manager_integrations_PR-1043/src/github.com/elastic/integrations
[2021-06-07T10:14:12.814Z] Archiving artifacts
[2021-06-07T10:14:13.099Z] ‘build/test-results/*.xml’ doesn’t match anything: ‘build’ exists but not ‘build/test-results/*.xml’
[2021-06-07T10:14:13.099Z] No artifacts found that match the file pattern "build/test-results/*.xml". Configuration error?
[2021-06-07T10:14:13.109Z] Recording test results
[2021-06-07T10:14:13.338Z] None of the test reports contained any result
[2021-06-07T10:14:13.338Z] [Checks API] No suitable checks publisher found.
[2021-06-07T10:14:13.639Z] + build/elastic-package stack dump -v --output build/elastic-stack-dump/latest/fortinet
[2021-06-07T10:14:13.639Z] 2021/06/07 10:14:13  WARN CommitHash is undefined, in both %s and the compiled binary, config may be out of date./var/lib/jenkins/workspace/est-manager_integrations_PR-1043/.elastic-package/version
[2021-06-07T10:14:13.640Z] 2021/06/07 10:14:13 DEBUG Enable verbose logging
[2021-06-07T10:14:13.640Z] 2021/06/07 10:14:13 DEBUG Dump Elastic stack data
[2021-06-07T10:14:13.640Z] 2021/06/07 10:14:13 DEBUG Dump stack logs
[2021-06-07T10:14:13.640Z] 2021/06/07 10:14:13 DEBUG Recreate the output location (path: build/elastic-stack-dump/latest/fortinet)
[2021-06-07T10:14:13.640Z] 2021/06/07 10:14:13 DEBUG Dump stack logs for elasticsearch
[2021-06-07T10:14:13.640Z] 2021/06/07 10:14:13 DEBUG running command: /usr/local/bin/docker-compose -f /var/lib/jenkins/workspace/est-manager_integrations_PR-1043/.elastic-package/profiles/default/stack/snapshot.yml -p elastic-package-stack logs elasticsearch
[2021-06-07T10:14:14.208Z] 2021/06/07 10:14:14 DEBUG Dump stack logs for elastic-agent
[2021-06-07T10:14:14.208Z] 2021/06/07 10:14:14 DEBUG running command: /usr/local/bin/docker-compose -f /var/lib/jenkins/workspace/est-manager_integrations_PR-1043/.elastic-package/profiles/default/stack/snapshot.yml -p elastic-package-stack logs elastic-agent
[2021-06-07T10:14:15.148Z] 2021/06/07 10:14:14 DEBUG Dump stack logs for fleet-server
[2021-06-07T10:14:15.148Z] 2021/06/07 10:14:14 DEBUG running command: /usr/local/bin/docker-compose -f /var/lib/jenkins/workspace/est-manager_integrations_PR-1043/.elastic-package/profiles/default/stack/snapshot.yml -p elastic-package-stack logs fleet-server
[2021-06-07T10:14:15.717Z] 2021/06/07 10:14:15 DEBUG Dump stack logs for kibana
[2021-06-07T10:14:15.717Z] 2021/06/07 10:14:15 DEBUG running command: /usr/local/bin/docker-compose -f /var/lib/jenkins/workspace/est-manager_integrations_PR-1043/.elastic-package/profiles/default/stack/snapshot.yml -p elastic-package-stack logs kibana
[2021-06-07T10:14:16.286Z] 2021/06/07 10:14:16 DEBUG Dump stack logs for package-registry
[2021-06-07T10:14:16.286Z] 2021/06/07 10:14:16 DEBUG running command: /usr/local/bin/docker-compose -f /var/lib/jenkins/workspace/est-manager_integrations_PR-1043/.elastic-package/profiles/default/stack/snapshot.yml -p elastic-package-stack logs package-registry
[2021-06-07T10:14:17.223Z] Path to stack dump: build/elastic-stack-dump/latest/fortinet
[2021-06-07T10:14:17.223Z] Done
[2021-06-07T10:14:17.240Z] Archiving artifacts
[2021-06-07T10:14:17.610Z] + build/elastic-package stack down -v
[2021-06-07T10:14:17.610Z] 2021/06/07 10:14:17  WARN CommitHash is undefined, in both %s and the compiled binary, config may be out of date./var/lib/jenkins/workspace/est-manager_integrations_PR-1043/.elastic-package/version
[2021-06-07T10:14:17.610Z] 2021/06/07 10:14:17 DEBUG Enable verbose logging
[2021-06-07T10:14:17.610Z] Take down the Elastic stack
[2021-06-07T10:14:17.610Z] 2021/06/07 10:14:17 DEBUG running command: /usr/local/bin/docker-compose -f /var/lib/jenkins/workspace/est-manager_integrations_PR-1043/.elastic-package/profiles/default/stack/snapshot.yml -p elastic-package-stack down
[2021-06-07T10:14:18.180Z] The ELASTICSEARCH_IMAGE_REF variable is not set. Defaulting to a blank string.
[2021-06-07T10:14:18.180Z] The KIBANA_IMAGE_REF variable is not set. Defaulting to a blank string.
[2021-06-07T10:14:18.180Z] The STACK_PATH variable is not set. Defaulting to a blank string.
[2021-06-07T10:14:18.180Z] The PROFILE_NAME variable is not set. Defaulting to a blank string.
[2021-06-07T10:14:18.180Z] The ELASTIC_AGENT_IMAGE_REF variable is not set. Defaulting to a blank string.
[2021-06-07T10:14:18.180Z] Removing network elastic-package-stack_default
[2021-06-07T10:14:18.180Z] Network elastic-package-stack_default not found.
[2021-06-07T10:14:18.180Z] Done
[2021-06-07T10:14:18.219Z] Failed in branch fortinet
[2021-06-07T10:14:18.452Z] Running on Jenkins in /var/lib/jenkins/workspace/est-manager_integrations_PR-1043
[2021-06-07T10:14:18.526Z] [INFO] getVaultSecret: Getting secrets
[2021-06-07T10:14:18.556Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2021-06-07T10:14:19.107Z] + chmod 755 generate-build-data.sh
[2021-06-07T10:14:19.107Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Ingest-manager/integrations/PR-1043/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Ingest-manager/integrations/PR-1043/runs/3 FAILURE 442199
[2021-06-07T10:14:19.108Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Ingest-manager/integrations/PR-1043/runs/3/steps/?limit=10000 -o steps-info.json
[2021-06-07T10:14:19.358Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Ingest-manager/integrations/PR-1043/runs/3/tests/?status=FAILED -o tests-errors.json
[2021-06-07T10:14:19.358Z] Retry 1/3 exited 22, retrying in 1 seconds...
[2021-06-07T10:14:20.269Z] Retry 2/3 exited 22, retrying in 2 seconds...

* Fixing data types of scalar fields * Adding CHANGELOG entry

* Updating elastic-package dependency * Re-generating READMEs * Updating syntax in README template for prometheus package * Rebasing on master

…r package GA (#1070) * stashing changes * stashing changes * updating aws ECS version and adding event.original options * linting, formatting and update manifest and changelog * adding missing ecs fields * updating pipeline based on PR review * fixing processor checks * decreasing version on this package so it can be merged * removing fields from fingerprint

* Osquery manager: add platform and version fields * Update PR number in changelog.yml * Bump up kibana version to 7.14

* Fix security pipeline to support string event.code Co-authored-by: Lee E. Hinman <lee.e.hinman@elastic.co>

elasticmachine · 2021-06-07T10:35:52Z

💔 Build Failed

the below badges are clickable and redirect to their specific view in the CI or DOCS

Expand to view the summary

Build stats

Build Cause: Pull request #1043 updated
Start Time: 2021-06-07T10:21:26.813+0000
Duration: 14 min 22 sec
Commit: 713ba1e

Test stats 🧪

Test	Results
Failed	0
Passed	8
Skipped	0
Total	8

Trends 🧪

Steps errors

Expand to view the steps failures

`Test integration: fortinet`

Took 4 min 39 sec . View more details on here
Description: eval "$(../../build/elastic-package stack shellinit)" ../../build/elastic-package test -v --report-format xUnit --report-output file

Log output

Expand to view the last 100 lines of log output

[2021-06-07T10:35:16.862Z] Creating elastic-package-service_fortinet-fortimail-udp_1      ... 
[2021-06-07T10:35:16.862Z] Creating elastic-package-service_fortinet-fortimanager-tcp_1   ... 
[2021-06-07T10:35:16.862Z] Creating elastic-package-service_fortinet-fortimanager-udp_1   ... 
[2021-06-07T10:35:16.862Z] Creating elastic-package-service_fortinet-logfile_1            ... 
[2021-06-07T10:35:16.862Z] Creating elastic-package-service_fortinet-firewall-tcp_1       ... 
[2021-06-07T10:35:16.862Z] Creating elastic-package-service_fortinet-firewall-udp_1       ... 
[2021-06-07T10:35:16.862Z] Creating elastic-package-service_fortinet-fortimail-tcp_1      ... 
[2021-06-07T10:35:16.862Z] Creating elastic-package-service_fortinet-clientendpoint-udp_1 ... 
[2021-06-07T10:35:19.890Z] 
Creating elastic-package-service_fortinet-logfile_1            ... done

Creating elastic-package-service_fortinet-firewall-udp_1       ... done

Creating elastic-package-service_fortinet-fortimail-tcp_1      ... done

Creating elastic-package-service_fortinet-fortimanager-tcp_1   ... done

Creating elastic-package-service_fortinet-clientendpoint-tcp_1 ... done

Creating elastic-package-service_fortinet-fortimail-udp_1      ... done

Creating elastic-package-service_fortinet-fortimanager-udp_1   ... done

Creating elastic-package-service_fortinet-firewall-tcp_1       ... done

Creating elastic-package-service_fortinet-clientendpoint-udp_1 ... done
2021/06/07 10:35:19 DEBUG output command: /usr/bin/docker network connect elastic-package-stack_default elastic-package-service_fortinet-logfile_1
[2021-06-07T10:35:19.890Z] 2021/06/07 10:35:19 DEBUG adding service container elastic-package-service_fortinet-logfile_1 internal ports to context
[2021-06-07T10:35:19.890Z] 2021/06/07 10:35:19 DEBUG running command: /usr/local/bin/docker-compose -f /var/lib/jenkins/workspace/est-manager_integrations_PR-1043/src/github.com/elastic/integrations/packages/fortinet/_dev/deploy/docker/docker-compose.yml -p elastic-package-service config
[2021-06-07T10:35:20.837Z] 2021/06/07 10:35:20 DEBUG GET http://127.0.0.1:5601/api/fleet/agents
[2021-06-07T10:35:20.837Z] 2021/06/07 10:35:20 DEBUG filter agents using criteria: NamePrefix=docker-fleet-agent
[2021-06-07T10:35:20.837Z] 2021/06/07 10:35:20 DEBUG found 1 enrolled agent(s)
[2021-06-07T10:35:20.837Z] 2021/06/07 10:35:20 DEBUG creating test policy...
[2021-06-07T10:35:20.837Z] 2021/06/07 10:35:20 DEBUG POST http://127.0.0.1:5601/api/fleet/agent_policies
[2021-06-07T10:35:23.386Z] 2021/06/07 10:35:22 DEBUG adding package data stream to test policy...
[2021-06-07T10:35:23.386Z] 2021/06/07 10:35:22 DEBUG POST http://127.0.0.1:5601/api/fleet/package_policies
[2021-06-07T10:35:23.386Z] 2021/06/07 10:35:23 DEBUG deleting test policy...
[2021-06-07T10:35:23.386Z] 2021/06/07 10:35:23 DEBUG POST http://127.0.0.1:5601/api/fleet/agent_policies/delete
[2021-06-07T10:35:23.957Z] 2021/06/07 10:35:23 DEBUG tearing down service...
[2021-06-07T10:35:23.957Z] 2021/06/07 10:35:23 DEBUG tearing down service using docker compose runner
[2021-06-07T10:35:23.957Z] 2021/06/07 10:35:23 DEBUG running command: /usr/local/bin/docker-compose -f /var/lib/jenkins/workspace/est-manager_integrations_PR-1043/src/github.com/elastic/integrations/packages/fortinet/_dev/deploy/docker/docker-compose.yml -p elastic-package-service down
[2021-06-07T10:35:24.539Z] Stopping elastic-package-service_fortinet-clientendpoint-udp_1 ... 
[2021-06-07T10:35:24.539Z] Stopping elastic-package-service_fortinet-fortimail-tcp_1      ... 
[2021-06-07T10:35:24.539Z] Stopping elastic-package-service_fortinet-firewall-tcp_1       ... 
[2021-06-07T10:35:24.539Z] Stopping elastic-package-service_fortinet-firewall-udp_1       ... 
[2021-06-07T10:35:24.539Z] Stopping elastic-package-service_fortinet-fortimanager-udp_1   ... 
[2021-06-07T10:35:24.539Z] Stopping elastic-package-service_fortinet-fortimanager-tcp_1   ... 
[2021-06-07T10:35:24.539Z] Stopping elastic-package-service_fortinet-fortimail-udp_1      ... 
[2021-06-07T10:35:24.539Z] Stopping elastic-package-service_fortinet-clientendpoint-tcp_1 ... 
[2021-06-07T10:35:26.189Z] 
Stopping elastic-package-service_fortinet-firewall-tcp_1       ... done

Stopping elastic-package-service_fortinet-fortimail-tcp_1      ... done

Stopping elastic-package-service_fortinet-fortimail-udp_1      ... done

Stopping elastic-package-service_fortinet-fortimanager-tcp_1   ... done

Stopping elastic-package-service_fortinet-clientendpoint-tcp_1 ... done

Stopping elastic-package-service_fortinet-clientendpoint-udp_1 ... done

Stopping elastic-package-service_fortinet-fortimanager-udp_1   ... done

Stopping elastic-package-service_fortinet-firewall-udp_1       ... done
Removing elastic-package-service_fortinet-clientendpoint-udp_1 ... 
[2021-06-07T10:35:26.189Z] Removing elastic-package-service_fortinet-fortimail-tcp_1      ... 
[2021-06-07T10:35:26.189Z] Removing elastic-package-service_fortinet-firewall-tcp_1       ... 
[2021-06-07T10:35:26.189Z] Removing elastic-package-service_fortinet-logfile_1            ... 
[2021-06-07T10:35:26.189Z] Removing elastic-package-service_fortinet-firewall-udp_1       ... 
[2021-06-07T10:35:26.189Z] Removing elastic-package-service_fortinet-fortimanager-udp_1   ... 
[2021-06-07T10:35:26.189Z] Removing elastic-package-service_fortinet-fortimanager-tcp_1   ... 
[2021-06-07T10:35:26.189Z] Removing elastic-package-service_fortinet-fortimail-udp_1      ... 
[2021-06-07T10:35:26.189Z] Removing elastic-package-service_fortinet-clientendpoint-tcp_1 ... 
[2021-06-07T10:35:26.189Z] 
Removing elastic-package-service_fortinet-clientendpoint-tcp_1 ... done

Removing elastic-package-service_fortinet-fortimail-tcp_1      ... done

Removing elastic-package-service_fortinet-fortimail-udp_1      ... done

Removing elastic-package-service_fortinet-logfile_1            ... done

Removing elastic-package-service_fortinet-fortimanager-udp_1   ... done

Removing elastic-package-service_fortinet-fortimanager-tcp_1   ... done

Removing elastic-package-service_fortinet-firewall-tcp_1       ... done

Removing elastic-package-service_fortinet-clientendpoint-udp_1 ... done

Removing elastic-package-service_fortinet-firewall-udp_1       ... done
Removing network elastic-package-service_default
[2021-06-07T10:35:26.450Z] Error: error running package system tests: could not complete test run: could not add data stream config to policy: could not add package to policy; API status code = 500; response body = {"statusCode":500,"error":"Internal Server Error","message":"bad indentation of a mapping entry at line 8, column 2:\n     - preserve_original_event\n     ^"}
[2021-06-07T10:35:26.504Z] Running in /var/lib/jenkins/workspace/est-manager_integrations_PR-1043/src/github.com/elastic/integrations
[2021-06-07T10:35:26.519Z] Archiving artifacts
[2021-06-07T10:35:26.743Z] Recording test results
[2021-06-07T10:35:27.067Z] [Checks API] No suitable checks publisher found.
[2021-06-07T10:35:27.364Z] + build/elastic-package stack dump -v --output build/elastic-stack-dump/latest/fortinet
[2021-06-07T10:35:27.364Z] 2021/06/07 10:35:27  WARN CommitHash is undefined, in both %s and the compiled binary, config may be out of date./var/lib/jenkins/workspace/est-manager_integrations_PR-1043/.elastic-package/version
[2021-06-07T10:35:27.364Z] 2021/06/07 10:35:27 DEBUG Enable verbose logging
[2021-06-07T10:35:27.364Z] 2021/06/07 10:35:27 DEBUG Dump Elastic stack data
[2021-06-07T10:35:27.364Z] 2021/06/07 10:35:27 DEBUG Dump stack logs
[2021-06-07T10:35:27.364Z] 2021/06/07 10:35:27 DEBUG Recreate the output location (path: build/elastic-stack-dump/latest/fortinet)
[2021-06-07T10:35:27.364Z] 2021/06/07 10:35:27 DEBUG Dump stack logs for elasticsearch
[2021-06-07T10:35:27.364Z] 2021/06/07 10:35:27 DEBUG running command: /usr/local/bin/docker-compose -f /var/lib/jenkins/workspace/est-manager_integrations_PR-1043/.elastic-package/profiles/default/stack/snapshot.yml -p elastic-package-stack logs elasticsearch
[2021-06-07T10:35:28.306Z] 2021/06/07 10:35:28 DEBUG Dump stack logs for elastic-agent
[2021-06-07T10:35:28.306Z] 2021/06/07 10:35:28 DEBUG running command: /usr/local/bin/docker-compose -f /var/lib/jenkins/workspace/est-manager_integrations_PR-1043/.elastic-package/profiles/default/stack/snapshot.yml -p elastic-package-stack logs elastic-agent
[2021-06-07T10:35:29.251Z] 2021/06/07 10:35:29 DEBUG Dump stack logs for fleet-server
[2021-06-07T10:35:29.251Z] 2021/06/07 10:35:29 DEBUG running command: /usr/local/bin/docker-compose -f /var/lib/jenkins/workspace/est-manager_integrations_PR-1043/.elastic-package/profiles/default/stack/snapshot.yml -p elastic-package-stack logs fleet-server
[2021-06-07T10:35:30.199Z] 2021/06/07 10:35:29 DEBUG Dump stack logs for kibana
[2021-06-07T10:35:30.200Z] 2021/06/07 10:35:29 DEBUG running command: /usr/local/bin/docker-compose -f /var/lib/jenkins/workspace/est-manager_integrations_PR-1043/.elastic-package/profiles/default/stack/snapshot.yml -p elastic-package-stack logs kibana
[2021-06-07T10:35:31.146Z] 2021/06/07 10:35:30 DEBUG Dump stack logs for package-registry
[2021-06-07T10:35:31.146Z] 2021/06/07 10:35:30 DEBUG running command: /usr/local/bin/docker-compose -f /var/lib/jenkins/workspace/est-manager_integrations_PR-1043/.elastic-package/profiles/default/stack/snapshot.yml -p elastic-package-stack logs package-registry
[2021-06-07T10:35:32.091Z] Path to stack dump: build/elastic-stack-dump/latest/fortinet
[2021-06-07T10:35:32.091Z] Done
[2021-06-07T10:35:32.111Z] Archiving artifacts
[2021-06-07T10:35:32.470Z] + build/elastic-package stack down -v
[2021-06-07T10:35:32.470Z] 2021/06/07 10:35:32  WARN CommitHash is undefined, in both %s and the compiled binary, config may be out of date./var/lib/jenkins/workspace/est-manager_integrations_PR-1043/.elastic-package/version
[2021-06-07T10:35:32.470Z] 2021/06/07 10:35:32 DEBUG Enable verbose logging
[2021-06-07T10:35:32.470Z] Take down the Elastic stack
[2021-06-07T10:35:32.470Z] 2021/06/07 10:35:32 DEBUG running command: /usr/local/bin/docker-compose -f /var/lib/jenkins/workspace/est-manager_integrations_PR-1043/.elastic-package/profiles/default/stack/snapshot.yml -p elastic-package-stack down
[2021-06-07T10:35:33.042Z] The ELASTICSEARCH_IMAGE_REF variable is not set. Defaulting to a blank string.
[2021-06-07T10:35:33.042Z] The KIBANA_IMAGE_REF variable is not set. Defaulting to a blank string.
[2021-06-07T10:35:33.042Z] The STACK_PATH variable is not set. Defaulting to a blank string.
[2021-06-07T10:35:33.042Z] The PROFILE_NAME variable is not set. Defaulting to a blank string.
[2021-06-07T10:35:33.042Z] The ELASTIC_AGENT_IMAGE_REF variable is not set. Defaulting to a blank string.
[2021-06-07T10:35:33.042Z] Stopping elastic-package-stack_elastic-agent_1    ... 
[2021-06-07T10:35:33.042Z] Stopping elastic-package-stack_fleet-server_1     ... 
[2021-06-07T10:35:33.042Z] Stopping elastic-package-stack_kibana_1           ... 
[2021-06-07T10:35:33.042Z] Stopping elastic-package-stack_elasticsearch_1    ... 
[2021-06-07T10:35:33.042Z] Stopping elastic-package-stack_package-registry_1 ... 
[2021-06-07T10:35:47.865Z] 
Stopping elastic-package-stack_elastic-agent_1    ... done

Stopping elastic-package-stack_fleet-server_1     ... done

Stopping elastic-package-stack_kibana_1           ... done

Stopping elastic-package-stack_package-registry_1 ... done

Stopping elastic-package-stack_elasticsearch_1    ... done
Removing elastic-package-stack_elastic-agent_is_ready_1    ... 
[2021-06-07T10:35:47.866Z] Removing elastic-package-stack_elastic-agent_1             ... 
[2021-06-07T10:35:47.866Z] Removing elastic-package-stack_fleet-server_is_ready_1     ... 
[2021-06-07T10:35:47.866Z] Removing elastic-package-stack_fleet-server_1              ... 
[2021-06-07T10:35:47.866Z] Removing elastic-package-stack_kibana_is_ready_1           ... 
[2021-06-07T10:35:47.866Z] Removing elastic-package-stack_kibana_1                    ... 
[2021-06-07T10:35:47.866Z] Removing elastic-package-stack_elasticsearch_is_ready_1    ... 
[2021-06-07T10:35:47.866Z] Removing elastic-package-stack_package-registry_is_ready_1 ... 
[2021-06-07T10:35:47.866Z] Removing elastic-package-stack_elasticsearch_1             ... 
[2021-06-07T10:35:47.866Z] Removing elastic-package-stack_package-registry_1          ... 
[2021-06-07T10:35:47.866Z] 
Removing elastic-package-stack_kibana_1                    ... done

Removing elastic-package-stack_fleet-server_is_ready_1     ... done

Removing elastic-package-stack_package-registry_is_ready_1 ... done

Removing elastic-package-stack_kibana_is_ready_1           ... done

Removing elastic-package-stack_package-registry_1          ... done

Removing elastic-package-stack_elastic-agent_is_ready_1    ... done

Removing elastic-package-stack_elasticsearch_is_ready_1    ... done

Removing elastic-package-stack_elasticsearch_1             ... done

Removing elastic-package-stack_elastic-agent_1             ... done

Removing elastic-package-stack_fleet-server_1              ... done
Removing network elastic-package-stack_default
[2021-06-07T10:35:47.866Z] Done
[2021-06-07T10:35:47.907Z] Failed in branch fortinet
[2021-06-07T10:35:48.530Z] Running on Jenkins in /var/lib/jenkins/workspace/est-manager_integrations_PR-1043
[2021-06-07T10:35:48.561Z] [INFO] getVaultSecret: Getting secrets
[2021-06-07T10:35:48.596Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2021-06-07T10:35:49.223Z] + chmod 755 generate-build-data.sh
[2021-06-07T10:35:49.223Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Ingest-manager/integrations/PR-1043/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Ingest-manager/integrations/PR-1043/runs/4 FAILURE 862148
[2021-06-07T10:35:49.223Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Ingest-manager/integrations/PR-1043/runs/4/steps/?limit=10000 -o steps-info.json
[2021-06-07T10:35:49.473Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Ingest-manager/integrations/PR-1043/runs/4/tests/?status=FAILED -o tests-errors.json

updating fortinet ecs version and add event.original options

60cb1b5

P1llus added enhancement New feature or request Team:Security-External Integrations 7.14 candidate Integration:Fortinet (Deprecated) Use one of the specific fortinet_X labels. labels Jun 1, 2021

update changelog, manifest and running format/lints

f252cfb

P1llus mentioned this pull request Jun 1, 2021

[Meta] 7.14 Planned changes to all packages #994

Closed

marc-gr and others added 15 commits June 3, 2021 16:21

Make event.original optional for asa,ftd, and ios data streams. (#1073)

b109fee

Add system tests for security data_stream (#1069)

18a6edb

Make event.original optional in fortinet (#1075)

bd52635

Add aws.cloudwatch.namespace field (#1077)

4247dfe

Skip apache/status system test (#1078)

867f672

Fixing data types of scalar fields (#1081)

53fb56a

* Fixing data types of scalar fields * Adding CHANGELOG entry

Updating elastic-package dependency (#1076)

2c132c0

* Updating elastic-package dependency * Re-generating READMEs * Updating syntax in README template for prometheus package * Rebasing on master

Osquery manager: add platform and version fields (#985)

5fc3ccb

* Osquery manager: add platform and version fields * Update PR number in changelog.yml * Bump up kibana version to 7.14

[system] Fix security pipeline to support string event.code (#1089)

e01117f

* Fix security pipeline to support string event.code Co-authored-by: Lee E. Hinman <lee.e.hinman@elastic.co>

[windows] Fix security pipeline to support string event.code (#1090)

c335d60

* Fix security pipeline to support string event.code Co-authored-by: Lee E. Hinman <lee.e.hinman@elastic.co>

updating fortinet ecs version and add event.original options

067b8c8

update changelog, manifest and running format/lints

7b22d39

rebasing

490582e

fixing rebase and adding last pieces ready for review

713ba1e

P1llus closed this Jun 7, 2021

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Fortinet] updating fortinet ecs version and add event.original options #1043

[Fortinet] updating fortinet ecs version and add event.original options #1043

P1llus commented Jun 1, 2021

elasticmachine commented Jun 1, 2021 •

edited

Loading

Build stats

Trends 🧪

`Check integration: fortinet`

elasticmachine commented Jun 7, 2021

Build stats

Test stats 🧪

Trends 🧪

`Test integration: fortinet`

[Fortinet] updating fortinet ecs version and add event.original options #1043

[Fortinet] updating fortinet ecs version and add event.original options #1043

Conversation

P1llus commented Jun 1, 2021

What does this PR do?

Checklist

Related issues

elasticmachine commented Jun 1, 2021 • edited Loading

💔 Build Failed

Build stats

Trends 🧪

Steps errors

Check integration: fortinet

Log output

elasticmachine commented Jun 7, 2021

💔 Build Failed

Build stats

Test stats 🧪

Trends 🧪

Steps errors

Test integration: fortinet

Log output

elasticmachine commented Jun 1, 2021 •

edited

Loading

`Check integration: fortinet`

`Test integration: fortinet`