Added synthetics package

[shahzad31]

What does this PR do?

Adds synthetics integration

Checklist

• I have reviewed tips for building integrations and this pull request is aligned with them.
• I have verified that all datasets collect metrics or logs.

Author's Checklist

• [ ]

How to test this PR locally

Related issues

Screenshots

[elasticmachine]

💔 Build Failed

Expand to view the summary

Build stats

• Build Cause: [Branch indexing]

• Start Time: 2020-08-07T01:44:24.463+0000

• Duration: 4 min 17 sec

Steps errors

Expand to view the steps failures

• Name: Checks and builds integration sources

  • Description: mage -debug check

  • Duration: 0 min 19 sec

  • Start Time: 2020-08-07T01:48:21.529+0000

  • log

Log output

Expand to view the last 100 lines of log output

[2020-08-07T01:48:23.595Z] MAGEFILE_DEBUG=1
[2020-08-07T01:48:23.595Z] MAGEFILE_GOCMD=go
[2020-08-07T01:48:23.595Z] >> fmt - go-licenser: Adding missing headers
[2020-08-07T01:48:23.595Z] >> fmt - goimports: Formatting Go code
[2020-08-07T01:48:23.595Z] packages/apache: elastic-package build
[2020-08-07T01:48:23.595Z] go: downloading github.com/elastic/elastic-package v0.0.0-20200731114746-b0437f8f05ca
[2020-08-07T01:48:23.595Z] go: downloading github.com/spf13/cobra v1.0.0
[2020-08-07T01:48:23.595Z] go: downloading gopkg.in/yaml.v2 v2.3.0
[2020-08-07T01:48:23.595Z] go: downloading github.com/spf13/pflag v1.0.3
[2020-08-07T01:48:25.515Z] packages/aws: elastic-package build
[2020-08-07T01:48:25.776Z] packages/checkpoint: elastic-package build
[2020-08-07T01:48:26.037Z] packages/cisco: elastic-package build
[2020-08-07T01:48:26.608Z] packages/crowdstrike: elastic-package build
[2020-08-07T01:48:27.179Z] packages/fortinet: elastic-package build
[2020-08-07T01:48:27.439Z] packages/haproxy: elastic-package build
[2020-08-07T01:48:28.012Z] packages/iis: elastic-package build
[2020-08-07T01:48:28.582Z] packages/kafka: elastic-package build
[2020-08-07T01:48:28.843Z] packages/kubernetes: elastic-package build
[2020-08-07T01:48:29.416Z] packages/log: elastic-package build
[2020-08-07T01:48:29.677Z] packages/microsoft: elastic-package build
[2020-08-07T01:48:30.249Z] packages/mongodb: elastic-package build
[2020-08-07T01:48:30.822Z] packages/mysql: elastic-package build
[2020-08-07T01:48:31.083Z] packages/netflow: elastic-package build
[2020-08-07T01:48:31.656Z] packages/nginx: elastic-package build
[2020-08-07T01:48:32.228Z] packages/o365: elastic-package build
[2020-08-07T01:48:32.804Z] packages/panw: elastic-package build
[2020-08-07T01:48:33.075Z] packages/postgresql: elastic-package build
[2020-08-07T01:48:33.647Z] packages/prometheus: elastic-package build
[2020-08-07T01:48:33.909Z] packages/rabbitmq: elastic-package build
[2020-08-07T01:48:34.482Z] packages/redis: elastic-package build
[2020-08-07T01:48:35.054Z] packages/suricata: elastic-package build
[2020-08-07T01:48:35.315Z] packages/synthetics: elastic-package build
[2020-08-07T01:48:35.886Z] packages/system: elastic-package build
[2020-08-07T01:48:36.458Z] packages/windows: elastic-package build
[2020-08-07T01:48:36.718Z] packages/zookeeper: elastic-package build
[2020-08-07T01:48:37.290Z] go: downloading github.com/elastic/package-registry v0.10.0
[2020-08-07T01:48:37.552Z] go: downloading github.com/joeshaw/multierror v0.0.0-20140124173710-69b34d4ec901
[2020-08-07T01:48:37.552Z] go: downloading github.com/elastic/go-ucfg v0.8.4-0.20200415140258-1232bd4774a6
[2020-08-07T01:48:37.552Z] go: downloading github.com/gorilla/mux v1.7.4
[2020-08-07T01:48:37.552Z] go: downloading github.com/Masterminds/semver/v3 v3.1.0
[2020-08-07T01:48:37.552Z] go: downloading github.com/aymerick/raymond v2.0.2+incompatible
[2020-08-07T01:48:39.465Z] 2020/08/07 01:48:39 Package registry started.
[2020-08-07T01:48:39.465Z] 2020/08/07 01:48:39 Public dir (legacy): ./public
[2020-08-07T01:48:39.465Z] 2020/08/07 01:48:39 Packages paths: ./build/integrations
[2020-08-07T01:48:39.465Z] 2020/08/07 01:48:39 Cache time for /search:  10m0s
[2020-08-07T01:48:39.465Z] 2020/08/07 01:48:39 Cache time for /categories:  10m0s
[2020-08-07T01:48:39.465Z] 2020/08/07 01:48:39 Cache time for all others:  10m0s
[2020-08-07T01:48:39.465Z] 2020/08/07 01:48:39 Packages in public/package:
[2020-08-07T01:48:39.465Z] 2020/08/07 01:48:39 Packages in ./build/integrations:
[2020-08-07T01:48:39.465Z] 2020/08/07 01:48:39 apache              	     0.1.4	build/integrations/apache/0.1.4
[2020-08-07T01:48:39.465Z] 2020/08/07 01:48:39 aws                 	     0.2.4	build/integrations/aws/0.2.4
[2020-08-07T01:48:39.465Z] 2020/08/07 01:48:39 checkpoint          	     0.1.0	build/integrations/checkpoint/0.1.0
[2020-08-07T01:48:39.465Z] 2020/08/07 01:48:39 cisco               	     0.3.0	build/integrations/cisco/0.3.0
[2020-08-07T01:48:39.465Z] 2020/08/07 01:48:39 crowdstrike         	     0.1.2	build/integrations/crowdstrike/0.1.2
[2020-08-07T01:48:39.465Z] 2020/08/07 01:48:39 fortinet            	     0.1.0	build/integrations/fortinet/0.1.0
[2020-08-07T01:48:39.465Z] 2020/08/07 01:48:39 haproxy             	     0.1.3	build/integrations/haproxy/0.1.3
[2020-08-07T01:48:39.466Z] 2020/08/07 01:48:39 iis                 	     0.1.3	build/integrations/iis/0.1.3
[2020-08-07T01:48:39.466Z] 2020/08/07 01:48:39 kafka               	     0.2.4	build/integrations/kafka/0.2.4
[2020-08-07T01:48:39.466Z] 2020/08/07 01:48:39 kubernetes          	     0.1.6	build/integrations/kubernetes/0.1.6
[2020-08-07T01:48:39.466Z] 2020/08/07 01:48:39 log                 	     0.3.4	build/integrations/log/0.3.4
[2020-08-07T01:48:39.466Z] 2020/08/07 01:48:39 microsoft           	     0.1.0	build/integrations/microsoft/0.1.0
[2020-08-07T01:48:39.466Z] 2020/08/07 01:48:39 mongodb             	     0.1.4	build/integrations/mongodb/0.1.4
[2020-08-07T01:48:39.466Z] 2020/08/07 01:48:39 mysql               	     0.2.4	build/integrations/mysql/0.2.4
[2020-08-07T01:48:39.466Z] 2020/08/07 01:48:39 netflow             	     0.2.3	build/integrations/netflow/0.2.3
[2020-08-07T01:48:39.466Z] 2020/08/07 01:48:39 nginx               	     0.2.4	build/integrations/nginx/0.2.4
[2020-08-07T01:48:39.466Z] 2020/08/07 01:48:39 o365                	     0.1.0	build/integrations/o365/0.1.0
[2020-08-07T01:48:39.466Z] 2020/08/07 01:48:39 panw                	     0.1.0	build/integrations/panw/0.1.0
[2020-08-07T01:48:39.466Z] 2020/08/07 01:48:39 postgresql          	     0.1.3	build/integrations/postgresql/0.1.3
[2020-08-07T01:48:39.466Z] 2020/08/07 01:48:39 prometheus          	     0.1.3	build/integrations/prometheus/0.1.3
[2020-08-07T01:48:39.466Z] 2020/08/07 01:48:39 rabbitmq            	     0.1.4	build/integrations/rabbitmq/0.1.4
[2020-08-07T01:48:39.466Z] 2020/08/07 01:48:39 redis               	     0.2.4	build/integrations/redis/0.2.4
[2020-08-07T01:48:39.466Z] 2020/08/07 01:48:39 suricata            	     0.0.2	build/integrations/suricata/0.0.2
[2020-08-07T01:48:39.466Z] 2020/08/07 01:48:39 synthetics          	     0.1.2	build/integrations/synthetics/0.1.2
[2020-08-07T01:48:39.466Z] 2020/08/07 01:48:39 system              	     0.5.3	build/integrations/system/0.5.3
[2020-08-07T01:48:39.466Z] 2020/08/07 01:48:39 windows             	     0.1.4	build/integrations/windows/0.1.4
[2020-08-07T01:48:39.466Z] 2020/08/07 01:48:39 zookeeper           	     0.1.3	build/integrations/zookeeper/0.1.3
[2020-08-07T01:48:40.408Z] 2020/08/07 01:48:40 reading packages from filesystem failed: loading package failed (path: build/integrations/synthetics/0.1.2): building dataset failed (path: build/integrations/synthetics/0.1.2/dataset/monitor): error building dataset (path: monitor) in package: synthetics: validating required fields failed: finding field failed (searchedName: data_stream.type): failed to find fields array: field 'data_stream' not found accessing config accessing config
[2020-08-07T01:48:40.408Z] exit status 1
[2020-08-07T01:48:40.408Z] Error: running "go run github.com/elastic/package-registry -dry-run=true" failed with exit code 1
[2020-08-07T01:48:40.408Z] package-registry dry-run failed
[2020-08-07T01:48:40.408Z] main.dryRunPackageRegistry
[2020-08-07T01:48:40.408Z] 	/var/lib/jenkins/workspace/Beats_integrations_PR-218/src/github.com/elastic/integrations/magefile.go:112
[2020-08-07T01:48:40.408Z] main.Build
[2020-08-07T01:48:40.408Z] 	/var/lib/jenkins/workspace/Beats_integrations_PR-218/src/github.com/elastic/integrations/magefile.go:35
[2020-08-07T01:48:40.408Z] main.Check
[2020-08-07T01:48:40.408Z] 	/var/lib/jenkins/workspace/Beats_integrations_PR-218/src/github.com/elastic/integrations/magefile.go:166
[2020-08-07T01:48:40.408Z] main.main.func16
[2020-08-07T01:48:40.408Z] 	/var/lib/jenkins/workspace/Beats_integrations_PR-218/src/github.com/elastic/integrations/mage_output_file.go:501
[2020-08-07T01:48:40.408Z] main.main.func12.1
[2020-08-07T01:48:40.408Z] 	/var/lib/jenkins/workspace/Beats_integrations_PR-218/src/github.com/elastic/integrations/mage_output_file.go:275
[2020-08-07T01:48:40.408Z] runtime.goexit
[2020-08-07T01:48:40.408Z] 	/var/lib/jenkins/workspace/Beats_integrations_PR-218/.gvm/versions/go1.14.2.linux.amd64/src/runtime/asm_amd64.s:1373
[2020-08-07T01:48:40.454Z] Stage "Update Package Storage" skipped due to earlier failure(s)
[2020-08-07T01:48:40.622Z] Running on Jenkins in /var/lib/jenkins/workspace/Beats_integrations_PR-218
[2020-08-07T01:48:40.692Z] [INFO] getVaultSecret: Getting secrets
[2020-08-07T01:48:40.766Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2020-08-07T01:48:41.348Z] + chmod 755 generate-build-data.sh
[2020-08-07T01:48:41.348Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/integrations/PR-218/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/integrations/PR-218/runs/5 FAILURE 256626
[2020-08-07T01:48:41.348Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/integrations/PR-218/runs/5/steps/?limit=10000 -o steps-info.json
[2020-08-07T01:48:41.598Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/integrations/PR-218/runs/5/tests/?status=FAILED -o tests-errors.json

[mtojek]

Could you please convert it to draft until it's ready and working? Here is a sample PR for HAProxy integration: #148

[shahzad31]

closing in favor of #241