Run base tests when applying module selective testing #26976

jsoriano · 2021-07-20T10:36:13Z

What does this PR do?

Run base tests when applying module selective testing in python integration tests.

Why is it important?

Dashboards are not tested at the module level, they are only tested by the base tests. When a single module is modified, selective testing is applied, so dashboard tests were not executed, allowing to introduce issues when single dashboards are modified.

Checklist

My code follows the style guidelines of this project
I have commented my code, particularly in hard-to-understand areas
I have made corresponding changes to the documentation
I have made corresponding change to the default configuration files
I have added tests that prove my fix is effective or that my feature works
I have added an entry in CHANGELOG.next.asciidoc or CHANGELOG-developer.next.asciidoc.

How to test this PR locally

Introduce a failure in a dashboard of the kubernetes module (or any other module).
Run integration tests for this module MODULE="kubernetes" mage -v pythonIntegTest, failure should be detected.

Related issues

Add Cluster filter on Kubernetes Overview ECS dashboard #26919 added a dashboard that required 7.14 to work, before it was released, making tests to fail, but not being detected in CI.

elasticmachine · 2021-07-20T10:36:15Z

Pinging @elastic/integrations (Team:Integrations)

botelastic · 2021-07-20T10:36:29Z

This pull request doesn't have a Team:<team> label.

elasticmachine · 2021-07-20T12:23:19Z

💔 Tests Failed

the below badges are clickable and redirect to their specific view in the CI or DOCS

Expand to view the summary

Build stats

Start Time: 2021-07-20T10:36:28.294+0000
Duration: 106 min 24 sec
Commit: a145284

Test stats 🧪

Test	Results
Failed	1
Passed	19362
Skipped	1536
Total	20899

Trends 🧪

Test errors

Expand to view the tests failures

`Build&Test / metricbeat-pythonIntegTest / test_dashboards – metricbeat.tests.system.test_base.Test`

Expand to view the error details

 AssertionError: Error output: 2021-07-20T12:00:36.302Z	INFO	instance/beat.go:654	Home path: [/go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards] Config path: [/go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards] Data path: [/go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/data] Logs path: [/go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/logs]
  2021-07-20T12:00:36.302Z	DEBUG	[beat]	instance/beat.go:712	Beat metadata path: /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/data/meta.json
  2021-07-20T12:00:36.307Z	INFO	instance/beat.go:662	Beat ID: 1698b9a6-8132-4b59-8475-69feacfed989
  2021-07-20T12:00:36.307Z	INFO	[beat]	instance/beat.go:996	Beat info	{"system_info": {"beat": {"path": {"config": "/go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards", "data": "/go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/data", "home": "/go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards", "logs": "/go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/logs"}, "type": "metricbeat", "uuid": "1698b9a6-8132-4b59-8475-69feacfed989"}}}
  2021-07-20T12:00:36.307Z	INFO	[beat]	instance/beat.go:1005	Build info	{"system_info": {"build": {"commit": "unknown", "libbeat": "8.0.0", "time": "1754-08-30T22:43:41.128Z", "version": "8.0.0"}}}
  2021-07-20T12:00:36.307Z	INFO	[beat]	instance/beat.go:1008	Go runtime info	{"system_info": {"go": {"os":"linux","arch":"amd64","max_procs":8,"version":"go1.16.6"}}}
  2021-07-20T12:00:36.309Z	INFO	[beat]	instance/beat.go:1012	Host info	{"system_info": {"host": {"architecture":"x86_64","boot_time":"2021-07-20T10:58:18Z","containerized":true,"name":"beats-ci-immutable-ubuntu-1804-1626778671975416100","ip":["127.0.0.1/8","::1/128","10.224.3.47/32","fe80::4001:aff:fee0:32f/64","172.17.0.1/16","fe80::42:dfff:fe7b:6c/64","172.18.0.1/16","172.19.0.1/16","fe80::42:bbff:fef7:d0a/64","fe80::dc3a:7cff:fe5e:b5ac/64","fe80::cb6:2ff:feec:c814/64"],"kernel_version":"5.4.0-1046-gcp","mac":["42:01:0a:e0:03:2f","02:42:df:7b:00:6c","02:42:b8:15:f9:a3","02:42:bb:f7:0d:0a","de:3a:7c:5e:b5:ac","0e:b6:02:ec:c8:14"],"os":{"type":"linux","family":"debian","platform":"debian","name":"Debian GNU/Linux","version":"10 (buster)","major":10,"minor":0,"patch":0,"codename":"buster"},"timezone":"UTC","timezone_offset_sec":0,"id":"88ca5e7b2819c56ffc2ab2fc4af49881"}}}
  2021-07-20T12:00:36.310Z	INFO	[beat]	instance/beat.go:1041	Process info	{"system_info": {"process": {"capabilities": {"inheritable":["chown","dac_override","fowner","fsetid","kill","setgid","setuid","setpcap","net_bind_service","net_raw","sys_chroot","mknod","audit_write","setfcap"],"permitted":["chown","dac_override","fowner","fsetid","kill","setgid","setuid","setpcap","net_bind_service","net_raw","sys_chroot","mknod","audit_write","setfcap"],"effective":["chown","dac_override","fowner","fsetid","kill","setgid","setuid","setpcap","net_bind_service","net_raw","sys_chroot","mknod","audit_write","setfcap"],"bounding":["chown","dac_override","fowner","fsetid","kill","setgid","setuid","setpcap","net_bind_service","net_raw","sys_chroot","mknod","audit_write","setfcap"],"ambient":null}, "cwd": "/go/src/github.com/elastic/beats/metricbeat", "exe": "/go/src/github.com/elastic/beats/metricbeat/metricbeat.test", "name": "metricbeat.test", "pid": 244, "ppid": 176, "seccomp": {"mode":"filter","no_new_privs":false}, "start_time": "2021-07-20T12:00:35.680Z"}}}
  2021-07-20T12:00:36.310Z	INFO	instance/beat.go:309	Setup Beat: metricbeat; Version: 8.0.0
  2021-07-20T12:00:36.310Z	DEBUG	[beat]	instance/beat.go:335	Initializing output plugins
  2021-07-20T12:00:36.310Z	INFO	[index-management]	idxmgmt/std.go:184	Set output.elasticsearch.index to 'metricbeat-8.0.0' as ILM is enabled.
  2021-07-20T12:00:36.311Z	INFO	[esclientleg]	eslegclient/connection.go:100	elasticsearch url: http://172.19.0.2:9200
  2021-07-20T12:00:36.311Z	DEBUG	[publisher]	pipeline/consumer.go:148	start pipeline event consumer
  2021-07-20T12:00:36.311Z	INFO	[publisher]	pipeline/module.go:113	Beat name: beats-ci-immutable-ubuntu-1804-1626778671975416100
  2021-07-20T12:00:36.311Z	DEBUG	[registry.lightmodules]	mb/lightmodules.go:262	Light modules directory '%!d(string=/go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/module)' doesn't exist
  2021-07-20T12:00:36.311Z	DEBUG	[modules]	beater/metricbeat.go:151	Available modules and metricsets: Register [ModuleFactory:[beat, docker, elasticsearch, kibana, kubernetes, linux, logstash, mongodb, mysql, postgresql, system, uwsgi], MetricSetFactory:[aerospike/namespace, apache/status, beat/state, beat/stats, ceph/cluster_disk, ceph/cluster_health, ceph/cluster_status, ceph/mgr_cluster_disk, ceph/mgr_cluster_health, ceph/mgr_osd_perf, ceph/mgr_osd_pool_stats, ceph/mgr_osd_tree, ceph/mgr_pool_disk, ceph/monitor_health, ceph/osd_df, ceph/osd_tree, ceph/pool_disk, consul/agent, couchbase/bucket, couchbase/cluster, couchbase/node, couchdb/server, docker/container, docker/cpu, docker/diskio, docker/event, docker/healthcheck, docker/image, docker/info, docker/memory, docker/network, docker/network_summary, dropwizard/collector, elasticsearch/ccr, elasticsearch/cluster_stats, elasticsearch/enrich, elasticsearch/index, elasticsearch/index_recovery, elasticsearch/index_summary, elasticsearch/ml_job, elasticsearch/node, elasticsearch/node_stats, elasticsearch/pending_tasks, elasticsearch/shard, envoyproxy/server, etcd/leader, etcd/metrics, etcd/self, etcd/store, golang/expvar, golang/heap, graphite/server, haproxy/info, haproxy/stat, http/json, http/server, jolokia/jmx, kafka/consumergroup, kafka/partition, kibana/settings, kibana/stats, kibana/status, kubernetes/apiserver, kubernetes/container, kubernetes/controllermanager, kubernetes/event, kubernetes/node, kubernetes/pod, kubernetes/proxy, kubernetes/scheduler, kubernetes/state_container, kubernetes/state_cronjob, kubernetes/state_daemonset, kubernetes/state_deployment, kubernetes/state_job, kubernetes/state_node, kubernetes/state_persistentvolume, kubernetes/state_persistentvolumeclaim, kubernetes/state_pod, kubernetes/state_replicaset, kubernetes/state_resourcequota, kubernetes/state_service, kubernetes/state_statefulset, kubernetes/state_storageclass, kubernetes/system, kubernetes/volume, kvm/dommemstat, kvm/status, linux/conntrack, linux/iostat, linux/ksm, linux/memory, linux/pageinfo, logstash/node, logstash/node_stats, memcached/stats, mongodb/collstats, mongodb/dbstats, mongodb/metrics, mongodb/replstatus, mongodb/status, munin/node, mysql/galera_status, mysql/query, mysql/status, nats/connection, nats/connections, nats/route, nats/routes, nats/stats, nats/subscriptions, nginx/stubstatus, openmetrics/collector, php_fpm/pool, php_fpm/process, postgresql/activity, postgresql/bgwriter, postgresql/database, postgresql/statement, prometheus/collector, prometheus/query, prometheus/remote_write, rabbitmq/connection, rabbitmq/exchange, rabbitmq/node, rabbitmq/queue, redis/info, redis/key, redis/keyspace, system/core, system/cpu, system/diskio, system/entropy, system/filesystem, system/fsstat, system/load, system/memory, system/network, system/network_summary, system/process, system/process_summary, system/raid, system/service, system/socket, system/socket_summary, system/uptime, system/users, traefik/health, uwsgi/status, vsphere/datastore, vsphere/host, vsphere/virtualmachine, zookeeper/connection, zookeeper/mntr, zookeeper/server], LightModules:[LightModules:[]]]
  Loading dashboards (Kibana must be running and reachable)
  2021-07-20T12:00:36.311Z	INFO	[kibana]	kibana/client.go:124	Kibana url: http://172.19.0.3:5601
  2021-07-20T12:00:36.861Z	INFO	[kibana]	kibana/client.go:124	Kibana url: http://172.19.0.3:5601
  2021-07-20T12:00:36.881Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Initialize the Kibana 7.12.0 loader
  2021-07-20T12:00:36.881Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Kibana URL http://172.19.0.3:5601
  2021-07-20T12:00:38.176Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Importing directory /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7
  2021-07-20T12:00:38.176Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import directory /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7
  2021-07-20T12:00:38.176Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-Host-Services-overview.json
  2021-07-20T12:00:39.170Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-aerospike-overview.json
  2021-07-20T12:00:40.203Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-apache-overview.json
  2021-07-20T12:00:41.218Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-ceph-overview.json
  2021-07-20T12:00:42.248Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-consul-overview.json
  2021-07-20T12:00:43.263Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-containers-overview.json
  2021-07-20T12:00:44.290Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-couchbase-overview.json
  2021-07-20T12:00:45.305Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-couchdb-overview.json
  2021-07-20T12:00:46.333Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-docker-overview.json
  2021-07-20T12:00:47.338Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-golang-overview.json
  2021-07-20T12:00:48.357Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-haproxy-backend.json
  2021-07-20T12:00:49.409Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-haproxy-frontend.json
  2021-07-20T12:00:50.387Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-haproxy-http-backend.json
  2021-07-20T12:00:51.396Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-haproxy-http-frontend.json
  2021-07-20T12:00:52.457Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-haproxy-http-server.json
  2021-07-20T12:00:53.427Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-haproxy-overview.json
  2021-07-20T12:00:54.458Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-haproxy-visualizations.json
  2021-07-20T12:00:55.464Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-host-overview.json
  2021-07-20T12:00:56.500Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-kafka-overview.json
  2021-07-20T12:00:57.498Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-kubernetes-apiserver.json
  2021-07-20T12:00:58.516Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-kubernetes-controller-manager.json
  2021-07-20T12:00:59.569Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-kubernetes-overview.json
  2021-07-20T12:00:59.633Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-kubernetes-proxy.json
  2021-07-20T12:01:00.549Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-kubernetes-scheduler.json
  2021-07-20T12:01:01.562Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-mongodb-overview.json
  2021-07-20T12:01:02.588Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-mysql-overview.json
  2021-07-20T12:01:03.599Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-nats-overview.json
  2021-07-20T12:01:04.620Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-postgresql-overview.json
  2021-07-20T12:01:05.678Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-prometheus-overview.json
  2021-07-20T12:01:06.648Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-rabbitmq-overview.json
  2021-07-20T12:01:07.658Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-redis-keys.json
  2021-07-20T12:01:08.678Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-redis-overview.json
  2021-07-20T12:01:09.683Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-system-overview.json
  2021-07-20T12:01:10.706Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-uwsgi-overview.json
  2021-07-20T12:01:11.753Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-zookeeper-overview.json
  2021-07-20T12:01:12.736Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/metricbeat-nginx-overview.json
  2021-07-20T12:01:13.742Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/metricbeat-vsphere-host.json
  2021-07-20T12:01:14.760Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/metricbeat-vsphere-vm.json
  2021-07-20T12:01:15.821Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/metricbeat-windows-service.json
  2021-07-20T12:01:16.796Z	ERROR	instance/beat.go:971	Exiting: Failed to import dashboard: Failed to load directory /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard:
    error loading /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-kubernetes-overview.json: returned 500 to import file: <nil>. Response: {"statusCode":500,"error":"Internal Server Error","message":"An internal server error occurred."}
  Exiting: Failed to import dashboard: Failed to load directory /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard:
    error loading /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-kubernetes-overview.json: returned 500 to import file: <nil>. Response: {"statusCode":500,"error":"Internal Server Error","message":"An internal server error occurred."}
  
assert 1 == 0

Expand to view the stacktrace

 self = <test_base.Test testMethod=test_dashboards>

    @unittest.skipUnless(INTEGRATION_TESTS, "integration test")
    @pytest.mark.timeout(180, func_only=True)
    def test_dashboards(self):
        """
        Test that the dashboards can be loaded with `setup --dashboards`
        """
        shutil.copytree(self.kibana_dir(), os.path.join(self.working_dir, "kibana"))
    
        es = Elasticsearch([self.get_elasticsearch_url()])
        self.render_config_template(
            modules=[{
                "name": "apache",
                "metricsets": ["status"],
                "hosts": ["localhost"],
            }],
            elasticsearch={"host": self.get_elasticsearch_url()},
            kibana={"host": self.get_kibana_url()},
        )
        exit_code = self.run_beat(extra_args=["setup", "--dashboards"])
    
>       assert exit_code == 0, 'Error output: ' + self.get_log()
E       AssertionError: Error output: 2021-07-20T12:00:36.302Z	INFO	instance/beat.go:654	Home path: [/go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards] Config path: [/go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards] Data path: [/go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/data] Logs path: [/go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/logs]
E         2021-07-20T12:00:36.302Z	DEBUG	[beat]	instance/beat.go:712	Beat metadata path: /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/data/meta.json
E         2021-07-20T12:00:36.307Z	INFO	instance/beat.go:662	Beat ID: 1698b9a6-8132-4b59-8475-69feacfed989
E         2021-07-20T12:00:36.307Z	INFO	[beat]	instance/beat.go:996	Beat info	{"system_info": {"beat": {"path": {"config": "/go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards", "data": "/go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/data", "home": "/go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards", "logs": "/go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/logs"}, "type": "metricbeat", "uuid": "1698b9a6-8132-4b59-8475-69feacfed989"}}}
E         2021-07-20T12:00:36.307Z	INFO	[beat]	instance/beat.go:1005	Build info	{"system_info": {"build": {"commit": "unknown", "libbeat": "8.0.0", "time": "1754-08-30T22:43:41.128Z", "version": "8.0.0"}}}
E         2021-07-20T12:00:36.307Z	INFO	[beat]	instance/beat.go:1008	Go runtime info	{"system_info": {"go": {"os":"linux","arch":"amd64","max_procs":8,"version":"go1.16.6"}}}
E         2021-07-20T12:00:36.309Z	INFO	[beat]	instance/beat.go:1012	Host info	{"system_info": {"host": {"architecture":"x86_64","boot_time":"2021-07-20T10:58:18Z","containerized":true,"name":"beats-ci-immutable-ubuntu-1804-1626778671975416100","ip":["127.0.0.1/8","::1/128","10.224.3.47/32","fe80::4001:aff:fee0:32f/64","172.17.0.1/16","fe80::42:dfff:fe7b:6c/64","172.18.0.1/16","172.19.0.1/16","fe80::42:bbff:fef7:d0a/64","fe80::dc3a:7cff:fe5e:b5ac/64","fe80::cb6:2ff:feec:c814/64"],"kernel_version":"5.4.0-1046-gcp","mac":["42:01:0a:e0:03:2f","02:42:df:7b:00:6c","02:42:b8:15:f9:a3","02:42:bb:f7:0d:0a","de:3a:7c:5e:b5:ac","0e:b6:02:ec:c8:14"],"os":{"type":"linux","family":"debian","platform":"debian","name":"Debian GNU/Linux","version":"10 (buster)","major":10,"minor":0,"patch":0,"codename":"buster"},"timezone":"UTC","timezone_offset_sec":0,"id":"88ca5e7b2819c56ffc2ab2fc4af49881"}}}
E         2021-07-20T12:00:36.310Z	INFO	[beat]	instance/beat.go:1041	Process info	{"system_info": {"process": {"capabilities": {"inheritable":["chown","dac_override","fowner","fsetid","kill","setgid","setuid","setpcap","net_bind_service","net_raw","sys_chroot","mknod","audit_write","setfcap"],"permitted":["chown","dac_override","fowner","fsetid","kill","setgid","setuid","setpcap","net_bind_service","net_raw","sys_chroot","mknod","audit_write","setfcap"],"effective":["chown","dac_override","fowner","fsetid","kill","setgid","setuid","setpcap","net_bind_service","net_raw","sys_chroot","mknod","audit_write","setfcap"],"bounding":["chown","dac_override","fowner","fsetid","kill","setgid","setuid","setpcap","net_bind_service","net_raw","sys_chroot","mknod","audit_write","setfcap"],"ambient":null}, "cwd": "/go/src/github.com/elastic/beats/metricbeat", "exe": "/go/src/github.com/elastic/beats/metricbeat/metricbeat.test", "name": "metricbeat.test", "pid": 244, "ppid": 176, "seccomp": {"mode":"filter","no_new_privs":false}, "start_time": "2021-07-20T12:00:35.680Z"}}}
E         2021-07-20T12:00:36.310Z	INFO	instance/beat.go:309	Setup Beat: metricbeat; Version: 8.0.0
E         2021-07-20T12:00:36.310Z	DEBUG	[beat]	instance/beat.go:335	Initializing output plugins
E         2021-07-20T12:00:36.310Z	INFO	[index-management]	idxmgmt/std.go:184	Set output.elasticsearch.index to 'metricbeat-8.0.0' as ILM is enabled.
E         2021-07-20T12:00:36.311Z	INFO	[esclientleg]	eslegclient/connection.go:100	elasticsearch url: http://172.19.0.2:9200
E         2021-07-20T12:00:36.311Z	DEBUG	[publisher]	pipeline/consumer.go:148	start pipeline event consumer
E         2021-07-20T12:00:36.311Z	INFO	[publisher]	pipeline/module.go:113	Beat name: beats-ci-immutable-ubuntu-1804-1626778671975416100
E         2021-07-20T12:00:36.311Z	DEBUG	[registry.lightmodules]	mb/lightmodules.go:262	Light modules directory '%!d(string=/go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/module)' doesn't exist
E         2021-07-20T12:00:36.311Z	DEBUG	[modules]	beater/metricbeat.go:151	Available modules and metricsets: Register [ModuleFactory:[beat, docker, elasticsearch, kibana, kubernetes, linux, logstash, mongodb, mysql, postgresql, system, uwsgi], MetricSetFactory:[aerospike/namespace, apache/status, beat/state, beat/stats, ceph/cluster_disk, ceph/cluster_health, ceph/cluster_status, ceph/mgr_cluster_disk, ceph/mgr_cluster_health, ceph/mgr_osd_perf, ceph/mgr_osd_pool_stats, ceph/mgr_osd_tree, ceph/mgr_pool_disk, ceph/monitor_health, ceph/osd_df, ceph/osd_tree, ceph/pool_disk, consul/agent, couchbase/bucket, couchbase/cluster, couchbase/node, couchdb/server, docker/container, docker/cpu, docker/diskio, docker/event, docker/healthcheck, docker/image, docker/info, docker/memory, docker/network, docker/network_summary, dropwizard/collector, elasticsearch/ccr, elasticsearch/cluster_stats, elasticsearch/enrich, elasticsearch/index, elasticsearch/index_recovery, elasticsearch/index_summary, elasticsearch/ml_job, elasticsearch/node, elasticsearch/node_stats, elasticsearch/pending_tasks, elasticsearch/shard, envoyproxy/server, etcd/leader, etcd/metrics, etcd/self, etcd/store, golang/expvar, golang/heap, graphite/server, haproxy/info, haproxy/stat, http/json, http/server, jolokia/jmx, kafka/consumergroup, kafka/partition, kibana/settings, kibana/stats, kibana/status, kubernetes/apiserver, kubernetes/container, kubernetes/controllermanager, kubernetes/event, kubernetes/node, kubernetes/pod, kubernetes/proxy, kubernetes/scheduler, kubernetes/state_container, kubernetes/state_cronjob, kubernetes/state_daemonset, kubernetes/state_deployment, kubernetes/state_job, kubernetes/state_node, kubernetes/state_persistentvolume, kubernetes/state_persistentvolumeclaim, kubernetes/state_pod, kubernetes/state_replicaset, kubernetes/state_resourcequota, kubernetes/state_service, kubernetes/state_statefulset, kubernetes/state_storageclass, kubernetes/system, kubernetes/volume, kvm/dommemstat, kvm/status, linux/conntrack, linux/iostat, linux/ksm, linux/memory, linux/pageinfo, logstash/node, logstash/node_stats, memcached/stats, mongodb/collstats, mongodb/dbstats, mongodb/metrics, mongodb/replstatus, mongodb/status, munin/node, mysql/galera_status, mysql/query, mysql/status, nats/connection, nats/connections, nats/route, nats/routes, nats/stats, nats/subscriptions, nginx/stubstatus, openmetrics/collector, php_fpm/pool, php_fpm/process, postgresql/activity, postgresql/bgwriter, postgresql/database, postgresql/statement, prometheus/collector, prometheus/query, prometheus/remote_write, rabbitmq/connection, rabbitmq/exchange, rabbitmq/node, rabbitmq/queue, redis/info, redis/key, redis/keyspace, system/core, system/cpu, system/diskio, system/entropy, system/filesystem, system/fsstat, system/load, system/memory, system/network, system/network_summary, system/process, system/process_summary, system/raid, system/service, system/socket, system/socket_summary, system/uptime, system/users, traefik/health, uwsgi/status, vsphere/datastore, vsphere/host, vsphere/virtualmachine, zookeeper/connection, zookeeper/mntr, zookeeper/server], LightModules:[LightModules:[]]]
E         Loading dashboards (Kibana must be running and reachable)
E         2021-07-20T12:00:36.311Z	INFO	[kibana]	kibana/client.go:124	Kibana url: http://172.19.0.3:5601
E         2021-07-20T12:00:36.861Z	INFO	[kibana]	kibana/client.go:124	Kibana url: http://172.19.0.3:5601
E         2021-07-20T12:00:36.881Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Initialize the Kibana 7.12.0 loader
E         2021-07-20T12:00:36.881Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Kibana URL http://172.19.0.3:5601
E         2021-07-20T12:00:38.176Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Importing directory /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7
E         2021-07-20T12:00:38.176Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import directory /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7
E         2021-07-20T12:00:38.176Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-Host-Services-overview.json
E         2021-07-20T12:00:39.170Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-aerospike-overview.json
E         2021-07-20T12:00:40.203Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-apache-overview.json
E         2021-07-20T12:00:41.218Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-ceph-overview.json
E         2021-07-20T12:00:42.248Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-consul-overview.json
E         2021-07-20T12:00:43.263Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-containers-overview.json
E         2021-07-20T12:00:44.290Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-couchbase-overview.json
E         2021-07-20T12:00:45.305Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-couchdb-overview.json
E         2021-07-20T12:00:46.333Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-docker-overview.json
E         2021-07-20T12:00:47.338Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-golang-overview.json
E         2021-07-20T12:00:48.357Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-haproxy-backend.json
E         2021-07-20T12:00:49.409Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-haproxy-frontend.json
E         2021-07-20T12:00:50.387Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-haproxy-http-backend.json
E         2021-07-20T12:00:51.396Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-haproxy-http-frontend.json
E         2021-07-20T12:00:52.457Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-haproxy-http-server.json
E         2021-07-20T12:00:53.427Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-haproxy-overview.json
E         2021-07-20T12:00:54.458Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-haproxy-visualizations.json
E         2021-07-20T12:00:55.464Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-host-overview.json
E         2021-07-20T12:00:56.500Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-kafka-overview.json
E         2021-07-20T12:00:57.498Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-kubernetes-apiserver.json
E         2021-07-20T12:00:58.516Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-kubernetes-controller-manager.json
E         2021-07-20T12:00:59.569Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-kubernetes-overview.json
E         2021-07-20T12:00:59.633Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-kubernetes-proxy.json
E         2021-07-20T12:01:00.549Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-kubernetes-scheduler.json
E         2021-07-20T12:01:01.562Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-mongodb-overview.json
E         2021-07-20T12:01:02.588Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-mysql-overview.json
E         2021-07-20T12:01:03.599Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-nats-overview.json
E         2021-07-20T12:01:04.620Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-postgresql-overview.json
E         2021-07-20T12:01:05.678Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-prometheus-overview.json
E         2021-07-20T12:01:06.648Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-rabbitmq-overview.json
E         2021-07-20T12:01:07.658Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-redis-keys.json
E         2021-07-20T12:01:08.678Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-redis-overview.json
E         2021-07-20T12:01:09.683Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-system-overview.json
E         2021-07-20T12:01:10.706Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-uwsgi-overview.json
E         2021-07-20T12:01:11.753Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-zookeeper-overview.json
E         2021-07-20T12:01:12.736Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/metricbeat-nginx-overview.json
E         2021-07-20T12:01:13.742Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/metricbeat-vsphere-host.json
E         2021-07-20T12:01:14.760Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/metricbeat-vsphere-vm.json
E         2021-07-20T12:01:15.821Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/metricbeat-windows-service.json
E         2021-07-20T12:01:16.796Z	ERROR	instance/beat.go:971	Exiting: Failed to import dashboard: Failed to load directory /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard:
E           error loading /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-kubernetes-overview.json: returned 500 to import file: <nil>. Response: {"statusCode":500,"error":"Internal Server Error","message":"An internal server error occurred."}
E         Exiting: Failed to import dashboard: Failed to load directory /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard:
E           error loading /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-kubernetes-overview.json: returned 500 to import file: <nil>. Response: {"statusCode":500,"error":"Internal Server Error","message":"An internal server error occurred."}
E         
E       assert 1 == 0

tests/system/test_base.py:79: AssertionError

Steps errors

Expand to view the steps failures

`metricbeat-pythonIntegTest - mage pythonIntegTest`

Took 31 min 52 sec . View more details on here
Description: mage pythonIntegTest

`metricbeat-pythonIntegTest - mage pythonIntegTest`

Took 22 min 11 sec . View more details on here
Description: mage pythonIntegTest

`metricbeat-pythonIntegTest - mage pythonIntegTest`

Took 22 min 11 sec . View more details on here
Description: mage pythonIntegTest

`Error signal`

Took 0 min 0 sec . View more details on here
Description: Error 'hudson.AbortException: script returned exit code 1'

Log output

Expand to view the last 100 lines of log output

[2021-07-20T12:21:33.279Z] 
[2021-07-20T12:21:33.279Z] metricbeat/module/elasticsearch/test_elasticsearch.py::Test::test_metricsets_0_ccr
[2021-07-20T12:21:33.279Z] metricbeat/module/elasticsearch/test_elasticsearch.py::Test::test_xpack
[2021-07-20T12:21:33.279Z]   /go/src/github.com/elastic/beats/build/ve/docker/lib/python3.7/site-packages/elasticsearch/connection/base.py:177: ElasticsearchDeprecationWarning: the default value for the ?wait_for_active_shards parameter will change from '0' to 'index-setting' in version 8; specify '?wait_for_active_shards=index-setting' to adopt the future default behaviour, or '?wait_for_active_shards=0' to preserve today's behaviour
[2021-07-20T12:21:33.279Z]     warnings.warn(message, category=ElasticsearchDeprecationWarning)
[2021-07-20T12:21:33.279Z] 
[2021-07-20T12:21:33.279Z] -- Docs: https://docs.pytest.org/en/stable/warnings.html
[2021-07-20T12:21:33.279Z] - generated xml file: /go/src/github.com/elastic/beats/metricbeat/build/TEST-python-integration.xml -
[2021-07-20T12:21:33.279Z] ============================= slowest 20 durations =============================
[2021-07-20T12:21:33.279Z] 61.62s setup    metricbeat/module/ceph/test_ceph.py::Test_0::test_ceph_0_cluster_disk
[2021-07-20T12:21:33.279Z] 51.41s setup    metricbeat/module/kafka/test_kafka.py::KafkaTest_0::test_kafka_jmx_0_consumer
[2021-07-20T12:21:33.279Z] 50.44s setup    metricbeat/module/kafka/test_kafka.py::KafkaTest_1::test_kafka_jmx_0_consumer
[2021-07-20T12:21:33.279Z] 50.19s setup    metricbeat/module/kafka/test_kafka.py::KafkaTest_2::test_kafka_jmx_0_consumer
[2021-07-20T12:21:33.279Z] 48.38s setup    metricbeat/module/couchbase/test_couchbase.py::Test::test_couchbase_0_bucket
[2021-07-20T12:21:33.279Z] 48.21s setup    metricbeat/module/kafka/test_kafka.py::KafkaTest_3::test_kafka_jmx_0_consumer
[2021-07-20T12:21:33.279Z] 48.21s setup    metricbeat/module/kafka/test_kafka.py::KafkaTest_4::test_kafka_jmx_0_consumer
[2021-07-20T12:21:33.279Z] 40.71s call     metricbeat/tests/system/test_base.py::Test::test_dashboards
[2021-07-20T12:21:33.279Z] 27.32s setup    metricbeat/module/ceph/test_ceph.py::Test_1::test_ceph_0_cluster_disk
[2021-07-20T12:21:33.279Z] 26.29s setup    metricbeat/module/logstash/test_logstash.py::Test::test_node
[2021-07-20T12:21:33.279Z] 26.11s setup    metricbeat/module/kibana/test_kibana.py::Test::test_status
[2021-07-20T12:21:33.279Z] 25.09s setup    metricbeat/tests/system/test_base.py::Test::test_dashboards
[2021-07-20T12:21:33.279Z] 20.41s teardown metricbeat/module/logstash/test_logstash.py::Test::test_xpack
[2021-07-20T12:21:33.279Z] 19.65s setup    metricbeat/tests/system/test_beat.py::Test::test_metricsets_0_stats
[2021-07-20T12:21:33.279Z] 19.37s setup    metricbeat/module/elasticsearch/test_elasticsearch.py::Test::test_metricsets_0_ccr
[2021-07-20T12:21:33.279Z] 17.10s setup    metricbeat/module/mysql/test_mysql.py::Test_6::test_status
[2021-07-20T12:21:33.279Z] 14.11s setup    metricbeat/module/mysql/test_mysql.py::Test_3::test_status
[2021-07-20T12:21:33.279Z] 13.07s setup    metricbeat/module/mysql/test_mysql.py::Test_1::test_status
[2021-07-20T12:21:33.279Z] 11.99s setup    metricbeat/module/postgresql/test_postgresql.py::Test_3::test_activity
[2021-07-20T12:21:33.279Z] 11.97s setup    metricbeat/module/postgresql/test_postgresql.py::Test_4::test_activity
[2021-07-20T12:21:33.279Z] =========================== short test summary info ============================
[2021-07-20T12:21:33.279Z] FAILED tests/system/test_base.py::Test::test_dashboards - AssertionError: Error output: 2021-07-20T12:00:36.302Z	INFO	instance/beat.go:654	Home path: [/go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards] Config path: [/go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards] Data path: [/go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/data] Logs path: [/go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/logs]
[2021-07-20T12:21:33.280Z] ====== 1 failed, 233 passed, 13 skipped, 3 warnings in 1298.92s (0:21:38) ======
[2021-07-20T12:21:33.539Z] >> python test: Integration Testing Complete
[2021-07-20T12:21:33.539Z] Error: running "/go/src/github.com/elastic/beats/build/ve/docker/bin/pytest --timeout=90 --durations=20 --junit-xml=build/TEST-python-integration.xml tests/system/test_autodiscover.py tests/system/test_autodiscover_jolokia.py tests/system/test_base.py tests/system/test_beat.py tests/system/test_cmd.py tests/system/test_config.py tests/system/test_lightmodules.py tests/system/test_processors.py tests/system/test_reload.py tests/system/test_template.py tests/system/test_timeseries.py module/aerospike/test_aerospike.py module/apache/test_apache.py module/ceph/test_ceph.py module/consul/test_consul.py module/couchbase/test_couchbase.py module/couchdb/test_couchdb.py module/docker/test_docker.py module/dropwizard/test_dropwizard.py module/elasticsearch/test_elasticsearch.py module/envoyproxy/test_envoyproxy.py module/etcd/test_etcd.py module/golang/test_golang.py module/haproxy/test_haproxy.py module/http/test_http.py module/jolokia/test_jolokia.py module/kafka/test_kafka.py module/kibana/test_kibana.py module/logstash/test_logstash.py module/memcached/test_memcached.py module/mongodb/test_mongodb.py module/munin/test_munin.py module/mysql/test_mysql.py module/nats/test_nats.py module/openmetrics/test_openmetrics.py module/php_fpm/test_phpfpm.py module/postgresql/test_postgresql.py module/prometheus/test_prometheus.py module/redis/test_redis.py module/system/test_system.py module/traefik/test_traefik.py module/uwsgi/test_uwsgi.py module/vsphere/test_vsphere.py module/zookeeper/test_zookeeper.py" failed with exit code 1
[2021-07-20T12:21:34.921Z] Error: running "docker-compose -p metricbeat_8_0_0_a145284e2e-snapshot run -e DOCKER_COMPOSE_PROJECT_NAME=metricbeat_8_0_0_a145284e2e-snapshot -e BEAT_STRICT_PERMS=false -e STACK_ENVIRONMENT=snapshot -e TESTING_ENVIRONMENT=snapshot -e GOCACHE=/go/src/github.com/elastic/beats/build/docker-gocache -v /var/lib/jenkins/workspace/PR-26976-1-a6b82cf1-243f-43ef-b1d1-0ba4ec0cdfc6/pkg/mod/cache/download:/gocache:ro -e GOPROXY=file:///gocache,direct -e EXEC_UID=1166 -e EXEC_GID=1167 -e BEATS_INSIDE_INTEGRATION_TEST_ENV=true -e GOFLAGS=-mod=readonly -e TEST_COVERAGE=true -e RACE_DETECTOR=true -e TEST_TAGS=null,oracle beat /go/src/github.com/elastic/beats/metricbeat/build/mage-linux-amd64 pythonIntegTest" failed with exit code 1
[2021-07-20T12:21:35.283Z] Timeout set to expire in 5 min 0 sec
[2021-07-20T12:21:35.620Z] Cleaning up /var/lib/jenkins/workspace/PR-26976-1-a6b82cf1-243f-43ef-b1d1-0ba4ec0cdfc6
[2021-07-20T12:21:35.620Z] Change ownership of all files inside the specific folder from root/root to current user/group
[2021-07-20T12:21:35.620Z] ++ id -u
[2021-07-20T12:21:35.620Z] ++ id -g
[2021-07-20T12:21:35.620Z] + docker run -v /var/lib/jenkins/workspace/PR-26976-1-a6b82cf1-243f-43ef-b1d1-0ba4ec0cdfc6:/beat alpine:3.4 sh -c 'find /beat -user 0 -exec chown -h 1166:1167 {} \;'
[2021-07-20T12:21:35.620Z] Unable to find image 'alpine:3.4' locally
[2021-07-20T12:21:36.189Z] 3.4: Pulling from library/alpine
[2021-07-20T12:21:36.448Z] c1e54eec4b57: Pulling fs layer
[2021-07-20T12:21:36.708Z] c1e54eec4b57: Download complete
[2021-07-20T12:21:36.967Z] c1e54eec4b57: Pull complete
[2021-07-20T12:21:36.967Z] Digest: sha256:b733d4a32c4da6a00a84df2ca32791bb03df95400243648d8c539e7b4cce329c
[2021-07-20T12:21:36.967Z] Status: Downloaded newer image for alpine:3.4
[2021-07-20T12:21:38.877Z] + set -e
[2021-07-20T12:21:38.877Z] + echo 'Change permissions with write access of all files inside the specific folder'
[2021-07-20T12:21:38.877Z] Change permissions with write access of all files inside the specific folder
[2021-07-20T12:21:38.877Z] + chmod -R +w /var/lib/jenkins/workspace/PR-26976-1-a6b82cf1-243f-43ef-b1d1-0ba4ec0cdfc6
[2021-07-20T12:21:40.007Z] Running in /var/lib/jenkins/workspace/PR-26976-1-a6b82cf1-243f-43ef-b1d1-0ba4ec0cdfc6/src/github.com/elastic/beats/build
[2021-07-20T12:21:40.337Z] + rm -rf ve
[2021-07-20T12:21:40.337Z] + find . -type d -name vendor -exec rm -r {} ;
[2021-07-20T12:21:40.768Z] + python .ci/scripts/pre_archive_test.py
[2021-07-20T12:21:41.707Z] Copy ./metricbeat/build into build/metricbeat/build
[2021-07-20T12:21:41.744Z] Running in /var/lib/jenkins/workspace/PR-26976-1-a6b82cf1-243f-43ef-b1d1-0ba4ec0cdfc6/src/github.com/elastic/beats/build
[2021-07-20T12:21:41.795Z] Recording test results
[2021-07-20T12:21:43.769Z] [Checks API] No suitable checks publisher found.
[2021-07-20T12:21:44.125Z] + tar --version
[2021-07-20T12:21:44.498Z] + tar --exclude=test-build-artifacts-metricbeat-pythonIntegTest-tgz -czf test-build-artifacts-metricbeat-pythonIntegTest-tgz .
[2021-07-20T12:22:17.049Z] + gsutil --version
[2021-07-20T12:22:20.387Z] Masking supported pattern matches of $FILE_CREDENTIAL
[2021-07-20T12:22:20.798Z] + gcloud auth activate-service-account --key-file ****
[2021-07-20T12:22:21.737Z] Activated service account credentials for: [beats-ci-gcs-plugin@elastic-ci-prod.iam.gserviceaccount.com]
[2021-07-20T12:22:22.138Z] + gsutil -m -q cp -a public-read test-build-artifacts-metricbeat-pythonIntegTest-tgz gs://beats-ci-temp/Beats/beats/PR-26976-1
[2021-07-20T12:22:25.927Z] + python .ci/scripts/search_system_tests.py
[2021-07-20T12:22:25.971Z] [INFO] system-tests='build/metricbeat/build/system-tests'. If no empty then let's create a tarball
[2021-07-20T12:22:26.329Z] + tar --version
[2021-07-20T12:22:26.703Z] + tar --exclude=metricbeat--system-tests-linux-tgz -czf metricbeat--system-tests-linux-tgz build/metricbeat/build/system-tests
[2021-07-20T12:22:35.246Z] + gsutil --version
[2021-07-20T12:22:36.676Z] Masking supported pattern matches of $FILE_CREDENTIAL
[2021-07-20T12:22:37.038Z] + gcloud auth activate-service-account --key-file ****
[2021-07-20T12:22:37.605Z] Activated service account credentials for: [beats-ci-gcs-plugin@elastic-ci-prod.iam.gserviceaccount.com]
[2021-07-20T12:22:38.000Z] + gsutil -m -q cp -a public-read metricbeat--system-tests-linux-tgz gs://beats-ci-temp/Beats/beats/PR-26976-1
[2021-07-20T12:22:41.110Z] + go clean -modcache
[2021-07-20T12:22:44.505Z] Timeout set to expire in 5 min 0 sec
[2021-07-20T12:22:44.839Z] Cleaning up /var/lib/jenkins/workspace/PR-26976-1-a6b82cf1-243f-43ef-b1d1-0ba4ec0cdfc6
[2021-07-20T12:22:44.839Z] Change ownership of all files inside the specific folder from root/root to current user/group
[2021-07-20T12:22:44.839Z] ++ id -u
[2021-07-20T12:22:44.839Z] ++ id -g
[2021-07-20T12:22:44.839Z] + docker run -v /var/lib/jenkins/workspace/PR-26976-1-a6b82cf1-243f-43ef-b1d1-0ba4ec0cdfc6:/beat alpine:3.4 sh -c 'find /beat -user 0 -exec chown -h 1166:1167 {} \;'
[2021-07-20T12:22:45.780Z] + set -e
[2021-07-20T12:22:45.780Z] + echo 'Change permissions with write access of all files inside the specific folder'
[2021-07-20T12:22:45.780Z] Change permissions with write access of all files inside the specific folder
[2021-07-20T12:22:45.780Z] + chmod -R +w /var/lib/jenkins/workspace/PR-26976-1-a6b82cf1-243f-43ef-b1d1-0ba4ec0cdfc6
[2021-07-20T12:22:46.224Z] Running in /var/lib/jenkins/workspace/PR-26976-1-a6b82cf1-243f-43ef-b1d1-0ba4ec0cdfc6
[2021-07-20T12:22:49.732Z] Failed in branch metricbeat-pythonIntegTest
[2021-07-20T12:22:50.882Z] Stage "Extended" skipped due to earlier failure(s)
[2021-07-20T12:22:50.987Z] Stage "Packaging" skipped due to earlier failure(s)
[2021-07-20T12:22:51.083Z] Stage "Packaging-Pipeline" skipped due to earlier failure(s)
[2021-07-20T12:22:51.229Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-26976/src/github.com/elastic/beats
[2021-07-20T12:22:51.752Z] Running on Jenkins in /var/lib/jenkins/workspace/Beats_beats_PR-26976
[2021-07-20T12:22:51.867Z] [INFO] getVaultSecret: Getting secrets
[2021-07-20T12:22:51.921Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2021-07-20T12:22:52.900Z] + chmod 755 generate-build-data.sh
[2021-07-20T12:22:52.901Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-26976/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-26976/runs/1 FAILURE 6384331
[2021-07-20T12:22:52.901Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-26976/runs/1/steps/?limit=10000 -o steps-info.json
[2021-07-20T12:22:58.095Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-26976/runs/1/tests/?status=FAILED -o tests-errors.json

🐛 Flaky test report

❕ There are test failures but not known flaky tests.

Expand to view the summary

Test stats 🧪

Test	Results
Failed	1
Passed	19362
Skipped	1536
Total	20899

Genuine test errors

💔 There are test failures but not known flaky tests, most likely a genuine test failure.

Name: Build&Test / metricbeat-pythonIntegTest / test_dashboards – metricbeat.tests.system.test_base.Test

jsoriano · 2021-07-28T12:17:22Z

Merged as part of #26972

Run base tests when applying module selective testing

a145284

jsoriano added review Team:Integrations Label for the Integrations team labels Jul 20, 2021

jsoriano self-assigned this Jul 20, 2021

botelastic bot added needs_team Indicates that the issue/PR needs a Team:* label and removed needs_team Indicates that the issue/PR needs a Team:* label labels Jul 20, 2021

jsoriano added backport-v7.14.0 Automated backport with mergify backport-v7.15.0 Automated backport with mergify needs_team Indicates that the issue/PR needs a Team:* label labels Jul 20, 2021

botelastic bot removed the needs_team Indicates that the issue/PR needs a Team:* label label Jul 20, 2021

jsoriano mentioned this pull request Jul 20, 2021

Fix k8s overview dashboard version #26972

Merged

jsoriano closed this Jul 28, 2021

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Run base tests when applying module selective testing #26976

Run base tests when applying module selective testing #26976

jsoriano commented Jul 20, 2021 •

edited

Loading

elasticmachine commented Jul 20, 2021

botelastic bot commented Jul 20, 2021

elasticmachine commented Jul 20, 2021

Build stats

Test stats 🧪

Trends 🧪

`Build&Test / metricbeat-pythonIntegTest / test_dashboards – metricbeat.tests.system.test_base.Test`

`metricbeat-pythonIntegTest - mage pythonIntegTest`

`metricbeat-pythonIntegTest - mage pythonIntegTest`

`metricbeat-pythonIntegTest - mage pythonIntegTest`

`Error signal`

Test stats 🧪

Genuine test errors

jsoriano commented Jul 28, 2021

Run base tests when applying module selective testing #26976

Run base tests when applying module selective testing #26976

Conversation

jsoriano commented Jul 20, 2021 • edited Loading

What does this PR do?

Why is it important?

Checklist

How to test this PR locally

Related issues

elasticmachine commented Jul 20, 2021

botelastic bot commented Jul 20, 2021

elasticmachine commented Jul 20, 2021

💔 Tests Failed

Build stats

Test stats 🧪

Trends 🧪

Test errors

Build&Test / metricbeat-pythonIntegTest / test_dashboards – metricbeat.tests.system.test_base.Test

Steps errors

metricbeat-pythonIntegTest - mage pythonIntegTest

metricbeat-pythonIntegTest - mage pythonIntegTest

metricbeat-pythonIntegTest - mage pythonIntegTest

Error signal

Log output

🐛 Flaky test report

Test stats 🧪

Genuine test errors

jsoriano commented Jul 28, 2021

jsoriano commented Jul 20, 2021 •

edited

Loading

`Build&Test / metricbeat-pythonIntegTest / test_dashboards – metricbeat.tests.system.test_base.Test`

`metricbeat-pythonIntegTest - mage pythonIntegTest`

`metricbeat-pythonIntegTest - mage pythonIntegTest`

`metricbeat-pythonIntegTest - mage pythonIntegTest`

`Error signal`