# /usr/bin/ansible-playbook cluster.yml -b -i inventory/inventory.ini PLAY [localhost] *************************************************************** TASK [Check ansible version >=2.7.8] ******************************************* Thursday 09 May 2019 02:13:33 -0300 (0:00:00.038) 0:00:00.038 ********** ok: [localhost] => { "changed": false, "msg": "All assertions passed" } [WARNING]: Could not match supplied host pattern, ignoring: bastion PLAY [bastion[0]] ************************************************************** skipping: no hosts matched [WARNING]: Could not match supplied host pattern, ignoring: calico-rr PLAY [k8s-cluster:etcd:calico-rr] ********************************************** TASK [download : include_tasks] ************************************************ Thursday 09 May 2019 02:13:33 -0300 (0:00:00.092) 0:00:00.130 ********** TASK [download : Download items] *********************************************** Thursday 09 May 2019 02:13:33 -0300 (0:00:00.235) 0:00:00.366 ********** TASK [download : Sync container] *********************************************** Thursday 09 May 2019 02:13:34 -0300 (0:00:00.857) 0:00:01.224 ********** TASK [download : include_tasks] ************************************************ Thursday 09 May 2019 02:13:35 -0300 (0:00:00.793) 0:00:02.017 ********** TASK [kubespray-defaults : Configure defaults] ********************************* Thursday 09 May 2019 02:13:35 -0300 (0:00:00.220) 0:00:02.238 ********** ok: [k8s-master01-lab-20190425] => { "msg": "Check roles/kubespray-defaults/defaults/main.yml" } ok: [k8s-node01-lab] => { "msg": "Check roles/kubespray-defaults/defaults/main.yml" } ok: [k8s-node02-lab] => { "msg": "Check roles/kubespray-defaults/defaults/main.yml" } ok: [k8s-etcd01-lab-20190425] => { "msg": "Check roles/kubespray-defaults/defaults/main.yml" } TASK [bootstrap-os : Fetch /etc/os-release] ************************************ Thursday 09 May 2019 02:13:35 -0300 (0:00:00.245) 0:00:02.484 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [bootstrap-os : include_tasks] ******************************************** Thursday 09 May 2019 02:13:36 -0300 (0:00:00.583) 0:00:03.067 ********** TASK [bootstrap-os : include_tasks] ******************************************** Thursday 09 May 2019 02:13:36 -0300 (0:00:00.216) 0:00:03.284 ********** TASK [bootstrap-os : include_tasks] ******************************************** Thursday 09 May 2019 02:13:36 -0300 (0:00:00.227) 0:00:03.511 ********** TASK [bootstrap-os : include_tasks] ******************************************** Thursday 09 May 2019 02:13:37 -0300 (0:00:00.233) 0:00:03.744 ********** included: /kubespray/roles/bootstrap-os/tasks/bootstrap-debian.yml for k8s-master01-lab-20190425, k8s-node01-lab, k8s-node02-lab, k8s-etcd01-lab-20190425 TASK [bootstrap-os : Check if bootstrap is needed] ***************************** Thursday 09 May 2019 02:13:37 -0300 (0:00:00.415) 0:00:04.159 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [bootstrap-os : Check http::proxy in /etc/apt/apt.conf] ******************* Thursday 09 May 2019 02:13:37 -0300 (0:00:00.281) 0:00:04.441 ********** TASK [bootstrap-os : Add http_proxy to /etc/apt/apt.conf if http_proxy is defined] *** Thursday 09 May 2019 02:13:37 -0300 (0:00:00.214) 0:00:04.656 ********** TASK [bootstrap-os : Check https::proxy in /etc/apt/apt.conf] ****************** Thursday 09 May 2019 02:13:38 -0300 (0:00:00.220) 0:00:04.876 ********** TASK [bootstrap-os : Add https_proxy to /etc/apt/apt.conf if https_proxy is defined] *** Thursday 09 May 2019 02:13:38 -0300 (0:00:00.224) 0:00:05.100 ********** TASK [bootstrap-os : Install python] ******************************************* Thursday 09 May 2019 02:13:38 -0300 (0:00:00.217) 0:00:05.318 ********** TASK [bootstrap-os : Install dbus for the hostname module] ********************* Thursday 09 May 2019 02:13:38 -0300 (0:00:00.213) 0:00:05.531 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-etcd01-lab-20190425] ok: [k8s-node02-lab] TASK [bootstrap-os : include_tasks] ******************************************** Thursday 09 May 2019 02:13:40 -0300 (0:00:01.238) 0:00:06.769 ********** TASK [bootstrap-os : include_tasks] ******************************************** Thursday 09 May 2019 02:13:40 -0300 (0:00:00.222) 0:00:06.992 ********** TASK [bootstrap-os : Create remote_tmp for it is used by another module] ******* Thursday 09 May 2019 02:13:40 -0300 (0:00:00.383) 0:00:07.375 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node02-lab] ok: [k8s-node01-lab] ok: [k8s-etcd01-lab-20190425] TASK [bootstrap-os : Gather host facts to get ansible_os_family] *************** Thursday 09 May 2019 02:13:41 -0300 (0:00:00.364) 0:00:07.739 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node02-lab] ok: [k8s-node01-lab] ok: [k8s-etcd01-lab-20190425] TASK [bootstrap-os : Assign inventory name to unconfigured hostnames (non-CoreOS, Suse and ClearLinux)] *** Thursday 09 May 2019 02:13:41 -0300 (0:00:00.675) 0:00:08.415 ********** ok: [k8s-etcd01-lab-20190425] ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [bootstrap-os : Assign inventory name to unconfigured hostnames (CoreOS, Suse and ClearLinux only)] *** Thursday 09 May 2019 02:13:42 -0300 (0:00:01.239) 0:00:09.654 ********** TASK [bootstrap-os : Update hostname fact (CoreOS, Suse and ClearLinux only)] *** Thursday 09 May 2019 02:13:43 -0300 (0:00:00.228) 0:00:09.883 ********** TASK [bootstrap-os : Install ceph-commmon package] ***************************** Thursday 09 May 2019 02:13:43 -0300 (0:00:00.225) 0:00:10.109 ********** PLAY [k8s-cluster:etcd:calico-rr] ********************************************** TASK [gather facts from all instances] ***************************************** Thursday 09 May 2019 02:13:43 -0300 (0:00:00.401) 0:00:10.511 ********** ok: [k8s-master01-lab-20190425 -> k8s-master01-lab-20190425] => (item=k8s-master01-lab-20190425) ok: [k8s-master01-lab-20190425 -> k8s-node01-lab] => (item=k8s-node01-lab) ok: [k8s-master01-lab-20190425 -> k8s-node02-lab] => (item=k8s-node02-lab) ok: [k8s-master01-lab-20190425 -> k8s-etcd01-lab-20190425] => (item=k8s-etcd01-lab-20190425) PLAY [k8s-cluster:etcd:calico-rr] ********************************************** TASK [download : include_tasks] ************************************************ Thursday 09 May 2019 02:13:46 -0300 (0:00:02.313) 0:00:12.824 ********** TASK [download : Download items] *********************************************** Thursday 09 May 2019 02:13:46 -0300 (0:00:00.219) 0:00:13.044 ********** TASK [download : Sync container] *********************************************** Thursday 09 May 2019 02:13:47 -0300 (0:00:00.917) 0:00:13.962 ********** TASK [download : include_tasks] ************************************************ Thursday 09 May 2019 02:13:48 -0300 (0:00:00.925) 0:00:14.888 ********** TASK [kubespray-defaults : Configure defaults] ********************************* Thursday 09 May 2019 02:13:48 -0300 (0:00:00.226) 0:00:15.114 ********** ok: [k8s-master01-lab-20190425] => { "msg": "Check roles/kubespray-defaults/defaults/main.yml" } ok: [k8s-node01-lab] => { "msg": "Check roles/kubespray-defaults/defaults/main.yml" } ok: [k8s-node02-lab] => { "msg": "Check roles/kubespray-defaults/defaults/main.yml" } ok: [k8s-etcd01-lab-20190425] => { "msg": "Check roles/kubespray-defaults/defaults/main.yml" } TASK [adduser : User | Create User Group] ************************************** Thursday 09 May 2019 02:13:48 -0300 (0:00:00.381) 0:00:15.495 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [adduser : User | Create User] ******************************************** Thursday 09 May 2019 02:13:49 -0300 (0:00:00.480) 0:00:15.976 ********** ok: [k8s-node01-lab] ok: [k8s-etcd01-lab-20190425] ok: [k8s-master01-lab-20190425] ok: [k8s-node02-lab] TASK [kubernetes/preinstall : Remove swapfile from /etc/fstab] ***************** Thursday 09 May 2019 02:13:49 -0300 (0:00:00.461) 0:00:16.437 ********** ok: [k8s-node01-lab] => (item=swap) ok: [k8s-master01-lab-20190425] => (item=swap) ok: [k8s-node02-lab] => (item=swap) ok: [k8s-etcd01-lab-20190425] => (item=swap) ok: [k8s-node01-lab] => (item=none) ok: [k8s-node02-lab] => (item=none) ok: [k8s-master01-lab-20190425] => (item=none) ok: [k8s-etcd01-lab-20190425] => (item=none) TASK [kubernetes/preinstall : check swap] ************************************** Thursday 09 May 2019 02:13:50 -0300 (0:00:00.553) 0:00:16.990 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [kubernetes/preinstall : Disable swap] ************************************ Thursday 09 May 2019 02:13:50 -0300 (0:00:00.392) 0:00:17.383 ********** TASK [kubernetes/preinstall : Stop if either kube-master, kube-node or etcd is empty] *** Thursday 09 May 2019 02:13:50 -0300 (0:00:00.225) 0:00:17.609 ********** ok: [k8s-master01-lab-20190425] => (item=kube-master) => { "changed": false, "item": "kube-master", "msg": "All assertions passed" } ok: [k8s-master01-lab-20190425] => (item=kube-node) => { "changed": false, "item": "kube-node", "msg": "All assertions passed" } ok: [k8s-master01-lab-20190425] => (item=etcd) => { "changed": false, "item": "etcd", "msg": "All assertions passed" } TASK [kubernetes/preinstall : Stop if non systemd OS type] ********************* Thursday 09 May 2019 02:13:51 -0300 (0:00:00.184) 0:00:17.793 ********** ok: [k8s-master01-lab-20190425] => { "changed": false, "msg": "All assertions passed" } ok: [k8s-node01-lab] => { "changed": false, "msg": "All assertions passed" } ok: [k8s-node02-lab] => { "changed": false, "msg": "All assertions passed" } ok: [k8s-etcd01-lab-20190425] => { "changed": false, "msg": "All assertions passed" } TASK [kubernetes/preinstall : Stop if unknown OS] ****************************** Thursday 09 May 2019 02:13:51 -0300 (0:00:00.291) 0:00:18.085 ********** ok: [k8s-master01-lab-20190425] => { "changed": false, "msg": "All assertions passed" } ok: [k8s-node01-lab] => { "changed": false, "msg": "All assertions passed" } ok: [k8s-node02-lab] => { "changed": false, "msg": "All assertions passed" } ok: [k8s-etcd01-lab-20190425] => { "changed": false, "msg": "All assertions passed" } TASK [kubernetes/preinstall : Stop if unknown network plugin] ****************** Thursday 09 May 2019 02:13:51 -0300 (0:00:00.283) 0:00:18.368 ********** ok: [k8s-master01-lab-20190425] => { "changed": false, "msg": "All assertions passed" } ok: [k8s-node01-lab] => { "changed": false, "msg": "All assertions passed" } ok: [k8s-node02-lab] => { "changed": false, "msg": "All assertions passed" } ok: [k8s-etcd01-lab-20190425] => { "changed": false, "msg": "All assertions passed" } TASK [kubernetes/preinstall : Stop if incompatible network plugin and cloudprovider] *** Thursday 09 May 2019 02:13:51 -0300 (0:00:00.285) 0:00:18.654 ********** TASK [kubernetes/preinstall : Stop if known booleans are set as strings (Use JSON format on CLI: -e "{'key': true }")] *** Thursday 09 May 2019 02:13:52 -0300 (0:00:00.251) 0:00:18.905 ********** ok: [k8s-master01-lab-20190425] => (item={u'name': u'download_run_once', u'value': False}) => { "changed": false, "item": { "name": "download_run_once", "value": false }, "msg": "All assertions passed" } ok: [k8s-master01-lab-20190425] => (item={u'name': u'deploy_netchecker', u'value': False}) => { "changed": false, "item": { "name": "deploy_netchecker", "value": false }, "msg": "All assertions passed" } ok: [k8s-master01-lab-20190425] => (item={u'name': u'download_always_pull', u'value': False}) => { "changed": false, "item": { "name": "download_always_pull", "value": false }, "msg": "All assertions passed" } ok: [k8s-master01-lab-20190425] => (item={u'name': u'helm_enabled', u'value': True}) => { "changed": false, "item": { "name": "helm_enabled", "value": true }, "msg": "All assertions passed" } ok: [k8s-master01-lab-20190425] => (item={u'name': u'openstack_lbaas_enabled', u'value': False}) => { "changed": false, "item": { "name": "openstack_lbaas_enabled", "value": false }, "msg": "All assertions passed" } TASK [kubernetes/preinstall : Stop if even number of etcd hosts] *************** Thursday 09 May 2019 02:13:52 -0300 (0:00:00.242) 0:00:19.148 ********** ok: [k8s-master01-lab-20190425] => { "changed": false, "msg": "All assertions passed" } ok: [k8s-node01-lab] => { "changed": false, "msg": "All assertions passed" } ok: [k8s-node02-lab] => { "changed": false, "msg": "All assertions passed" } ok: [k8s-etcd01-lab-20190425] => { "changed": false, "msg": "All assertions passed" } TASK [kubernetes/preinstall : Stop if memory is too small for masters] ********* Thursday 09 May 2019 02:13:52 -0300 (0:00:00.285) 0:00:19.434 ********** ok: [k8s-master01-lab-20190425] => { "changed": false, "msg": "All assertions passed" } TASK [kubernetes/preinstall : Stop if memory is too small for nodes] *********** Thursday 09 May 2019 02:13:52 -0300 (0:00:00.226) 0:00:19.661 ********** ok: [k8s-node01-lab] => { "changed": false, "msg": "All assertions passed" } ok: [k8s-node02-lab] => { "changed": false, "msg": "All assertions passed" } TASK [kubernetes/preinstall : Guarantee that enough network address space is available for all pods] *** Thursday 09 May 2019 02:13:53 -0300 (0:00:00.255) 0:00:19.917 ********** ok: [k8s-node01-lab] => { "changed": false, "msg": "All assertions passed" } ok: [k8s-node02-lab] => { "changed": false, "msg": "All assertions passed" } TASK [kubernetes/preinstall : Stop if ip var does not match local ips] ********* Thursday 09 May 2019 02:13:53 -0300 (0:00:00.256) 0:00:20.174 ********** TASK [kubernetes/preinstall : Stop if access_ip is not pingable] *************** Thursday 09 May 2019 02:13:53 -0300 (0:00:00.226) 0:00:20.401 ********** TASK [kubernetes/preinstall : Stop if RBAC is not enabled when dashboard is enabled] *** Thursday 09 May 2019 02:13:53 -0300 (0:00:00.235) 0:00:20.636 ********** ok: [k8s-etcd01-lab-20190425] => { "changed": false, "msg": "All assertions passed" } TASK [kubernetes/preinstall : Stop if RBAC is not enabled when OCI cloud controller is enabled] *** Thursday 09 May 2019 02:13:54 -0300 (0:00:00.278) 0:00:20.915 ********** TASK [kubernetes/preinstall : Stop if RBAC and anonymous-auth are not enabled when insecure port is disabled] *** Thursday 09 May 2019 02:13:54 -0300 (0:00:00.226) 0:00:21.142 ********** ok: [k8s-master01-lab-20190425] => { "changed": false, "msg": "All assertions passed" } TASK [kubernetes/preinstall : Stop if kernel version is too low] *************** Thursday 09 May 2019 02:13:54 -0300 (0:00:00.232) 0:00:21.374 ********** TASK [kubernetes/preinstall : Stop if bad hostname] **************************** Thursday 09 May 2019 02:13:54 -0300 (0:00:00.230) 0:00:21.605 ********** ok: [k8s-master01-lab-20190425] => { "changed": false, "msg": "All assertions passed" } ok: [k8s-node01-lab] => { "changed": false, "msg": "All assertions passed" } ok: [k8s-node02-lab] => { "changed": false, "msg": "All assertions passed" } ok: [k8s-etcd01-lab-20190425] => { "changed": false, "msg": "All assertions passed" } TASK [kubernetes/preinstall : check cloud_provider value] ********************** Thursday 09 May 2019 02:13:55 -0300 (0:00:00.284) 0:00:21.889 ********** TASK [kubernetes/preinstall : Get current version of calico cluster version] *** Thursday 09 May 2019 02:13:55 -0300 (0:00:00.230) 0:00:22.119 ********** ok: [k8s-master01-lab-20190425] TASK [kubernetes/preinstall : Check that calico version is enough for upgrade] *** Thursday 09 May 2019 02:13:55 -0300 (0:00:00.253) 0:00:22.372 ********** ok: [k8s-master01-lab-20190425] => { "changed": false, "msg": "All assertions passed" } TASK [kubernetes/preinstall : Check that kube_service_addresses is a network range] *** Thursday 09 May 2019 02:13:55 -0300 (0:00:00.129) 0:00:22.501 ********** ok: [k8s-master01-lab-20190425] => { "changed": false, "msg": "All assertions passed" } TASK [kubernetes/preinstall : Check that kube_pods_subnet is a network range] *** Thursday 09 May 2019 02:13:55 -0300 (0:00:00.120) 0:00:22.622 ********** ok: [k8s-master01-lab-20190425] => { "changed": false, "msg": "All assertions passed" } TASK [kubernetes/preinstall : Check that kube_pods_subnet does not collide with kube_service_addresses] *** Thursday 09 May 2019 02:13:56 -0300 (0:00:00.122) 0:00:22.744 ********** ok: [k8s-master01-lab-20190425] => { "changed": false, "msg": "All assertions passed" } TASK [kubernetes/preinstall : Stop if unknown dns mode] ************************ Thursday 09 May 2019 02:13:56 -0300 (0:00:00.119) 0:00:22.864 ********** ok: [k8s-master01-lab-20190425] => { "changed": false, "msg": "All assertions passed" } TASK [kubernetes/preinstall : Stop if unknown kube proxy mode] ***************** Thursday 09 May 2019 02:13:56 -0300 (0:00:00.122) 0:00:22.987 ********** ok: [k8s-master01-lab-20190425] => { "changed": false, "msg": "All assertions passed" } TASK [kubernetes/preinstall : Stop if vault is chose] ************************** Thursday 09 May 2019 02:13:56 -0300 (0:00:00.121) 0:00:23.109 ********** ok: [k8s-master01-lab-20190425] => { "changed": false, "msg": "All assertions passed" } TASK [kubernetes/preinstall : Stop if unknown cert_management] ***************** Thursday 09 May 2019 02:13:56 -0300 (0:00:00.122) 0:00:23.231 ********** ok: [k8s-master01-lab-20190425] => { "changed": false, "msg": "All assertions passed" } TASK [kubernetes/preinstall : Stop if unknown resolvconf_mode] ***************** Thursday 09 May 2019 02:13:56 -0300 (0:00:00.121) 0:00:23.353 ********** ok: [k8s-master01-lab-20190425] => { "changed": false, "msg": "All assertions passed" } TASK [kubernetes/preinstall : Pre-upgrade | check if old credential dir exists] *** Thursday 09 May 2019 02:13:56 -0300 (0:00:00.124) 0:00:23.478 ********** ok: [k8s-master01-lab-20190425 -> localhost] TASK [kubernetes/preinstall : Pre-upgrade | check if new credential dir exists] *** Thursday 09 May 2019 02:13:57 -0300 (0:00:00.388) 0:00:23.866 ********** TASK [kubernetes/preinstall : Pre-upgrade | move data from old credential dir to new] *** Thursday 09 May 2019 02:13:57 -0300 (0:00:00.075) 0:00:23.942 ********** TASK [kubernetes/preinstall : set_fact] **************************************** Thursday 09 May 2019 02:13:57 -0300 (0:00:00.068) 0:00:24.010 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [kubernetes/preinstall : ansible_architecture_rename] ********************* Thursday 09 May 2019 02:13:57 -0300 (0:00:00.283) 0:00:24.293 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [kubernetes/preinstall : Force binaries directory for Container Linux by CoreOS] *** Thursday 09 May 2019 02:13:57 -0300 (0:00:00.288) 0:00:24.582 ********** TASK [kubernetes/preinstall : check if atomic host] **************************** Thursday 09 May 2019 02:13:58 -0300 (0:00:00.235) 0:00:24.818 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [kubernetes/preinstall : set_fact] **************************************** Thursday 09 May 2019 02:13:58 -0300 (0:00:00.469) 0:00:25.287 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [kubernetes/preinstall : set_fact] **************************************** Thursday 09 May 2019 02:13:58 -0300 (0:00:00.385) 0:00:25.673 ********** TASK [kubernetes/preinstall : check resolvconf] ******************************** Thursday 09 May 2019 02:13:59 -0300 (0:00:00.222) 0:00:25.895 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [kubernetes/preinstall : set_fact] **************************************** Thursday 09 May 2019 02:13:59 -0300 (0:00:00.506) 0:00:26.402 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [kubernetes/preinstall : set_fact] **************************************** Thursday 09 May 2019 02:14:00 -0300 (0:00:00.381) 0:00:26.783 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [kubernetes/preinstall : check if kubelet is configured] ****************** Thursday 09 May 2019 02:14:00 -0300 (0:00:00.393) 0:00:27.176 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [kubernetes/preinstall : check if early DNS configuration stage] ********** Thursday 09 May 2019 02:14:01 -0300 (0:00:00.541) 0:00:27.718 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [kubernetes/preinstall : target resolv.conf files] ************************ Thursday 09 May 2019 02:14:01 -0300 (0:00:00.282) 0:00:28.001 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [kubernetes/preinstall : target temporary resolvconf cloud init file (Container Linux by CoreOS)] *** Thursday 09 May 2019 02:14:01 -0300 (0:00:00.288) 0:00:28.290 ********** TASK [kubernetes/preinstall : check if /etc/dhclient.conf exists] ************** Thursday 09 May 2019 02:14:01 -0300 (0:00:00.221) 0:00:28.511 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [kubernetes/preinstall : target dhclient conf file for /etc/dhclient.conf] *** Thursday 09 May 2019 02:14:02 -0300 (0:00:00.378) 0:00:28.890 ********** TASK [kubernetes/preinstall : check if /etc/dhcp/dhclient.conf exists] ********* Thursday 09 May 2019 02:14:02 -0300 (0:00:00.226) 0:00:29.116 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [kubernetes/preinstall : target dhclient conf file for /etc/dhcp/dhclient.conf] *** Thursday 09 May 2019 02:14:02 -0300 (0:00:00.390) 0:00:29.507 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [kubernetes/preinstall : target dhclient hook file for Red Hat family] **** Thursday 09 May 2019 02:14:03 -0300 (0:00:00.281) 0:00:29.788 ********** TASK [kubernetes/preinstall : target dhclient hook file for Debian family] ***** Thursday 09 May 2019 02:14:03 -0300 (0:00:00.232) 0:00:30.021 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [kubernetes/preinstall : generate search domains to resolvconf] *********** Thursday 09 May 2019 02:14:03 -0300 (0:00:00.290) 0:00:30.312 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [kubernetes/preinstall : pick coredns cluster IP or default resolver] ***** Thursday 09 May 2019 02:14:03 -0300 (0:00:00.285) 0:00:30.597 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [kubernetes/preinstall : generate nameservers to resolvconf] ************** Thursday 09 May 2019 02:14:04 -0300 (0:00:00.290) 0:00:30.888 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [kubernetes/preinstall : gather os specific variables] ******************** Thursday 09 May 2019 02:14:04 -0300 (0:00:00.288) 0:00:31.177 ********** ok: [k8s-master01-lab-20190425] => (item=/kubespray/roles/kubernetes/preinstall/vars/../vars/ubuntu.yml) ok: [k8s-node01-lab] => (item=/kubespray/roles/kubernetes/preinstall/vars/../vars/ubuntu.yml) ok: [k8s-node02-lab] => (item=/kubespray/roles/kubernetes/preinstall/vars/../vars/ubuntu.yml) ok: [k8s-etcd01-lab-20190425] => (item=/kubespray/roles/kubernetes/preinstall/vars/../vars/ubuntu.yml) TASK [kubernetes/preinstall : override kube_proxy_mode to ipvs if kube_proxy_remove is set, as ipvs won't require kube-proxy cleanup when kube-proxy daemonset gets deleted] *** Thursday 09 May 2019 02:14:04 -0300 (0:00:00.294) 0:00:31.471 ********** TASK [kubernetes/preinstall : Create kubernetes directories] ******************* Thursday 09 May 2019 02:14:04 -0300 (0:00:00.221) 0:00:31.693 ********** ok: [k8s-master01-lab-20190425] => (item=/usr/local/bin) ok: [k8s-node01-lab] => (item=/usr/local/bin) ok: [k8s-node02-lab] => (item=/usr/local/bin) ok: [k8s-master01-lab-20190425] => (item=/etc/kubernetes) ok: [k8s-node01-lab] => (item=/etc/kubernetes) ok: [k8s-master01-lab-20190425] => (item=/etc/kubernetes/ssl) ok: [k8s-node02-lab] => (item=/etc/kubernetes) ok: [k8s-node01-lab] => (item=/etc/kubernetes/ssl) ok: [k8s-master01-lab-20190425] => (item=/etc/kubernetes/manifests) ok: [k8s-node02-lab] => (item=/etc/kubernetes/ssl) ok: [k8s-node01-lab] => (item=/etc/kubernetes/manifests) ok: [k8s-master01-lab-20190425] => (item=/usr/local/bin/kubernetes-scripts) ok: [k8s-node02-lab] => (item=/etc/kubernetes/manifests) ok: [k8s-node01-lab] => (item=/usr/local/bin/kubernetes-scripts) ok: [k8s-node02-lab] => (item=/usr/local/bin/kubernetes-scripts) TASK [kubernetes/preinstall : Create kubernetes kubeadm compat cert dir (kubernetes/kubeadm issue 1498)] *** Thursday 09 May 2019 02:14:05 -0300 (0:00:00.969) 0:00:32.662 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [kubernetes/preinstall : Create cni directories] ************************** Thursday 09 May 2019 02:14:06 -0300 (0:00:00.357) 0:00:33.020 ********** ok: [k8s-master01-lab-20190425] => (item=/etc/cni/net.d) ok: [k8s-node01-lab] => (item=/etc/cni/net.d) ok: [k8s-node02-lab] => (item=/etc/cni/net.d) ok: [k8s-master01-lab-20190425] => (item=/opt/cni/bin) ok: [k8s-node01-lab] => (item=/opt/cni/bin) ok: [k8s-node02-lab] => (item=/opt/cni/bin) ok: [k8s-master01-lab-20190425] => (item=/var/lib/calico) ok: [k8s-node01-lab] => (item=/var/lib/calico) ok: [k8s-node02-lab] => (item=/var/lib/calico) TASK [kubernetes/preinstall : Create local volume provisioner directories] ***** Thursday 09 May 2019 02:14:06 -0300 (0:00:00.657) 0:00:33.678 ********** TASK [kubernetes/preinstall : create temporary resolveconf cloud init file] **** Thursday 09 May 2019 02:14:07 -0300 (0:00:00.243) 0:00:33.921 ********** TASK [kubernetes/preinstall : Add domain/search/nameservers/options to resolv.conf] *** Thursday 09 May 2019 02:14:07 -0300 (0:00:00.239) 0:00:34.161 ********** TASK [kubernetes/preinstall : Remove search/domain/nameserver options before block] *** Thursday 09 May 2019 02:14:07 -0300 (0:00:00.236) 0:00:34.398 ********** TASK [kubernetes/preinstall : Remove search/domain/nameserver options after block] *** Thursday 09 May 2019 02:14:07 -0300 (0:00:00.279) 0:00:34.677 ********** TASK [kubernetes/preinstall : get temporary resolveconf cloud init file content] *** Thursday 09 May 2019 02:14:08 -0300 (0:00:00.278) 0:00:34.956 ********** TASK [kubernetes/preinstall : persist resolvconf cloud init file] ************** Thursday 09 May 2019 02:14:08 -0300 (0:00:00.235) 0:00:35.192 ********** TASK [kubernetes/preinstall : Update package management cache (zypper) - SUSE] *** Thursday 09 May 2019 02:14:08 -0300 (0:00:00.227) 0:00:35.419 ********** TASK [kubernetes/preinstall : Update package management cache (APT)] *********** Thursday 09 May 2019 02:14:08 -0300 (0:00:00.227) 0:00:35.647 ********** changed: [k8s-etcd01-lab-20190425] changed: [k8s-node01-lab] changed: [k8s-master01-lab-20190425] changed: [k8s-node02-lab] TASK [kubernetes/preinstall : Install python-dnf for latest RedHat versions] *** Thursday 09 May 2019 02:14:13 -0300 (0:00:04.840) 0:00:40.487 ********** TASK [kubernetes/preinstall : Install epel-release on RedHat/CentOS] *********** Thursday 09 May 2019 02:14:14 -0300 (0:00:00.231) 0:00:40.719 ********** TASK [kubernetes/preinstall : Update common_required_pkgs with ipvsadm when kube_proxy_mode is ipvs] *** Thursday 09 May 2019 02:14:14 -0300 (0:00:00.229) 0:00:40.949 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [kubernetes/preinstall : Install packages requirements] ******************* Thursday 09 May 2019 02:14:14 -0300 (0:00:00.410) 0:00:41.359 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-etcd01-lab-20190425] ok: [k8s-node02-lab] TASK [kubernetes/preinstall : Install ipvsadm for ClearLinux] ****************** Thursday 09 May 2019 02:14:15 -0300 (0:00:01.243) 0:00:42.603 ********** TASK [kubernetes/preinstall : Confirm selinux deployed] ************************ Thursday 09 May 2019 02:14:16 -0300 (0:00:00.244) 0:00:42.848 ********** TASK [kubernetes/preinstall : Set selinux policy] ****************************** Thursday 09 May 2019 02:14:16 -0300 (0:00:00.233) 0:00:43.081 ********** TASK [kubernetes/preinstall : Disable IPv6 DNS lookup] ************************* Thursday 09 May 2019 02:14:16 -0300 (0:00:00.231) 0:00:43.312 ********** TASK [kubernetes/preinstall : Stat sysctl file configuration] ****************** Thursday 09 May 2019 02:14:16 -0300 (0:00:00.248) 0:00:43.561 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [kubernetes/preinstall : Change sysctl file path to link source if linked] *** Thursday 09 May 2019 02:14:17 -0300 (0:00:00.494) 0:00:44.056 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [kubernetes/preinstall : Make sure sysctl file path folder exists] ******** Thursday 09 May 2019 02:14:17 -0300 (0:00:00.290) 0:00:44.346 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [kubernetes/preinstall : Enable ip forwarding] **************************** Thursday 09 May 2019 02:14:18 -0300 (0:00:00.384) 0:00:44.731 ********** ok: [k8s-node01-lab] ok: [k8s-master01-lab-20190425] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [kubernetes/preinstall : Hosts | populate inventory into hosts file] ****** Thursday 09 May 2019 02:14:18 -0300 (0:00:00.403) 0:00:45.135 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [kubernetes/preinstall : Hosts | populate kubernetes loadbalancer address into hosts file] *** Thursday 09 May 2019 02:14:19 -0300 (0:00:01.403) 0:00:46.538 ********** TASK [kubernetes/preinstall : Hosts | Retrieve hosts file content] ************* Thursday 09 May 2019 02:14:20 -0300 (0:00:00.254) 0:00:46.793 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [kubernetes/preinstall : Hosts | Extract existing entries for localhost from hosts file] *** Thursday 09 May 2019 02:14:20 -0300 (0:00:00.392) 0:00:47.186 ********** ok: [k8s-master01-lab-20190425] => (item=127.0.0.1 localhost localhost.localdomain) ok: [k8s-node01-lab] => (item=127.0.0.1 localhost localhost.localdomain) ok: [k8s-master01-lab-20190425] => (item=::1 ip6-localhost ip6-loopback localhost6 localhost6.localdomain) ok: [k8s-node01-lab] => (item=::1 ip6-localhost ip6-loopback localhost6 localhost6.localdomain) ok: [k8s-node02-lab] => (item=127.0.0.1 localhost localhost.localdomain) ok: [k8s-etcd01-lab-20190425] => (item=127.0.0.1 localhost localhost.localdomain) ok: [k8s-node02-lab] => (item=::1 ip6-localhost ip6-loopback localhost6 localhost6.localdomain) ok: [k8s-etcd01-lab-20190425] => (item=::1 ip6-localhost ip6-loopback localhost6 localhost6.localdomain) TASK [kubernetes/preinstall : Hosts | Update target hosts file entries dict with required entries] *** Thursday 09 May 2019 02:14:20 -0300 (0:00:00.517) 0:00:47.703 ********** ok: [k8s-master01-lab-20190425] => (item={'value': {u'expected': [u'localhost6', u'localhost6.localdomain'], u'unexpected': [u'localhost', u'localhost.localdomain']}, 'key': u'::1'}) ok: [k8s-master01-lab-20190425] => (item={'value': {u'expected': [u'localhost', u'localhost.localdomain']}, 'key': u'127.0.0.1'}) ok: [k8s-node01-lab] => (item={'value': {u'expected': [u'localhost6', u'localhost6.localdomain'], u'unexpected': [u'localhost', u'localhost.localdomain']}, 'key': u'::1'}) ok: [k8s-node01-lab] => (item={'value': {u'expected': [u'localhost', u'localhost.localdomain']}, 'key': u'127.0.0.1'}) ok: [k8s-node02-lab] => (item={'value': {u'expected': [u'localhost6', u'localhost6.localdomain'], u'unexpected': [u'localhost', u'localhost.localdomain']}, 'key': u'::1'}) ok: [k8s-node02-lab] => (item={'value': {u'expected': [u'localhost', u'localhost.localdomain']}, 'key': u'127.0.0.1'}) ok: [k8s-etcd01-lab-20190425] => (item={'value': {u'expected': [u'localhost6', u'localhost6.localdomain'], u'unexpected': [u'localhost', u'localhost.localdomain']}, 'key': u'::1'}) ok: [k8s-etcd01-lab-20190425] => (item={'value': {u'expected': [u'localhost', u'localhost.localdomain']}, 'key': u'127.0.0.1'}) TASK [kubernetes/preinstall : Hosts | Update (if necessary) hosts file] ******** Thursday 09 May 2019 02:14:21 -0300 (0:00:00.361) 0:00:48.065 ********** ok: [k8s-node01-lab] => (item={'value': [u'ip6-localhost', u'ip6-loopback', u'localhost6', u'localhost6.localdomain'], 'key': u'::1'}) ok: [k8s-master01-lab-20190425] => (item={'value': [u'ip6-localhost', u'ip6-loopback', u'localhost6', u'localhost6.localdomain'], 'key': u'::1'}) ok: [k8s-node02-lab] => (item={'value': [u'ip6-localhost', u'ip6-loopback', u'localhost6', u'localhost6.localdomain'], 'key': u'::1'}) ok: [k8s-etcd01-lab-20190425] => (item={'value': [u'ip6-localhost', u'ip6-loopback', u'localhost6', u'localhost6.localdomain'], 'key': u'::1'}) ok: [k8s-node01-lab] => (item={'value': [u'localhost', u'localhost.localdomain'], 'key': u'127.0.0.1'}) ok: [k8s-master01-lab-20190425] => (item={'value': [u'localhost', u'localhost.localdomain'], 'key': u'127.0.0.1'}) ok: [k8s-node02-lab] => (item={'value': [u'localhost', u'localhost.localdomain'], 'key': u'127.0.0.1'}) ok: [k8s-etcd01-lab-20190425] => (item={'value': [u'localhost', u'localhost.localdomain'], 'key': u'127.0.0.1'}) TASK [kubernetes/preinstall : Configure dhclient to supersede search/domain/nameservers] *** Thursday 09 May 2019 02:14:21 -0300 (0:00:00.526) 0:00:48.591 ********** TASK [kubernetes/preinstall : Configure dhclient hooks for resolv.conf (non-RH)] *** Thursday 09 May 2019 02:14:22 -0300 (0:00:00.228) 0:00:48.820 ********** TASK [kubernetes/preinstall : Configure dhclient hooks for resolv.conf (RH-only)] *** Thursday 09 May 2019 02:14:22 -0300 (0:00:00.228) 0:00:49.048 ********** TASK [kubernetes/preinstall : Remove kubespray specific config from dhclient config] *** Thursday 09 May 2019 02:14:22 -0300 (0:00:00.233) 0:00:49.282 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [kubernetes/preinstall : Remove kubespray specific dhclient hook] ********* Thursday 09 May 2019 02:14:22 -0300 (0:00:00.380) 0:00:49.663 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [kubernetes/preinstall : Check if we are running inside a Azure VM] ******* Thursday 09 May 2019 02:14:23 -0300 (0:00:00.390) 0:00:50.053 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [kubernetes/preinstall : install growpart] ******************************** Thursday 09 May 2019 02:14:23 -0300 (0:00:00.385) 0:00:50.439 ********** TASK [kubernetes/preinstall : check if growpart needs to be run] *************** Thursday 09 May 2019 02:14:23 -0300 (0:00:00.229) 0:00:50.668 ********** TASK [kubernetes/preinstall : check fs type] *********************************** Thursday 09 May 2019 02:14:24 -0300 (0:00:00.226) 0:00:50.895 ********** TASK [kubernetes/preinstall : run growpart] ************************************ Thursday 09 May 2019 02:14:24 -0300 (0:00:00.238) 0:00:51.133 ********** TASK [kubernetes/preinstall : run xfs_growfs] ********************************** Thursday 09 May 2019 02:14:24 -0300 (0:00:00.230) 0:00:51.363 ********** TASK [container-engine/cri-o : gather os specific variables] ******************* Thursday 09 May 2019 02:14:24 -0300 (0:00:00.228) 0:00:51.592 ********** TASK [container-engine/cri-o : Add OpenShift Origin repository] **************** Thursday 09 May 2019 02:14:25 -0300 (0:00:00.239) 0:00:51.832 ********** TASK [container-engine/cri-o : Make sure needed folders exist in the system] *** Thursday 09 May 2019 02:14:25 -0300 (0:00:00.235) 0:00:52.068 ********** TASK [container-engine/cri-o : Install cri-o packages] ************************* Thursday 09 May 2019 02:14:25 -0300 (0:00:00.246) 0:00:52.315 ********** TASK [container-engine/cri-o : Install cri-o config] *************************** Thursday 09 May 2019 02:14:25 -0300 (0:00:00.225) 0:00:52.540 ********** TASK [container-engine/cri-o : Copy mounts.conf] ******************************* Thursday 09 May 2019 02:14:26 -0300 (0:00:00.232) 0:00:52.773 ********** TASK [container-engine/cri-o : Create directory for oci hooks] ***************** Thursday 09 May 2019 02:14:26 -0300 (0:00:00.227) 0:00:53.000 ********** TASK [container-engine/cri-o : Install cri-o service] ************************** Thursday 09 May 2019 02:14:26 -0300 (0:00:00.226) 0:00:53.227 ********** TASK [container-engine/docker-storage : docker-storage-setup | install git and make] *** Thursday 09 May 2019 02:14:26 -0300 (0:00:00.232) 0:00:53.460 ********** TASK [container-engine/docker-storage : docker-storage-setup | docker-storage-setup sysconfig template] *** Thursday 09 May 2019 02:14:27 -0300 (0:00:00.253) 0:00:53.713 ********** TASK [container-engine/docker-storage : docker-storage-override-directory | docker service storage-setup override dir] *** Thursday 09 May 2019 02:14:27 -0300 (0:00:00.227) 0:00:53.940 ********** TASK [container-engine/docker-storage : docker-storage-override | docker service storage-setup override file] *** Thursday 09 May 2019 02:14:27 -0300 (0:00:00.237) 0:00:54.178 ********** TASK [container-engine/docker-storage : docker-storage-setup | install lvm2] *** Thursday 09 May 2019 02:14:27 -0300 (0:00:00.232) 0:00:54.411 ********** TASK [container-engine/docker-storage : docker-storage-setup | install and run container-storage-setup] *** Thursday 09 May 2019 02:14:27 -0300 (0:00:00.228) 0:00:54.639 ********** TASK [container-engine/docker : check if atomic host] ************************** Thursday 09 May 2019 02:14:28 -0300 (0:00:00.236) 0:00:54.875 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [container-engine/docker : set_fact] ************************************** Thursday 09 May 2019 02:14:28 -0300 (0:00:00.511) 0:00:55.387 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [container-engine/docker : gather os specific variables] ****************** Thursday 09 May 2019 02:14:29 -0300 (0:00:00.384) 0:00:55.772 ********** ok: [k8s-master01-lab-20190425] => (item=/kubespray/roles/container-engine/docker/vars/../vars/ubuntu-amd64.yml) ok: [k8s-node01-lab] => (item=/kubespray/roles/container-engine/docker/vars/../vars/ubuntu-amd64.yml) ok: [k8s-node02-lab] => (item=/kubespray/roles/container-engine/docker/vars/../vars/ubuntu-amd64.yml) ok: [k8s-etcd01-lab-20190425] => (item=/kubespray/roles/container-engine/docker/vars/../vars/ubuntu-amd64.yml) TASK [container-engine/docker : Warn about Docker version on SUSE] ************* Thursday 09 May 2019 02:14:29 -0300 (0:00:00.402) 0:00:56.174 ********** TASK [container-engine/docker : include_tasks] ********************************* Thursday 09 May 2019 02:14:29 -0300 (0:00:00.238) 0:00:56.413 ********** included: /kubespray/roles/container-engine/docker/tasks/set_facts_dns.yml for k8s-master01-lab-20190425, k8s-node01-lab, k8s-node02-lab, k8s-etcd01-lab-20190425 TASK [container-engine/docker : set dns server for docker] ********************* Thursday 09 May 2019 02:14:30 -0300 (0:00:00.414) 0:00:56.827 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [container-engine/docker : show docker_dns_servers] *********************** Thursday 09 May 2019 02:14:30 -0300 (0:00:00.295) 0:00:57.123 ********** ok: [k8s-master01-lab-20190425] => { "msg": [ "10.233.0.3" ] } ok: [k8s-node01-lab] => { "msg": [ "10.233.0.3" ] } ok: [k8s-node02-lab] => { "msg": [ "10.233.0.3" ] } ok: [k8s-etcd01-lab-20190425] => { "msg": [ "10.233.0.3" ] } TASK [container-engine/docker : set base docker dns facts] ********************* Thursday 09 May 2019 02:14:30 -0300 (0:00:00.296) 0:00:57.419 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [container-engine/docker : add upstream dns servers] ********************** Thursday 09 May 2019 02:14:31 -0300 (0:00:00.290) 0:00:57.710 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [container-engine/docker : add global searchdomains] ********************** Thursday 09 May 2019 02:14:31 -0300 (0:00:00.291) 0:00:58.001 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [container-engine/docker : check system nameservers] ********************** Thursday 09 May 2019 02:14:31 -0300 (0:00:00.295) 0:00:58.297 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [container-engine/docker : check system search domains] ******************* Thursday 09 May 2019 02:14:31 -0300 (0:00:00.388) 0:00:58.685 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [container-engine/docker : add system nameservers to docker options] ****** Thursday 09 May 2019 02:14:32 -0300 (0:00:00.393) 0:00:59.078 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [container-engine/docker : add system search domains to docker options] *** Thursday 09 May 2019 02:14:32 -0300 (0:00:00.301) 0:00:59.380 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [container-engine/docker : check number of nameservers] ******************* Thursday 09 May 2019 02:14:32 -0300 (0:00:00.296) 0:00:59.677 ********** TASK [container-engine/docker : rtrim number of nameservers to 3] ************** Thursday 09 May 2019 02:14:33 -0300 (0:00:00.234) 0:00:59.911 ********** TASK [container-engine/docker : check number of search domains] **************** Thursday 09 May 2019 02:14:33 -0300 (0:00:00.237) 0:01:00.149 ********** TASK [container-engine/docker : check length of search domains] **************** Thursday 09 May 2019 02:14:33 -0300 (0:00:00.236) 0:01:00.385 ********** TASK [container-engine/docker : check for minimum kernel version] ************** Thursday 09 May 2019 02:14:33 -0300 (0:00:00.238) 0:01:00.623 ********** TASK [container-engine/docker : Ensure old versions of Docker are not installed. | Debian] *** Thursday 09 May 2019 02:14:34 -0300 (0:00:00.240) 0:01:00.864 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [container-engine/docker : Ensure old versions of Docker are not installed. | RedHat] *** Thursday 09 May 2019 02:14:34 -0300 (0:00:00.822) 0:01:01.687 ********** TASK [container-engine/docker : ensure docker-ce repository public key is installed] *** Thursday 09 May 2019 02:14:35 -0300 (0:00:00.249) 0:01:01.937 ********** ok: [k8s-etcd01-lab-20190425] => (item=9DC858229FC7DD38854AE2D88D81803C0EBFCD88) ok: [k8s-master01-lab-20190425] => (item=9DC858229FC7DD38854AE2D88D81803C0EBFCD88) ok: [k8s-node01-lab] => (item=9DC858229FC7DD38854AE2D88D81803C0EBFCD88) ok: [k8s-node02-lab] => (item=9DC858229FC7DD38854AE2D88D81803C0EBFCD88) TASK [container-engine/docker : ensure docker-ce repository is enabled] ******** Thursday 09 May 2019 02:14:35 -0300 (0:00:00.716) 0:01:02.653 ********** ok: [k8s-etcd01-lab-20190425] => (item=deb https://download.docker.com/linux/ubuntu bionic stable ) ok: [k8s-node01-lab] => (item=deb https://download.docker.com/linux/ubuntu bionic stable ) ok: [k8s-master01-lab-20190425] => (item=deb https://download.docker.com/linux/ubuntu bionic stable ) ok: [k8s-node02-lab] => (item=deb https://download.docker.com/linux/ubuntu bionic stable ) TASK [container-engine/docker : ensure docker-engine repository public key is installed] *** Thursday 09 May 2019 02:14:36 -0300 (0:00:00.688) 0:01:03.342 ********** TASK [container-engine/docker : ensure docker-engine repository is enabled] **** Thursday 09 May 2019 02:14:36 -0300 (0:00:00.256) 0:01:03.598 ********** TASK [container-engine/docker : Configure docker repository on Fedora] ********* Thursday 09 May 2019 02:14:37 -0300 (0:00:00.254) 0:01:03.852 ********** TASK [container-engine/docker : Configure docker repository on RedHat/CentOS] *** Thursday 09 May 2019 02:14:37 -0300 (0:00:00.231) 0:01:04.083 ********** TASK [container-engine/docker : check if container-selinux is available] ******* Thursday 09 May 2019 02:14:37 -0300 (0:00:00.237) 0:01:04.321 ********** TASK [container-engine/docker : Configure extras repository on RedHat/CentOS if container-selinux is not available in current repos] *** Thursday 09 May 2019 02:14:37 -0300 (0:00:00.241) 0:01:04.563 ********** TASK [container-engine/docker : Copy yum.conf for editing] ********************* Thursday 09 May 2019 02:14:38 -0300 (0:00:00.230) 0:01:04.793 ********** TASK [container-engine/docker : Edit copy of yum.conf to set obsoletes=0] ****** Thursday 09 May 2019 02:14:38 -0300 (0:00:00.229) 0:01:05.023 ********** TASK [container-engine/docker : ensure docker packages are installed] ********** Thursday 09 May 2019 02:14:38 -0300 (0:00:00.239) 0:01:05.262 ********** ok: [k8s-master01-lab-20190425] => (item={u'force': True, u'name': u'docker-ce=5:18.09.5~3-0~ubuntu-bionic'}) ok: [k8s-node01-lab] => (item={u'force': True, u'name': u'docker-ce=5:18.09.5~3-0~ubuntu-bionic'}) ok: [k8s-etcd01-lab-20190425] => (item={u'force': True, u'name': u'docker-ce=5:18.09.5~3-0~ubuntu-bionic'}) ok: [k8s-node02-lab] => (item={u'force': True, u'name': u'docker-ce=5:18.09.5~3-0~ubuntu-bionic'}) TASK [container-engine/docker : Ensure docker packages are installed] ********** Thursday 09 May 2019 02:14:40 -0300 (0:00:02.248) 0:01:07.510 ********** TASK [container-engine/docker : get available packages on Ubuntu] ************** Thursday 09 May 2019 02:14:41 -0300 (0:00:00.263) 0:01:07.774 ********** TASK [container-engine/docker : show available packages on ubuntu] ************* Thursday 09 May 2019 02:14:41 -0300 (0:00:00.229) 0:01:08.003 ********** TASK [container-engine/docker : Set docker pin priority to apt_preferences on Debian family] *** Thursday 09 May 2019 02:14:41 -0300 (0:00:00.238) 0:01:08.242 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [container-engine/docker : ensure service is started if docker packages are already present] *** Thursday 09 May 2019 02:14:42 -0300 (0:00:00.591) 0:01:08.834 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] ok: [k8s-node01-lab] [WARNING]: flush_handlers task does not support when conditional TASK [container-engine/docker : set fact for docker_version] ******************* Thursday 09 May 2019 02:14:42 -0300 (0:00:00.698) 0:01:09.533 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [container-engine/docker : check minimum docker version for docker_dns mode. You need at least docker version >= 1.12 for resolvconf_mode=docker_dns] *** Thursday 09 May 2019 02:14:43 -0300 (0:00:00.441) 0:01:09.974 ********** TASK [container-engine/docker : Create docker service systemd directory if it doesn't exist] *** Thursday 09 May 2019 02:14:43 -0300 (0:00:00.238) 0:01:10.213 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [container-engine/docker : Write docker proxy drop-in] ******************** Thursday 09 May 2019 02:14:43 -0300 (0:00:00.440) 0:01:10.653 ********** TASK [container-engine/docker : get systemd version] *************************** Thursday 09 May 2019 02:14:44 -0300 (0:00:00.235) 0:01:10.889 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [container-engine/docker : Write docker.service systemd file] ************* Thursday 09 May 2019 02:14:44 -0300 (0:00:00.398) 0:01:11.287 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [container-engine/docker : Write docker options systemd drop-in] ********** Thursday 09 May 2019 02:14:45 -0300 (0:00:00.579) 0:01:11.867 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [container-engine/docker : Write docker dns systemd drop-in] ************** Thursday 09 May 2019 02:14:45 -0300 (0:00:00.560) 0:01:12.428 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [container-engine/docker : Copy docker orphan clean up script to the node] *** Thursday 09 May 2019 02:14:46 -0300 (0:00:00.559) 0:01:12.987 ********** TASK [container-engine/docker : Write docker orphan clean up systemd drop-in] *** Thursday 09 May 2019 02:14:46 -0300 (0:00:00.239) 0:01:13.227 ********** TASK [container-engine/docker : ensure docker service is started and enabled] *** Thursday 09 May 2019 02:14:46 -0300 (0:00:00.236) 0:01:13.463 ********** ok: [k8s-master01-lab-20190425] => (item=docker) ok: [k8s-node01-lab] => (item=docker) ok: [k8s-node02-lab] => (item=docker) ok: [k8s-etcd01-lab-20190425] => (item=docker) TASK [download : include_tasks] ************************************************ Thursday 09 May 2019 02:14:47 -0300 (0:00:00.479) 0:01:13.943 ********** included: /kubespray/roles/download/tasks/download_prep.yml for k8s-master01-lab-20190425, k8s-node01-lab, k8s-node02-lab, k8s-etcd01-lab-20190425 TASK [download : Register docker images info] ********************************** Thursday 09 May 2019 02:14:47 -0300 (0:00:00.404) 0:01:14.348 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-etcd01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [download : container_download | Create dest directory for saved/loaded container images] *** Thursday 09 May 2019 02:14:48 -0300 (0:00:00.673) 0:01:15.022 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [download : container_download | create local directory for saved/loaded container images] *** Thursday 09 May 2019 02:14:48 -0300 (0:00:00.386) 0:01:15.409 ********** TASK [download : Download items] *********************************************** Thursday 09 May 2019 02:14:48 -0300 (0:00:00.080) 0:01:15.489 ********** included: /kubespray/roles/download/tasks/download_container.yml for k8s-master01-lab-20190425, k8s-node01-lab, k8s-node02-lab, k8s-etcd01-lab-20190425 => (item={'key': u'dnsautoscaler', 'value': {u'container': True, u'enabled': True, u'repo': u'k8s.gcr.io/cluster-proportional-autoscaler-amd64', u'tag': u'1.4.0', u'groups': [u'kube-master'], u'sha256': u''}}) included: /kubespray/roles/download/tasks/download_container.yml for k8s-master01-lab-20190425, k8s-node01-lab, k8s-node02-lab, k8s-etcd01-lab-20190425 => (item={'key': u'pod_infra', 'value': {u'container': True, u'enabled': True, u'repo': u'gcr.io/google_containers/pause-amd64', u'tag': u'3.1', u'groups': [u'k8s-cluster'], u'sha256': u''}}) included: /kubespray/roles/download/tasks/download_container.yml for k8s-master01-lab-20190425, k8s-node01-lab, k8s-node02-lab, k8s-etcd01-lab-20190425 => (item={'key': u'etcd', 'value': {u'unarchive': True, u'container': True, u'groups': [u'etcd'], u'dest': u'/tmp/releases/etcd-v3.2.26-linux-amd64.tar.gz', u'version': u'v3.2.26', u'enabled': True, u'repo': u'quay.io/coreos/etcd', u'url': u'https://github.com/coreos/etcd/releases/download/v3.2.26/etcd-v3.2.26-linux-amd64.tar.gz', u'tag': u'v3.2.26', u'mode': u'0755', u'file': False, u'owner': u'root', u'sha256': u''}}) included: /kubespray/roles/download/tasks/download_container.yml for k8s-master01-lab-20190425, k8s-node01-lab, k8s-node02-lab => (item={'key': u'helm', 'value': {u'container': True, u'enabled': True, u'repo': u'docker.io/lachlanevenson/k8s-helm', u'tag': u'v2.13.1', u'groups': [u'kube-node'], u'sha256': u''}}) included: /kubespray/roles/download/tasks/download_file.yml for k8s-master01-lab-20190425, k8s-node01-lab, k8s-node02-lab => (item={'key': u'kubeadm', 'value': {u'unarchive': False, u'file': True, u'dest': u'/tmp/releases/kubeadm', u'enabled': True, u'url': u'https://storage.googleapis.com/kubernetes-release/release/v1.13.5/bin/linux/amd64/kubeadm', u'version': u'v1.13.5', u'mode': u'0755', u'groups': [u'k8s-cluster'], u'owner': u'root', u'sha256': u'274bf887039a9993e30f96047a4a474c39e8471c4094acb75aea6beed793f079'}}) included: /kubespray/roles/download/tasks/download_file.yml for k8s-master01-lab-20190425, k8s-node01-lab, k8s-node02-lab, k8s-etcd01-lab-20190425 => (item={'key': u'calicoctl', 'value': {u'unarchive': False, u'file': True, u'dest': u'/tmp/releases/calicoctl', u'enabled': True, u'url': u'https://github.com/projectcalico/calicoctl/releases/download/v3.4.4/calicoctl-linux-amd64', u'version': u'v3.4.4', u'mode': u'0755', u'groups': [u'k8s-cluster'], u'owner': u'root', u'sha256': u'93bd084e053cf1bf3b7fef369677bd6767c30fe7135e2c7e044e31693422ef61'}}) included: /kubespray/roles/download/tasks/download_file.yml for k8s-master01-lab-20190425, k8s-node01-lab, k8s-node02-lab => (item={'key': u'hyperkube_file', 'value': {u'unarchive': False, u'file': True, u'dest': u'/tmp/releases/hyperkube', u'enabled': True, u'url': u'https://storage.googleapis.com/kubernetes-release/release/v1.13.5/bin/linux/amd64/hyperkube', u'version': u'v1.13.5', u'mode': u'0755', u'groups': [u'k8s-cluster'], u'owner': u'root', u'sha256': u'1a8a357ebfeab8ec62d0c6f11b59df1a93d6711c3a16e1501da32b55c144c73a'}}) included: /kubespray/roles/download/tasks/download_container.yml for k8s-master01-lab-20190425, k8s-node01-lab, k8s-node02-lab, k8s-etcd01-lab-20190425 => (item={'key': u'nginx', 'value': {u'container': True, u'enabled': True, u'repo': u'docker.io/nginx', u'tag': 1.15, u'groups': [u'kube-node'], u'sha256': u''}}) included: /kubespray/roles/download/tasks/download_container.yml for k8s-master01-lab-20190425, k8s-node01-lab, k8s-node02-lab => (item={'key': u'tiller', 'value': {u'container': True, u'enabled': True, u'repo': u'gcr.io/kubernetes-helm/tiller', u'tag': u'v2.13.1', u'groups': [u'kube-node'], u'sha256': u''}}) included: /kubespray/roles/download/tasks/download_container.yml for k8s-master01-lab-20190425, k8s-node01-lab, k8s-node02-lab, k8s-etcd01-lab-20190425 => (item={'key': u'calico_policy', 'value': {u'container': True, u'enabled': True, u'repo': u'docker.io/calico/kube-controllers', u'tag': u'v3.4.0', u'groups': [u'k8s-cluster'], u'sha256': u''}}) included: /kubespray/roles/download/tasks/download_container.yml for k8s-master01-lab-20190425, k8s-node01-lab, k8s-node02-lab, k8s-etcd01-lab-20190425 => (item={'key': u'nodelocaldns', 'value': {u'container': True, u'enabled': True, u'repo': u'k8s.gcr.io/k8s-dns-node-cache', u'tag': u'1.15.1', u'groups': [u'k8s-cluster'], u'sha256': u''}}) included: /kubespray/roles/download/tasks/download_file.yml for k8s-master01-lab-20190425, k8s-node01-lab, k8s-node02-lab, k8s-etcd01-lab-20190425 => (item={'key': u'cni', 'value': {u'unarchive': False, u'file': True, u'dest': u'/tmp/releases/cni-plugins-amd64-v0.6.0.tgz', u'enabled': True, u'url': u'https://github.com/containernetworking/plugins/releases/download/v0.6.0/cni-plugins-amd64-v0.6.0.tgz', u'version': u'v0.6.0', u'mode': u'0755', u'groups': [u'k8s-cluster'], u'owner': u'root', u'sha256': u'f04339a21b8edf76d415e7f17b620e63b8f37a76b2f706671587ab6464411f2d'}}) included: /kubespray/roles/download/tasks/download_container.yml for k8s-master01-lab-20190425, k8s-node01-lab, k8s-node02-lab, k8s-etcd01-lab-20190425 => (item={'key': u'calico_node', 'value': {u'container': True, u'enabled': True, u'repo': u'docker.io/calico/node', u'tag': u'v3.4.0', u'groups': [u'k8s-cluster'], u'sha256': u''}}) included: /kubespray/roles/download/tasks/download_container.yml for k8s-master01-lab-20190425, k8s-node01-lab, k8s-node02-lab, k8s-etcd01-lab-20190425 => (item={'key': u'coredns', 'value': {u'container': True, u'enabled': True, u'repo': u'docker.io/coredns/coredns', u'tag': u'1.5.0', u'groups': [u'kube-master'], u'sha256': u''}}) included: /kubespray/roles/download/tasks/download_container.yml for k8s-master01-lab-20190425, k8s-node01-lab, k8s-node02-lab, k8s-etcd01-lab-20190425 => (item={'key': u'calico_cni', 'value': {u'container': True, u'enabled': True, u'repo': u'docker.io/calico/cni', u'tag': u'v3.4.0', u'groups': [u'k8s-cluster'], u'sha256': u''}}) included: /kubespray/roles/download/tasks/download_file.yml for k8s-etcd01-lab-20190425 => (item={'key': u'kubeadm', 'value': {u'unarchive': False, u'file': True, u'dest': u'/tmp/releases/kubeadm', u'enabled': True, u'url': u'https://storage.googleapis.com/kubernetes-release/release/v1.14.1/bin/linux/amd64/kubeadm', u'version': u'v1.14.1', u'mode': u'0755', u'groups': [u'k8s-cluster'], u'owner': u'root', u'sha256': u'c4fc478572b5623857f5d820e1c107ae02049ca02cf2993e512a091a0196957b'}}) included: /kubespray/roles/download/tasks/download_container.yml for k8s-etcd01-lab-20190425 => (item={'key': u'local_path_provisioner', 'value': {u'container': True, u'enabled': u'false', u'repo': u'docker.io/rancher/local-path-provisioner', u'tag': u'v0.0.2', u'groups': [u'kube-node'], u'sha256': u''}}) included: /kubespray/roles/download/tasks/download_file.yml for k8s-etcd01-lab-20190425 => (item={'key': u'hyperkube_file', 'value': {u'unarchive': False, u'file': True, u'dest': u'/tmp/releases/hyperkube', u'enabled': True, u'url': u'https://storage.googleapis.com/kubernetes-release/release/v1.14.1/bin/linux/amd64/hyperkube', u'version': u'v1.14.1', u'mode': u'0755', u'groups': [u'k8s-cluster'], u'owner': u'root', u'sha256': u'fb34b98da9325feca8daa09bb934dbe6a533aad69c2a5599bbed81b99bb9c267'}}) included: /kubespray/roles/download/tasks/download_container.yml for k8s-etcd01-lab-20190425 => (item={'key': u'dashboard', 'value': {u'container': True, u'enabled': True, u'repo': u'gcr.io/google_containers/kubernetes-dashboard-amd64', u'tag': u'v1.10.1', u'groups': [u'kube-master'], u'sha256': u''}}) included: /kubespray/roles/download/tasks/download_container.yml for k8s-etcd01-lab-20190425 => (item={'key': u'local_volume_provisioner', 'value': {u'container': True, u'enabled': u'false', u'repo': u'quay.io/external_storage/local-volume-provisioner', u'tag': u'v2.1.0', u'groups': [u'kube-node'], u'sha256': u''}}) TASK [download : container_download | Make download decision if pull is required by tag or sha256] *** Thursday 09 May 2019 02:14:50 -0300 (0:00:02.030) 0:01:17.519 ********** included: /kubespray/roles/download/tasks/set_docker_image_facts.yml for k8s-master01-lab-20190425, k8s-node01-lab, k8s-node02-lab, k8s-etcd01-lab-20190425 TASK [download : set_fact] ***************************************************** Thursday 09 May 2019 02:14:51 -0300 (0:00:00.719) 0:01:18.239 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [download : set_fact] ***************************************************** Thursday 09 May 2019 02:14:51 -0300 (0:00:00.318) 0:01:18.558 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [download : Register docker images info] ********************************** Thursday 09 May 2019 02:14:52 -0300 (0:00:00.308) 0:01:18.866 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-etcd01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [download : set_fact] ***************************************************** Thursday 09 May 2019 02:14:52 -0300 (0:00:00.678) 0:01:19.545 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [download : Check the local digest sha256 corresponds to the given image tag] *** Thursday 09 May 2019 02:14:53 -0300 (0:00:00.306) 0:01:19.851 ********** TASK [download : container_download | Download containers if pull is required or told to always pull (delegate)] *** Thursday 09 May 2019 02:14:53 -0300 (0:00:00.287) 0:01:20.139 ********** TASK [download : container_download | Download containers if pull is required or told to always pull (all nodes)] *** Thursday 09 May 2019 02:14:53 -0300 (0:00:00.070) 0:01:20.209 ********** TASK [download : container_download | Make download decision if pull is required by tag or sha256] *** Thursday 09 May 2019 02:14:53 -0300 (0:00:00.287) 0:01:20.497 ********** included: /kubespray/roles/download/tasks/set_docker_image_facts.yml for k8s-master01-lab-20190425, k8s-node01-lab, k8s-node02-lab, k8s-etcd01-lab-20190425 TASK [download : set_fact] ***************************************************** Thursday 09 May 2019 02:14:54 -0300 (0:00:00.734) 0:01:21.231 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [download : set_fact] ***************************************************** Thursday 09 May 2019 02:14:54 -0300 (0:00:00.309) 0:01:21.541 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [download : Register docker images info] ********************************** Thursday 09 May 2019 02:14:55 -0300 (0:00:00.316) 0:01:21.857 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-etcd01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [download : set_fact] ***************************************************** Thursday 09 May 2019 02:14:55 -0300 (0:00:00.685) 0:01:22.543 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [download : Check the local digest sha256 corresponds to the given image tag] *** Thursday 09 May 2019 02:14:56 -0300 (0:00:00.322) 0:01:22.865 ********** TASK [download : container_download | Download containers if pull is required or told to always pull (delegate)] *** Thursday 09 May 2019 02:14:56 -0300 (0:00:00.356) 0:01:23.222 ********** TASK [download : container_download | Download containers if pull is required or told to always pull (all nodes)] *** Thursday 09 May 2019 02:14:56 -0300 (0:00:00.074) 0:01:23.297 ********** changed: [k8s-master01-lab-20190425] TASK [download : container_download | Make download decision if pull is required by tag or sha256] *** Thursday 09 May 2019 02:15:00 -0300 (0:00:03.927) 0:01:27.225 ********** included: /kubespray/roles/download/tasks/set_docker_image_facts.yml for k8s-master01-lab-20190425, k8s-node01-lab, k8s-node02-lab, k8s-etcd01-lab-20190425 TASK [download : set_fact] ***************************************************** Thursday 09 May 2019 02:15:01 -0300 (0:00:00.801) 0:01:28.026 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [download : set_fact] ***************************************************** Thursday 09 May 2019 02:15:01 -0300 (0:00:00.308) 0:01:28.335 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [download : Register docker images info] ********************************** Thursday 09 May 2019 02:15:01 -0300 (0:00:00.295) 0:01:28.630 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-etcd01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [download : set_fact] ***************************************************** Thursday 09 May 2019 02:15:02 -0300 (0:00:00.680) 0:01:29.312 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [download : Check the local digest sha256 corresponds to the given image tag] *** Thursday 09 May 2019 02:15:02 -0300 (0:00:00.293) 0:01:29.605 ********** TASK [download : container_download | Download containers if pull is required or told to always pull (delegate)] *** Thursday 09 May 2019 02:15:03 -0300 (0:00:00.266) 0:01:29.871 ********** TASK [download : container_download | Download containers if pull is required or told to always pull (all nodes)] *** Thursday 09 May 2019 02:15:03 -0300 (0:00:00.066) 0:01:29.937 ********** TASK [download : container_download | Make download decision if pull is required by tag or sha256] *** Thursday 09 May 2019 02:15:03 -0300 (0:00:00.294) 0:01:30.232 ********** included: /kubespray/roles/download/tasks/set_docker_image_facts.yml for k8s-master01-lab-20190425, k8s-node01-lab, k8s-node02-lab TASK [download : set_fact] ***************************************************** Thursday 09 May 2019 02:15:04 -0300 (0:00:00.583) 0:01:30.816 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [download : set_fact] ***************************************************** Thursday 09 May 2019 02:15:04 -0300 (0:00:00.272) 0:01:31.089 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [download : Register docker images info] ********************************** Thursday 09 May 2019 02:15:04 -0300 (0:00:00.264) 0:01:31.354 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [download : set_fact] ***************************************************** Thursday 09 May 2019 02:15:05 -0300 (0:00:00.678) 0:01:32.032 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [download : Check the local digest sha256 corresponds to the given image tag] *** Thursday 09 May 2019 02:15:05 -0300 (0:00:00.267) 0:01:32.300 ********** TASK [download : container_download | Download containers if pull is required or told to always pull (delegate)] *** Thursday 09 May 2019 02:15:05 -0300 (0:00:00.250) 0:01:32.550 ********** TASK [download : container_download | Download containers if pull is required or told to always pull (all nodes)] *** Thursday 09 May 2019 02:15:05 -0300 (0:00:00.069) 0:01:32.620 ********** [WARNING]: noop task does not support when conditional changed: [k8s-node01-lab] changed: [k8s-node02-lab] TASK [download : file_download | Downloading...] ******************************* Thursday 09 May 2019 02:15:08 -0300 (0:00:02.353) 0:01:34.973 ********** ok: [k8s-master01-lab-20190425] => { "msg": [ "URL: https://storage.googleapis.com/kubernetes-release/release/v1.13.5/bin/linux/amd64/kubeadm", "Dest: /tmp/releases/kubeadm" ] } ok: [k8s-node01-lab] => { "msg": [ "URL: https://storage.googleapis.com/kubernetes-release/release/v1.13.5/bin/linux/amd64/kubeadm", "Dest: /tmp/releases/kubeadm" ] } ok: [k8s-node02-lab] => { "msg": [ "URL: https://storage.googleapis.com/kubernetes-release/release/v1.13.5/bin/linux/amd64/kubeadm", "Dest: /tmp/releases/kubeadm" ] } TASK [download : file_download | Create dest directory] ************************ Thursday 09 May 2019 02:15:08 -0300 (0:00:00.267) 0:01:35.241 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [download : file_download | Download item] ******************************** Thursday 09 May 2019 02:15:08 -0300 (0:00:00.370) 0:01:35.612 ********** changed: [k8s-master01-lab-20190425] changed: [k8s-node01-lab] changed: [k8s-node02-lab] TASK [download : file_download | Extract archives] ***************************** Thursday 09 May 2019 02:15:11 -0300 (0:00:02.837) 0:01:38.449 ********** TASK [download : file_download | Downloading...] ******************************* Thursday 09 May 2019 02:15:11 -0300 (0:00:00.224) 0:01:38.673 ********** ok: [k8s-master01-lab-20190425] => { "msg": [ "URL: https://github.com/projectcalico/calicoctl/releases/download/v3.4.4/calicoctl-linux-amd64", "Dest: /tmp/releases/calicoctl" ] } ok: [k8s-node01-lab] => { "msg": [ "URL: https://github.com/projectcalico/calicoctl/releases/download/v3.4.4/calicoctl-linux-amd64", "Dest: /tmp/releases/calicoctl" ] } ok: [k8s-node02-lab] => { "msg": [ "URL: https://github.com/projectcalico/calicoctl/releases/download/v3.4.4/calicoctl-linux-amd64", "Dest: /tmp/releases/calicoctl" ] } ok: [k8s-etcd01-lab-20190425] => { "msg": [ "URL: https://github.com/projectcalico/calicoctl/releases/download/v3.4.4/calicoctl-linux-amd64", "Dest: /tmp/releases/calicoctl" ] } TASK [download : file_download | Create dest directory] ************************ Thursday 09 May 2019 02:15:12 -0300 (0:00:00.430) 0:01:39.104 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [download : file_download | Download item] ******************************** Thursday 09 May 2019 02:15:12 -0300 (0:00:00.515) 0:01:39.619 ********** ok: [k8s-node02-lab] ok: [k8s-node01-lab] ok: [k8s-master01-lab-20190425] TASK [download : file_download | Extract archives] ***************************** Thursday 09 May 2019 02:15:13 -0300 (0:00:00.671) 0:01:40.291 ********** TASK [download : file_download | Downloading...] ******************************* Thursday 09 May 2019 02:15:13 -0300 (0:00:00.253) 0:01:40.545 ********** ok: [k8s-master01-lab-20190425] => { "msg": [ "URL: https://storage.googleapis.com/kubernetes-release/release/v1.13.5/bin/linux/amd64/hyperkube", "Dest: /tmp/releases/hyperkube" ] } ok: [k8s-node01-lab] => { "msg": [ "URL: https://storage.googleapis.com/kubernetes-release/release/v1.13.5/bin/linux/amd64/hyperkube", "Dest: /tmp/releases/hyperkube" ] } ok: [k8s-node02-lab] => { "msg": [ "URL: https://storage.googleapis.com/kubernetes-release/release/v1.13.5/bin/linux/amd64/hyperkube", "Dest: /tmp/releases/hyperkube" ] } TASK [download : file_download | Create dest directory] ************************ Thursday 09 May 2019 02:15:14 -0300 (0:00:00.384) 0:01:40.929 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [download : file_download | Download item] ******************************** Thursday 09 May 2019 02:15:14 -0300 (0:00:00.580) 0:01:41.510 ********** changed: [k8s-master01-lab-20190425] changed: [k8s-node02-lab] changed: [k8s-node01-lab] TASK [download : file_download | Extract archives] ***************************** Thursday 09 May 2019 02:15:23 -0300 (0:00:08.555) 0:01:50.065 ********** TASK [download : container_download | Make download decision if pull is required by tag or sha256] *** Thursday 09 May 2019 02:15:23 -0300 (0:00:00.262) 0:01:50.327 ********** included: /kubespray/roles/download/tasks/set_docker_image_facts.yml for k8s-master01-lab-20190425, k8s-node01-lab, k8s-node02-lab, k8s-etcd01-lab-20190425 TASK [download : set_fact] ***************************************************** Thursday 09 May 2019 02:15:24 -0300 (0:00:00.733) 0:01:51.061 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [download : set_fact] ***************************************************** Thursday 09 May 2019 02:15:24 -0300 (0:00:00.308) 0:01:51.369 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [download : Register docker images info] ********************************** Thursday 09 May 2019 02:15:24 -0300 (0:00:00.296) 0:01:51.666 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-etcd01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [download : set_fact] ***************************************************** Thursday 09 May 2019 02:15:25 -0300 (0:00:00.707) 0:01:52.373 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [download : Check the local digest sha256 corresponds to the given image tag] *** Thursday 09 May 2019 02:15:25 -0300 (0:00:00.293) 0:01:52.667 ********** TASK [download : container_download | Download containers if pull is required or told to always pull (delegate)] *** Thursday 09 May 2019 02:15:26 -0300 (0:00:00.275) 0:01:52.943 ********** TASK [download : container_download | Download containers if pull is required or told to always pull (all nodes)] *** Thursday 09 May 2019 02:15:26 -0300 (0:00:00.069) 0:01:53.012 ********** changed: [k8s-node02-lab] changed: [k8s-node01-lab] TASK [download : container_download | Make download decision if pull is required by tag or sha256] *** Thursday 09 May 2019 02:15:29 -0300 (0:00:02.987) 0:01:56.000 ********** included: /kubespray/roles/download/tasks/set_docker_image_facts.yml for k8s-master01-lab-20190425, k8s-node01-lab, k8s-node02-lab TASK [download : set_fact] ***************************************************** Thursday 09 May 2019 02:15:29 -0300 (0:00:00.593) 0:01:56.593 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [download : set_fact] ***************************************************** Thursday 09 May 2019 02:15:30 -0300 (0:00:00.266) 0:01:56.859 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [download : Register docker images info] ********************************** Thursday 09 May 2019 02:15:30 -0300 (0:00:00.260) 0:01:57.120 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [download : set_fact] ***************************************************** Thursday 09 May 2019 02:15:31 -0300 (0:00:00.785) 0:01:57.906 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [download : Check the local digest sha256 corresponds to the given image tag] *** Thursday 09 May 2019 02:15:31 -0300 (0:00:00.370) 0:01:58.277 ********** TASK [download : container_download | Download containers if pull is required or told to always pull (delegate)] *** Thursday 09 May 2019 02:15:31 -0300 (0:00:00.237) 0:01:58.514 ********** TASK [download : container_download | Download containers if pull is required or told to always pull (all nodes)] *** Thursday 09 May 2019 02:15:31 -0300 (0:00:00.066) 0:01:58.581 ********** TASK [download : container_download | Make download decision if pull is required by tag or sha256] *** Thursday 09 May 2019 02:15:32 -0300 (0:00:00.247) 0:01:58.829 ********** included: /kubespray/roles/download/tasks/set_docker_image_facts.yml for k8s-master01-lab-20190425, k8s-node01-lab, k8s-node02-lab, k8s-etcd01-lab-20190425 TASK [download : set_fact] ***************************************************** Thursday 09 May 2019 02:15:32 -0300 (0:00:00.810) 0:01:59.640 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [download : set_fact] ***************************************************** Thursday 09 May 2019 02:15:33 -0300 (0:00:00.302) 0:01:59.943 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [download : Register docker images info] ********************************** Thursday 09 May 2019 02:15:33 -0300 (0:00:00.310) 0:02:00.253 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-etcd01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [download : set_fact] ***************************************************** Thursday 09 May 2019 02:15:34 -0300 (0:00:00.683) 0:02:00.937 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [download : Check the local digest sha256 corresponds to the given image tag] *** Thursday 09 May 2019 02:15:34 -0300 (0:00:00.302) 0:02:01.239 ********** TASK [download : container_download | Download containers if pull is required or told to always pull (delegate)] *** Thursday 09 May 2019 02:15:34 -0300 (0:00:00.268) 0:02:01.508 ********** TASK [download : container_download | Download containers if pull is required or told to always pull (all nodes)] *** Thursday 09 May 2019 02:15:34 -0300 (0:00:00.066) 0:02:01.575 ********** changed: [k8s-master01-lab-20190425] changed: [k8s-node01-lab] changed: [k8s-node02-lab] TASK [download : container_download | Make download decision if pull is required by tag or sha256] *** Thursday 09 May 2019 02:15:37 -0300 (0:00:03.000) 0:02:04.576 ********** included: /kubespray/roles/download/tasks/set_docker_image_facts.yml for k8s-master01-lab-20190425, k8s-node01-lab, k8s-node02-lab, k8s-etcd01-lab-20190425 TASK [download : set_fact] ***************************************************** Thursday 09 May 2019 02:15:38 -0300 (0:00:00.723) 0:02:05.299 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [download : set_fact] ***************************************************** Thursday 09 May 2019 02:15:38 -0300 (0:00:00.314) 0:02:05.613 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [download : Register docker images info] ********************************** Thursday 09 May 2019 02:15:39 -0300 (0:00:00.298) 0:02:05.912 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-etcd01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [download : set_fact] ***************************************************** Thursday 09 May 2019 02:15:39 -0300 (0:00:00.696) 0:02:06.608 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [download : Check the local digest sha256 corresponds to the given image tag] *** Thursday 09 May 2019 02:15:40 -0300 (0:00:00.295) 0:02:06.904 ********** TASK [download : container_download | Download containers if pull is required or told to always pull (delegate)] *** Thursday 09 May 2019 02:15:40 -0300 (0:00:00.275) 0:02:07.179 ********** TASK [download : container_download | Download containers if pull is required or told to always pull (all nodes)] *** Thursday 09 May 2019 02:15:40 -0300 (0:00:00.072) 0:02:07.251 ********** TASK [download : file_download | Downloading...] ******************************* Thursday 09 May 2019 02:15:40 -0300 (0:00:00.263) 0:02:07.515 ********** ok: [k8s-master01-lab-20190425] => { "msg": [ "URL: https://github.com/containernetworking/plugins/releases/download/v0.6.0/cni-plugins-amd64-v0.6.0.tgz", "Dest: /tmp/releases/cni-plugins-amd64-v0.6.0.tgz" ] } ok: [k8s-node01-lab] => { "msg": [ "URL: https://github.com/containernetworking/plugins/releases/download/v0.6.0/cni-plugins-amd64-v0.6.0.tgz", "Dest: /tmp/releases/cni-plugins-amd64-v0.6.0.tgz" ] } ok: [k8s-node02-lab] => { "msg": [ "URL: https://github.com/containernetworking/plugins/releases/download/v0.6.0/cni-plugins-amd64-v0.6.0.tgz", "Dest: /tmp/releases/cni-plugins-amd64-v0.6.0.tgz" ] } ok: [k8s-etcd01-lab-20190425] => { "msg": [ "URL: https://github.com/containernetworking/plugins/releases/download/v0.6.0/cni-plugins-amd64-v0.6.0.tgz", "Dest: /tmp/releases/cni-plugins-amd64-v0.6.0.tgz" ] } TASK [download : file_download | Create dest directory] ************************ Thursday 09 May 2019 02:15:41 -0300 (0:00:00.289) 0:02:07.805 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [download : file_download | Download item] ******************************** Thursday 09 May 2019 02:15:41 -0300 (0:00:00.377) 0:02:08.183 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [download : file_download | Extract archives] ***************************** Thursday 09 May 2019 02:15:41 -0300 (0:00:00.477) 0:02:08.661 ********** TASK [download : container_download | Make download decision if pull is required by tag or sha256] *** Thursday 09 May 2019 02:15:42 -0300 (0:00:00.297) 0:02:08.959 ********** included: /kubespray/roles/download/tasks/set_docker_image_facts.yml for k8s-master01-lab-20190425, k8s-node01-lab, k8s-node02-lab, k8s-etcd01-lab-20190425 TASK [download : set_fact] ***************************************************** Thursday 09 May 2019 02:15:43 -0300 (0:00:00.838) 0:02:09.797 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [download : set_fact] ***************************************************** Thursday 09 May 2019 02:15:43 -0300 (0:00:00.323) 0:02:10.121 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [download : Register docker images info] ********************************** Thursday 09 May 2019 02:15:43 -0300 (0:00:00.310) 0:02:10.432 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-etcd01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [download : set_fact] ***************************************************** Thursday 09 May 2019 02:15:44 -0300 (0:00:00.710) 0:02:11.142 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [download : Check the local digest sha256 corresponds to the given image tag] *** Thursday 09 May 2019 02:15:44 -0300 (0:00:00.306) 0:02:11.449 ********** TASK [download : container_download | Download containers if pull is required or told to always pull (delegate)] *** Thursday 09 May 2019 02:15:45 -0300 (0:00:00.288) 0:02:11.737 ********** TASK [download : container_download | Download containers if pull is required or told to always pull (all nodes)] *** Thursday 09 May 2019 02:15:45 -0300 (0:00:00.073) 0:02:11.810 ********** changed: [k8s-master01-lab-20190425] changed: [k8s-node01-lab] changed: [k8s-node02-lab] TASK [download : container_download | Make download decision if pull is required by tag or sha256] *** Thursday 09 May 2019 02:15:48 -0300 (0:00:03.066) 0:02:14.877 ********** included: /kubespray/roles/download/tasks/set_docker_image_facts.yml for k8s-master01-lab-20190425, k8s-node01-lab, k8s-node02-lab, k8s-etcd01-lab-20190425 TASK [download : set_fact] ***************************************************** Thursday 09 May 2019 02:15:48 -0300 (0:00:00.718) 0:02:15.595 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [download : set_fact] ***************************************************** Thursday 09 May 2019 02:15:49 -0300 (0:00:00.295) 0:02:15.890 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [download : Register docker images info] ********************************** Thursday 09 May 2019 02:15:49 -0300 (0:00:00.297) 0:02:16.187 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-etcd01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [download : set_fact] ***************************************************** Thursday 09 May 2019 02:15:50 -0300 (0:00:00.694) 0:02:16.882 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [download : Check the local digest sha256 corresponds to the given image tag] *** Thursday 09 May 2019 02:15:50 -0300 (0:00:00.298) 0:02:17.180 ********** TASK [download : container_download | Download containers if pull is required or told to always pull (delegate)] *** Thursday 09 May 2019 02:15:50 -0300 (0:00:00.275) 0:02:17.456 ********** TASK [download : container_download | Download containers if pull is required or told to always pull (all nodes)] *** Thursday 09 May 2019 02:15:50 -0300 (0:00:00.068) 0:02:17.524 ********** changed: [k8s-master01-lab-20190425] TASK [download : container_download | Make download decision if pull is required by tag or sha256] *** Thursday 09 May 2019 02:15:53 -0300 (0:00:02.978) 0:02:20.503 ********** included: /kubespray/roles/download/tasks/set_docker_image_facts.yml for k8s-master01-lab-20190425, k8s-node01-lab, k8s-node02-lab, k8s-etcd01-lab-20190425 TASK [download : set_fact] ***************************************************** Thursday 09 May 2019 02:15:54 -0300 (0:00:00.711) 0:02:21.215 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [download : set_fact] ***************************************************** Thursday 09 May 2019 02:15:54 -0300 (0:00:00.424) 0:02:21.639 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [download : Register docker images info] ********************************** Thursday 09 May 2019 02:15:55 -0300 (0:00:00.411) 0:02:22.051 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-etcd01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [download : set_fact] ***************************************************** Thursday 09 May 2019 02:15:56 -0300 (0:00:00.681) 0:02:22.732 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] ok: [k8s-etcd01-lab-20190425] TASK [download : Check the local digest sha256 corresponds to the given image tag] *** Thursday 09 May 2019 02:15:56 -0300 (0:00:00.300) 0:02:23.033 ********** TASK [download : container_download | Download containers if pull is required or told to always pull (delegate)] *** Thursday 09 May 2019 02:15:56 -0300 (0:00:00.279) 0:02:23.312 ********** TASK [download : container_download | Download containers if pull is required or told to always pull (all nodes)] *** Thursday 09 May 2019 02:15:56 -0300 (0:00:00.069) 0:02:23.381 ********** changed: [k8s-node01-lab] changed: [k8s-master01-lab-20190425] changed: [k8s-node02-lab] TASK [download : file_download | Downloading...] ******************************* Thursday 09 May 2019 02:15:59 -0300 (0:00:03.027) 0:02:26.409 ********** ok: [k8s-etcd01-lab-20190425] => { "msg": [ "URL: https://storage.googleapis.com/kubernetes-release/release/v1.14.1/bin/linux/amd64/kubeadm", "Dest: /tmp/releases/kubeadm" ] } TASK [download : file_download | Create dest directory] ************************ Thursday 09 May 2019 02:15:59 -0300 (0:00:00.117) 0:02:26.526 ********** TASK [download : file_download | Download item] ******************************** Thursday 09 May 2019 02:15:59 -0300 (0:00:00.076) 0:02:26.603 ********** TASK [download : file_download | Extract archives] ***************************** Thursday 09 May 2019 02:15:59 -0300 (0:00:00.075) 0:02:26.678 ********** TASK [download : container_download | Make download decision if pull is required by tag or sha256] *** Thursday 09 May 2019 02:16:00 -0300 (0:00:00.109) 0:02:26.787 ********** included: /kubespray/roles/download/tasks/set_docker_image_facts.yml for k8s-etcd01-lab-20190425 TASK [download : set_fact] ***************************************************** Thursday 09 May 2019 02:16:00 -0300 (0:00:00.249) 0:02:27.037 ********** ok: [k8s-etcd01-lab-20190425] TASK [download : set_fact] ***************************************************** Thursday 09 May 2019 02:16:00 -0300 (0:00:00.124) 0:02:27.161 ********** ok: [k8s-etcd01-lab-20190425] TASK [download : Register docker images info] ********************************** Thursday 09 May 2019 02:16:00 -0300 (0:00:00.122) 0:02:27.284 ********** ok: [k8s-etcd01-lab-20190425] TASK [download : set_fact] ***************************************************** Thursday 09 May 2019 02:16:00 -0300 (0:00:00.290) 0:02:27.575 ********** ok: [k8s-etcd01-lab-20190425] TASK [download : Check the local digest sha256 corresponds to the given image tag] *** Thursday 09 May 2019 02:16:00 -0300 (0:00:00.118) 0:02:27.693 ********** TASK [download : container_download | Download containers if pull is required or told to always pull (delegate)] *** Thursday 09 May 2019 02:16:01 -0300 (0:00:00.097) 0:02:27.791 ********** TASK [download : container_download | Download containers if pull is required or told to always pull (all nodes)] *** Thursday 09 May 2019 02:16:01 -0300 (0:00:00.058) 0:02:27.849 ********** TASK [download : file_download | Downloading...] ******************************* Thursday 09 May 2019 02:16:01 -0300 (0:00:00.074) 0:02:27.924 ********** ok: [k8s-etcd01-lab-20190425] => { "msg": [ "URL: https://storage.googleapis.com/kubernetes-release/release/v1.14.1/bin/linux/amd64/hyperkube", "Dest: /tmp/releases/hyperkube" ] } TASK [download : file_download | Create dest directory] ************************ Thursday 09 May 2019 02:16:01 -0300 (0:00:00.114) 0:02:28.038 ********** TASK [download : file_download | Download item] ******************************** Thursday 09 May 2019 02:16:01 -0300 (0:00:00.069) 0:02:28.107 ********** TASK [download : file_download | Extract archives] ***************************** Thursday 09 May 2019 02:16:01 -0300 (0:00:00.072) 0:02:28.179 ********** TASK [download : container_download | Make download decision if pull is required by tag or sha256] *** Thursday 09 May 2019 02:16:01 -0300 (0:00:00.107) 0:02:28.287 ********** included: /kubespray/roles/download/tasks/set_docker_image_facts.yml for k8s-etcd01-lab-20190425 TASK [download : set_fact] ***************************************************** Thursday 09 May 2019 02:16:01 -0300 (0:00:00.187) 0:02:28.475 ********** ok: [k8s-etcd01-lab-20190425] TASK [download : set_fact] ***************************************************** Thursday 09 May 2019 02:16:01 -0300 (0:00:00.117) 0:02:28.593 ********** ok: [k8s-etcd01-lab-20190425] TASK [download : Register docker images info] ********************************** Thursday 09 May 2019 02:16:02 -0300 (0:00:00.115) 0:02:28.708 ********** ok: [k8s-etcd01-lab-20190425] TASK [download : set_fact] ***************************************************** Thursday 09 May 2019 02:16:02 -0300 (0:00:00.295) 0:02:29.003 ********** ok: [k8s-etcd01-lab-20190425] TASK [download : Check the local digest sha256 corresponds to the given image tag] *** Thursday 09 May 2019 02:16:02 -0300 (0:00:00.118) 0:02:29.122 ********** TASK [download : container_download | Download containers if pull is required or told to always pull (delegate)] *** Thursday 09 May 2019 02:16:02 -0300 (0:00:00.098) 0:02:29.220 ********** TASK [download : container_download | Download containers if pull is required or told to always pull (all nodes)] *** Thursday 09 May 2019 02:16:02 -0300 (0:00:00.067) 0:02:29.287 ********** TASK [download : container_download | Make download decision if pull is required by tag or sha256] *** Thursday 09 May 2019 02:16:02 -0300 (0:00:00.113) 0:02:29.400 ********** included: /kubespray/roles/download/tasks/set_docker_image_facts.yml for k8s-etcd01-lab-20190425 TASK [download : set_fact] ***************************************************** Thursday 09 May 2019 02:16:02 -0300 (0:00:00.178) 0:02:29.579 ********** ok: [k8s-etcd01-lab-20190425] TASK [download : set_fact] ***************************************************** Thursday 09 May 2019 02:16:02 -0300 (0:00:00.118) 0:02:29.697 ********** ok: [k8s-etcd01-lab-20190425] TASK [download : Register docker images info] ********************************** Thursday 09 May 2019 02:16:03 -0300 (0:00:00.114) 0:02:29.812 ********** ok: [k8s-etcd01-lab-20190425] TASK [download : set_fact] ***************************************************** Thursday 09 May 2019 02:16:03 -0300 (0:00:00.300) 0:02:30.113 ********** ok: [k8s-etcd01-lab-20190425] TASK [download : Check the local digest sha256 corresponds to the given image tag] *** Thursday 09 May 2019 02:16:03 -0300 (0:00:00.120) 0:02:30.233 ********** TASK [download : container_download | Download containers if pull is required or told to always pull (delegate)] *** Thursday 09 May 2019 02:16:03 -0300 (0:00:00.099) 0:02:30.332 ********** TASK [download : container_download | Download containers if pull is required or told to always pull (all nodes)] *** Thursday 09 May 2019 02:16:03 -0300 (0:00:00.059) 0:02:30.392 ********** TASK [download : Sync container] *********************************************** Thursday 09 May 2019 02:16:03 -0300 (0:00:00.086) 0:02:30.478 ********** TASK [download : include_tasks] ************************************************ Thursday 09 May 2019 02:16:05 -0300 (0:00:01.287) 0:02:31.765 ********** included: /kubespray/roles/download/tasks/kubeadm_images.yml for k8s-master01-lab-20190425 TASK [download : kubeadm | Create kubeadm config] ****************************** Thursday 09 May 2019 02:16:05 -0300 (0:00:00.394) 0:02:32.160 ********** changed: [k8s-master01-lab-20190425] TASK [download : kubeadm | Copy kubeadm binary from download dir] ************** Thursday 09 May 2019 02:16:06 -0300 (0:00:00.885) 0:02:33.046 ********** changed: [k8s-master01-lab-20190425 -> k8s-master01-lab-20190425] TASK [download : kubeadm | Set kubeadm binary permissions] ********************* Thursday 09 May 2019 02:16:06 -0300 (0:00:00.585) 0:02:33.632 ********** ok: [k8s-master01-lab-20190425] TASK [download : container_download | download images for kubeadm config images] *** Thursday 09 May 2019 02:16:07 -0300 (0:00:00.319) 0:02:33.951 ********** changed: [k8s-master01-lab-20190425] PLAY [etcd] ******************************************************************** TASK [download : include_tasks] ************************************************ Thursday 09 May 2019 02:16:36 -0300 (0:00:29.305) 0:03:03.256 ********** TASK [download : Download items] *********************************************** Thursday 09 May 2019 02:16:36 -0300 (0:00:00.062) 0:03:03.319 ********** TASK [download : Sync container] *********************************************** Thursday 09 May 2019 02:16:37 -0300 (0:00:00.644) 0:03:03.963 ********** TASK [download : include_tasks] ************************************************ Thursday 09 May 2019 02:16:37 -0300 (0:00:00.667) 0:03:04.631 ********** TASK [kubespray-defaults : Configure defaults] ********************************* Thursday 09 May 2019 02:16:37 -0300 (0:00:00.060) 0:03:04.691 ********** ok: [k8s-etcd01-lab-20190425] => { "msg": "Check roles/kubespray-defaults/defaults/main.yml" } TASK [adduser : User | Create User Group] ************************************** Thursday 09 May 2019 02:16:38 -0300 (0:00:00.089) 0:03:04.780 ********** ok: [k8s-etcd01-lab-20190425] TASK [adduser : User | Create User] ******************************************** Thursday 09 May 2019 02:16:38 -0300 (0:00:00.207) 0:03:04.988 ********** ok: [k8s-etcd01-lab-20190425] TASK [adduser : User | Create User Group] ************************************** Thursday 09 May 2019 02:16:38 -0300 (0:00:00.245) 0:03:05.234 ********** ok: [k8s-etcd01-lab-20190425] TASK [adduser : User | Create User] ******************************************** Thursday 09 May 2019 02:16:38 -0300 (0:00:00.204) 0:03:05.438 ********** ok: [k8s-etcd01-lab-20190425] TASK [etcd : set_fact] ********************************************************* Thursday 09 May 2019 02:16:38 -0300 (0:00:00.227) 0:03:05.665 ********** ok: [k8s-etcd01-lab-20190425] TASK [etcd : ansible_architecture_rename] ************************************** Thursday 09 May 2019 02:16:39 -0300 (0:00:00.094) 0:03:05.760 ********** ok: [k8s-etcd01-lab-20190425] TASK [etcd : include_tasks] **************************************************** Thursday 09 May 2019 02:16:39 -0300 (0:00:00.096) 0:03:05.857 ********** included: /kubespray/roles/etcd/tasks/check_certs.yml for k8s-etcd01-lab-20190425 TASK [etcd : Check_certs | check if all certs have already been generated on first master] *** Thursday 09 May 2019 02:16:39 -0300 (0:00:00.111) 0:03:05.968 ********** ok: [k8s-etcd01-lab-20190425 -> k8s-etcd01-lab-20190425] TASK [etcd : Check_certs | Set default value for 'sync_certs', 'gen_certs' and 'etcd_secret_changed' to false] *** Thursday 09 May 2019 02:16:39 -0300 (0:00:00.335) 0:03:06.304 ********** ok: [k8s-etcd01-lab-20190425] TASK [etcd : Check certs | check if a cert already exists on node] ************* Thursday 09 May 2019 02:16:39 -0300 (0:00:00.096) 0:03:06.400 ********** ok: [k8s-etcd01-lab-20190425] => (item=ca.pem) ok: [k8s-etcd01-lab-20190425] => (item=node-k8s-etcd01-lab-20190425-key.pem) TASK [etcd : Check_certs | Set 'gen_certs' to true] **************************** Thursday 09 May 2019 02:16:40 -0300 (0:00:00.320) 0:03:06.720 ********** ok: [k8s-etcd01-lab-20190425] => (item=/etc/ssl/etcd/ssl/node-k8s-etcd01-lab-20190425-key.pem) TASK [etcd : Check_certs | Set 'gen_node_certs' to true] *********************** Thursday 09 May 2019 02:16:40 -0300 (0:00:00.159) 0:03:06.880 ********** ok: [k8s-etcd01-lab-20190425] TASK [etcd : Check_certs | Set 'sync_certs' to true] *************************** Thursday 09 May 2019 02:16:40 -0300 (0:00:00.100) 0:03:06.980 ********** ok: [k8s-etcd01-lab-20190425] TASK [etcd : include_tasks] **************************************************** Thursday 09 May 2019 02:16:40 -0300 (0:00:00.107) 0:03:07.088 ********** included: /kubespray/roles/etcd/tasks/gen_certs_script.yml for k8s-etcd01-lab-20190425 TASK [etcd : Gen_certs | create etcd cert dir] ********************************* Thursday 09 May 2019 02:16:40 -0300 (0:00:00.114) 0:03:07.202 ********** changed: [k8s-etcd01-lab-20190425] TASK [etcd : Gen_certs | create etcd script dir (on k8s-etcd01-lab-20190425)] *** Thursday 09 May 2019 02:16:40 -0300 (0:00:00.228) 0:03:07.431 ********** ok: [k8s-etcd01-lab-20190425 -> k8s-etcd01-lab-20190425] TASK [etcd : Gen_certs | create etcd cert dir (on k8s-etcd01-lab-20190425)] **** Thursday 09 May 2019 02:16:40 -0300 (0:00:00.228) 0:03:07.660 ********** ok: [k8s-etcd01-lab-20190425 -> k8s-etcd01-lab-20190425] TASK [etcd : Gen_certs | write openssl config] ********************************* Thursday 09 May 2019 02:16:41 -0300 (0:00:00.232) 0:03:07.892 ********** ok: [k8s-etcd01-lab-20190425 -> k8s-etcd01-lab-20190425] TASK [etcd : Gen_certs | copy certs generation script] ************************* Thursday 09 May 2019 02:16:41 -0300 (0:00:00.619) 0:03:08.512 ********** ok: [k8s-etcd01-lab-20190425 -> k8s-etcd01-lab-20190425] TASK [etcd : Gen_certs | run cert generation script] *************************** Thursday 09 May 2019 02:16:42 -0300 (0:00:00.416) 0:03:08.929 ********** changed: [k8s-etcd01-lab-20190425 -> k8s-etcd01-lab-20190425] TASK [etcd : Gen_certs | Gather etcd master certs] ***************************** Thursday 09 May 2019 02:16:42 -0300 (0:00:00.556) 0:03:09.486 ********** TASK [etcd : Gen_certs | Write etcd master certs] ****************************** Thursday 09 May 2019 02:16:42 -0300 (0:00:00.218) 0:03:09.704 ********** TASK [etcd : set_fact] ********************************************************* Thursday 09 May 2019 02:16:43 -0300 (0:00:00.218) 0:03:09.922 ********** ok: [k8s-etcd01-lab-20190425] TASK [etcd : Check_certs | Set 'sync_certs' to true on nodes] ****************** Thursday 09 May 2019 02:16:43 -0300 (0:00:00.091) 0:03:10.013 ********** TASK [etcd : Gen_certs | Gather node certs] ************************************ Thursday 09 May 2019 02:16:43 -0300 (0:00:00.106) 0:03:10.119 ********** TASK [etcd : Gen_certs | Copy certs on nodes] ********************************** Thursday 09 May 2019 02:16:43 -0300 (0:00:00.057) 0:03:10.177 ********** TASK [etcd : Gen_certs | check certificate permissions] ************************ Thursday 09 May 2019 02:16:43 -0300 (0:00:00.055) 0:03:10.233 ********** changed: [k8s-etcd01-lab-20190425] TASK [etcd : include_tasks] **************************************************** Thursday 09 May 2019 02:16:43 -0300 (0:00:00.206) 0:03:10.439 ********** included: /kubespray/roles/etcd/tasks/upd_ca_trust.yml for k8s-etcd01-lab-20190425 TASK [etcd : Gen_certs | target ca-certificate store file] ********************* Thursday 09 May 2019 02:16:43 -0300 (0:00:00.091) 0:03:10.531 ********** ok: [k8s-etcd01-lab-20190425] TASK [etcd : Gen_certs | add CA to trusted CA dir] ***************************** Thursday 09 May 2019 02:16:43 -0300 (0:00:00.095) 0:03:10.626 ********** ok: [k8s-etcd01-lab-20190425] TASK [etcd : Gen_certs | update ca-certificates (Debian/Ubuntu/SUSE/Container Linux by CoreOS)] *** Thursday 09 May 2019 02:16:44 -0300 (0:00:00.225) 0:03:10.852 ********** TASK [etcd : Gen_certs | update ca-certificates (RedHat)] ********************** Thursday 09 May 2019 02:16:44 -0300 (0:00:00.056) 0:03:10.908 ********** TASK [etcd : Gen_certs | update ca-certificates (ClearLinux)] ****************** Thursday 09 May 2019 02:16:44 -0300 (0:00:00.053) 0:03:10.962 ********** TASK [etcd : Gen_certs | Get etcd certificate serials] ************************* Thursday 09 May 2019 02:16:44 -0300 (0:00:00.052) 0:03:11.015 ********** TASK [etcd : Set etcd_client_cert_serial] ************************************** Thursday 09 May 2019 02:16:44 -0300 (0:00:00.053) 0:03:11.069 ********** TASK [etcd : include_tasks] **************************************************** Thursday 09 May 2019 02:16:44 -0300 (0:00:00.053) 0:03:11.122 ********** included: /kubespray/roles/etcd/tasks/install_docker.yml for k8s-etcd01-lab-20190425 TASK [etcd : Install | Copy etcdctl binary from docker container] ************** Thursday 09 May 2019 02:16:44 -0300 (0:00:00.099) 0:03:11.222 ********** ok: [k8s-etcd01-lab-20190425] TASK [etcd : Install etcd launch script] *************************************** Thursday 09 May 2019 02:16:45 -0300 (0:00:00.531) 0:03:11.754 ********** ok: [k8s-etcd01-lab-20190425] TASK [etcd : Install etcd-events launch script] ******************************** Thursday 09 May 2019 02:16:45 -0300 (0:00:00.384) 0:03:12.138 ********** TASK [etcd : include_tasks] **************************************************** Thursday 09 May 2019 02:16:45 -0300 (0:00:00.052) 0:03:12.191 ********** included: /kubespray/roles/etcd/tasks/configure.yml for k8s-etcd01-lab-20190425 TASK [etcd : Configure | Check if etcd cluster is healthy] ********************* Thursday 09 May 2019 02:16:45 -0300 (0:00:00.120) 0:03:12.312 ********** ok: [k8s-etcd01-lab-20190425] TASK [etcd : Configure | Check if etcd-events cluster is healthy] ************** Thursday 09 May 2019 02:16:46 -0300 (0:00:00.445) 0:03:12.757 ********** TASK [etcd : include_tasks] **************************************************** Thursday 09 May 2019 02:16:46 -0300 (0:00:00.057) 0:03:12.815 ********** included: /kubespray/roles/etcd/tasks/refresh_config.yml for k8s-etcd01-lab-20190425 TASK [etcd : Refresh config | Create etcd config file] ************************* Thursday 09 May 2019 02:16:46 -0300 (0:00:00.085) 0:03:12.901 ********** ok: [k8s-etcd01-lab-20190425] TASK [etcd : Refresh config | Create etcd-events config file] ****************** Thursday 09 May 2019 02:16:46 -0300 (0:00:00.611) 0:03:13.512 ********** TASK [etcd : Configure | Copy etcd.service systemd file] *********************** Thursday 09 May 2019 02:16:46 -0300 (0:00:00.059) 0:03:13.571 ********** ok: [k8s-etcd01-lab-20190425] TASK [etcd : Configure | Copy etcd-events.service systemd file] **************** Thursday 09 May 2019 02:16:47 -0300 (0:00:00.376) 0:03:13.948 ********** TASK [etcd : Configure | reload systemd] *************************************** Thursday 09 May 2019 02:16:47 -0300 (0:00:00.057) 0:03:14.006 ********** ok: [k8s-etcd01-lab-20190425] TASK [etcd : Configure | Ensure etcd is running] ******************************* Thursday 09 May 2019 02:16:47 -0300 (0:00:00.378) 0:03:14.385 ********** ok: [k8s-etcd01-lab-20190425] TASK [etcd : Configure | Ensure etcd-events is running] ************************ Thursday 09 May 2019 02:16:47 -0300 (0:00:00.274) 0:03:14.660 ********** TASK [etcd : Configure | Check if etcd cluster is healthy] ********************* Thursday 09 May 2019 02:16:48 -0300 (0:00:00.055) 0:03:14.716 ********** ok: [k8s-etcd01-lab-20190425] TASK [etcd : Configure | Check if etcd-events cluster is healthy] ************** Thursday 09 May 2019 02:16:48 -0300 (0:00:00.457) 0:03:15.173 ********** TASK [etcd : Configure | Check if member is in etcd cluster] ******************* Thursday 09 May 2019 02:16:48 -0300 (0:00:00.059) 0:03:15.233 ********** ok: [k8s-etcd01-lab-20190425] TASK [etcd : Configure | Check if member is in etcd-events cluster] ************ Thursday 09 May 2019 02:16:48 -0300 (0:00:00.426) 0:03:15.660 ********** TASK [etcd : Configure | Join member(s) to etcd cluster one at a time] ********* Thursday 09 May 2019 02:16:49 -0300 (0:00:00.058) 0:03:15.719 ********** TASK [etcd : Configure | Join member(s) to etcd-events cluster one at a time] *** Thursday 09 May 2019 02:16:49 -0300 (0:00:00.062) 0:03:15.782 ********** TASK [etcd : include_tasks] **************************************************** Thursday 09 May 2019 02:16:49 -0300 (0:00:00.063) 0:03:15.845 ********** included: /kubespray/roles/etcd/tasks/refresh_config.yml for k8s-etcd01-lab-20190425 TASK [etcd : Refresh config | Create etcd config file] ************************* Thursday 09 May 2019 02:16:49 -0300 (0:00:00.095) 0:03:15.940 ********** ok: [k8s-etcd01-lab-20190425] TASK [etcd : Refresh config | Create etcd-events config file] ****************** Thursday 09 May 2019 02:16:49 -0300 (0:00:00.600) 0:03:16.541 ********** TASK [etcd : Restart etcd if certs changed] ************************************ Thursday 09 May 2019 02:16:49 -0300 (0:00:00.057) 0:03:16.599 ********** TASK [etcd : Restart etcd-events if certs changed] ***************************** Thursday 09 May 2019 02:16:49 -0300 (0:00:00.057) 0:03:16.657 ********** TASK [etcd : include_tasks] **************************************************** Thursday 09 May 2019 02:16:50 -0300 (0:00:00.057) 0:03:16.715 ********** included: /kubespray/roles/etcd/tasks/refresh_config.yml for k8s-etcd01-lab-20190425 TASK [etcd : Refresh config | Create etcd config file] ************************* Thursday 09 May 2019 02:16:50 -0300 (0:00:00.095) 0:03:16.810 ********** ok: [k8s-etcd01-lab-20190425] TASK [etcd : Refresh config | Create etcd-events config file] ****************** Thursday 09 May 2019 02:16:50 -0300 (0:00:00.607) 0:03:17.418 ********** RUNNING HANDLER [etcd : set etcd_secret_changed] ******************************* Thursday 09 May 2019 02:16:50 -0300 (0:00:00.039) 0:03:17.458 ********** ok: [k8s-etcd01-lab-20190425] PLAY [k8s-cluster:calico-rr] *************************************************** TASK [download : include_tasks] ************************************************ Thursday 09 May 2019 02:16:50 -0300 (0:00:00.142) 0:03:17.600 ********** TASK [download : Download items] *********************************************** Thursday 09 May 2019 02:16:51 -0300 (0:00:00.197) 0:03:17.797 ********** TASK [download : Sync container] *********************************************** Thursday 09 May 2019 02:16:51 -0300 (0:00:00.784) 0:03:18.582 ********** TASK [download : include_tasks] ************************************************ Thursday 09 May 2019 02:16:52 -0300 (0:00:00.797) 0:03:19.379 ********** TASK [kubespray-defaults : Configure defaults] ********************************* Thursday 09 May 2019 02:16:52 -0300 (0:00:00.198) 0:03:19.578 ********** ok: [k8s-master01-lab-20190425] => { "msg": "Check roles/kubespray-defaults/defaults/main.yml" } ok: [k8s-node01-lab] => { "msg": "Check roles/kubespray-defaults/defaults/main.yml" } ok: [k8s-node02-lab] => { "msg": "Check roles/kubespray-defaults/defaults/main.yml" } TASK [adduser : User | Create User Group] ************************************** Thursday 09 May 2019 02:16:53 -0300 (0:00:00.350) 0:03:19.929 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [adduser : User | Create User] ******************************************** Thursday 09 May 2019 02:16:53 -0300 (0:00:00.492) 0:03:20.421 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [adduser : User | Create User Group] ************************************** Thursday 09 May 2019 02:16:54 -0300 (0:00:00.504) 0:03:20.926 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [adduser : User | Create User] ******************************************** Thursday 09 May 2019 02:16:54 -0300 (0:00:00.471) 0:03:21.397 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [etcd : set_fact] ********************************************************* Thursday 09 May 2019 02:16:55 -0300 (0:00:00.526) 0:03:21.923 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [etcd : ansible_architecture_rename] ************************************** Thursday 09 May 2019 02:16:55 -0300 (0:00:00.433) 0:03:22.357 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [etcd : include_tasks] **************************************************** Thursday 09 May 2019 02:16:55 -0300 (0:00:00.258) 0:03:22.616 ********** included: /kubespray/roles/etcd/tasks/check_certs.yml for k8s-master01-lab-20190425, k8s-node01-lab, k8s-node02-lab TASK [etcd : Check_certs | check if all certs have already been generated on first master] *** Thursday 09 May 2019 02:16:56 -0300 (0:00:00.382) 0:03:22.999 ********** ok: [k8s-master01-lab-20190425 -> k8s-etcd01-lab-20190425] TASK [etcd : Check_certs | Set default value for 'sync_certs', 'gen_certs' and 'etcd_secret_changed' to false] *** Thursday 09 May 2019 02:16:56 -0300 (0:00:00.232) 0:03:23.231 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [etcd : Check certs | check if a cert already exists on node] ************* Thursday 09 May 2019 02:16:56 -0300 (0:00:00.250) 0:03:23.482 ********** ok: [k8s-master01-lab-20190425] => (item=ca.pem) ok: [k8s-node01-lab] => (item=ca.pem) ok: [k8s-master01-lab-20190425] => (item=node-k8s-master01-lab-20190425-key.pem) ok: [k8s-node02-lab] => (item=ca.pem) ok: [k8s-node01-lab] => (item=node-k8s-node01-lab-key.pem) ok: [k8s-node02-lab] => (item=node-k8s-node02-lab-key.pem) TASK [etcd : Check_certs | Set 'gen_certs' to true] **************************** Thursday 09 May 2019 02:16:57 -0300 (0:00:00.499) 0:03:23.981 ********** ok: [k8s-master01-lab-20190425] => (item=/etc/ssl/etcd/ssl/node-k8s-etcd01-lab-20190425-key.pem) TASK [etcd : Check_certs | Set 'gen_node_certs' to true] *********************** Thursday 09 May 2019 02:16:57 -0300 (0:00:00.182) 0:03:24.163 ********** ok: [k8s-master01-lab-20190425] TASK [etcd : Check_certs | Set 'sync_certs' to true] *************************** Thursday 09 May 2019 02:16:57 -0300 (0:00:00.111) 0:03:24.275 ********** TASK [etcd : include_tasks] **************************************************** Thursday 09 May 2019 02:16:57 -0300 (0:00:00.199) 0:03:24.475 ********** included: /kubespray/roles/etcd/tasks/gen_certs_script.yml for k8s-master01-lab-20190425, k8s-node01-lab, k8s-node02-lab TASK [etcd : Gen_certs | create etcd cert dir] ********************************* Thursday 09 May 2019 02:16:58 -0300 (0:00:00.357) 0:03:24.832 ********** changed: [k8s-master01-lab-20190425] changed: [k8s-node01-lab] changed: [k8s-node02-lab] TASK [etcd : Gen_certs | create etcd script dir (on k8s-etcd01-lab-20190425)] *** Thursday 09 May 2019 02:16:58 -0300 (0:00:00.361) 0:03:25.193 ********** TASK [etcd : Gen_certs | create etcd cert dir (on k8s-etcd01-lab-20190425)] **** Thursday 09 May 2019 02:16:58 -0300 (0:00:00.092) 0:03:25.286 ********** TASK [etcd : Gen_certs | write openssl config] ********************************* Thursday 09 May 2019 02:16:58 -0300 (0:00:00.088) 0:03:25.374 ********** TASK [etcd : Gen_certs | copy certs generation script] ************************* Thursday 09 May 2019 02:16:58 -0300 (0:00:00.107) 0:03:25.482 ********** TASK [etcd : Gen_certs | run cert generation script] *************************** Thursday 09 May 2019 02:16:58 -0300 (0:00:00.094) 0:03:25.576 ********** changed: [k8s-master01-lab-20190425 -> k8s-etcd01-lab-20190425] TASK [etcd : Gen_certs | Gather etcd master certs] ***************************** Thursday 09 May 2019 02:16:59 -0300 (0:00:00.392) 0:03:25.969 ********** TASK [etcd : Gen_certs | Write etcd master certs] ****************************** Thursday 09 May 2019 02:16:59 -0300 (0:00:00.425) 0:03:26.394 ********** TASK [etcd : set_fact] ********************************************************* Thursday 09 May 2019 02:17:00 -0300 (0:00:00.331) 0:03:26.725 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [etcd : Check_certs | Set 'sync_certs' to true on nodes] ****************** Thursday 09 May 2019 02:17:00 -0300 (0:00:00.246) 0:03:26.971 ********** ok: [k8s-master01-lab-20190425] => (item=ca.pem) ok: [k8s-master01-lab-20190425] => (item=node-k8s-master01-lab-20190425.pem) ok: [k8s-master01-lab-20190425] => (item=node-k8s-master01-lab-20190425-key.pem) ok: [k8s-node01-lab] => (item=ca.pem) ok: [k8s-node01-lab] => (item=node-k8s-node01-lab.pem) ok: [k8s-node01-lab] => (item=node-k8s-node01-lab-key.pem) ok: [k8s-node02-lab] => (item=ca.pem) ok: [k8s-node02-lab] => (item=node-k8s-node02-lab.pem) ok: [k8s-node02-lab] => (item=node-k8s-node02-lab-key.pem) TASK [etcd : Gen_certs | Gather node certs] ************************************ Thursday 09 May 2019 02:17:00 -0300 (0:00:00.310) 0:03:27.281 ********** changed: [k8s-master01-lab-20190425 -> k8s-etcd01-lab-20190425] changed: [k8s-node01-lab -> k8s-etcd01-lab-20190425] changed: [k8s-node02-lab -> k8s-etcd01-lab-20190425] TASK [etcd : Gen_certs | Copy certs on nodes] ********************************** Thursday 09 May 2019 02:17:00 -0300 (0:00:00.391) 0:03:27.673 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [etcd : Gen_certs | check certificate permissions] ************************ Thursday 09 May 2019 02:17:01 -0300 (0:00:00.353) 0:03:28.027 ********** changed: [k8s-master01-lab-20190425] changed: [k8s-node01-lab] changed: [k8s-node02-lab] TASK [etcd : include_tasks] **************************************************** Thursday 09 May 2019 02:17:01 -0300 (0:00:00.341) 0:03:28.368 ********** included: /kubespray/roles/etcd/tasks/upd_ca_trust.yml for k8s-master01-lab-20190425, k8s-node01-lab, k8s-node02-lab TASK [etcd : Gen_certs | target ca-certificate store file] ********************* Thursday 09 May 2019 02:17:02 -0300 (0:00:00.368) 0:03:28.737 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [etcd : Gen_certs | add CA to trusted CA dir] ***************************** Thursday 09 May 2019 02:17:02 -0300 (0:00:00.234) 0:03:28.972 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [etcd : Gen_certs | update ca-certificates (Debian/Ubuntu/SUSE/Container Linux by CoreOS)] *** Thursday 09 May 2019 02:17:02 -0300 (0:00:00.367) 0:03:29.339 ********** TASK [etcd : Gen_certs | update ca-certificates (RedHat)] ********************** Thursday 09 May 2019 02:17:02 -0300 (0:00:00.192) 0:03:29.531 ********** TASK [etcd : Gen_certs | update ca-certificates (ClearLinux)] ****************** Thursday 09 May 2019 02:17:03 -0300 (0:00:00.189) 0:03:29.721 ********** TASK [etcd : Gen_certs | Get etcd certificate serials] ************************* Thursday 09 May 2019 02:17:03 -0300 (0:00:00.185) 0:03:29.907 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [etcd : Set etcd_client_cert_serial] ************************************** Thursday 09 May 2019 02:17:03 -0300 (0:00:00.469) 0:03:30.377 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [etcd : include_tasks] **************************************************** Thursday 09 May 2019 02:17:04 -0300 (0:00:00.349) 0:03:30.726 ********** TASK [etcd : include_tasks] **************************************************** Thursday 09 May 2019 02:17:04 -0300 (0:00:00.192) 0:03:30.919 ********** TASK [etcd : include_tasks] **************************************************** Thursday 09 May 2019 02:17:04 -0300 (0:00:00.209) 0:03:31.128 ********** TASK [etcd : Restart etcd if certs changed] ************************************ Thursday 09 May 2019 02:17:04 -0300 (0:00:00.271) 0:03:31.399 ********** TASK [etcd : Restart etcd-events if certs changed] ***************************** Thursday 09 May 2019 02:17:04 -0300 (0:00:00.194) 0:03:31.594 ********** TASK [etcd : include_tasks] **************************************************** Thursday 09 May 2019 02:17:05 -0300 (0:00:00.193) 0:03:31.787 ********** RUNNING HANDLER [etcd : set etcd_secret_changed] ******************************* Thursday 09 May 2019 02:17:05 -0300 (0:00:00.172) 0:03:31.959 ********** ok: [k8s-master01-lab-20190425] PLAY [k8s-cluster] ************************************************************* TASK [download : include_tasks] ************************************************ Thursday 09 May 2019 02:17:05 -0300 (0:00:00.172) 0:03:32.132 ********** TASK [download : Download items] *********************************************** Thursday 09 May 2019 02:17:05 -0300 (0:00:00.192) 0:03:32.324 ********** TASK [download : Sync container] *********************************************** Thursday 09 May 2019 02:17:06 -0300 (0:00:00.783) 0:03:33.108 ********** TASK [download : include_tasks] ************************************************ Thursday 09 May 2019 02:17:07 -0300 (0:00:00.796) 0:03:33.905 ********** TASK [kubespray-defaults : Configure defaults] ********************************* Thursday 09 May 2019 02:17:07 -0300 (0:00:00.207) 0:03:34.112 ********** ok: [k8s-master01-lab-20190425] => { "msg": "Check roles/kubespray-defaults/defaults/main.yml" } ok: [k8s-node01-lab] => { "msg": "Check roles/kubespray-defaults/defaults/main.yml" } ok: [k8s-node02-lab] => { "msg": "Check roles/kubespray-defaults/defaults/main.yml" } TASK [kubernetes/node : look up docker cgroup driver] ************************** Thursday 09 May 2019 02:17:07 -0300 (0:00:00.254) 0:03:34.367 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [kubernetes/node : set_fact] ********************************************** Thursday 09 May 2019 02:17:08 -0300 (0:00:00.447) 0:03:34.815 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [kubernetes/node : os specific vars] ************************************** Thursday 09 May 2019 02:17:08 -0300 (0:00:00.260) 0:03:35.076 ********** ok: [k8s-master01-lab-20190425] => (item=/kubespray/roles/kubernetes/node/vars/ubuntu-18.yml) ok: [k8s-node01-lab] => (item=/kubespray/roles/kubernetes/node/vars/ubuntu-18.yml) ok: [k8s-node02-lab] => (item=/kubespray/roles/kubernetes/node/vars/ubuntu-18.yml) TASK [kubernetes/node : Pre-upgrade | check if kubelet container exists] ******* Thursday 09 May 2019 02:17:08 -0300 (0:00:00.275) 0:03:35.351 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [kubernetes/node : Pre-upgrade | copy /var/lib/cni from kubelet] ********** Thursday 09 May 2019 02:17:09 -0300 (0:00:00.420) 0:03:35.772 ********** TASK [kubernetes/node : Pre-upgrade | ensure kubelet container service is stopped if using host deployment] *** Thursday 09 May 2019 02:17:09 -0300 (0:00:00.191) 0:03:35.964 ********** TASK [kubernetes/node : Pre-upgrade | ensure kubelet container is removed if using host deployment] *** Thursday 09 May 2019 02:17:09 -0300 (0:00:00.190) 0:03:36.155 ********** TASK [kubernetes/node : Ensure /var/lib/cni exists] **************************** Thursday 09 May 2019 02:17:09 -0300 (0:00:00.200) 0:03:36.355 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [kubernetes/node : install | Copy kubeadm binary from download dir] ******* Thursday 09 May 2019 02:17:10 -0300 (0:00:00.392) 0:03:36.748 ********** changed: [k8s-node01-lab -> k8s-node01-lab] changed: [k8s-node02-lab -> k8s-node02-lab] TASK [kubernetes/node : install | Set kubeadm binary permissions] ************** Thursday 09 May 2019 02:17:10 -0300 (0:00:00.743) 0:03:37.491 ********** ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [kubernetes/node : install | Copy kubelet binary from download dir] ******* Thursday 09 May 2019 02:17:11 -0300 (0:00:00.389) 0:03:37.880 ********** changed: [k8s-master01-lab-20190425 -> k8s-master01-lab-20190425] changed: [k8s-node01-lab -> k8s-node01-lab] changed: [k8s-node02-lab -> k8s-node02-lab] TASK [kubernetes/node : install | Set kubelet binary permissions] ************** Thursday 09 May 2019 02:17:12 -0300 (0:00:01.337) 0:03:39.218 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [kubernetes/node : install | Copy hyperkube binary from download dir] ***** Thursday 09 May 2019 02:17:12 -0300 (0:00:00.385) 0:03:39.604 ********** changed: [k8s-node01-lab -> k8s-node01-lab] changed: [k8s-master01-lab-20190425 -> k8s-master01-lab-20190425] changed: [k8s-node02-lab -> k8s-node02-lab] TASK [kubernetes/node : install | Set hyperkube binary permissions] ************ Thursday 09 May 2019 02:17:14 -0300 (0:00:01.278) 0:03:40.882 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [kubernetes/node : install | Copy socat wrapper for Container Linux] ****** Thursday 09 May 2019 02:17:14 -0300 (0:00:00.502) 0:03:41.385 ********** TASK [kubernetes/node : install | Write kubelet systemd init file] ************* Thursday 09 May 2019 02:17:14 -0300 (0:00:00.194) 0:03:41.580 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [kubernetes/node : haproxy | Cleanup potentially deployed haproxy] ******** Thursday 09 May 2019 02:17:15 -0300 (0:00:00.645) 0:03:42.226 ********** ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [kubernetes/node : nginx-proxy | Write static pod] ************************ Thursday 09 May 2019 02:17:15 -0300 (0:00:00.472) 0:03:42.699 ********** ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [kubernetes/node : nginx-proxy | Make nginx directory] ******************** Thursday 09 May 2019 02:17:16 -0300 (0:00:00.645) 0:03:43.344 ********** ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [kubernetes/node : nginx-proxy | Write nginx-proxy configuration] ********* Thursday 09 May 2019 02:17:17 -0300 (0:00:00.481) 0:03:43.826 ********** ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [kubernetes/node : haproxy | Cleanup potentially deployed nginx-proxy] **** Thursday 09 May 2019 02:17:17 -0300 (0:00:00.866) 0:03:44.693 ********** TASK [kubernetes/node : haproxy | Write static pod] **************************** Thursday 09 May 2019 02:17:18 -0300 (0:00:00.199) 0:03:44.892 ********** TASK [kubernetes/node : haproxy | Make haproxy directory] ********************** Thursday 09 May 2019 02:17:18 -0300 (0:00:00.208) 0:03:45.101 ********** TASK [kubernetes/node : haproxy | Write haproxy configuration] ***************** Thursday 09 May 2019 02:17:18 -0300 (0:00:00.211) 0:03:45.313 ********** TASK [kubernetes/node : Make sure dynamic kubelet configuration directory is writeable] *** Thursday 09 May 2019 02:17:18 -0300 (0:00:00.200) 0:03:45.514 ********** TASK [kubernetes/node : Write kubelet config file (kubeadm)] ******************* Thursday 09 May 2019 02:17:18 -0300 (0:00:00.189) 0:03:45.703 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [kubernetes/node : Ensure nodePort range is reserved] ********************* Thursday 09 May 2019 02:17:19 -0300 (0:00:00.760) 0:03:46.463 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [kubernetes/node : Verify if br_netfilter module exists] ****************** Thursday 09 May 2019 02:17:20 -0300 (0:00:00.360) 0:03:46.824 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [kubernetes/node : Verify br_netfilter module path exists] **************** Thursday 09 May 2019 02:17:20 -0300 (0:00:00.365) 0:03:47.189 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [kubernetes/node : Enable br_netfilter module] **************************** Thursday 09 May 2019 02:17:20 -0300 (0:00:00.348) 0:03:47.537 ********** ok: [k8s-node01-lab] ok: [k8s-master01-lab-20190425] ok: [k8s-node02-lab] TASK [kubernetes/node : Persist br_netfilter module] *************************** Thursday 09 May 2019 02:17:21 -0300 (0:00:00.362) 0:03:47.900 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [kubernetes/node : Check if bridge-nf-call-iptables key exists] *********** Thursday 09 May 2019 02:17:21 -0300 (0:00:00.528) 0:03:48.429 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [kubernetes/node : Enable bridge-nf-call tables] ************************** Thursday 09 May 2019 02:17:22 -0300 (0:00:00.350) 0:03:48.780 ********** ok: [k8s-master01-lab-20190425] => (item=net.bridge.bridge-nf-call-iptables) ok: [k8s-node01-lab] => (item=net.bridge.bridge-nf-call-iptables) ok: [k8s-master01-lab-20190425] => (item=net.bridge.bridge-nf-call-arptables) ok: [k8s-node02-lab] => (item=net.bridge.bridge-nf-call-iptables) ok: [k8s-node01-lab] => (item=net.bridge.bridge-nf-call-arptables) ok: [k8s-master01-lab-20190425] => (item=net.bridge.bridge-nf-call-ip6tables) ok: [k8s-node02-lab] => (item=net.bridge.bridge-nf-call-arptables) ok: [k8s-node01-lab] => (item=net.bridge.bridge-nf-call-ip6tables) ok: [k8s-node02-lab] => (item=net.bridge.bridge-nf-call-ip6tables) TASK [kubernetes/node : Modprode Kernel Module for IPVS] *********************** Thursday 09 May 2019 02:17:22 -0300 (0:00:00.657) 0:03:49.438 ********** ok: [k8s-master01-lab-20190425] => (item=ip_vs) ok: [k8s-node01-lab] => (item=ip_vs) ok: [k8s-node02-lab] => (item=ip_vs) ok: [k8s-master01-lab-20190425] => (item=ip_vs_rr) ok: [k8s-node01-lab] => (item=ip_vs_rr) ok: [k8s-master01-lab-20190425] => (item=ip_vs_wrr) ok: [k8s-node02-lab] => (item=ip_vs_rr) ok: [k8s-node01-lab] => (item=ip_vs_wrr) ok: [k8s-master01-lab-20190425] => (item=ip_vs_sh) ok: [k8s-node02-lab] => (item=ip_vs_wrr) ok: [k8s-node01-lab] => (item=ip_vs_sh) ok: [k8s-node02-lab] => (item=ip_vs_sh) TASK [kubernetes/node : Modprobe nf_conntrack_ipv4 for kernels < 4.19] ********* Thursday 09 May 2019 02:17:23 -0300 (0:00:00.776) 0:03:50.214 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [kubernetes/node : Modprobe nf_conntrack for kernels >= 4.19] ************* Thursday 09 May 2019 02:17:23 -0300 (0:00:00.363) 0:03:50.577 ********** TASK [kubernetes/node : Persist ip_vs modules] ********************************* Thursday 09 May 2019 02:17:24 -0300 (0:00:00.189) 0:03:50.767 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [kubernetes/node : Purge proxy manifest for kubeadm or if proxy services being provided by other means, e.g. network_plugin] *** Thursday 09 May 2019 02:17:24 -0300 (0:00:00.555) 0:03:51.323 ********** TASK [kubernetes/node : Cleanup kube-proxy leftovers from node] **************** Thursday 09 May 2019 02:17:24 -0300 (0:00:00.189) 0:03:51.513 ********** TASK [kubernetes/node : include_tasks] ***************************************** Thursday 09 May 2019 02:17:24 -0300 (0:00:00.188) 0:03:51.702 ********** TASK [kubernetes/node : Write cacert file] ************************************* Thursday 09 May 2019 02:17:25 -0300 (0:00:00.191) 0:03:51.894 ********** TASK [kubernetes/node : Write cloud-config] ************************************ Thursday 09 May 2019 02:17:25 -0300 (0:00:00.198) 0:03:52.092 ********** RUNNING HANDLER [kubernetes/node : restart kubelet] **************************** Thursday 09 May 2019 02:17:25 -0300 (0:00:00.162) 0:03:52.255 ********** changed: [k8s-master01-lab-20190425] changed: [k8s-node01-lab] changed: [k8s-node02-lab] RUNNING HANDLER [kubernetes/node : Kubelet | reload systemd] ******************* Thursday 09 May 2019 02:17:25 -0300 (0:00:00.360) 0:03:52.615 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] RUNNING HANDLER [kubernetes/node : Kubelet | reload kubelet] ******************* Thursday 09 May 2019 02:17:26 -0300 (0:00:00.600) 0:03:53.216 ********** changed: [k8s-master01-lab-20190425] changed: [k8s-node01-lab] changed: [k8s-node02-lab] TASK [kubernetes/node : Enable kubelet] **************************************** Thursday 09 May 2019 02:17:27 -0300 (0:00:00.574) 0:03:53.791 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] PLAY [kube-master] ************************************************************* TASK [download : include_tasks] ************************************************ Thursday 09 May 2019 02:17:27 -0300 (0:00:00.571) 0:03:54.362 ********** TASK [download : Download items] *********************************************** Thursday 09 May 2019 02:17:27 -0300 (0:00:00.066) 0:03:54.429 ********** TASK [download : Sync container] *********************************************** Thursday 09 May 2019 02:17:28 -0300 (0:00:00.660) 0:03:55.089 ********** TASK [download : include_tasks] ************************************************ Thursday 09 May 2019 02:17:29 -0300 (0:00:00.647) 0:03:55.737 ********** TASK [kubespray-defaults : Configure defaults] ********************************* Thursday 09 May 2019 02:17:29 -0300 (0:00:00.067) 0:03:55.805 ********** ok: [k8s-master01-lab-20190425] => { "msg": "Check roles/kubespray-defaults/defaults/main.yml" } TASK [kubernetes/tokens : Check_tokens | check if the tokens have already been generated on first master] *** Thursday 09 May 2019 02:17:29 -0300 (0:00:00.230) 0:03:56.036 ********** TASK [kubernetes/tokens : Check_tokens | Set default value for 'sync_tokens' and 'gen_tokens' to false] *** Thursday 09 May 2019 02:17:29 -0300 (0:00:00.062) 0:03:56.099 ********** TASK [kubernetes/tokens : Check_tokens | Set 'sync_tokens' and 'gen_tokens' to true] *** Thursday 09 May 2019 02:17:29 -0300 (0:00:00.061) 0:03:56.160 ********** TASK [kubernetes/tokens : Check tokens | check if a cert already exists] ******* Thursday 09 May 2019 02:17:29 -0300 (0:00:00.059) 0:03:56.220 ********** TASK [kubernetes/tokens : Check_tokens | Set 'sync_tokens' to true] ************ Thursday 09 May 2019 02:17:29 -0300 (0:00:00.058) 0:03:56.279 ********** TASK [kubernetes/tokens : Make sure the tokens directory exits] **************** Thursday 09 May 2019 02:17:29 -0300 (0:00:00.059) 0:03:56.338 ********** TASK [kubernetes/tokens : Gen_tokens | copy tokens generation script] ********** Thursday 09 May 2019 02:17:29 -0300 (0:00:00.091) 0:03:56.430 ********** TASK [kubernetes/tokens : Gen_tokens | generate tokens for master components] *** Thursday 09 May 2019 02:17:29 -0300 (0:00:00.097) 0:03:56.527 ********** TASK [kubernetes/tokens : Gen_tokens | generate tokens for node components] **** Thursday 09 May 2019 02:17:29 -0300 (0:00:00.107) 0:03:56.635 ********** TASK [kubernetes/tokens : Gen_tokens | Get list of tokens from first master] *** Thursday 09 May 2019 02:17:30 -0300 (0:00:00.107) 0:03:56.743 ********** TASK [kubernetes/tokens : Gen_tokens | Gather tokens] ************************** Thursday 09 May 2019 02:17:30 -0300 (0:00:00.094) 0:03:56.838 ********** TASK [kubernetes/tokens : Gen_tokens | Copy tokens on masters] ***************** Thursday 09 May 2019 02:17:30 -0300 (0:00:00.060) 0:03:56.899 ********** TASK [kubernetes/master : Pre-upgrade | Delete master manifests if etcd secrets changed] *** Thursday 09 May 2019 02:17:30 -0300 (0:00:00.060) 0:03:56.959 ********** ok: [k8s-master01-lab-20190425] => (item=kube-apiserver) ok: [k8s-master01-lab-20190425] => (item=kube-controller-manager) ok: [k8s-master01-lab-20190425] => (item=kube-scheduler) TASK [kubernetes/master : Pre-upgrade | Delete master containers forcefully] *** Thursday 09 May 2019 02:17:30 -0300 (0:00:00.622) 0:03:57.581 ********** TASK [kubernetes/master : Make sure the users directory exits] ***************** Thursday 09 May 2019 02:17:30 -0300 (0:00:00.094) 0:03:57.676 ********** TASK [kubernetes/master : Populate users for basic auth in API] **************** Thursday 09 May 2019 02:17:31 -0300 (0:00:00.067) 0:03:57.743 ********** TASK [kubernetes/master : Create webhook token auth config] ******************** Thursday 09 May 2019 02:17:31 -0300 (0:00:00.062) 0:03:57.806 ********** TASK [kubernetes/master : Check if secret for encrypting data at rest already exist] *** Thursday 09 May 2019 02:17:31 -0300 (0:00:00.061) 0:03:57.868 ********** TASK [kubernetes/master : Slurp secrets_encryption file if it exists] ********** Thursday 09 May 2019 02:17:31 -0300 (0:00:00.060) 0:03:57.929 ********** TASK [kubernetes/master : Base 64 Decode slurped secrets_encryption.yaml file] *** Thursday 09 May 2019 02:17:31 -0300 (0:00:00.060) 0:03:57.990 ********** TASK [kubernetes/master : Extract secret value from secrets_encryption.yaml] *** Thursday 09 May 2019 02:17:31 -0300 (0:00:00.059) 0:03:58.049 ********** TASK [kubernetes/master : Set kube_encrypt_token across master nodes] ********** Thursday 09 May 2019 02:17:31 -0300 (0:00:00.093) 0:03:58.143 ********** TASK [kubernetes/master : Write secrets for encrypting secret data at rest] **** Thursday 09 May 2019 02:17:31 -0300 (0:00:00.078) 0:03:58.221 ********** TASK [kubernetes/master : Install | Copy kubectl binary from download dir] ***** Thursday 09 May 2019 02:17:31 -0300 (0:00:00.093) 0:03:58.315 ********** ok: [k8s-master01-lab-20190425 -> k8s-master01-lab-20190425] TASK [kubernetes/master : install | Set kubectl binary permissions] ************ Thursday 09 May 2019 02:17:32 -0300 (0:00:01.088) 0:03:59.403 ********** ok: [k8s-master01-lab-20190425] TASK [kubernetes/master : Make sure bash_completion.d folder exists] *********** Thursday 09 May 2019 02:17:33 -0300 (0:00:00.321) 0:03:59.725 ********** TASK [kubernetes/master : Install kubectl bash completion] ********************* Thursday 09 May 2019 02:17:33 -0300 (0:00:00.076) 0:03:59.802 ********** changed: [k8s-master01-lab-20190425] TASK [kubernetes/master : Set kubectl bash completion file] ******************** Thursday 09 May 2019 02:17:33 -0300 (0:00:00.455) 0:04:00.258 ********** ok: [k8s-master01-lab-20190425] TASK [kubernetes/master : Disable SecurityContextDeny admission-controller and enable PodSecurityPolicy] *** Thursday 09 May 2019 02:17:33 -0300 (0:00:00.348) 0:04:00.606 ********** TASK [kubernetes/master : kubeadm | Check if old apiserver cert exists on host] *** Thursday 09 May 2019 02:17:33 -0300 (0:00:00.094) 0:04:00.701 ********** ok: [k8s-master01-lab-20190425 -> k8s-master01-lab-20190425] TASK [kubernetes/master : Copy old certs to the kubeadm expected path] ********* Thursday 09 May 2019 02:17:34 -0300 (0:00:00.339) 0:04:01.040 ********** TASK [kubernetes/master : Install OIDC certificate] **************************** Thursday 09 May 2019 02:17:34 -0300 (0:00:00.193) 0:04:01.233 ********** TASK [kubernetes/master : kubeadm | Check serviceaccount key] ****************** Thursday 09 May 2019 02:17:34 -0300 (0:00:00.061) 0:04:01.295 ********** ok: [k8s-master01-lab-20190425] TASK [kubernetes/master : kubeadm | Check if kubeadm has already run] ********** Thursday 09 May 2019 02:17:34 -0300 (0:00:00.311) 0:04:01.607 ********** ok: [k8s-master01-lab-20190425] TASK [kubernetes/master : kubeadm | Delete old admin.conf] ********************* Thursday 09 May 2019 02:17:35 -0300 (0:00:00.322) 0:04:01.930 ********** TASK [kubernetes/master : kubeadm | Delete old static pods] ******************** Thursday 09 May 2019 02:17:35 -0300 (0:00:00.065) 0:04:01.995 ********** TASK [kubernetes/master : kubeadm | Forcefully delete old static pods] ********* Thursday 09 May 2019 02:17:35 -0300 (0:00:00.095) 0:04:02.091 ********** TASK [kubernetes/master : kubeadm | aggregate all SANs] ************************ Thursday 09 May 2019 02:17:35 -0300 (0:00:00.085) 0:04:02.176 ********** ok: [k8s-master01-lab-20190425] TASK [kubernetes/master : Create audit-policy directory] *********************** Thursday 09 May 2019 02:17:35 -0300 (0:00:00.318) 0:04:02.495 ********** TASK [kubernetes/master : Write api audit policy yaml] ************************* Thursday 09 May 2019 02:17:35 -0300 (0:00:00.066) 0:04:02.561 ********** TASK [kubernetes/master : set kubeadm_config_api_fqdn define] ****************** Thursday 09 May 2019 02:17:35 -0300 (0:00:00.067) 0:04:02.629 ********** TASK [kubernetes/master : gets the kubeadm version] **************************** Thursday 09 May 2019 02:17:35 -0300 (0:00:00.063) 0:04:02.692 ********** changed: [k8s-master01-lab-20190425] TASK [kubernetes/master : sets kubeadm api version to v1alpha2] **************** Thursday 09 May 2019 02:17:36 -0300 (0:00:00.331) 0:04:03.024 ********** TASK [kubernetes/master : sets kubeadm api version to v1alpha3] **************** Thursday 09 May 2019 02:17:36 -0300 (0:00:00.068) 0:04:03.092 ********** TASK [kubernetes/master : sets kubeadm api version to v1beta1] ***************** Thursday 09 May 2019 02:17:36 -0300 (0:00:00.069) 0:04:03.162 ********** ok: [k8s-master01-lab-20190425] TASK [kubernetes/master : kubeadm | Create kubeadm config] ********************* Thursday 09 May 2019 02:17:36 -0300 (0:00:00.221) 0:04:03.383 ********** changed: [k8s-master01-lab-20190425] TASK [kubernetes/master : Backup old certs and keys] *************************** Thursday 09 May 2019 02:17:37 -0300 (0:00:00.925) 0:04:04.309 ********** ok: [k8s-master01-lab-20190425] => (item={u'dest': u'apiserver.crt.old', u'src': u'apiserver.crt'}) ok: [k8s-master01-lab-20190425] => (item={u'dest': u'apiserver.key.old', u'src': u'apiserver.key'}) ok: [k8s-master01-lab-20190425] => (item={u'dest': u'apiserver-kubelet-client.crt.old', u'src': u'apiserver-kubelet-client.crt'}) ok: [k8s-master01-lab-20190425] => (item={u'dest': u'apiserver-kubelet-client.key.old', u'src': u'apiserver-kubelet-client.key'}) ok: [k8s-master01-lab-20190425] => (item={u'dest': u'front-proxy-client.crt.old', u'src': u'front-proxy-client.crt'}) ok: [k8s-master01-lab-20190425] => (item={u'dest': u'front-proxy-client.key.old', u'src': u'front-proxy-client.key'}) TASK [kubernetes/master : kubeadm | Initialize first master] ******************* Thursday 09 May 2019 02:17:38 -0300 (0:00:01.263) 0:04:05.572 ********** TASK [kubernetes/master : set kubeadm certificate key] ************************* Thursday 09 May 2019 02:17:38 -0300 (0:00:00.067) 0:04:05.640 ********** TASK [kubernetes/master : Create hardcoded kubeadm token for joining nodes with 24h expiration (if defined)] *** Thursday 09 May 2019 02:17:39 -0300 (0:00:00.091) 0:04:05.732 ********** TASK [kubernetes/master : Create kubeadm token for joining nodes with 24h expiration (default)] *** Thursday 09 May 2019 02:17:39 -0300 (0:00:00.098) 0:04:05.831 ********** changed: [k8s-master01-lab-20190425 -> k8s-master01-lab-20190425] TASK [kubernetes/master : Set kubeadm_token] *********************************** Thursday 09 May 2019 02:17:39 -0300 (0:00:00.475) 0:04:06.306 ********** ok: [k8s-master01-lab-20190425] TASK [kubernetes/master : Set kubeadm_discovery_address] *********************** Thursday 09 May 2019 02:17:39 -0300 (0:00:00.209) 0:04:06.516 ********** TASK [kubernetes/master : Create kubeadm ControlPlane config] ****************** Thursday 09 May 2019 02:17:39 -0300 (0:00:00.061) 0:04:06.577 ********** TASK [kubernetes/master : Wait for k8s apiserver] ****************************** Thursday 09 May 2019 02:17:39 -0300 (0:00:00.064) 0:04:06.642 ********** TASK [kubernetes/master : Upload certificates so they are fresh and not expired] *** Thursday 09 May 2019 02:17:40 -0300 (0:00:00.143) 0:04:06.786 ********** TASK [kubernetes/master : Parse certificate key if not set] ******************** Thursday 09 May 2019 02:17:40 -0300 (0:00:00.065) 0:04:06.852 ********** TASK [kubernetes/master : Joining control plane node to the cluster.] ********** Thursday 09 May 2019 02:17:40 -0300 (0:00:00.062) 0:04:06.915 ********** TASK [kubernetes/master : Set secret_changed to false to avoid extra token rotation] *** Thursday 09 May 2019 02:17:40 -0300 (0:00:00.063) 0:04:06.978 ********** TASK [kubernetes/master : slurp kubeadm certs] ********************************* Thursday 09 May 2019 02:17:40 -0300 (0:00:00.118) 0:04:07.097 ********** ok: [k8s-master01-lab-20190425 -> k8s-master01-lab-20190425] => (item=/etc/kubernetes/ssl/apiserver.crt) ok: [k8s-master01-lab-20190425 -> k8s-master01-lab-20190425] => (item=/etc/kubernetes/ssl/apiserver.key) ok: [k8s-master01-lab-20190425 -> k8s-master01-lab-20190425] => (item=/etc/kubernetes/ssl/apiserver-kubelet-client.crt) ok: [k8s-master01-lab-20190425 -> k8s-master01-lab-20190425] => (item=/etc/kubernetes/ssl/apiserver-kubelet-client.key) ok: [k8s-master01-lab-20190425 -> k8s-master01-lab-20190425] => (item=/etc/kubernetes/ssl/ca.crt) ok: [k8s-master01-lab-20190425 -> k8s-master01-lab-20190425] => (item=/etc/kubernetes/ssl/ca.key) ok: [k8s-master01-lab-20190425 -> k8s-master01-lab-20190425] => (item=/etc/kubernetes/ssl/front-proxy-ca.crt) ok: [k8s-master01-lab-20190425 -> k8s-master01-lab-20190425] => (item=/etc/kubernetes/ssl/front-proxy-ca.key) ok: [k8s-master01-lab-20190425 -> k8s-master01-lab-20190425] => (item=/etc/kubernetes/ssl/front-proxy-client.crt) ok: [k8s-master01-lab-20190425 -> k8s-master01-lab-20190425] => (item=/etc/kubernetes/ssl/front-proxy-client.key) ok: [k8s-master01-lab-20190425 -> k8s-master01-lab-20190425] => (item=/etc/kubernetes/ssl/sa.key) ok: [k8s-master01-lab-20190425 -> k8s-master01-lab-20190425] => (item=/etc/kubernetes/ssl/sa.pub) TASK [kubernetes/master : kubeadm | write out kubeadm certs] ******************* Thursday 09 May 2019 02:17:42 -0300 (0:00:01.670) 0:04:08.767 ********** TASK [kubernetes/master : kubeadm | Init other uninitialized masters] ********** Thursday 09 May 2019 02:17:42 -0300 (0:00:00.231) 0:04:08.999 ********** TASK [kubernetes/master : kubeadm | Upgrade first master] ********************** Thursday 09 May 2019 02:17:42 -0300 (0:00:00.070) 0:04:09.070 ********** TASK [kubernetes/master : kubeadm | Upgrade other masters] ********************* Thursday 09 May 2019 02:17:42 -0300 (0:00:00.065) 0:04:09.135 ********** TASK [kubernetes/master : kubeadm | Check serviceaccount key again] ************ Thursday 09 May 2019 02:17:42 -0300 (0:00:00.063) 0:04:09.199 ********** ok: [k8s-master01-lab-20190425] TASK [kubernetes/master : kubeadm | Set secret_changed if service account key was updated] *** Thursday 09 May 2019 02:17:42 -0300 (0:00:00.232) 0:04:09.431 ********** TASK [kubernetes/master : kubeadm | Retrieve files to purge] ******************* Thursday 09 May 2019 02:17:42 -0300 (0:00:00.066) 0:04:09.498 ********** TASK [kubernetes/master : kubeadm | Purge old certs] *************************** Thursday 09 May 2019 02:17:42 -0300 (0:00:00.064) 0:04:09.563 ********** TASK [kubernetes/master : kubeadm | Purge old kubeconfig] ********************** Thursday 09 May 2019 02:17:42 -0300 (0:00:00.072) 0:04:09.636 ********** TASK [kubernetes/master : kubeadm | Remove taint for master with node role] **** Thursday 09 May 2019 02:17:43 -0300 (0:00:00.097) 0:04:09.733 ********** TASK [kubernetes/client : Set external kube-apiserver endpoint] **************** Thursday 09 May 2019 02:17:43 -0300 (0:00:00.064) 0:04:09.798 ********** ok: [k8s-master01-lab-20190425] TASK [kubernetes/client : Create kube config dir] ****************************** Thursday 09 May 2019 02:17:43 -0300 (0:00:00.272) 0:04:10.070 ********** ok: [k8s-master01-lab-20190425] TASK [kubernetes/client : Copy admin kubeconfig to root user home] ************* Thursday 09 May 2019 02:17:43 -0300 (0:00:00.223) 0:04:10.294 ********** ok: [k8s-master01-lab-20190425] TASK [kubernetes/client : Create kube artifacts dir] *************************** Thursday 09 May 2019 02:17:43 -0300 (0:00:00.270) 0:04:10.564 ********** TASK [kubernetes/client : Generate admin kubeconfig with external api endpoint] *** Thursday 09 May 2019 02:17:43 -0300 (0:00:00.070) 0:04:10.634 ********** changed: [k8s-master01-lab-20190425] TASK [kubernetes/client : Write admin kubeconfig on ansible host] ************** Thursday 09 May 2019 02:17:45 -0300 (0:00:01.952) 0:04:12.586 ********** TASK [kubernetes/client : Copy kubectl binary to ansible host] ***************** Thursday 09 May 2019 02:17:45 -0300 (0:00:00.071) 0:04:12.658 ********** TASK [kubernetes/client : create helper script kubectl.sh on ansible host] ***** Thursday 09 May 2019 02:17:46 -0300 (0:00:00.074) 0:04:12.733 ********** TASK [kubernetes-apps/cluster_roles : Kubernetes Apps | Wait for kube-apiserver] *** Thursday 09 May 2019 02:17:46 -0300 (0:00:00.066) 0:04:12.800 ********** ok: [k8s-master01-lab-20190425] TASK [kubernetes-apps/cluster_roles : Kubernetes Apps | Check AppArmor status] *** Thursday 09 May 2019 02:17:46 -0300 (0:00:00.874) 0:04:13.675 ********** TASK [kubernetes-apps/cluster_roles : Kubernetes Apps | Set apparmor_enabled] *** Thursday 09 May 2019 02:17:47 -0300 (0:00:00.066) 0:04:13.741 ********** TASK [kubernetes-apps/cluster_roles : Kubernetes Apps | Render templates for PodSecurityPolicy] *** Thursday 09 May 2019 02:17:47 -0300 (0:00:00.075) 0:04:13.816 ********** TASK [kubernetes-apps/cluster_roles : Kubernetes Apps | Add policies, roles, bindings for PodSecurityPolicy] *** Thursday 09 May 2019 02:17:47 -0300 (0:00:00.084) 0:04:13.901 ********** TASK [kubernetes-apps/cluster_roles : Kubernetes Apps | Add ClusterRoleBinding to admit nodes] *** Thursday 09 May 2019 02:17:47 -0300 (0:00:00.100) 0:04:14.002 ********** ok: [k8s-master01-lab-20190425] TASK [kubernetes-apps/cluster_roles : Apply workaround to allow all nodes with cert O=system:nodes to register] *** Thursday 09 May 2019 02:17:47 -0300 (0:00:00.409) 0:04:14.411 ********** TASK [kubernetes-apps/cluster_roles : Kubernetes Apps | Add webhook ClusterRole that grants access to proxy, stats, log, spec, and metrics on a kubelet] *** Thursday 09 May 2019 02:17:47 -0300 (0:00:00.071) 0:04:14.483 ********** TASK [kubernetes-apps/cluster_roles : Apply webhook ClusterRole] *************** Thursday 09 May 2019 02:17:47 -0300 (0:00:00.065) 0:04:14.549 ********** TASK [kubernetes-apps/cluster_roles : Kubernetes Apps | Add ClusterRoleBinding for system:nodes to webhook ClusterRole] *** Thursday 09 May 2019 02:17:47 -0300 (0:00:00.065) 0:04:14.614 ********** TASK [kubernetes-apps/cluster_roles : Grant system:nodes the webhook ClusterRole] *** Thursday 09 May 2019 02:17:47 -0300 (0:00:00.067) 0:04:14.682 ********** TASK [kubernetes-apps/cluster_roles : Check if vsphere-cloud-provider ClusterRole exists] *** Thursday 09 May 2019 02:17:48 -0300 (0:00:00.067) 0:04:14.750 ********** TASK [kubernetes-apps/cluster_roles : Write vsphere-cloud-provider ClusterRole manifest] *** Thursday 09 May 2019 02:17:48 -0300 (0:00:00.088) 0:04:14.838 ********** TASK [kubernetes-apps/cluster_roles : Apply vsphere-cloud-provider ClusterRole] *** Thursday 09 May 2019 02:17:48 -0300 (0:00:00.071) 0:04:14.910 ********** TASK [kubernetes-apps/cluster_roles : include_tasks] *************************** Thursday 09 May 2019 02:17:48 -0300 (0:00:00.078) 0:04:14.988 ********** TASK [kubernetes-apps/cluster_roles : PriorityClass | Copy k8s-cluster-critical-pc.yml file] *** Thursday 09 May 2019 02:17:48 -0300 (0:00:00.069) 0:04:15.058 ********** ok: [k8s-master01-lab-20190425] TASK [kubernetes-apps/cluster_roles : PriorityClass | Create k8s-cluster-critical] *** Thursday 09 May 2019 02:17:48 -0300 (0:00:00.440) 0:04:15.498 ********** ok: [k8s-master01-lab-20190425] PLAY [k8s-cluster] ************************************************************* TASK [download : include_tasks] ************************************************ Thursday 09 May 2019 02:17:50 -0300 (0:00:01.680) 0:04:17.179 ********** TASK [download : Download items] *********************************************** Thursday 09 May 2019 02:17:50 -0300 (0:00:00.206) 0:04:17.385 ********** TASK [download : Sync container] *********************************************** Thursday 09 May 2019 02:17:51 -0300 (0:00:00.803) 0:04:18.189 ********** TASK [download : include_tasks] ************************************************ Thursday 09 May 2019 02:17:52 -0300 (0:00:00.802) 0:04:18.991 ********** TASK [kubespray-defaults : Configure defaults] ********************************* Thursday 09 May 2019 02:17:52 -0300 (0:00:00.212) 0:04:19.204 ********** ok: [k8s-master01-lab-20190425] => { "msg": "Check roles/kubespray-defaults/defaults/main.yml" } ok: [k8s-node01-lab] => { "msg": "Check roles/kubespray-defaults/defaults/main.yml" } ok: [k8s-node02-lab] => { "msg": "Check roles/kubespray-defaults/defaults/main.yml" } TASK [kubernetes/kubeadm : Set kubeadm_discovery_address] ********************** Thursday 09 May 2019 02:17:52 -0300 (0:00:00.243) 0:04:19.448 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [kubernetes/kubeadm : Check if kubelet.conf exists] *********************** Thursday 09 May 2019 02:17:53 -0300 (0:00:00.473) 0:04:19.922 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [kubernetes/kubeadm : Calculate kubeadm CA cert hash] ********************* Thursday 09 May 2019 02:17:53 -0300 (0:00:00.437) 0:04:20.360 ********** changed: [k8s-master01-lab-20190425 -> k8s-master01-lab-20190425] TASK [kubernetes/kubeadm : Create kubeadm token for joining nodes with 24h expiration (default)] *** Thursday 09 May 2019 02:17:53 -0300 (0:00:00.271) 0:04:20.631 ********** changed: [k8s-node01-lab -> k8s-master01-lab-20190425] changed: [k8s-node02-lab -> k8s-master01-lab-20190425] TASK [kubernetes/kubeadm : Set kubeadm_token to generated token] *************** Thursday 09 May 2019 02:17:54 -0300 (0:00:00.575) 0:04:21.207 ********** ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [kubernetes/kubeadm : gets the kubeadm version] *************************** Thursday 09 May 2019 02:17:54 -0300 (0:00:00.366) 0:04:21.573 ********** changed: [k8s-master01-lab-20190425] changed: [k8s-node01-lab] changed: [k8s-node02-lab] TASK [kubernetes/kubeadm : sets kubeadm api version to v1alpha1] *************** Thursday 09 May 2019 02:17:55 -0300 (0:00:00.400) 0:04:21.974 ********** TASK [kubernetes/kubeadm : sets kubeadm api version to v1alpha2] *************** Thursday 09 May 2019 02:17:55 -0300 (0:00:00.210) 0:04:22.184 ********** TASK [kubernetes/kubeadm : sets kubeadm api version to v1alpha3] *************** Thursday 09 May 2019 02:17:55 -0300 (0:00:00.203) 0:04:22.387 ********** TASK [kubernetes/kubeadm : sets kubeadm api version to v1beta1] **************** Thursday 09 May 2019 02:17:55 -0300 (0:00:00.197) 0:04:22.584 ********** ok: [k8s-node01-lab] ok: [k8s-master01-lab-20190425] ok: [k8s-node02-lab] TASK [kubernetes/kubeadm : Create kubeadm client config] *********************** Thursday 09 May 2019 02:17:56 -0300 (0:00:00.342) 0:04:22.926 ********** changed: [k8s-node01-lab] changed: [k8s-node02-lab] TASK [kubernetes/kubeadm : Join to cluster] ************************************ Thursday 09 May 2019 02:17:57 -0300 (0:00:00.782) 0:04:23.709 ********** TASK [kubernetes/kubeadm : Display kubeadm join stderr if any] ***************** Thursday 09 May 2019 02:17:57 -0300 (0:00:00.210) 0:04:23.919 ********** TASK [kubernetes/kubeadm : Wait for kubelet bootstrap to create config] ******** Thursday 09 May 2019 02:17:57 -0300 (0:00:00.217) 0:04:24.137 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [kubernetes/kubeadm : Update server field in kubelet kubeconfig] ********** Thursday 09 May 2019 02:17:58 -0300 (0:00:01.505) 0:04:25.643 ********** ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [kubernetes/kubeadm : Update server field in kube-proxy kubeconfig] ******* Thursday 09 May 2019 02:17:59 -0300 (0:00:00.778) 0:04:26.421 ********** changed: [k8s-master01-lab-20190425] TASK [kubernetes/kubeadm : Restart all kube-proxy pods to ensure that they load the new configmap] *** Thursday 09 May 2019 02:18:00 -0300 (0:00:01.098) 0:04:27.519 ********** changed: [k8s-master01-lab-20190425] TASK [kubernetes/kubeadm : Symlink kubelet kubeconfig for calico/canal] ******** Thursday 09 May 2019 02:18:01 -0300 (0:00:00.689) 0:04:28.209 ********** TASK [kubernetes/kubeadm : Delete kube-proxy daemonset if kube_proxy_remove set, e.g. kube_network_plugin providing proxy services] *** Thursday 09 May 2019 02:18:01 -0300 (0:00:00.200) 0:04:28.410 ********** TASK [network_plugin/cilium : Cilium | Ensure BFPFS mounted] ******************* Thursday 09 May 2019 02:18:01 -0300 (0:00:00.066) 0:04:28.477 ********** TASK [network_plugin/cilium : Cilium | Create Cilium certs directory] ********** Thursday 09 May 2019 02:18:01 -0300 (0:00:00.193) 0:04:28.671 ********** TASK [network_plugin/cilium : Cilium | Link etcd certificates for cilium] ****** Thursday 09 May 2019 02:18:02 -0300 (0:00:00.189) 0:04:28.860 ********** TASK [network_plugin/cilium : Cilium | Create Cilium node manifests] *********** Thursday 09 May 2019 02:18:02 -0300 (0:00:00.242) 0:04:29.103 ********** TASK [network_plugin/cilium : Cilium | Set CNI directory permissions] ********** Thursday 09 May 2019 02:18:02 -0300 (0:00:00.247) 0:04:29.351 ********** TASK [network_plugin/cilium : Cilium | Create network policy directory] ******** Thursday 09 May 2019 02:18:02 -0300 (0:00:00.192) 0:04:29.543 ********** TASK [network_plugin/calico : Check vars defined correctly] ******************** Thursday 09 May 2019 02:18:03 -0300 (0:00:00.190) 0:04:29.733 ********** ok: [k8s-master01-lab-20190425] => { "changed": false, "msg": "All assertions passed" } TASK [network_plugin/calico : Get current version of calico cluster version] *** Thursday 09 May 2019 02:18:03 -0300 (0:00:00.137) 0:04:29.871 ********** ok: [k8s-master01-lab-20190425] TASK [network_plugin/calico : Check that calico version is enough for upgrade] *** Thursday 09 May 2019 02:18:03 -0300 (0:00:00.503) 0:04:30.374 ********** ok: [k8s-master01-lab-20190425] => { "changed": false, "msg": "All assertions passed" } TASK [network_plugin/calico : Set upgrade flag when version needs to be updated] *** Thursday 09 May 2019 02:18:03 -0300 (0:00:00.122) 0:04:30.497 ********** TASK [network_plugin/calico : Calico | Disable calico-node service if it exists] *** Thursday 09 May 2019 02:18:03 -0300 (0:00:00.079) 0:04:30.577 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [network_plugin/calico : Calico | Get kubelet hostname] ******************* Thursday 09 May 2019 02:18:04 -0300 (0:00:00.506) 0:04:31.083 ********** TASK [network_plugin/calico : Download calico-upgrade tool (force version)] **** Thursday 09 May 2019 02:18:04 -0300 (0:00:00.306) 0:04:31.390 ********** TASK [network_plugin/calico : Create etcdv2 and etcdv3 calicoApiConfig] ******** Thursday 09 May 2019 02:18:04 -0300 (0:00:00.100) 0:04:31.491 ********** TASK [network_plugin/calico : Tests data migration (dry-run)] ****************** Thursday 09 May 2019 02:18:04 -0300 (0:00:00.113) 0:04:31.604 ********** TASK [network_plugin/calico : If test migration is success continue with calico data real migration] *** Thursday 09 May 2019 02:18:05 -0300 (0:00:00.106) 0:04:31.711 ********** TASK [network_plugin/calico : include_tasks] *********************************** Thursday 09 May 2019 02:18:05 -0300 (0:00:00.071) 0:04:31.782 ********** included: /kubespray/roles/network_plugin/calico/tasks/install.yml for k8s-master01-lab-20190425, k8s-node01-lab, k8s-node02-lab TASK [network_plugin/calico : Calico | Copy calicoctl binary from download dir] *** Thursday 09 May 2019 02:18:05 -0300 (0:00:00.396) 0:04:32.178 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [network_plugin/calico : Calico | Write Calico cni config] **************** Thursday 09 May 2019 02:18:06 -0300 (0:00:00.567) 0:04:32.746 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [network_plugin/calico : Calico | Create calico certs directory] ********** Thursday 09 May 2019 02:18:06 -0300 (0:00:00.808) 0:04:33.554 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [network_plugin/calico : Calico | Link etcd certificates for calico-node] *** Thursday 09 May 2019 02:18:07 -0300 (0:00:00.342) 0:04:33.896 ********** changed: [k8s-master01-lab-20190425] => (item={u's': u'ca.pem', u'd': u'ca_cert.crt'}) changed: [k8s-node01-lab] => (item={u's': u'ca.pem', u'd': u'ca_cert.crt'}) changed: [k8s-master01-lab-20190425] => (item={u's': u'node-k8s-master01-lab-20190425.pem', u'd': u'cert.crt'}) changed: [k8s-node02-lab] => (item={u's': u'ca.pem', u'd': u'ca_cert.crt'}) changed: [k8s-node01-lab] => (item={u's': u'node-k8s-node01-lab.pem', u'd': u'cert.crt'}) changed: [k8s-master01-lab-20190425] => (item={u's': u'node-k8s-master01-lab-20190425-key.pem', u'd': u'key.pem'}) changed: [k8s-node02-lab] => (item={u's': u'node-k8s-node02-lab.pem', u'd': u'cert.crt'}) changed: [k8s-node01-lab] => (item={u's': u'node-k8s-node01-lab-key.pem', u'd': u'key.pem'}) changed: [k8s-node02-lab] => (item={u's': u'node-k8s-node02-lab-key.pem', u'd': u'key.pem'}) TASK [network_plugin/calico : Calico | Install calicoctl wrapper script] ******* Thursday 09 May 2019 02:18:07 -0300 (0:00:00.693) 0:04:34.590 ********** ok: [k8s-master01-lab-20190425] ok: [k8s-node01-lab] ok: [k8s-node02-lab] TASK [network_plugin/calico : Calico | wait for etcd] ************************** Thursday 09 May 2019 02:18:08 -0300 (0:00:00.752) 0:04:35.343 ********** ok: [k8s-master01-lab-20190425] TASK [network_plugin/calico : Calico | Check if calico network pool has already been configured] *** Thursday 09 May 2019 02:18:09 -0300 (0:00:00.530) 0:04:35.874 ********** ok: [k8s-master01-lab-20190425 -> k8s-master01-lab-20190425] TASK [network_plugin/calico : Calico | Ensure that calico_pool_cidr is within kube_pods_subnet when defined] *** Thursday 09 May 2019 02:18:09 -0300 (0:00:00.272) 0:04:36.146 ********** TASK [network_plugin/calico : Calico | Configure calico network pool (v3.0.0 <= version < v3.3.0)] *** Thursday 09 May 2019 02:18:09 -0300 (0:00:00.105) 0:04:36.252 ********** TASK [network_plugin/calico : Calico | Configure calico network pool (version >= v3.3.0)] *** Thursday 09 May 2019 02:18:09 -0300 (0:00:00.103) 0:04:36.355 ********** TASK [network_plugin/calico : Calico | Configure calico network pool (legacy)] *** Thursday 09 May 2019 02:18:09 -0300 (0:00:00.100) 0:04:36.456 ********** TASK [network_plugin/calico : Determine nodeToNodeMesh needed state] *********** Thursday 09 May 2019 02:18:09 -0300 (0:00:00.067) 0:04:36.524 ********** TASK [network_plugin/calico : Calico | Set global as_num] ********************** Thursday 09 May 2019 02:18:09 -0300 (0:00:00.103) 0:04:36.627 ********** ok: [k8s-master01-lab-20190425 -> k8s-master01-lab-20190425] TASK [network_plugin/calico : Calico | Set global as_num (legacy)] ************* Thursday 09 May 2019 02:18:10 -0300 (0:00:00.374) 0:04:37.001 ********** TASK [network_plugin/calico : Calico | Disable node mesh (legacy)] ************* Thursday 09 May 2019 02:18:10 -0300 (0:00:00.071) 0:04:37.073 ********** TASK [network_plugin/calico : Calico | Configure node asNumber for per node peering] *** Thursday 09 May 2019 02:18:10 -0300 (0:00:00.069) 0:04:37.143 ********** TASK [network_plugin/calico : Calico | Configure node asNumber for per node peering (legacy)] *** Thursday 09 May 2019 02:18:10 -0300 (0:00:00.200) 0:04:37.343 ********** TASK [network_plugin/calico : Calico | Configure peering with router(s) at node scope] *** Thursday 09 May 2019 02:18:10 -0300 (0:00:00.193) 0:04:37.536 ********** TASK [network_plugin/calico : Calico | Configure peering with router(s) at node scope (legacy)] *** Thursday 09 May 2019 02:18:11 -0300 (0:00:00.209) 0:04:37.746 ********** TASK [network_plugin/calico : Calico | Configure peering with router(s) at global scope] *** Thursday 09 May 2019 02:18:11 -0300 (0:00:00.201) 0:04:37.948 ********** TASK [network_plugin/calico : Calico | Configure peering with router(s) at global scope (legacy)] *** Thursday 09 May 2019 02:18:11 -0300 (0:00:00.076) 0:04:38.025 ********** TASK [network_plugin/calico : Calico | Configure peering with route reflectors] *** Thursday 09 May 2019 02:18:11 -0300 (0:00:00.078) 0:04:38.104 ********** TASK [network_plugin/calico : Calico | Configure peering with route reflectors (legacy)] *** Thursday 09 May 2019 02:18:11 -0300 (0:00:00.188) 0:04:38.292 ********** TASK [network_plugin/calico : Calico | Create calico manifests] **************** Thursday 09 May 2019 02:18:11 -0300 (0:00:00.196) 0:04:38.489 ********** ok: [k8s-master01-lab-20190425] => (item={u'type': u'cm', u'name': u'calico-config', u'file': u'calico-config.yml'}) ok: [k8s-master01-lab-20190425] => (item={u'type': u'ds', u'name': u'calico-node', u'file': u'calico-node.yml'}) ok: [k8s-master01-lab-20190425] => (item={u'type': u'sa', u'name': u'calico', u'file': u'calico-node-sa.yml'}) ok: [k8s-master01-lab-20190425] => (item={u'type': u'clusterrole', u'name': u'calico', u'file': u'calico-cr.yml'}) ok: [k8s-master01-lab-20190425] => (item={u'type': u'clusterrolebinding', u'name': u'calico', u'file': u'calico-crb.yml'}) TASK [network_plugin/calico : Calico | Create calico manifests for kdd] ******** Thursday 09 May 2019 02:18:13 -0300 (0:00:02.070) 0:04:40.559 ********** TASK [network_plugin/calico : Calico | Create calico manifests for typha] ****** Thursday 09 May 2019 02:18:14 -0300 (0:00:00.211) 0:04:40.771 ********** TASK [network_plugin/flannel : Flannel | Create Flannel manifests] ************* Thursday 09 May 2019 02:18:14 -0300 (0:00:00.205) 0:04:40.977 ********** TASK [network_plugin/weave : Weave | Set cni directory permissions] ************ Thursday 09 May 2019 02:18:14 -0300 (0:00:00.213) 0:04:41.190 ********** TASK [network_plugin/weave : Weave | Copy cni plugins] ************************* Thursday 09 May 2019 02:18:14 -0300 (0:00:00.201) 0:04:41.391 ********** TASK [network_plugin/weave : Weave | Create manifest] ************************** Thursday 09 May 2019 02:18:14 -0300 (0:00:00.195) 0:04:41.587 ********** TASK [network_plugin/weave : Weave | Fix nodePort for Weave] ******************* Thursday 09 May 2019 02:18:15 -0300 (0:00:00.193) 0:04:41.781 ********** TASK [network_plugin/canal : Canal | Write Canal cni config] ******************* Thursday 09 May 2019 02:18:15 -0300 (0:00:00.192) 0:04:41.973 ********** TASK [network_plugin/canal : Canal | Create canal certs directory] ************* Thursday 09 May 2019 02:18:15 -0300 (0:00:00.212) 0:04:42.186 ********** TASK [network_plugin/canal : Canal | Link etcd certificates for canal-node] **** Thursday 09 May 2019 02:18:15 -0300 (0:00:00.199) 0:04:42.386 ********** TASK [network_plugin/canal : Canal | Set Flannel etcd configuration] *********** Thursday 09 May 2019 02:18:15 -0300 (0:00:00.258) 0:04:42.644 ********** TASK [network_plugin/canal : Canal | Create canal node manifests] ************** Thursday 09 May 2019 02:18:16 -0300 (0:00:00.065) 0:04:42.710 ********** TASK [network_plugin/canal : Canal | Install calicoctl wrapper script] ********* Thursday 09 May 2019 02:18:16 -0300 (0:00:00.274) 0:04:42.984 ********** TASK [network_plugin/canal : Canal | Create network policy directory] ********** Thursday 09 May 2019 02:18:16 -0300 (0:00:00.194) 0:04:43.179 ********** TASK [network_plugin/contiv : Contiv | Load openvswitch kernel module] ********* Thursday 09 May 2019 02:18:16 -0300 (0:00:00.207) 0:04:43.387 ********** TASK [network_plugin/contiv : Contiv | Create contiv etcd directories] ********* Thursday 09 May 2019 02:18:16 -0300 (0:00:00.225) 0:04:43.613 ********** TASK [network_plugin/contiv : Contiv | Workaround https://github.com/contiv/netplugin/issues/1152] *** Thursday 09 May 2019 02:18:17 -0300 (0:00:00.250) 0:04:43.863 ********** TASK [network_plugin/contiv : Contiv | Set necessary facts] ******************** Thursday 09 May 2019 02:18:17 -0300 (0:00:00.229) 0:04:44.093 ********** TASK [network_plugin/contiv : set_fact] **************************************** Thursday 09 May 2019 02:18:17 -0300 (0:00:00.201) 0:04:44.294 ********** TASK [network_plugin/contiv : Contiv | Create /var/contiv] ********************* Thursday 09 May 2019 02:18:17 -0300 (0:00:00.221) 0:04:44.516 ********** TASK [network_plugin/contiv : Contiv | Create contiv config directory] ********* Thursday 09 May 2019 02:18:18 -0300 (0:00:00.202) 0:04:44.718 ********** TASK [network_plugin/contiv : Contiv | Install all Kubernetes resources] ******* Thursday 09 May 2019 02:18:18 -0300 (0:00:00.202) 0:04:44.921 ********** TASK [network_plugin/contiv : Contiv | Copy certs generation script] *********** Thursday 09 May 2019 02:18:18 -0300 (0:00:00.229) 0:04:45.151 ********** TASK [network_plugin/contiv : Contiv | Check for cert key existence] *********** Thursday 09 May 2019 02:18:18 -0300 (0:00:00.120) 0:04:45.271 ********** TASK [network_plugin/contiv : Contiv | Generate contiv-api-proxy certificates] *** Thursday 09 May 2019 02:18:18 -0300 (0:00:00.104) 0:04:45.376 ********** TASK [network_plugin/contiv : Contiv | Fetch the generated certificate] ******** Thursday 09 May 2019 02:18:18 -0300 (0:00:00.105) 0:04:45.481 ********** TASK [network_plugin/contiv : Contiv | Copy the generated certificate on nodes] *** Thursday 09 May 2019 02:18:18 -0300 (0:00:00.081) 0:04:45.563 ********** TASK [network_plugin/contiv : Contiv | Set cni directory permissions] ********** Thursday 09 May 2019 02:18:19 -0300 (0:00:00.215) 0:04:45.779 ********** TASK [network_plugin/contiv : Contiv | Copy cni plugins] *********************** Thursday 09 May 2019 02:18:19 -0300 (0:00:00.200) 0:04:45.979 ********** TASK [network_plugin/contiv : Contiv | Copy netctl binary from docker container] *** Thursday 09 May 2019 02:18:19 -0300 (0:00:00.199) 0:04:46.179 ********** TASK [network_plugin/kube-router : kube-router | Add annotations on kube-master] *** Thursday 09 May 2019 02:18:19 -0300 (0:00:00.204) 0:04:46.384 ********** TASK [network_plugin/kube-router : kube-router | Add annotations on kube-node] *** Thursday 09 May 2019 02:18:19 -0300 (0:00:00.200) 0:04:46.585 ********** TASK [network_plugin/kube-router : kube-router | Add common annotations on all servers] *** Thursday 09 May 2019 02:18:20 -0300 (0:00:00.218) 0:04:46.803 ********** TASK [network_plugin/kube-router : kube-roter | Set cni directory permissions] *** Thursday 09 May 2019 02:18:20 -0300 (0:00:00.204) 0:04:47.008 ********** TASK [network_plugin/kube-router : kube-router | Copy cni plugins] ************* Thursday 09 May 2019 02:18:20 -0300 (0:00:00.195) 0:04:47.204 ********** TASK [network_plugin/kube-router : kube-router | Create manifest] ************** Thursday 09 May 2019 02:18:20 -0300 (0:00:00.214) 0:04:47.419 ********** TASK [network_plugin/cloud : Cloud | Set cni directory permissions] ************ Thursday 09 May 2019 02:18:20 -0300 (0:00:00.195) 0:04:47.614 ********** TASK [network_plugin/cloud : Canal | Copy cni plugins] ************************* Thursday 09 May 2019 02:18:21 -0300 (0:00:00.198) 0:04:47.813 ********** TASK [network_plugin/multus : Multus | Copy manifest files] ******************** Thursday 09 May 2019 02:18:21 -0300 (0:00:00.191) 0:04:48.004 ********** TASK [network_plugin/multus : Multus | Copy manifest templates] **************** Thursday 09 May 2019 02:18:21 -0300 (0:00:00.237) 0:04:48.241 ********** PLAY [kube-master[0]] ********************************************************** TASK [download : include_tasks] ************************************************ Thursday 09 May 2019 02:18:21 -0300 (0:00:00.217) 0:04:48.459 ********** TASK [download : Download items] *********************************************** Thursday 09 May 2019 02:18:21 -0300 (0:00:00.066) 0:04:48.525 ********** TASK [download : Sync container] *********************************************** Thursday 09 May 2019 02:18:22 -0300 (0:00:00.670) 0:04:49.196 ********** TASK [download : include_tasks] ************************************************ Thursday 09 May 2019 02:18:23 -0300 (0:00:00.663) 0:04:49.859 ********** TASK [kubespray-defaults : Configure defaults] ********************************* Thursday 09 May 2019 02:18:23 -0300 (0:00:00.070) 0:04:49.929 ********** ok: [k8s-master01-lab-20190425] => { "msg": "Check roles/kubespray-defaults/defaults/main.yml" } TASK [kubernetes-apps/rotate_tokens : Rotate Tokens | Get default token name] *** Thursday 09 May 2019 02:18:23 -0300 (0:00:00.206) 0:04:50.136 ********** TASK [kubernetes-apps/rotate_tokens : Rotate Tokens | Get default token data] *** Thursday 09 May 2019 02:18:23 -0300 (0:00:00.068) 0:04:50.204 ********** TASK [kubernetes-apps/rotate_tokens : Rotate Tokens | Test if default certificate is expired] *** Thursday 09 May 2019 02:18:23 -0300 (0:00:00.075) 0:04:50.280 ********** TASK [kubernetes-apps/rotate_tokens : Rotate Tokens | Determine if certificate is expired] *** Thursday 09 May 2019 02:18:23 -0300 (0:00:00.064) 0:04:50.345 ********** TASK [kubernetes-apps/rotate_tokens : Rotate Tokens | Get all serviceaccount tokens to expire] *** Thursday 09 May 2019 02:18:23 -0300 (0:00:00.064) 0:04:50.409 ********** TASK [kubernetes-apps/rotate_tokens : Rotate Tokens | Delete expired tokens] *** Thursday 09 May 2019 02:18:23 -0300 (0:00:00.064) 0:04:50.474 ********** TASK [kubernetes-apps/rotate_tokens : Rotate Tokens | Delete pods in system namespace] *** Thursday 09 May 2019 02:18:23 -0300 (0:00:00.066) 0:04:50.540 ********** TASK [win_nodes/kubernetes_patch : Ensure that user manifests directory exists] *** Thursday 09 May 2019 02:18:23 -0300 (0:00:00.062) 0:04:50.603 ********** ok: [k8s-master01-lab-20190425] TASK [win_nodes/kubernetes_patch : Copy kube-proxy daemonset nodeselector patch] *** Thursday 09 May 2019 02:18:24 -0300 (0:00:00.334) 0:04:50.937 ********** ok: [k8s-master01-lab-20190425] TASK [win_nodes/kubernetes_patch : Check current nodeselector for kube-proxy daemonset] *** Thursday 09 May 2019 02:18:24 -0300 (0:00:00.504) 0:04:51.442 ********** changed: [k8s-master01-lab-20190425] TASK [win_nodes/kubernetes_patch : Apply nodeselector patch for kube-proxy daemonset] *** Thursday 09 May 2019 02:18:25 -0300 (0:00:00.480) 0:04:51.922 ********** changed: [k8s-master01-lab-20190425] TASK [win_nodes/kubernetes_patch : debug] ************************************** Thursday 09 May 2019 02:18:25 -0300 (0:00:00.481) 0:04:52.404 ********** ok: [k8s-master01-lab-20190425] => { "msg": [ "daemonset.extensions/kube-proxy patched (no change)" ] } TASK [win_nodes/kubernetes_patch : debug] ************************************** Thursday 09 May 2019 02:18:25 -0300 (0:00:00.211) 0:04:52.616 ********** ok: [k8s-master01-lab-20190425] => { "msg": [] } PLAY [kube-master] ************************************************************* TASK [download : include_tasks] ************************************************ Thursday 09 May 2019 02:18:26 -0300 (0:00:00.254) 0:04:52.870 ********** TASK [download : Download items] *********************************************** Thursday 09 May 2019 02:18:26 -0300 (0:00:00.066) 0:04:52.936 ********** TASK [download : Sync container] *********************************************** Thursday 09 May 2019 02:18:26 -0300 (0:00:00.762) 0:04:53.699 ********** TASK [download : include_tasks] ************************************************ Thursday 09 May 2019 02:18:27 -0300 (0:00:00.754) 0:04:54.453 ********** TASK [kubespray-defaults : Configure defaults] ********************************* Thursday 09 May 2019 02:18:27 -0300 (0:00:00.075) 0:04:54.529 ********** ok: [k8s-master01-lab-20190425] => { "msg": "Check roles/kubespray-defaults/defaults/main.yml" } TASK [kubernetes-apps/network_plugin/cilium : Cilium | Start Resources] ******** Thursday 09 May 2019 02:18:27 -0300 (0:00:00.104) 0:04:54.634 ********** TASK [kubernetes-apps/network_plugin/cilium : Cilium | Wait for pods to run] *** Thursday 09 May 2019 02:18:28 -0300 (0:00:00.115) 0:04:54.749 ********** TASK [kubernetes-apps/network_plugin/calico : Start Calico resources] ********** Thursday 09 May 2019 02:18:28 -0300 (0:00:00.066) 0:04:54.816 ********** ok: [k8s-master01-lab-20190425] => (item=calico-config.yml) ok: [k8s-master01-lab-20190425] => (item=calico-node.yml) ok: [k8s-master01-lab-20190425] => (item=calico-node-sa.yml) ok: [k8s-master01-lab-20190425] => (item=calico-cr.yml) ok: [k8s-master01-lab-20190425] => (item=calico-crb.yml) TASK [kubernetes-apps/network_plugin/calico : calico upgrade complete] ********* Thursday 09 May 2019 02:18:30 -0300 (0:00:02.140) 0:04:56.957 ********** TASK [kubernetes-apps/network_plugin/canal : Canal | Start Resources] ********** Thursday 09 May 2019 02:18:30 -0300 (0:00:00.076) 0:04:57.033 ********** TASK [kubernetes-apps/network_plugin/flannel : Flannel | Start Resources] ****** Thursday 09 May 2019 02:18:30 -0300 (0:00:00.136) 0:04:57.170 ********** TASK [kubernetes-apps/network_plugin/flannel : Flannel | Wait for flannel subnet.env file presence] *** Thursday 09 May 2019 02:18:30 -0300 (0:00:00.087) 0:04:57.258 ********** TASK [kubernetes-apps/network_plugin/contiv : Contiv | Create Kubernetes resources] *** Thursday 09 May 2019 02:18:30 -0300 (0:00:00.065) 0:04:57.323 ********** TASK [kubernetes-apps/network_plugin/contiv : Contiv | Wait for netmaster] ***** Thursday 09 May 2019 02:18:30 -0300 (0:00:00.067) 0:04:57.391 ********** TASK [kubernetes-apps/network_plugin/contiv : Contiv | Get global configuration] *** Thursday 09 May 2019 02:18:30 -0300 (0:00:00.065) 0:04:57.456 ********** TASK [kubernetes-apps/network_plugin/contiv : set_fact] ************************ Thursday 09 May 2019 02:18:30 -0300 (0:00:00.064) 0:04:57.521 ********** TASK [kubernetes-apps/network_plugin/contiv : Contiv | Set global forwarding mode] *** Thursday 09 May 2019 02:18:30 -0300 (0:00:00.064) 0:04:57.585 ********** TASK [kubernetes-apps/network_plugin/contiv : Contiv | Set global fabric mode] *** Thursday 09 May 2019 02:18:30 -0300 (0:00:00.064) 0:04:57.650 ********** TASK [kubernetes-apps/network_plugin/contiv : Contiv | Set peer hostname] ****** Thursday 09 May 2019 02:18:31 -0300 (0:00:00.065) 0:04:57.715 ********** TASK [kubernetes-apps/network_plugin/contiv : Contiv | Get BGP configuration] *** Thursday 09 May 2019 02:18:31 -0300 (0:00:00.095) 0:04:57.811 ********** TASK [kubernetes-apps/network_plugin/contiv : Contiv | Configure peering with router(s)] *** Thursday 09 May 2019 02:18:31 -0300 (0:00:00.064) 0:04:57.875 ********** TASK [kubernetes-apps/network_plugin/contiv : Contiv | Get existing networks] *** Thursday 09 May 2019 02:18:31 -0300 (0:00:00.083) 0:04:57.959 ********** TASK [kubernetes-apps/network_plugin/contiv : Contiv | Create networks] ******** Thursday 09 May 2019 02:18:31 -0300 (0:00:00.065) 0:04:58.025 ********** TASK [kubernetes-apps/network_plugin/contiv : Contiv | Check if default group exists] *** Thursday 09 May 2019 02:18:31 -0300 (0:00:00.067) 0:04:58.092 ********** TASK [kubernetes-apps/network_plugin/contiv : Contiv | Create default group] *** Thursday 09 May 2019 02:18:31 -0300 (0:00:00.066) 0:04:58.159 ********** TASK [kubernetes-apps/network_plugin/cni : CNI | make sure /opt/cni/bin exists] *** Thursday 09 May 2019 02:18:31 -0300 (0:00:00.065) 0:04:58.224 ********** TASK [kubernetes-apps/network_plugin/cni : CNI | Copy cni plugins] ************* Thursday 09 May 2019 02:18:31 -0300 (0:00:00.064) 0:04:58.289 ********** TASK [kubernetes-apps/network_plugin/weave : Weave | Start Resources] ********** Thursday 09 May 2019 02:18:31 -0300 (0:00:00.065) 0:04:58.354 ********** TASK [kubernetes-apps/network_plugin/weave : Weave | Wait for Weave to become available] *** Thursday 09 May 2019 02:18:31 -0300 (0:00:00.065) 0:04:58.420 ********** TASK [kubernetes-apps/network_plugin/kube-router : kube-router | Start Resources] *** Thursday 09 May 2019 02:18:31 -0300 (0:00:00.066) 0:04:58.487 ********** TASK [kubernetes-apps/network_plugin/kube-router : kube-router | Wait for kube-router pods to be ready] *** Thursday 09 May 2019 02:18:31 -0300 (0:00:00.064) 0:04:58.552 ********** TASK [kubernetes-apps/network_plugin/multus : Multus | Start resources] ******** Thursday 09 May 2019 02:18:31 -0300 (0:00:00.067) 0:04:58.619 ********** TASK [policy_controller/calico : Set cert dir] ********************************* Thursday 09 May 2019 02:18:32 -0300 (0:00:00.121) 0:04:58.741 ********** TASK [policy_controller/calico : Create calico-kube-controllers manifests] ***** Thursday 09 May 2019 02:18:32 -0300 (0:00:00.072) 0:04:58.813 ********** ok: [k8s-master01-lab-20190425] => (item={u'type': u'deployment', u'name': u'calico-kube-controllers', u'file': u'calico-kube-controllers.yml'}) ok: [k8s-master01-lab-20190425] => (item={u'type': u'sa', u'name': u'calico-kube-controllers', u'file': u'calico-kube-sa.yml'}) ok: [k8s-master01-lab-20190425] => (item={u'type': u'clusterrole', u'name': u'calico-kube-controllers', u'file': u'calico-kube-cr.yml'}) ok: [k8s-master01-lab-20190425] => (item={u'type': u'clusterrolebinding', u'name': u'calico-kube-controllers', u'file': u'calico-kube-crb.yml'}) TASK [policy_controller/calico : Start of Calico kube controllers] ************* Thursday 09 May 2019 02:18:33 -0300 (0:00:01.515) 0:05:00.329 ********** ok: [k8s-master01-lab-20190425] => (item=calico-kube-controllers.yml) ok: [k8s-master01-lab-20190425] => (item=calico-kube-sa.yml) ok: [k8s-master01-lab-20190425] => (item=calico-kube-cr.yml) ok: [k8s-master01-lab-20190425] => (item=calico-kube-crb.yml) TASK [policy_controller/calico : Set cert dir] ********************************* Thursday 09 May 2019 02:18:35 -0300 (0:00:01.556) 0:05:01.886 ********** TASK [policy_controller/calico : Create calico-kube-controllers manifests] ***** Thursday 09 May 2019 02:18:35 -0300 (0:00:00.068) 0:05:01.955 ********** TASK [policy_controller/calico : Start of Calico kube controllers] ************* Thursday 09 May 2019 02:18:35 -0300 (0:00:00.103) 0:05:02.058 ********** TASK [kubernetes-apps/ingress_controller/ingress_nginx : NGINX Ingress Controller | Create addon dir] *** Thursday 09 May 2019 02:18:35 -0300 (0:00:00.108) 0:05:02.167 ********** TASK [kubernetes-apps/ingress_controller/ingress_nginx : NGINX Ingress Controller | Templates list] *** Thursday 09 May 2019 02:18:35 -0300 (0:00:00.063) 0:05:02.230 ********** TASK [kubernetes-apps/ingress_controller/ingress_nginx : NGINX Ingress Controller | Append extra templates to NGINX Ingress Templates list for PodSecurityPolicy] *** Thursday 09 May 2019 02:18:35 -0300 (0:00:00.065) 0:05:02.296 ********** TASK [kubernetes-apps/ingress_controller/ingress_nginx : NGINX Ingress Controller | Create manifests] *** Thursday 09 May 2019 02:18:35 -0300 (0:00:00.062) 0:05:02.359 ********** TASK [kubernetes-apps/ingress_controller/ingress_nginx : NGINX Ingress Controller | Apply manifests] *** Thursday 09 May 2019 02:18:35 -0300 (0:00:00.064) 0:05:02.423 ********** TASK [kubernetes-apps/ingress_controller/cert_manager : Cert Manager | Remove legacy addon dir and manifests] *** Thursday 09 May 2019 02:18:35 -0300 (0:00:00.064) 0:05:02.487 ********** TASK [kubernetes-apps/ingress_controller/cert_manager : Cert Manager | Remove legacy namespace] *** Thursday 09 May 2019 02:18:35 -0300 (0:00:00.061) 0:05:02.549 ********** TASK [kubernetes-apps/ingress_controller/cert_manager : Cert Manager | Create addon dir] *** Thursday 09 May 2019 02:18:35 -0300 (0:00:00.061) 0:05:02.611 ********** TASK [kubernetes-apps/ingress_controller/cert_manager : Cert Manager | Create manifests] *** Thursday 09 May 2019 02:18:35 -0300 (0:00:00.061) 0:05:02.672 ********** TASK [kubernetes-apps/ingress_controller/cert_manager : Cert Manager | Apply manifests] *** Thursday 09 May 2019 02:18:36 -0300 (0:00:00.131) 0:05:02.804 ********** TASK [kubernetes-apps/external_provisioner/local_volume_provisioner : Local Volume Provisioner | Ensure base dir is created on all hosts] *** Thursday 09 May 2019 02:18:36 -0300 (0:00:00.289) 0:05:03.093 ********** TASK [kubernetes-apps/external_provisioner/local_volume_provisioner : Local Volume Provisioner | Create addon dir] *** Thursday 09 May 2019 02:18:36 -0300 (0:00:00.096) 0:05:03.190 ********** TASK [kubernetes-apps/external_provisioner/local_volume_provisioner : Local Volume Provisioner | Templates list] *** Thursday 09 May 2019 02:18:36 -0300 (0:00:00.066) 0:05:03.257 ********** TASK [kubernetes-apps/external_provisioner/local_volume_provisioner : Local Volume Provisioner | Insert extra templates to Local Volume Provisioner templates list for PodSecurityPolicy] *** Thursday 09 May 2019 02:18:36 -0300 (0:00:00.065) 0:05:03.323 ********** TASK [kubernetes-apps/external_provisioner/local_volume_provisioner : Local Volume Provisioner | Create manifests] *** Thursday 09 May 2019 02:18:36 -0300 (0:00:00.062) 0:05:03.385 ********** TASK [kubernetes-apps/external_provisioner/local_volume_provisioner : Local Volume Provisioner | Apply manifests] *** Thursday 09 May 2019 02:18:36 -0300 (0:00:00.065) 0:05:03.451 ********** TASK [kubernetes-apps/external_provisioner/cephfs_provisioner : CephFS Provisioner | Remove legacy addon dir and manifests] *** Thursday 09 May 2019 02:18:36 -0300 (0:00:00.067) 0:05:03.519 ********** TASK [kubernetes-apps/external_provisioner/cephfs_provisioner : CephFS Provisioner | Remove legacy namespace] *** Thursday 09 May 2019 02:18:36 -0300 (0:00:00.064) 0:05:03.583 ********** TASK [kubernetes-apps/external_provisioner/cephfs_provisioner : CephFS Provisioner | Remove legacy storageclass] *** Thursday 09 May 2019 02:18:36 -0300 (0:00:00.063) 0:05:03.647 ********** TASK [kubernetes-apps/external_provisioner/cephfs_provisioner : CephFS Provisioner | Create addon dir] *** Thursday 09 May 2019 02:18:37 -0300 (0:00:00.062) 0:05:03.709 ********** TASK [kubernetes-apps/external_provisioner/cephfs_provisioner : CephFS Provisioner | Templates list] *** Thursday 09 May 2019 02:18:37 -0300 (0:00:00.085) 0:05:03.794 ********** TASK [kubernetes-apps/external_provisioner/cephfs_provisioner : CephFS Provisioner | Append extra templates to CephFS Provisioner Templates list for PodSecurityPolicy] *** Thursday 09 May 2019 02:18:37 -0300 (0:00:00.065) 0:05:03.860 ********** TASK [kubernetes-apps/external_provisioner/cephfs_provisioner : CephFS Provisioner | Create manifests] *** Thursday 09 May 2019 02:18:37 -0300 (0:00:00.062) 0:05:03.923 ********** TASK [kubernetes-apps/external_provisioner/cephfs_provisioner : CephFS Provisioner | Apply manifests] *** Thursday 09 May 2019 02:18:37 -0300 (0:00:00.068) 0:05:03.992 ********** TASK [kubernetes-apps/external_provisioner/rbd_provisioner : RBD Provisioner | Remove legacy addon dir and manifests] *** Thursday 09 May 2019 02:18:37 -0300 (0:00:00.068) 0:05:04.060 ********** TASK [kubernetes-apps/external_provisioner/rbd_provisioner : RBD Provisioner | Remove legacy namespace] *** Thursday 09 May 2019 02:18:37 -0300 (0:00:00.063) 0:05:04.123 ********** TASK [kubernetes-apps/external_provisioner/rbd_provisioner : RBD Provisioner | Remove legacy storageclass] *** Thursday 09 May 2019 02:18:37 -0300 (0:00:00.062) 0:05:04.186 ********** TASK [kubernetes-apps/external_provisioner/rbd_provisioner : RBD Provisioner | Create addon dir] *** Thursday 09 May 2019 02:18:37 -0300 (0:00:00.060) 0:05:04.247 ********** TASK [kubernetes-apps/external_provisioner/rbd_provisioner : RBD Provisioner | Templates list] *** Thursday 09 May 2019 02:18:37 -0300 (0:00:00.060) 0:05:04.308 ********** TASK [kubernetes-apps/external_provisioner/rbd_provisioner : RBD Provisioner | Append extra templates to RBD Provisioner Templates list for PodSecurityPolicy] *** Thursday 09 May 2019 02:18:37 -0300 (0:00:00.061) 0:05:04.370 ********** TASK [kubernetes-apps/external_provisioner/rbd_provisioner : RBD Provisioner | Create manifests] *** Thursday 09 May 2019 02:18:37 -0300 (0:00:00.061) 0:05:04.431 ********** TASK [kubernetes-apps/external_provisioner/rbd_provisioner : RBD Provisioner | Apply manifests] *** Thursday 09 May 2019 02:18:37 -0300 (0:00:00.082) 0:05:04.514 ********** TASK [kubernetes-apps/external_provisioner/local_path_provisioner : Local Path Provisioner | Create addon dir] *** Thursday 09 May 2019 02:18:37 -0300 (0:00:00.064) 0:05:04.578 ********** TASK [kubernetes-apps/external_provisioner/local_path_provisioner : Local Path Provisioner | Create claim root dir] *** Thursday 09 May 2019 02:18:37 -0300 (0:00:00.064) 0:05:04.643 ********** TASK [kubernetes-apps/external_provisioner/local_path_provisioner : Local Path Provisioner | Render Template] *** Thursday 09 May 2019 02:18:37 -0300 (0:00:00.065) 0:05:04.708 ********** TASK [kubernetes-apps/external_provisioner/local_path_provisioner : Local Path Provisioner | Create manifests] *** Thursday 09 May 2019 02:18:38 -0300 (0:00:00.065) 0:05:04.773 ********** TASK [kubernetes-apps/external_provisioner/local_path_provisioner : Local Path Provisioner | Apply manifests] *** Thursday 09 May 2019 02:18:38 -0300 (0:00:00.066) 0:05:04.840 ********** PLAY [calico-rr] *************************************************************** skipping: no hosts matched PLAY [kube-master] ************************************************************* TASK [download : include_tasks] ************************************************ Thursday 09 May 2019 02:18:38 -0300 (0:00:00.106) 0:05:04.947 ********** TASK [download : Download items] *********************************************** Thursday 09 May 2019 02:18:38 -0300 (0:00:00.065) 0:05:05.013 ********** TASK [download : Sync container] *********************************************** Thursday 09 May 2019 02:18:38 -0300 (0:00:00.681) 0:05:05.695 ********** TASK [download : include_tasks] ************************************************ Thursday 09 May 2019 02:18:39 -0300 (0:00:00.673) 0:05:06.368 ********** TASK [kubespray-defaults : Configure defaults] ********************************* Thursday 09 May 2019 02:18:39 -0300 (0:00:00.071) 0:05:06.439 ********** ok: [k8s-master01-lab-20190425] => { "msg": "Check roles/kubespray-defaults/defaults/main.yml" } TASK [kubernetes-apps/ansible : Kubernetes Apps | Wait for kube-apiserver] ***** Thursday 09 May 2019 02:18:39 -0300 (0:00:00.114) 0:05:06.554 ********** ok: [k8s-master01-lab-20190425] TASK [kubernetes-apps/ansible : Kubernetes Apps | Delete kubeadm CoreDNS] ****** Thursday 09 May 2019 02:18:40 -0300 (0:00:00.536) 0:05:07.091 ********** TASK [kubernetes-apps/ansible : Kubernetes Apps | Lay Down CoreDNS Template] *** Thursday 09 May 2019 02:18:40 -0300 (0:00:00.072) 0:05:07.163 ********** ok: [k8s-master01-lab-20190425] => (item={u'module': u'template', u'type': u'configmap', u'name': u'coredns', u'file': u'coredns-config.yml'}) ok: [k8s-master01-lab-20190425] => (item={u'module': u'copy', u'type': u'sa', u'name': u'coredns', u'file': u'coredns-sa.yml'}) ok: [k8s-master01-lab-20190425] => (item={u'module': u'template', u'type': u'deployment', u'name': u'coredns', u'file': u'coredns-deployment.yml'}) ok: [k8s-master01-lab-20190425] => (item={u'module': u'template', u'type': u'svc', u'name': u'coredns', u'file': u'coredns-svc.yml'}) ok: [k8s-master01-lab-20190425] => (item={u'module': u'copy', u'type': u'clusterrole', u'name': u'coredns', u'file': u'coredns-clusterrole.yml'}) ok: [k8s-master01-lab-20190425] => (item={u'module': u'copy', u'type': u'clusterrolebinding', u'name': u'coredns', u'file': u'coredns-clusterrolebinding.yml'}) ok: [k8s-master01-lab-20190425] => (item={u'module': u'copy', u'type': u'sa', u'name': u'dns-autoscaler', u'file': u'dns-autoscaler-sa.yml'}) ok: [k8s-master01-lab-20190425] => (item={u'module': u'copy', u'type': u'clusterrole', u'name': u'dns-autoscaler', u'file': u'dns-autoscaler-clusterrole.yml'}) ok: [k8s-master01-lab-20190425] => (item={u'module': u'copy', u'type': u'clusterrolebinding', u'name': u'dns-autoscaler', u'file': u'dns-autoscaler-clusterrolebinding.yml'}) ok: [k8s-master01-lab-20190425] => (item={u'module': u'template', u'type': u'deployment', u'name': u'dns-autoscaler', u'file': u'dns-autoscaler.yml'}) TASK [kubernetes-apps/ansible : Kubernetes Apps | Lay Down Secondary CoreDNS Template] *** Thursday 09 May 2019 02:18:43 -0300 (0:00:03.306) 0:05:10.469 ********** TASK [kubernetes-apps/ansible : Kubernetes Apps | set up necessary nodelocaldns parameters] *** Thursday 09 May 2019 02:18:43 -0300 (0:00:00.136) 0:05:10.606 ********** ok: [k8s-master01-lab-20190425] TASK [kubernetes-apps/ansible : Kubernetes Apps | Lay Down nodelocaldns Template] *** Thursday 09 May 2019 02:18:44 -0300 (0:00:00.134) 0:05:10.741 ********** ok: [k8s-master01-lab-20190425] => (item={u'type': u'configmap', u'name': u'nodelocaldns', u'file': u'nodelocaldns-config.yml'}) ok: [k8s-master01-lab-20190425] => (item={u'type': u'sa', u'name': u'nodelocaldns', u'file': u'nodelocaldns-sa.yml'}) ok: [k8s-master01-lab-20190425] => (item={u'type': u'daemonset', u'name': u'nodelocaldns', u'file': u'nodelocaldns-daemonset.yml'}) TASK [kubernetes-apps/ansible : Kubernetes Apps | Start Resources] ************* Thursday 09 May 2019 02:18:45 -0300 (0:00:01.084) 0:05:11.825 ********** ok: [k8s-master01-lab-20190425] => (item=coredns-config.yml) ok: [k8s-master01-lab-20190425] => (item=coredns-sa.yml) ok: [k8s-master01-lab-20190425] => (item=coredns-deployment.yml) ok: [k8s-master01-lab-20190425] => (item=coredns-svc.yml) ok: [k8s-master01-lab-20190425] => (item=coredns-clusterrole.yml) ok: [k8s-master01-lab-20190425] => (item=coredns-clusterrolebinding.yml) ok: [k8s-master01-lab-20190425] => (item=dns-autoscaler-sa.yml) ok: [k8s-master01-lab-20190425] => (item=dns-autoscaler-clusterrole.yml) ok: [k8s-master01-lab-20190425] => (item=dns-autoscaler-clusterrolebinding.yml) ok: [k8s-master01-lab-20190425] => (item=dns-autoscaler.yml) ok: [k8s-master01-lab-20190425] => (item=nodelocaldns-config.yml) ok: [k8s-master01-lab-20190425] => (item=nodelocaldns-sa.yml) ok: [k8s-master01-lab-20190425] => (item=nodelocaldns-daemonset.yml) TASK [kubernetes-apps/ansible : Kubernetes Apps | Check if netchecker-server manifest already exists] *** Thursday 09 May 2019 02:18:50 -0300 (0:00:05.219) 0:05:17.045 ********** TASK [kubernetes-apps/ansible : Kubernetes Apps | Apply netchecker-server manifest to update annotations] *** Thursday 09 May 2019 02:18:50 -0300 (0:00:00.068) 0:05:17.113 ********** TASK [kubernetes-apps/ansible : Kubernetes Apps | Netchecker Templates list] *** Thursday 09 May 2019 02:18:50 -0300 (0:00:00.068) 0:05:17.182 ********** TASK [kubernetes-apps/ansible : Kubernetes Apps | Append extra templates to Netchecker Templates list for PodSecurityPolicy] *** Thursday 09 May 2019 02:18:50 -0300 (0:00:00.065) 0:05:17.248 ********** TASK [kubernetes-apps/ansible : Kubernetes Apps | Lay Down Netchecker Template] *** Thursday 09 May 2019 02:18:50 -0300 (0:00:00.064) 0:05:17.312 ********** TASK [kubernetes-apps/ansible : Kubernetes Apps | Start Netchecker Resources] *** Thursday 09 May 2019 02:18:50 -0300 (0:00:00.065) 0:05:17.378 ********** TASK [kubernetes-apps/ansible : Kubernetes Apps | Lay down dashboard template] *** Thursday 09 May 2019 02:18:50 -0300 (0:00:00.068) 0:05:17.446 ********** TASK [kubernetes-apps/ansible : Kubernetes Apps | Start dashboard] ************* Thursday 09 May 2019 02:18:50 -0300 (0:00:00.069) 0:05:17.516 ********** TASK [kubernetes-apps/helm : Helm | Make sure HELM_HOME directory exists] ****** Thursday 09 May 2019 02:18:50 -0300 (0:00:00.077) 0:05:17.593 ********** ok: [k8s-master01-lab-20190425] TASK [kubernetes-apps/helm : Helm | Set up helm launcher] ********************** Thursday 09 May 2019 02:18:51 -0300 (0:00:00.255) 0:05:17.849 ********** included: /kubespray/roles/kubernetes-apps/helm/tasks/install_host.yml for k8s-master01-lab-20190425 TASK [kubernetes-apps/helm : Helm | Compare host helm with hyperkube container] *** Thursday 09 May 2019 02:18:51 -0300 (0:00:00.109) 0:05:17.959 ********** ok: [k8s-master01-lab-20190425] TASK [kubernetes-apps/helm : Helm | Copy helm from helm container] ************* Thursday 09 May 2019 02:18:53 -0300 (0:00:01.869) 0:05:19.829 ********** TASK [kubernetes-apps/helm : Helm | Copy socat wrapper for Container Linux] **** Thursday 09 May 2019 02:18:53 -0300 (0:00:00.069) 0:05:19.899 ********** TASK [kubernetes-apps/helm : Helm | Lay Down Helm Manifests (RBAC)] ************ Thursday 09 May 2019 02:18:53 -0300 (0:00:00.065) 0:05:19.964 ********** ok: [k8s-master01-lab-20190425] => (item={u'type': u'namespace', u'name': u'tiller', u'file': u'tiller-namespace.yml'}) ok: [k8s-master01-lab-20190425] => (item={u'type': u'sa', u'name': u'tiller', u'file': u'tiller-sa.yml'}) ok: [k8s-master01-lab-20190425] => (item={u'type': u'clusterrolebinding', u'name': u'tiller', u'file': u'tiller-clusterrolebinding.yml'}) TASK [kubernetes-apps/helm : Helm | Apply Helm Manifests (RBAC)] *************** Thursday 09 May 2019 02:18:54 -0300 (0:00:01.038) 0:05:21.002 ********** ok: [k8s-master01-lab-20190425] => (item={'_ansible_parsed': True, u'uid': 0, 'dest': u'/etc/kubernetes/tiller-namespace.yml', '_ansible_item_result': True, u'path': u'/etc/kubernetes/tiller-namespace.yml', u'owner': u'root', 'diff': {u'after': {u'path': u'/etc/kubernetes/tiller-namespace.yml'}, u'before': {u'path': u'/etc/kubernetes/tiller-namespace.yml'}}, '_ansible_no_log': False, u'group': u'root', '_ansible_item_label': {u'type': u'namespace', u'name': u'tiller', u'file': u'tiller-namespace.yml'}, 'item': {u'type': u'namespace', u'name': u'tiller', u'file': u'tiller-namespace.yml'}, 'checksum': u'cc0afb8e806c428a1ded62519eae45645c2268c7', u'changed': False, 'failed': False, u'state': u'file', u'gid': 0, u'mode': u'0644', u'invocation': {u'module_args': {u'directory_mode': None, u'force': False, u'remote_src': None, u'dest': u'/etc/kubernetes/tiller-namespace.yml', u'access_time': None, u'access_time_format': u'%Y%m%d%H%M.%S', u'_original_basename': u'tiller-namespace.yml.j2', u'state': u'file', u'follow': False, u'owner': None, u'path': u'/etc/kubernetes/tiller-namespace.yml', u'src': None, u'group': None, u'modification_time': None, u'unsafe_writes': None, u'delimiter': None, u'regexp': None, u'seuser': None, u'recurse': False, u'serole': None, u'_diff_peek': None, u'content': None, u'setype': None, u'mode': None, u'modification_time_format': u'%Y%m%d%H%M.%S', u'selevel': None, u'attributes': None, u'backup': None}}, u'size': 63, '_ansible_ignore_errors': None}) ok: [k8s-master01-lab-20190425] => (item={'_ansible_parsed': True, u'uid': 0, 'dest': u'/etc/kubernetes/tiller-sa.yml', '_ansible_item_result': True, u'path': u'/etc/kubernetes/tiller-sa.yml', u'owner': u'root', 'diff': {u'after': {u'path': u'/etc/kubernetes/tiller-sa.yml'}, u'before': {u'path': u'/etc/kubernetes/tiller-sa.yml'}}, '_ansible_no_log': False, u'group': u'root', '_ansible_item_label': {u'type': u'sa', u'name': u'tiller', u'file': u'tiller-sa.yml'}, 'item': {u'type': u'sa', u'name': u'tiller', u'file': u'tiller-sa.yml'}, 'checksum': u'4b11a54f4bf09d5835616e439e607ddd1fd92a1e', u'changed': False, 'failed': False, u'state': u'file', u'gid': 0, u'mode': u'0644', u'invocation': {u'module_args': {u'directory_mode': None, u'force': False, u'remote_src': None, u'dest': u'/etc/kubernetes/tiller-sa.yml', u'access_time': None, u'access_time_format': u'%Y%m%d%H%M.%S', u'_original_basename': u'tiller-sa.yml.j2', u'state': u'file', u'follow': False, u'owner': None, u'path': u'/etc/kubernetes/tiller-sa.yml', u'src': None, u'group': None, u'modification_time': None, u'unsafe_writes': None, u'delimiter': None, u'regexp': None, u'seuser': None, u'recurse': False, u'serole': None, u'_diff_peek': None, u'content': None, u'setype': None, u'mode': None, u'modification_time_format': u'%Y%m%d%H%M.%S', u'selevel': None, u'attributes': None, u'backup': None}}, u'size': 142, '_ansible_ignore_errors': None}) ok: [k8s-master01-lab-20190425] => (item={'_ansible_parsed': True, u'uid': 0, 'dest': u'/etc/kubernetes/tiller-clusterrolebinding.yml', '_ansible_item_result': True, u'path': u'/etc/kubernetes/tiller-clusterrolebinding.yml', u'owner': u'root', 'diff': {u'after': {u'path': u'/etc/kubernetes/tiller-clusterrolebinding.yml'}, u'before': {u'path': u'/etc/kubernetes/tiller-clusterrolebinding.yml'}}, '_ansible_no_log': False, u'group': u'root', '_ansible_item_label': {u'type': u'clusterrolebinding', u'name': u'tiller', u'file': u'tiller-clusterrolebinding.yml'}, 'item': {u'type': u'clusterrolebinding', u'name': u'tiller', u'file': u'tiller-clusterrolebinding.yml'}, 'checksum': u'b80838b730cd2b1e85ac0ebeabacfe85e6f61d42', u'changed': False, 'failed': False, u'state': u'file', u'gid': 0, u'mode': u'0644', u'invocation': {u'module_args': {u'directory_mode': None, u'force': False, u'remote_src': None, u'dest': u'/etc/kubernetes/tiller-clusterrolebinding.yml', u'access_time': None, u'access_time_format': u'%Y%m%d%H%M.%S', u'_original_basename': u'tiller-clusterrolebinding.yml.j2', u'state': u'file', u'follow': False, u'owner': None, u'path': u'/etc/kubernetes/tiller-clusterrolebinding.yml', u'src': None, u'group': None, u'modification_time': None, u'unsafe_writes': None, u'delimiter': None, u'regexp': None, u'seuser': None, u'recurse': False, u'serole': None, u'_diff_peek': None, u'content': None, u'setype': None, u'mode': None, u'modification_time_format': u'%Y%m%d%H%M.%S', u'selevel': None, u'attributes': None, u'backup': None}}, u'size': 293, '_ansible_ignore_errors': None}) TASK [kubernetes-apps/helm : Helm | Set up TLS] ******************************** Thursday 09 May 2019 02:18:55 -0300 (0:00:01.236) 0:05:22.239 ********** TASK [kubernetes-apps/helm : Helm | Install/upgrade helm] ********************** Thursday 09 May 2019 02:18:55 -0300 (0:00:00.064) 0:05:22.304 ********** ok: [k8s-master01-lab-20190425] TASK [kubernetes-apps/helm : Helm | Force apply tiller overrides if necessary] *** Thursday 09 May 2019 02:18:55 -0300 (0:00:00.310) 0:05:22.614 ********** ok: [k8s-master01-lab-20190425] TASK [kubernetes-apps/helm : Make sure bash_completion.d folder exists] ******** Thursday 09 May 2019 02:18:56 -0300 (0:00:00.562) 0:05:23.177 ********** TASK [kubernetes-apps/helm : Helm | Set up bash completion] ******************** Thursday 09 May 2019 02:18:56 -0300 (0:00:00.075) 0:05:23.252 ********** TASK [kubernetes-apps/registry : Registry | Create addon dir] ****************** Thursday 09 May 2019 02:18:56 -0300 (0:00:00.066) 0:05:23.318 ********** TASK [kubernetes-apps/registry : Registry | Templates list] ******************** Thursday 09 May 2019 02:18:56 -0300 (0:00:00.061) 0:05:23.379 ********** TASK [kubernetes-apps/registry : Registry | Append extra templates to Registry Templates list for PodSecurityPolicy] *** Thursday 09 May 2019 02:18:56 -0300 (0:00:00.062) 0:05:23.442 ********** TASK [kubernetes-apps/registry : Registry | Create manifests] ****************** Thursday 09 May 2019 02:18:56 -0300 (0:00:00.061) 0:05:23.504 ********** TASK [kubernetes-apps/registry : Registry | Apply manifests] ******************* Thursday 09 May 2019 02:18:56 -0300 (0:00:00.063) 0:05:23.567 ********** TASK [kubernetes-apps/registry : Registry | Create PVC manifests] ************** Thursday 09 May 2019 02:18:56 -0300 (0:00:00.065) 0:05:23.633 ********** TASK [kubernetes-apps/registry : Registry | Apply PVC manifests] *************** Thursday 09 May 2019 02:18:56 -0300 (0:00:00.067) 0:05:23.701 ********** TASK [kubernetes-apps/metrics_server : Check all masters are node or not] ****** Thursday 09 May 2019 02:18:57 -0300 (0:00:00.068) 0:05:23.769 ********** TASK [kubernetes-apps/metrics_server : Metrics Server | Delete addon dir] ****** Thursday 09 May 2019 02:18:57 -0300 (0:00:00.059) 0:05:23.829 ********** TASK [kubernetes-apps/metrics_server : Metrics Server | Create addon dir] ****** Thursday 09 May 2019 02:18:57 -0300 (0:00:00.059) 0:05:23.889 ********** TASK [kubernetes-apps/metrics_server : Metrics Server | Templates list] ******** Thursday 09 May 2019 02:18:57 -0300 (0:00:00.059) 0:05:23.949 ********** TASK [kubernetes-apps/metrics_server : Metrics Server | Create manifests] ****** Thursday 09 May 2019 02:18:57 -0300 (0:00:00.068) 0:05:24.018 ********** TASK [kubernetes-apps/metrics_server : Metrics Server | Apply manifests] ******* Thursday 09 May 2019 02:18:57 -0300 (0:00:00.063) 0:05:24.081 ********** TASK [kubernetes-apps/persistent_volumes/openstack : Kubernetes Persistent Volumes | Lay down OpenStack Cinder Storage Class template] *** Thursday 09 May 2019 02:18:57 -0300 (0:00:00.063) 0:05:24.145 ********** TASK [kubernetes-apps/persistent_volumes/openstack : Kubernetes Persistent Volumes | Add OpenStack Cinder Storage Class] *** Thursday 09 May 2019 02:18:57 -0300 (0:00:00.061) 0:05:24.206 ********** TASK [kubernetes-apps/container_engine_accelerator/nvidia_gpu : Container Engine Acceleration Nvidia GPU| gather os specific variables] *** Thursday 09 May 2019 02:18:57 -0300 (0:00:00.060) 0:05:24.267 ********** TASK [kubernetes-apps/container_engine_accelerator/nvidia_gpu : Container Engine Acceleration Nvidia GPU | Set fact of download url Tesla] *** Thursday 09 May 2019 02:18:57 -0300 (0:00:00.077) 0:05:24.345 ********** TASK [kubernetes-apps/container_engine_accelerator/nvidia_gpu : Container Engine Acceleration Nvidia GPU | Set fact of download url GTX] *** Thursday 09 May 2019 02:18:57 -0300 (0:00:00.060) 0:05:24.405 ********** TASK [kubernetes-apps/container_engine_accelerator/nvidia_gpu : Container Engine Acceleration Nvidia GPU | Create addon dir] *** Thursday 09 May 2019 02:18:57 -0300 (0:00:00.060) 0:05:24.466 ********** TASK [kubernetes-apps/container_engine_accelerator/nvidia_gpu : Container Engine Acceleration Nvidia GPU | Create manifests for nvidia accelerators] *** Thursday 09 May 2019 02:18:57 -0300 (0:00:00.060) 0:05:24.526 ********** TASK [kubernetes-apps/container_engine_accelerator/nvidia_gpu : Container Engine Acceleration Nvidia GPU | Apply manifests for nvidia accelerators] *** Thursday 09 May 2019 02:18:57 -0300 (0:00:00.073) 0:05:24.600 ********** TASK [kubernetes-apps/cloud_controller/oci : OCI Cloud Controller | Credentials Check | oci_private_key] *** Thursday 09 May 2019 02:18:57 -0300 (0:00:00.084) 0:05:24.685 ********** TASK [kubernetes-apps/cloud_controller/oci : OCI Cloud Controller | Credentials Check | oci_region_id] *** Thursday 09 May 2019 02:18:58 -0300 (0:00:00.075) 0:05:24.761 ********** TASK [kubernetes-apps/cloud_controller/oci : OCI Cloud Controller | Credentials Check | oci_tenancy_id] *** Thursday 09 May 2019 02:18:58 -0300 (0:00:00.063) 0:05:24.825 ********** TASK [kubernetes-apps/cloud_controller/oci : OCI Cloud Controller | Credentials Check | oci_user_id] *** Thursday 09 May 2019 02:18:58 -0300 (0:00:00.064) 0:05:24.889 ********** TASK [kubernetes-apps/cloud_controller/oci : OCI Cloud Controller | Credentials Check | oci_user_fingerprint] *** Thursday 09 May 2019 02:18:58 -0300 (0:00:00.064) 0:05:24.953 ********** TASK [kubernetes-apps/cloud_controller/oci : OCI Cloud Controller | Credentials Check | oci_compartment_id] *** Thursday 09 May 2019 02:18:58 -0300 (0:00:00.063) 0:05:25.017 ********** TASK [kubernetes-apps/cloud_controller/oci : OCI Cloud Controller | Credentials Check | oci_vnc_id] *** Thursday 09 May 2019 02:18:58 -0300 (0:00:00.064) 0:05:25.082 ********** TASK [kubernetes-apps/cloud_controller/oci : OCI Cloud Controller | Credentials Check | oci_subnet1_id] *** Thursday 09 May 2019 02:18:58 -0300 (0:00:00.064) 0:05:25.146 ********** TASK [kubernetes-apps/cloud_controller/oci : OCI Cloud Controller | Credentials Check | oci_subnet2_id] *** Thursday 09 May 2019 02:18:58 -0300 (0:00:00.063) 0:05:25.210 ********** TASK [kubernetes-apps/cloud_controller/oci : OCI Cloud Controller | Credentials Check | oci_security_list_management] *** Thursday 09 May 2019 02:18:58 -0300 (0:00:00.062) 0:05:25.273 ********** TASK [kubernetes-apps/cloud_controller/oci : OCI Cloud Controller | Generate Cloud Provider Configuration] *** Thursday 09 May 2019 02:18:58 -0300 (0:00:00.062) 0:05:25.335 ********** TASK [kubernetes-apps/cloud_controller/oci : OCI Cloud Controller | Slurp Configuration] *** Thursday 09 May 2019 02:18:58 -0300 (0:00:00.062) 0:05:25.397 ********** TASK [kubernetes-apps/cloud_controller/oci : OCI Cloud Controller | Encode Configuration] *** Thursday 09 May 2019 02:18:58 -0300 (0:00:00.078) 0:05:25.475 ********** TASK [kubernetes-apps/cloud_controller/oci : OCI Cloud Controller | Generate Manifests] *** Thursday 09 May 2019 02:18:58 -0300 (0:00:00.063) 0:05:25.539 ********** TASK [kubernetes-apps/cloud_controller/oci : OCI Cloud Controller | Apply Manifests] *** Thursday 09 May 2019 02:18:58 -0300 (0:00:00.063) 0:05:25.603 ********** PLAY [k8s-cluster] ************************************************************* TASK [download : include_tasks] ************************************************ Thursday 09 May 2019 02:18:59 -0300 (0:00:00.118) 0:05:25.721 ********** TASK [download : Download items] *********************************************** Thursday 09 May 2019 02:18:59 -0300 (0:00:00.193) 0:05:25.914 ********** TASK [download : Sync container] *********************************************** Thursday 09 May 2019 02:19:00 -0300 (0:00:00.918) 0:05:26.832 ********** TASK [download : include_tasks] ************************************************ Thursday 09 May 2019 02:19:01 -0300 (0:00:00.932) 0:05:27.765 ********** TASK [kubespray-defaults : Configure defaults] ********************************* Thursday 09 May 2019 02:19:01 -0300 (0:00:00.203) 0:05:27.969 ********** ok: [k8s-master01-lab-20190425] => { "msg": "Check roles/kubespray-defaults/defaults/main.yml" } ok: [k8s-node01-lab] => { "msg": "Check roles/kubespray-defaults/defaults/main.yml" } ok: [k8s-node02-lab] => { "msg": "Check roles/kubespray-defaults/defaults/main.yml" } TASK [adduser : User | Create User Group] ************************************** Thursday 09 May 2019 02:19:01 -0300 (0:00:00.239) 0:05:28.208 ********** TASK [adduser : User | Create User] ******************************************** Thursday 09 May 2019 02:19:01 -0300 (0:00:00.195) 0:05:28.404 ********** TASK [kubernetes/preinstall : Remove swapfile from /etc/fstab] ***************** Thursday 09 May 2019 02:19:01 -0300 (0:00:00.192) 0:05:28.597 ********** TASK [kubernetes/preinstall : check swap] ************************************** Thursday 09 May 2019 02:19:02 -0300 (0:00:00.216) 0:05:28.814 ********** TASK [kubernetes/preinstall : Disable swap] ************************************ Thursday 09 May 2019 02:19:02 -0300 (0:00:00.193) 0:05:29.008 ********** TASK [kubernetes/preinstall : Stop if either kube-master, kube-node or etcd is empty] *** Thursday 09 May 2019 02:19:02 -0300 (0:00:00.193) 0:05:29.201 ********** TASK [kubernetes/preinstall : Stop if non systemd OS type] ********************* Thursday 09 May 2019 02:19:02 -0300 (0:00:00.088) 0:05:29.289 ********** TASK [kubernetes/preinstall : Stop if unknown OS] ****************************** Thursday 09 May 2019 02:19:02 -0300 (0:00:00.192) 0:05:29.482 ********** TASK [kubernetes/preinstall : Stop if unknown network plugin] ****************** Thursday 09 May 2019 02:19:02 -0300 (0:00:00.200) 0:05:29.683 ********** TASK [kubernetes/preinstall : Stop if incompatible network plugin and cloudprovider] *** Thursday 09 May 2019 02:19:03 -0300 (0:00:00.195) 0:05:29.878 ********** TASK [kubernetes/preinstall : Stop if known booleans are set as strings (Use JSON format on CLI: -e "{'key': true }")] *** Thursday 09 May 2019 02:19:03 -0300 (0:00:00.194) 0:05:30.073 ********** TASK [kubernetes/preinstall : Stop if even number of etcd hosts] *************** Thursday 09 May 2019 02:19:03 -0300 (0:00:00.113) 0:05:30.187 ********** TASK [kubernetes/preinstall : Stop if memory is too small for masters] ********* Thursday 09 May 2019 02:19:03 -0300 (0:00:00.192) 0:05:30.379 ********** TASK [kubernetes/preinstall : Stop if memory is too small for nodes] *********** Thursday 09 May 2019 02:19:03 -0300 (0:00:00.198) 0:05:30.577 ********** TASK [kubernetes/preinstall : Guarantee that enough network address space is available for all pods] *** Thursday 09 May 2019 02:19:04 -0300 (0:00:00.194) 0:05:30.772 ********** TASK [kubernetes/preinstall : Stop if ip var does not match local ips] ********* Thursday 09 May 2019 02:19:04 -0300 (0:00:00.193) 0:05:30.966 ********** TASK [kubernetes/preinstall : Stop if access_ip is not pingable] *************** Thursday 09 May 2019 02:19:04 -0300 (0:00:00.192) 0:05:31.159 ********** TASK [kubernetes/preinstall : Stop if RBAC is not enabled when dashboard is enabled] *** Thursday 09 May 2019 02:19:04 -0300 (0:00:00.211) 0:05:31.371 ********** TASK [kubernetes/preinstall : Stop if RBAC is not enabled when OCI cloud controller is enabled] *** Thursday 09 May 2019 02:19:04 -0300 (0:00:00.193) 0:05:31.564 ********** TASK [kubernetes/preinstall : Stop if RBAC and anonymous-auth are not enabled when insecure port is disabled] *** Thursday 09 May 2019 02:19:05 -0300 (0:00:00.191) 0:05:31.756 ********** TASK [kubernetes/preinstall : Stop if kernel version is too low] *************** Thursday 09 May 2019 02:19:05 -0300 (0:00:00.190) 0:05:31.946 ********** TASK [kubernetes/preinstall : Stop if bad hostname] **************************** Thursday 09 May 2019 02:19:05 -0300 (0:00:00.204) 0:05:32.151 ********** TASK [kubernetes/preinstall : check cloud_provider value] ********************** Thursday 09 May 2019 02:19:05 -0300 (0:00:00.194) 0:05:32.346 ********** TASK [kubernetes/preinstall : Get current version of calico cluster version] *** Thursday 09 May 2019 02:19:05 -0300 (0:00:00.196) 0:05:32.542 ********** TASK [kubernetes/preinstall : Check that calico version is enough for upgrade] *** Thursday 09 May 2019 02:19:05 -0300 (0:00:00.068) 0:05:32.611 ********** TASK [kubernetes/preinstall : Check that kube_service_addresses is a network range] *** Thursday 09 May 2019 02:19:05 -0300 (0:00:00.067) 0:05:32.678 ********** TASK [kubernetes/preinstall : Check that kube_pods_subnet is a network range] *** Thursday 09 May 2019 02:19:06 -0300 (0:00:00.068) 0:05:32.746 ********** TASK [kubernetes/preinstall : Check that kube_pods_subnet does not collide with kube_service_addresses] *** Thursday 09 May 2019 02:19:06 -0300 (0:00:00.065) 0:05:32.812 ********** TASK [kubernetes/preinstall : Stop if unknown dns mode] ************************ Thursday 09 May 2019 02:19:06 -0300 (0:00:00.065) 0:05:32.878 ********** TASK [kubernetes/preinstall : Stop if unknown kube proxy mode] ***************** Thursday 09 May 2019 02:19:06 -0300 (0:00:00.085) 0:05:32.963 ********** TASK [kubernetes/preinstall : Stop if vault is chose] ************************** Thursday 09 May 2019 02:19:06 -0300 (0:00:00.066) 0:05:33.030 ********** TASK [kubernetes/preinstall : Stop if unknown cert_management] ***************** Thursday 09 May 2019 02:19:06 -0300 (0:00:00.066) 0:05:33.097 ********** TASK [kubernetes/preinstall : Stop if unknown resolvconf_mode] ***************** Thursday 09 May 2019 02:19:06 -0300 (0:00:00.066) 0:05:33.163 ********** TASK [kubernetes/preinstall : Pre-upgrade | check if old credential dir exists] *** Thursday 09 May 2019 02:19:06 -0300 (0:00:00.071) 0:05:33.235 ********** TASK [kubernetes/preinstall : Pre-upgrade | check if new credential dir exists] *** Thursday 09 May 2019 02:19:06 -0300 (0:00:00.073) 0:05:33.309 ********** TASK [kubernetes/preinstall : Pre-upgrade | move data from old credential dir to new] *** Thursday 09 May 2019 02:19:06 -0300 (0:00:00.072) 0:05:33.381 ********** TASK [kubernetes/preinstall : set_fact] **************************************** Thursday 09 May 2019 02:19:06 -0300 (0:00:00.066) 0:05:33.448 ********** TASK [kubernetes/preinstall : ansible_architecture_rename] ********************* Thursday 09 May 2019 02:19:06 -0300 (0:00:00.193) 0:05:33.642 ********** TASK [kubernetes/preinstall : Force binaries directory for Container Linux by CoreOS] *** Thursday 09 May 2019 02:19:07 -0300 (0:00:00.206) 0:05:33.848 ********** TASK [kubernetes/preinstall : check if atomic host] **************************** Thursday 09 May 2019 02:19:07 -0300 (0:00:00.196) 0:05:34.045 ********** TASK [kubernetes/preinstall : set_fact] **************************************** Thursday 09 May 2019 02:19:07 -0300 (0:00:00.197) 0:05:34.243 ********** TASK [kubernetes/preinstall : set_fact] **************************************** Thursday 09 May 2019 02:19:07 -0300 (0:00:00.194) 0:05:34.437 ********** TASK [kubernetes/preinstall : check resolvconf] ******************************** Thursday 09 May 2019 02:19:07 -0300 (0:00:00.205) 0:05:34.643 ********** TASK [kubernetes/preinstall : set_fact] **************************************** Thursday 09 May 2019 02:19:08 -0300 (0:00:00.201) 0:05:34.844 ********** TASK [kubernetes/preinstall : set_fact] **************************************** Thursday 09 May 2019 02:19:08 -0300 (0:00:00.195) 0:05:35.040 ********** TASK [kubernetes/preinstall : check if kubelet is configured] ****************** Thursday 09 May 2019 02:19:08 -0300 (0:00:00.191) 0:05:35.232 ********** TASK [kubernetes/preinstall : check if early DNS configuration stage] ********** Thursday 09 May 2019 02:19:08 -0300 (0:00:00.204) 0:05:35.436 ********** TASK [kubernetes/preinstall : target resolv.conf files] ************************ Thursday 09 May 2019 02:19:08 -0300 (0:00:00.199) 0:05:35.635 ********** TASK [kubernetes/preinstall : target temporary resolvconf cloud init file (Container Linux by CoreOS)] *** Thursday 09 May 2019 02:19:09 -0300 (0:00:00.199) 0:05:35.835 ********** TASK [kubernetes/preinstall : check if /etc/dhclient.conf exists] ************** Thursday 09 May 2019 02:19:09 -0300 (0:00:00.197) 0:05:36.032 ********** TASK [kubernetes/preinstall : target dhclient conf file for /etc/dhclient.conf] *** Thursday 09 May 2019 02:19:09 -0300 (0:00:00.206) 0:05:36.239 ********** TASK [kubernetes/preinstall : check if /etc/dhcp/dhclient.conf exists] ********* Thursday 09 May 2019 02:19:09 -0300 (0:00:00.196) 0:05:36.436 ********** TASK [kubernetes/preinstall : target dhclient conf file for /etc/dhcp/dhclient.conf] *** Thursday 09 May 2019 02:19:09 -0300 (0:00:00.199) 0:05:36.635 ********** TASK [kubernetes/preinstall : target dhclient hook file for Red Hat family] **** Thursday 09 May 2019 02:19:10 -0300 (0:00:00.192) 0:05:36.828 ********** TASK [kubernetes/preinstall : target dhclient hook file for Debian family] ***** Thursday 09 May 2019 02:19:10 -0300 (0:00:00.203) 0:05:37.032 ********** TASK [kubernetes/preinstall : generate search domains to resolvconf] *********** Thursday 09 May 2019 02:19:10 -0300 (0:00:00.198) 0:05:37.231 ********** TASK [kubernetes/preinstall : pick coredns cluster IP or default resolver] ***** Thursday 09 May 2019 02:19:10 -0300 (0:00:00.200) 0:05:37.431 ********** TASK [kubernetes/preinstall : generate nameservers to resolvconf] ************** Thursday 09 May 2019 02:19:10 -0300 (0:00:00.195) 0:05:37.626 ********** TASK [kubernetes/preinstall : gather os specific variables] ******************** Thursday 09 May 2019 02:19:11 -0300 (0:00:00.204) 0:05:37.831 ********** TASK [kubernetes/preinstall : override kube_proxy_mode to ipvs if kube_proxy_remove is set, as ipvs won't require kube-proxy cleanup when kube-proxy daemonset gets deleted] *** Thursday 09 May 2019 02:19:11 -0300 (0:00:00.220) 0:05:38.051 ********** TASK [kubernetes/preinstall : Create kubernetes directories] ******************* Thursday 09 May 2019 02:19:11 -0300 (0:00:00.196) 0:05:38.248 ********** TASK [kubernetes/preinstall : Create kubernetes kubeadm compat cert dir (kubernetes/kubeadm issue 1498)] *** Thursday 09 May 2019 02:19:11 -0300 (0:00:00.388) 0:05:38.636 ********** TASK [kubernetes/preinstall : Create cni directories] ************************** Thursday 09 May 2019 02:19:12 -0300 (0:00:00.297) 0:05:38.934 ********** TASK [kubernetes/preinstall : Create local volume provisioner directories] ***** Thursday 09 May 2019 02:19:12 -0300 (0:00:00.229) 0:05:39.163 ********** TASK [kubernetes/preinstall : create temporary resolveconf cloud init file] **** Thursday 09 May 2019 02:19:12 -0300 (0:00:00.207) 0:05:39.371 ********** TASK [kubernetes/preinstall : Add domain/search/nameservers/options to resolv.conf] *** Thursday 09 May 2019 02:19:12 -0300 (0:00:00.191) 0:05:39.563 ********** TASK [kubernetes/preinstall : Remove search/domain/nameserver options before block] *** Thursday 09 May 2019 02:19:13 -0300 (0:00:00.203) 0:05:39.767 ********** TASK [kubernetes/preinstall : Remove search/domain/nameserver options after block] *** Thursday 09 May 2019 02:19:13 -0300 (0:00:00.241) 0:05:40.008 ********** TASK [kubernetes/preinstall : get temporary resolveconf cloud init file content] *** Thursday 09 May 2019 02:19:13 -0300 (0:00:00.239) 0:05:40.248 ********** TASK [kubernetes/preinstall : persist resolvconf cloud init file] ************** Thursday 09 May 2019 02:19:13 -0300 (0:00:00.192) 0:05:40.441 ********** TASK [kubernetes/preinstall : Update package management cache (zypper) - SUSE] *** Thursday 09 May 2019 02:19:13 -0300 (0:00:00.211) 0:05:40.653 ********** TASK [kubernetes/preinstall : Update package management cache (APT)] *********** Thursday 09 May 2019 02:19:14 -0300 (0:00:00.195) 0:05:40.848 ********** TASK [kubernetes/preinstall : Install python-dnf for latest RedHat versions] *** Thursday 09 May 2019 02:19:14 -0300 (0:00:00.196) 0:05:41.045 ********** TASK [kubernetes/preinstall : Install epel-release on RedHat/CentOS] *********** Thursday 09 May 2019 02:19:14 -0300 (0:00:00.198) 0:05:41.243 ********** TASK [kubernetes/preinstall : Update common_required_pkgs with ipvsadm when kube_proxy_mode is ipvs] *** Thursday 09 May 2019 02:19:14 -0300 (0:00:00.203) 0:05:41.446 ********** TASK [kubernetes/preinstall : Install packages requirements] ******************* Thursday 09 May 2019 02:19:14 -0300 (0:00:00.199) 0:05:41.645 ********** TASK [kubernetes/preinstall : Install ipvsadm for ClearLinux] ****************** Thursday 09 May 2019 02:19:15 -0300 (0:00:00.197) 0:05:41.843 ********** TASK [kubernetes/preinstall : Confirm selinux deployed] ************************ Thursday 09 May 2019 02:19:15 -0300 (0:00:00.193) 0:05:42.037 ********** TASK [kubernetes/preinstall : Set selinux policy] ****************************** Thursday 09 May 2019 02:19:15 -0300 (0:00:00.202) 0:05:42.239 ********** TASK [kubernetes/preinstall : Disable IPv6 DNS lookup] ************************* Thursday 09 May 2019 02:19:15 -0300 (0:00:00.196) 0:05:42.436 ********** TASK [kubernetes/preinstall : Stat sysctl file configuration] ****************** Thursday 09 May 2019 02:19:15 -0300 (0:00:00.194) 0:05:42.630 ********** TASK [kubernetes/preinstall : Change sysctl file path to link source if linked] *** Thursday 09 May 2019 02:19:16 -0300 (0:00:00.192) 0:05:42.823 ********** TASK [kubernetes/preinstall : Make sure sysctl file path folder exists] ******** Thursday 09 May 2019 02:19:16 -0300 (0:00:00.202) 0:05:43.025 ********** TASK [kubernetes/preinstall : Enable ip forwarding] **************************** Thursday 09 May 2019 02:19:16 -0300 (0:00:00.195) 0:05:43.221 ********** TASK [kubernetes/preinstall : Hosts | populate inventory into hosts file] ****** Thursday 09 May 2019 02:19:16 -0300 (0:00:00.194) 0:05:43.415 ********** TASK [kubernetes/preinstall : Hosts | populate kubernetes loadbalancer address into hosts file] *** Thursday 09 May 2019 02:19:16 -0300 (0:00:00.195) 0:05:43.610 ********** TASK [kubernetes/preinstall : Hosts | Retrieve hosts file content] ************* Thursday 09 May 2019 02:19:17 -0300 (0:00:00.206) 0:05:43.817 ********** TASK [kubernetes/preinstall : Hosts | Extract existing entries for localhost from hosts file] *** Thursday 09 May 2019 02:19:17 -0300 (0:00:00.199) 0:05:44.016 ********** TASK [kubernetes/preinstall : Hosts | Update target hosts file entries dict with required entries] *** Thursday 09 May 2019 02:19:17 -0300 (0:00:00.204) 0:05:44.221 ********** TASK [kubernetes/preinstall : Hosts | Update (if necessary) hosts file] ******** Thursday 09 May 2019 02:19:17 -0300 (0:00:00.239) 0:05:44.460 ********** TASK [kubernetes/preinstall : Configure dhclient to supersede search/domain/nameservers] *** Thursday 09 May 2019 02:19:17 -0300 (0:00:00.230) 0:05:44.690 ********** TASK [kubernetes/preinstall : Configure dhclient hooks for resolv.conf (non-RH)] *** Thursday 09 May 2019 02:19:18 -0300 (0:00:00.203) 0:05:44.894 ********** TASK [kubernetes/preinstall : Configure dhclient hooks for resolv.conf (RH-only)] *** Thursday 09 May 2019 02:19:18 -0300 (0:00:00.197) 0:05:45.091 ********** TASK [kubernetes/preinstall : Remove kubespray specific config from dhclient config] *** Thursday 09 May 2019 02:19:18 -0300 (0:00:00.193) 0:05:45.285 ********** TASK [kubernetes/preinstall : Remove kubespray specific dhclient hook] ********* Thursday 09 May 2019 02:19:18 -0300 (0:00:00.205) 0:05:45.491 ********** TASK [kubernetes/preinstall : Check if we are running inside a Azure VM] ******* Thursday 09 May 2019 02:19:18 -0300 (0:00:00.198) 0:05:45.689 ********** TASK [kubernetes/preinstall : install growpart] ******************************** Thursday 09 May 2019 02:19:19 -0300 (0:00:00.195) 0:05:45.884 ********** TASK [kubernetes/preinstall : check if growpart needs to be run] *************** Thursday 09 May 2019 02:19:19 -0300 (0:00:00.191) 0:05:46.076 ********** TASK [kubernetes/preinstall : check fs type] *********************************** Thursday 09 May 2019 02:19:19 -0300 (0:00:00.202) 0:05:46.278 ********** TASK [kubernetes/preinstall : run growpart] ************************************ Thursday 09 May 2019 02:19:19 -0300 (0:00:00.197) 0:05:46.476 ********** TASK [kubernetes/preinstall : run xfs_growfs] ********************************** Thursday 09 May 2019 02:19:19 -0300 (0:00:00.199) 0:05:46.676 ********** PLAY RECAP ********************************************************************* k8s-etcd01-lab-20190425 : ok=204 changed=4 unreachable=0 failed=0 k8s-master01-lab-20190425 : ok=318 changed=31 unreachable=0 failed=0 k8s-node01-lab : ok=244 changed=20 unreachable=0 failed=0 k8s-node02-lab : ok=244 changed=20 unreachable=0 failed=0 localhost : ok=1 changed=0 unreachable=0 failed=0 Thursday 09 May 2019 02:19:20 -0300 (0:00:00.160) 0:05:46.837 ********** =============================================================================== download : container_download | download images for kubeadm config images -- 29.31s download : file_download | Download item -------------------------------- 8.56s kubernetes-apps/ansible : Kubernetes Apps | Start Resources ------------- 5.22s kubernetes/preinstall : Update package management cache (APT) ----------- 4.84s download : container_download | Download containers if pull is required or told to always pull (all nodes) --- 3.93s kubernetes-apps/ansible : Kubernetes Apps | Lay Down CoreDNS Template --- 3.31s download : container_download | Download containers if pull is required or told to always pull (all nodes) --- 3.07s download : container_download | Download containers if pull is required or told to always pull (all nodes) --- 3.03s download : container_download | Download containers if pull is required or told to always pull (all nodes) --- 3.00s download : container_download | Download containers if pull is required or told to always pull (all nodes) --- 2.99s download : container_download | Download containers if pull is required or told to always pull (all nodes) --- 2.98s download : file_download | Download item -------------------------------- 2.84s download : container_download | Download containers if pull is required or told to always pull (all nodes) --- 2.35s gather facts from all instances ----------------------------------------- 2.31s container-engine/docker : ensure docker packages are installed ---------- 2.25s kubernetes-apps/network_plugin/calico : Start Calico resources ---------- 2.14s network_plugin/calico : Calico | Create calico manifests ---------------- 2.07s download : Download items ----------------------------------------------- 2.03s kubernetes/client : Generate admin kubeconfig with external api endpoint --- 1.95s kubernetes-apps/helm : Helm | Compare host helm with hyperkube container --- 1.87s + R=0 + /usr/bin/ansible-playbook tjpr-cleanup.yaml -b -i inventory/inventory.ini.tmp PLAY [all] ********************************************************************* TASK [remove chave ssh] ******************************************************** Thursday 09 May 2019 02:19:21 -0300 (0:00:00.116) 0:00:00.117 ********** changed: [k8s-node01-lab] changed: [k8s-master01-lab-20190425] changed: [k8s-etcd01-lab-20190425] changed: [k8s-node02-lab] PLAY RECAP ********************************************************************* k8s-etcd01-lab-20190425 : ok=1 changed=1 unreachable=0 failed=0 k8s-master01-lab-20190425 : ok=1 changed=1 unreachable=0 failed=0 k8s-node01-lab : ok=1 changed=1 unreachable=0 failed=0 k8s-node02-lab : ok=1 changed=1 unreachable=0 failed=0 Thursday 09 May 2019 02:19:21 -0300 (0:00:00.404) 0:00:00.521 ********** =============================================================================== remove chave ssh -------------------------------------------------------- 0.40s + rm -fr inventory/inventory.ini.tmp + exit 0 Finished: SUCCESS