2022-01-07T00:34:57.149 INFO:root:teuthology version: 1.1.0-95a7d479 2022-01-07T00:34:57.278 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi046.front.sepia.ceph.com' reimaging 2022-01-07T00:34:57.279 INFO:teuthology.lock.ops:Updating [ubuntu@smithi046.front.sepia.ceph.com]: reset os type and version on server 2022-01-07T00:34:57.280 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2022-01-07T00:34:57.300 INFO:teuthology.lock.ops:Node 'ubuntu@smithi046.front.sepia.ceph.com' reimaging is complete 2022-01-07T00:34:57.301 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi185.front.sepia.ceph.com' reimaging 2022-01-07T00:34:57.301 INFO:teuthology.lock.ops:Updating [ubuntu@smithi185.front.sepia.ceph.com]: reset os type and version on server 2022-01-07T00:34:57.302 INFO:teuthology.lock.ops:Updating smithi185.front.sepia.ceph.com on lock server 2022-01-07T00:34:57.321 INFO:teuthology.lock.ops:Node 'ubuntu@smithi185.front.sepia.ceph.com' reimaging is complete 2022-01-07T00:34:57.520 INFO:teuthology.provision.fog.smithi046:Scheduling deploy of centos 8.3 2022-01-07T00:34:57.532 INFO:teuthology.provision.fog.smithi185:Scheduling deploy of centos 8.3 2022-01-07T00:34:57.883 INFO:teuthology.orchestra.console:Power off smithi185 2022-01-07T00:34:57.899 INFO:teuthology.orchestra.console:Power off smithi046 2022-01-07T00:35:06.263 INFO:teuthology.orchestra.console:Power off for smithi046 completed 2022-01-07T00:35:06.364 INFO:teuthology.orchestra.console:Power on smithi046 2022-01-07T00:35:10.371 INFO:teuthology.orchestra.console:Power off for smithi185 completed 2022-01-07T00:35:10.473 INFO:teuthology.orchestra.console:Power on smithi185 2022-01-07T00:35:14.734 INFO:teuthology.orchestra.console:Power on for smithi185 completed 2022-01-07T00:35:14.836 INFO:teuthology.provision.fog.smithi185:Waiting for deploy to finish 2022-01-07T00:35:14.842 INFO:teuthology.orchestra.console:Power on for smithi046 completed 2022-01-07T00:35:14.943 INFO:teuthology.provision.fog.smithi046:Waiting for deploy to finish 2022-01-07T00:39:42.096 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-07T00:40:02.563 INFO:teuthology.provision.fog.smithi185:Node is ready 2022-01-07T00:40:02.583 INFO:teuthology.orchestra.run.smithi185.stdout:smithi185.front.sepia.ceph.com 2022-01-07T00:40:02.640 INFO:teuthology.orchestra.run.smithi185.stdout:172.21.15.185 smithi185.front.sepia.ceph.com smithi185 2022-01-07T00:40:02.999 INFO:teuthology.provision.fog.smithi185:Deploy complete! 2022-01-07T00:40:04.702 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-07T00:40:05.014 INFO:teuthology.provision.fog.smithi046:Node is ready 2022-01-07T00:40:05.030 INFO:teuthology.orchestra.run.smithi046.stdout:smithi046.front.sepia.ceph.com 2022-01-07T00:40:05.087 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2022-01-07T00:40:05.417 INFO:teuthology.provision.fog.smithi046:Deploy complete! 2022-01-07T00:40:05.591 INFO:teuthology.lock.ops:Checking smithi046.front.sepia.ceph.com 2022-01-07T00:40:05.592 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-07T00:40:05.612 INFO:teuthology.lock.ops:Checking smithi185.front.sepia.ceph.com 2022-01-07T00:40:05.612 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-07T00:40:05.629 INFO:teuthology.lock.ops:Updating [smithi046.front.sepia.ceph.com]: set os type and version on server 2022-01-07T00:40:05.630 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2022-01-07T00:40:05.834 INFO:teuthology.orchestra.run.smithi046.stdout:x86_64 2022-01-07T00:40:05.889 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="CentOS Linux" 2022-01-07T00:40:05.889 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="8" 2022-01-07T00:40:05.890 INFO:teuthology.orchestra.run.smithi046.stdout:ID="centos" 2022-01-07T00:40:05.890 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE="rhel fedora" 2022-01-07T00:40:05.890 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="8" 2022-01-07T00:40:05.890 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM_ID="platform:el8" 2022-01-07T00:40:05.891 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="CentOS Linux 8" 2022-01-07T00:40:05.891 INFO:teuthology.orchestra.run.smithi046.stdout:ANSI_COLOR="0;31" 2022-01-07T00:40:05.891 INFO:teuthology.orchestra.run.smithi046.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-01-07T00:40:05.891 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://centos.org/" 2022-01-07T00:40:05.892 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2022-01-07T00:40:05.892 INFO:teuthology.orchestra.run.smithi046.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2022-01-07T00:40:05.892 INFO:teuthology.orchestra.run.smithi046.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2022-01-07T00:40:05.893 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2022-01-07T00:40:05.912 INFO:teuthology.lock.ops:Updating [smithi185.front.sepia.ceph.com]: set os type and version on server 2022-01-07T00:40:05.912 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi185.front.sepia.ceph.com' 2022-01-07T00:40:06.179 INFO:teuthology.orchestra.run.smithi185.stdout:x86_64 2022-01-07T00:40:06.233 INFO:teuthology.orchestra.run.smithi185.stdout:NAME="CentOS Linux" 2022-01-07T00:40:06.234 INFO:teuthology.orchestra.run.smithi185.stdout:VERSION="8" 2022-01-07T00:40:06.234 INFO:teuthology.orchestra.run.smithi185.stdout:ID="centos" 2022-01-07T00:40:06.235 INFO:teuthology.orchestra.run.smithi185.stdout:ID_LIKE="rhel fedora" 2022-01-07T00:40:06.235 INFO:teuthology.orchestra.run.smithi185.stdout:VERSION_ID="8" 2022-01-07T00:40:06.235 INFO:teuthology.orchestra.run.smithi185.stdout:PLATFORM_ID="platform:el8" 2022-01-07T00:40:06.236 INFO:teuthology.orchestra.run.smithi185.stdout:PRETTY_NAME="CentOS Linux 8" 2022-01-07T00:40:06.236 INFO:teuthology.orchestra.run.smithi185.stdout:ANSI_COLOR="0;31" 2022-01-07T00:40:06.236 INFO:teuthology.orchestra.run.smithi185.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-01-07T00:40:06.236 INFO:teuthology.orchestra.run.smithi185.stdout:HOME_URL="https://centos.org/" 2022-01-07T00:40:06.236 INFO:teuthology.orchestra.run.smithi185.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2022-01-07T00:40:06.237 INFO:teuthology.orchestra.run.smithi185.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2022-01-07T00:40:06.237 INFO:teuthology.orchestra.run.smithi185.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2022-01-07T00:40:06.238 INFO:teuthology.lock.ops:Updating smithi185.front.sepia.ceph.com on lock server 2022-01-07T00:40:06.333 INFO:teuthology.dispatcher.supervisor:Running job 6599325 2022-01-07T00:40:06.334 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-01-06_15:57:04-rados-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6599325 --name yuriw-2022-01-06_15:57:04-rados-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi --description rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} -- /home/teuthworker/archive/yuriw-2022-01-06_15:57:04-rados-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6599325/orig.config.yaml 2022-01-07T00:40:06.338 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-01-06_15:57:04-rados-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6599325 2022-01-07T00:40:06.338 INFO:teuthology.dispatcher.supervisor:Job PID: 1156 2022-01-07T00:40:06.339 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-01-07T12:41:05.319 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-01-07T12:41:05.485 INFO:teuthology.kill:Killing Pids: {1156} 2022-01-07T12:41:06.641 INFO:teuthology.task.internal:roles: ubuntu@smithi046.front.sepia.ceph.com - ['host.a', 'client.0'] 2022-01-07T12:41:06.642 INFO:teuthology.task.internal:roles: ubuntu@smithi185.front.sepia.ceph.com - ['host.b', 'client.1'] 2022-01-07T12:41:06.643 INFO:teuthology.misc:Compressing logs... 2022-01-07T12:41:06.643 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2022-01-07T12:41:06.848 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi185.front.sepia.ceph.com' 2022-01-07T12:41:06.897 INFO:teuthology.orchestra.run.smithi046.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-07T12:41:07.162 INFO:teuthology.orchestra.run.smithi185.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-07T12:41:07.203 INFO:teuthology.orchestra.run.smithi046.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-07T12:41:07.204 INFO:teuthology.orchestra.run.smithi046.stderr:tar: Error is not recoverable: exiting now 2022-01-07T12:41:07.238 INFO:teuthology.orchestra.run.smithi185.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-07T12:41:07.238 INFO:teuthology.orchestra.run.smithi185.stderr:tar: Error is not recoverable: exiting now 2022-01-07T12:41:07.240 INFO:teuthology.misc:Compressing logs... 2022-01-07T12:41:07.466 INFO:teuthology.misc:Compressing logs... 2022-01-07T12:41:21.156 INFO:teuthology.orchestra.run.smithi185.stderr:gzip: /var/log/ceph/d4a26f54-6f53-11ec-8c32-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2022-01-07T12:41:23.588 INFO:teuthology.orchestra.run.smithi046.stderr:gzip: /var/log/ceph/d4a26f54-6f53-11ec-8c32-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2022-01-07T12:41:38.167 INFO:teuthology.orchestra.run.smithi046.stderr:gzip: /var/log/ceph/d4a26f54-6f53-11ec-8c32-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2022-01-07T12:41:38.825 INFO:teuthology.orchestra.run.smithi185.stderr:gzip: /var/log/ceph/d4a26f54-6f53-11ec-8c32-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2022-01-07T12:41:41.644 INFO:teuthology.orchestra.run.smithi046.stderr:gzip: /var/log/ceph/d4a26f54-6f53-11ec-8c32-001a4aab830c/ceph-mgr.smithi046.ddoccg.log: file size changed while zipping 2022-01-07T12:41:51.570 INFO:teuthology.orchestra.run.smithi185.stderr:gzip: /var/log/ceph/d4a26f54-6f53-11ec-8c32-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2022-01-07T12:42:00.121 INFO:teuthology.orchestra.run.smithi046.stderr:gzip: /var/log/ceph/d4a26f54-6f53-11ec-8c32-001a4aab830c/ceph-mon.smithi046.log: file size changed while zipping 2022-01-07T12:42:09.310 INFO:teuthology.orchestra.run.smithi185.stderr:gzip: /var/log/ceph/d4a26f54-6f53-11ec-8c32-001a4aab830c/ceph-osd.6.log: file size changed while zipping 2022-01-07T12:42:15.762 INFO:teuthology.orchestra.run.smithi185.stderr:gzip: /var/log/ceph/d4a26f54-6f53-11ec-8c32-001a4aab830c/ceph-mon.smithi185.log: file size changed while zipping 2022-01-07T12:42:19.754 INFO:teuthology.orchestra.run.smithi046.stderr:gzip: /var/log/ceph/d4a26f54-6f53-11ec-8c32-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2022-01-07T12:42:34.398 INFO:teuthology.orchestra.run.smithi046.stderr:gzip: /var/log/ceph/d4a26f54-6f53-11ec-8c32-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2022-01-07T12:43:06.576 INFO:teuthology.kill:No teuthology processes running 2022-01-07T12:43:07.693 INFO:teuthology.kill:Nuking machines: ['smithi046', 'smithi185'] 2022-01-07T12:43:08.676 INFO:teuthology.kill:2022-01-07 12:43:08,675.675 INFO:teuthology.nuke:targets: 2022-01-07T12:43:08.677 INFO:teuthology.kill: smithi046.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDVlX/18Nzv/zXjYjpoAESvSTZabxgPFP2YQ8zfrcDyx/e9uCGuoQglxQHOVrmDwf+fdLUzciQ0XyRE0M79bPNviUpfYpg2UxRqs+44eTAhfQgiNzlmvNac6/9CgNZj6aAXsHanThtk7RFRmzBHyAY3IdoiM5vpI2tmPJS0/NPyFcw/17IoXJZwS5QJ6V34AvG7tHRN4tNjAfiDAlF+YE7FMZ2IQ2WBdCV7eluU1LMB6Y+121+yJAcdvaWFvM92bGJbf1oPew+OZ1lzVsmFxVgyWfWb0UPsWgI9qhwUb/rvJ6sL5NIpBUeDuyLTHbLg6pbF4LfRo9AtDWMxeWSwL/FuaVTN7hSdcMk90UB78FjX8wSSWSF0kY5vkqRZUxef+iUpZL039iplmRvgOPrRkhPwzlHNEeyjVKmdKJKvdONXpyWJXrSJDlBbwuvVnjBbIs7CpP7pktiJJnQGS1aftfTgPwcxeMYRRsgCtrDC78gRLwvYjEW65kUcPidequnuK+c= 2022-01-07T12:43:08.677 INFO:teuthology.kill: smithi185.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAqKcf2IUZdCR/7cdpFnIGRD3ma6iKFYYD924RCnk4OR83Yio5p30BH3ep17nPcTHeiDlStj43z+UkDTQv1zA7FaME88Qc6n4Yw8jH3dJHg/r3mJk8RJ5wa+g7lQ51gcIwEAjHSdGCe/6WDWHZdp4//SLxrQQM4kqgejkhIG7gG67msnDxMeG3P28oJbDQXjQ5vuLNhULZDClNVvBTUQM7nO0TprmZGwJCxYIXC++cNVKknTC3ESTrBKHe+eM4mwzXCQRf6tggHWmxa56QPxgJZXmEw/Pe1JGyhTyCWa3w1onRiMJZU6hxmO0teMrIJo+IeZbE2yXlR7DQgGBTKfK9abSUd6qtyxgLckH9x4+WCUYi86N8yZaW0Cq1N7IO3JI++/1MSAQekRHLg7jbd+wX/CA0SoCui1Fd84tlo+CHS+db7aHQ2Om4JdD1YjP4ggYST7dqZuOzYHY1zASw/6/dTQC3MN4576WDPySAZQF657gDTfVCioBQu7Nqt4ape3M= 2022-01-07T12:43:08.706 INFO:teuthology.kill:2022-01-07 12:43:08,706.706 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-07T12:43:08.710 INFO:teuthology.kill:2022-01-07 12:43:08,709.709 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-07T12:43:08.787 INFO:teuthology.kill:2022-01-07 12:43:08,787.787 INFO:teuthology.orchestra.console:Power off smithi046 2022-01-07T12:43:08.800 INFO:teuthology.kill:2022-01-07 12:43:08,799.799 INFO:teuthology.orchestra.console:Power off smithi185 2022-01-07T12:43:17.158 INFO:teuthology.kill:2022-01-07 12:43:17,158.158 INFO:teuthology.orchestra.console:Power off for smithi046 completed 2022-01-07T12:43:17.307 INFO:teuthology.kill:2022-01-07 12:43:17,306.306 INFO:teuthology.lock.ops:unlocked: smithi046.front.sepia.ceph.com 2022-01-07T12:43:21.272 INFO:teuthology.kill:2022-01-07 12:43:21,272.272 INFO:teuthology.orchestra.console:Power off for smithi185 completed 2022-01-07T12:43:21.421 INFO:teuthology.kill:2022-01-07 12:43:21,421.421 INFO:teuthology.lock.ops:unlocked: smithi185.front.sepia.ceph.com 2022-01-07T12:45:21.721 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-01-07T12:45:21.819 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi046 but it was locked by another job: /home/teuthworker/archive/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600973