2022-01-06T10:41:09.654 INFO:root:teuthology version: 1.1.0-95a7d479 2022-01-06T10:41:09.777 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi120.front.sepia.ceph.com' reimaging 2022-01-06T10:41:09.778 INFO:teuthology.lock.ops:Updating [ubuntu@smithi120.front.sepia.ceph.com]: reset os type and version on server 2022-01-06T10:41:09.778 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server 2022-01-06T10:41:09.797 INFO:teuthology.lock.ops:Node 'ubuntu@smithi120.front.sepia.ceph.com' reimaging is complete 2022-01-06T10:41:09.797 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi163.front.sepia.ceph.com' reimaging 2022-01-06T10:41:09.798 INFO:teuthology.lock.ops:Updating [ubuntu@smithi163.front.sepia.ceph.com]: reset os type and version on server 2022-01-06T10:41:09.798 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2022-01-06T10:41:09.816 INFO:teuthology.lock.ops:Node 'ubuntu@smithi163.front.sepia.ceph.com' reimaging is complete 2022-01-06T10:41:10.012 INFO:teuthology.provision.fog.smithi120:Scheduling deploy of centos 8.stream 2022-01-06T10:41:10.023 INFO:teuthology.provision.fog.smithi163:Scheduling deploy of centos 8.stream 2022-01-06T10:41:10.333 INFO:teuthology.orchestra.console:Power off smithi120 2022-01-06T10:41:10.350 INFO:teuthology.orchestra.console:Power off smithi163 2022-01-06T10:41:18.704 INFO:teuthology.orchestra.console:Power off for smithi120 completed 2022-01-06T10:41:18.805 INFO:teuthology.orchestra.console:Power on smithi120 2022-01-06T10:41:22.819 INFO:teuthology.orchestra.console:Power off for smithi163 completed 2022-01-06T10:41:22.920 INFO:teuthology.orchestra.console:Power on smithi163 2022-01-06T10:41:27.169 INFO:teuthology.orchestra.console:Power on for smithi120 completed 2022-01-06T10:41:27.175 INFO:teuthology.orchestra.console:Power on for smithi163 completed 2022-01-06T10:41:27.270 INFO:teuthology.provision.fog.smithi120:Waiting for deploy to finish 2022-01-06T10:41:27.276 INFO:teuthology.provision.fog.smithi163:Waiting for deploy to finish 2022-01-06T10:46:32.639 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-06T10:46:32.918 INFO:teuthology.provision.fog.smithi120:Node is ready 2022-01-06T10:46:32.934 INFO:teuthology.orchestra.run.smithi120.stdout:smithi120.front.sepia.ceph.com 2022-01-06T10:46:32.991 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120 smithi120.front.sepia.ceph.com smithi120 2022-01-06T10:46:33.331 INFO:teuthology.provision.fog.smithi120:Deploy complete! 2022-01-06T10:46:47.720 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-06T10:46:48.282 INFO:teuthology.provision.fog.smithi163:Node is ready 2022-01-06T10:46:48.297 INFO:teuthology.orchestra.run.smithi163.stdout:smithi126 2022-01-06T10:46:48.352 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.126 smithi126.front.sepia.ceph.com smithi126 2022-01-06T10:46:48.669 INFO:teuthology.provision.fog.smithi163:Deploy complete! 2022-01-06T10:46:48.821 INFO:teuthology.lock.ops:Checking smithi120.front.sepia.ceph.com 2022-01-06T10:46:48.822 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-06T10:46:48.842 INFO:teuthology.lock.ops:Checking smithi163.front.sepia.ceph.com 2022-01-06T10:46:48.843 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-06T10:46:48.861 INFO:teuthology.lock.ops:Updating [smithi120.front.sepia.ceph.com]: set os type and version on server 2022-01-06T10:46:48.862 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2022-01-06T10:46:49.104 INFO:teuthology.orchestra.run.smithi120.stdout:x86_64 2022-01-06T10:46:49.161 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="CentOS Stream" 2022-01-06T10:46:49.161 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="8" 2022-01-06T10:46:49.162 INFO:teuthology.orchestra.run.smithi120.stdout:ID="centos" 2022-01-06T10:46:49.162 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE="rhel fedora" 2022-01-06T10:46:49.162 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="8" 2022-01-06T10:46:49.162 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM_ID="platform:el8" 2022-01-06T10:46:49.163 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="CentOS Stream 8" 2022-01-06T10:46:49.163 INFO:teuthology.orchestra.run.smithi120.stdout:ANSI_COLOR="0;31" 2022-01-06T10:46:49.163 INFO:teuthology.orchestra.run.smithi120.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-01-06T10:46:49.163 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://centos.org/" 2022-01-06T10:46:49.163 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-01-06T10:46:49.164 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-01-06T10:46:49.164 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-01-06T10:46:49.165 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server 2022-01-06T10:46:49.183 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: set os type and version on server 2022-01-06T10:46:49.184 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2022-01-06T10:46:49.378 INFO:teuthology.orchestra.run.smithi163.stdout:x86_64 2022-01-06T10:46:49.433 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="CentOS Stream" 2022-01-06T10:46:49.434 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="8" 2022-01-06T10:46:49.434 INFO:teuthology.orchestra.run.smithi163.stdout:ID="centos" 2022-01-06T10:46:49.434 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="rhel fedora" 2022-01-06T10:46:49.435 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="8" 2022-01-06T10:46:49.435 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el8" 2022-01-06T10:46:49.435 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="CentOS Stream 8" 2022-01-06T10:46:49.435 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31" 2022-01-06T10:46:49.436 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-01-06T10:46:49.436 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://centos.org/" 2022-01-06T10:46:49.436 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-01-06T10:46:49.436 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-01-06T10:46:49.436 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-01-06T10:46:49.437 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2022-01-06T10:46:49.535 INFO:teuthology.dispatcher.supervisor:Running job 6597684 2022-01-06T10:46:49.535 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/bin/teuthology -v --owner scheduled_swagner@teuthology --archive /home/teuthworker/archive/swagner-2022-01-06_10:04:35-orch:cephadm-wip-swagner-testing-2022-01-05-1435-distro-default-smithi/6597684 --name swagner-2022-01-06_10:04:35-orch:cephadm-wip-swagner-testing-2022-01-05-1435-distro-default-smithi --description orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} -- /home/teuthworker/archive/swagner-2022-01-06_10:04:35-orch:cephadm-wip-swagner-testing-2022-01-05-1435-distro-default-smithi/6597684/orig.config.yaml 2022-01-06T10:46:49.538 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/swagner-2022-01-06_10:04:35-orch:cephadm-wip-swagner-testing-2022-01-05-1435-distro-default-smithi/6597684 2022-01-06T10:46:49.539 INFO:teuthology.dispatcher.supervisor:Job PID: 22414 2022-01-06T10:46:49.539 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-01-06T22:47:42.922 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-01-06T22:47:43.100 INFO:teuthology.kill:Killing Pids: {22414} 2022-01-06T22:47:44.346 INFO:teuthology.task.internal:roles: ubuntu@smithi120.front.sepia.ceph.com - ['host.a', 'client.0'] 2022-01-06T22:47:44.347 INFO:teuthology.task.internal:roles: ubuntu@smithi163.front.sepia.ceph.com - ['host.b', 'client.1'] 2022-01-06T22:47:44.347 INFO:teuthology.misc:Compressing logs... 2022-01-06T22:47:44.348 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2022-01-06T22:47:44.542 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2022-01-06T22:47:44.574 INFO:teuthology.orchestra.run.smithi120.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-06T22:47:44.760 INFO:teuthology.orchestra.run.smithi163.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-06T22:47:44.795 INFO:teuthology.orchestra.run.smithi120.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-06T22:47:44.796 INFO:teuthology.orchestra.run.smithi120.stderr:tar: Error is not recoverable: exiting now 2022-01-06T22:47:44.830 INFO:teuthology.orchestra.run.smithi163.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-06T22:47:44.831 INFO:teuthology.orchestra.run.smithi163.stderr:tar: Error is not recoverable: exiting now 2022-01-06T22:47:44.832 INFO:teuthology.misc:Compressing logs... 2022-01-06T22:47:45.258 INFO:teuthology.orchestra.run.smithi120.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-01-06T22:47:45.458 INFO:teuthology.misc:Compressing logs... 2022-01-06T22:47:51.603 INFO:teuthology.orchestra.run.smithi163.stderr:gzip: /var/log/ceph/2e1f3d0c-6edf-11ec-8c32-001a4aab830c/ceph-mon.smithi163.log: file size changed while zipping 2022-01-06T22:48:02.565 INFO:teuthology.orchestra.run.smithi120.stderr:gzip: /var/log/ceph/2e1f3d0c-6edf-11ec-8c32-001a4aab830c/ceph-mon.smithi120.log: file size changed while zipping 2022-01-06T22:48:21.237 INFO:teuthology.orchestra.run.smithi163.stderr:gzip: /var/log/ceph/2e1f3d0c-6edf-11ec-8c32-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2022-01-06T22:48:31.258 INFO:teuthology.orchestra.run.smithi120.stderr:gzip: /var/log/ceph/2e1f3d0c-6edf-11ec-8c32-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2022-01-06T22:48:59.002 INFO:teuthology.orchestra.run.smithi163.stderr:gzip: /var/log/ceph/2e1f3d0c-6edf-11ec-8c32-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2022-01-06T22:49:03.890 INFO:teuthology.orchestra.run.smithi120.stderr:gzip: /var/log/ceph/2e1f3d0c-6edf-11ec-8c32-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2022-01-06T22:49:30.363 INFO:teuthology.orchestra.run.smithi163.stderr:gzip: /var/log/ceph/2e1f3d0c-6edf-11ec-8c32-001a4aab830c/ceph-osd.6.log: file size changed while zipping 2022-01-06T22:49:44.905 INFO:teuthology.orchestra.run.smithi120.stderr:gzip: /var/log/ceph/2e1f3d0c-6edf-11ec-8c32-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2022-01-06T22:49:48.702 INFO:teuthology.orchestra.run.smithi120.stderr:gzip: /var/log/ceph/2e1f3d0c-6edf-11ec-8c32-001a4aab830c/ceph-mgr.smithi120.gbaaez.log: file size changed while zipping 2022-01-06T22:49:50.827 INFO:teuthology.orchestra.run.smithi163.stderr:gzip: /var/log/ceph/2e1f3d0c-6edf-11ec-8c32-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2022-01-06T22:50:20.784 INFO:teuthology.orchestra.run.smithi120.stderr:gzip: /var/log/ceph/2e1f3d0c-6edf-11ec-8c32-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2022-01-06T22:50:54.489 INFO:teuthology.orchestra.run.smithi120.stderr:tar: .: file changed as we read it 2022-01-06T22:51:20.647 INFO:teuthology.kill:No teuthology processes running 2022-01-06T22:51:21.787 INFO:teuthology.kill:Nuking machines: ['smithi120', 'smithi163'] 2022-01-06T22:51:22.797 INFO:teuthology.kill:2022-01-06 22:51:22,796.796 INFO:teuthology.nuke:targets: 2022-01-06T22:51:22.798 INFO:teuthology.kill: smithi120.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDRspVKUjk8kTtDsacxnaW/46kCtqcgM/0BCLyuT/e0tBF8nhpkULJEKG92WYF5M5IM0T8CLSiBTmNoU4vaPLqbAZI0EgkxkhqW0fTjgR7F2f7WuYynKMdIX7+LsTFBWSxpy36r+DHGS1OC4tnEq7a5HBfJAh8dNLM2mS5AeC5Xqyi5G4575KkX1z2UWfBiAdiPsGqaSmNWE1470Fi4vZTz4ob0dOSAx4/mzCz79blmwBU1hIXFn7XvhGawgdDTqwbY9NIlnFBQhHFgfJF9PRg0pkOs9efFbGmoXVGDkGdAdwVQRU5SPFCyyu5+t71dTi0QAPG7WuaV5IXI48eAUJg67+wvDUQsjzzFCdyGoF2u6WRvdWJ4s4k8abTvBhQ5ziPVkpHzGeAG6S2BBze4FgR81HZQmkNs8Vi1lxH6ftrG+yH0XxYNgEPDFWDP8NkERD8fI3xqPom5YrM4uvxkm20PmB2hPcfCcFQ9JU6iF0cQJj83R11uDe0Q+nXr72SxMWs= 2022-01-06T22:51:22.799 INFO:teuthology.kill: smithi163.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDN9vYQBmx1WomHRoWQfmZohb8JZjqNeRVfmFKOP5WZESCa1l27JlF7ut48s2OVaBhPw03faUSta/EYxFDnaYVbxhi9DgNNAlr4HaNO4bJz/nH31o4mPdsWhmVr/y49jjrhZoOeQu01ARE+Aaieln23sehduXP2mlaoqxZQJNf2f6bNC/r+Gxc1yAMm2WGVgGZY6LGaA9NAEv6VGuym/uoNrSrxZXChcV3/zqQWHpSGGVcVE6TxzKqui1e2qkJEYpvPRwOq3+v0PRZ2VXH+oLM0JmvFhTXf+6XvpL+FQjRQXPrpqCl2kTG8vXOUD0DdRRY0fQ5xyRy6kmlCNQ8BjxmpiAKDAR0airtZdXEOQ5lTG1BL6JcK6ag1zQdME72KCFGXJIDChqF7cL8e/a5aeAji7modxb+IgXCqM/fT+pB2DkdK7lcysRDUcqByFYxSTv1F/8teGdGWf1MkexsVU6mTgvo424YuOYaUyKmQmf5OELSvp7/+AFQSMRJUysHMi88= 2022-01-06T22:51:22.824 INFO:teuthology.kill:2022-01-06 22:51:22,824.824 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-06T22:51:22.828 INFO:teuthology.kill:2022-01-06 22:51:22,828.828 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-06T22:51:22.910 INFO:teuthology.kill:2022-01-06 22:51:22,910.910 INFO:teuthology.orchestra.console:Power off smithi163 2022-01-06T22:51:22.924 INFO:teuthology.kill:2022-01-06 22:51:22,924.924 INFO:teuthology.orchestra.console:Power off smithi120 2022-01-06T22:51:31.283 INFO:teuthology.kill:2022-01-06 22:51:31,283.283 INFO:teuthology.orchestra.console:Power off for smithi163 completed 2022-01-06T22:51:31.428 INFO:teuthology.kill:2022-01-06 22:51:31,427.427 INFO:teuthology.lock.ops:unlocked: smithi163.front.sepia.ceph.com 2022-01-06T22:51:35.401 INFO:teuthology.kill:2022-01-06 22:51:35,400.400 INFO:teuthology.orchestra.console:Power off for smithi120 completed 2022-01-06T22:51:35.547 INFO:teuthology.kill:2022-01-06 22:51:35,547.547 INFO:teuthology.lock.ops:unlocked: smithi120.front.sepia.ceph.com 2022-01-06T22:53:35.875 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-01-06T22:53:35.999 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi120 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-01-06_15:50:38-rados-wip-yuri8-testing-2022-01-05-1411-distro-default-smithi/6599142 2022-01-06T22:53:36.000 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi163 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-01-06_15:50:38-rados-wip-yuri8-testing-2022-01-05-1411-distro-default-smithi/6599140