2022-01-27T17:14:32.733 INFO:root:teuthology version: 1.1.0-7c0cb867
2022-01-27T17:14:32.860 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi023.front.sepia.ceph.com' reimaging
2022-01-27T17:14:32.861 INFO:teuthology.lock.ops:Updating [ubuntu@smithi023.front.sepia.ceph.com]: reset os type and version on server
2022-01-27T17:14:32.861 INFO:teuthology.lock.ops:Updating smithi023.front.sepia.ceph.com on lock server
2022-01-27T17:14:32.880 INFO:teuthology.lock.ops:Node 'ubuntu@smithi023.front.sepia.ceph.com' reimaging is complete
2022-01-27T17:14:32.880 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi165.front.sepia.ceph.com' reimaging
2022-01-27T17:14:32.881 INFO:teuthology.lock.ops:Updating [ubuntu@smithi165.front.sepia.ceph.com]: reset os type and version on server
2022-01-27T17:14:32.881 INFO:teuthology.lock.ops:Updating smithi165.front.sepia.ceph.com on lock server
2022-01-27T17:14:32.903 INFO:teuthology.lock.ops:Node 'ubuntu@smithi165.front.sepia.ceph.com' reimaging is complete
2022-01-27T17:14:33.106 INFO:teuthology.provision.fog.smithi023:Scheduling deploy of centos 8.stream
2022-01-27T17:14:33.114 INFO:teuthology.provision.fog.smithi165:Scheduling deploy of centos 8.stream
2022-01-27T17:14:33.454 INFO:teuthology.orchestra.console:Power off smithi165
2022-01-27T17:14:33.472 INFO:teuthology.orchestra.console:Power off smithi023
2022-01-27T17:14:41.828 INFO:teuthology.orchestra.console:Power off for smithi165 completed
2022-01-27T17:14:41.836 INFO:teuthology.orchestra.console:Power off for smithi023 completed
2022-01-27T17:14:41.930 INFO:teuthology.orchestra.console:Power on smithi165
2022-01-27T17:14:41.940 INFO:teuthology.orchestra.console:Power on smithi023
2022-01-27T17:14:50.312 INFO:teuthology.orchestra.console:Power on for smithi023 completed
2022-01-27T17:14:50.402 INFO:teuthology.orchestra.console:Power on for smithi165 completed
2022-01-27T17:14:50.414 INFO:teuthology.provision.fog.smithi023:Waiting for deploy to finish
2022-01-27T17:14:50.503 INFO:teuthology.provision.fog.smithi165:Waiting for deploy to finish
2022-01-27T17:19:37.353 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-27T17:19:37.611 INFO:teuthology.provision.fog.smithi165:Node is ready
2022-01-27T17:19:37.672 INFO:teuthology.orchestra.run.smithi165.stdout:smithi165.front.sepia.ceph.com
2022-01-27T17:19:37.732 INFO:teuthology.orchestra.run.smithi165.stdout:172.21.15.165 smithi165.front.sepia.ceph.com smithi165
2022-01-27T17:19:38.084 INFO:teuthology.provision.fog.smithi165:Deploy complete!
2022-01-27T17:19:38.712 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-27T17:19:58.983 INFO:teuthology.provision.fog.smithi023:Node is ready
2022-01-27T17:19:59.005 INFO:teuthology.orchestra.run.smithi023.stdout:smithi023.front.sepia.ceph.com
2022-01-27T17:19:59.065 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23 smithi023.front.sepia.ceph.com smithi023
2022-01-27T17:19:59.426 INFO:teuthology.provision.fog.smithi023:Deploy complete!
2022-01-27T17:19:59.605 INFO:teuthology.lock.ops:Checking smithi023.front.sepia.ceph.com
2022-01-27T17:19:59.606 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-27T17:19:59.626 INFO:teuthology.lock.ops:Checking smithi165.front.sepia.ceph.com
2022-01-27T17:19:59.626 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-27T17:19:59.646 INFO:teuthology.lock.ops:Updating [smithi023.front.sepia.ceph.com]: set os type and version on server
2022-01-27T17:19:59.646 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi023.front.sepia.ceph.com'
2022-01-27T17:19:59.839 INFO:teuthology.orchestra.run.smithi023.stdout:x86_64
2022-01-27T17:19:59.897 INFO:teuthology.orchestra.run.smithi023.stdout:NAME="CentOS Stream"
2022-01-27T17:19:59.897 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION="8"
2022-01-27T17:19:59.898 INFO:teuthology.orchestra.run.smithi023.stdout:ID="centos"
2022-01-27T17:19:59.899 INFO:teuthology.orchestra.run.smithi023.stdout:ID_LIKE="rhel fedora"
2022-01-27T17:19:59.899 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION_ID="8"
2022-01-27T17:19:59.900 INFO:teuthology.orchestra.run.smithi023.stdout:PLATFORM_ID="platform:el8"
2022-01-27T17:19:59.901 INFO:teuthology.orchestra.run.smithi023.stdout:PRETTY_NAME="CentOS Stream 8"
2022-01-27T17:19:59.901 INFO:teuthology.orchestra.run.smithi023.stdout:ANSI_COLOR="0;31"
2022-01-27T17:19:59.902 INFO:teuthology.orchestra.run.smithi023.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-01-27T17:19:59.902 INFO:teuthology.orchestra.run.smithi023.stdout:HOME_URL="https://centos.org/"
2022-01-27T17:19:59.903 INFO:teuthology.orchestra.run.smithi023.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-01-27T17:19:59.903 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-01-27T17:19:59.904 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-01-27T17:19:59.906 INFO:teuthology.lock.ops:Updating smithi023.front.sepia.ceph.com on lock server
2022-01-27T17:19:59.928 INFO:teuthology.lock.ops:Updating [smithi165.front.sepia.ceph.com]: set os type and version on server
2022-01-27T17:19:59.929 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com'
2022-01-27T17:20:00.174 INFO:teuthology.orchestra.run.smithi165.stdout:x86_64
2022-01-27T17:20:00.231 INFO:teuthology.orchestra.run.smithi165.stdout:NAME="CentOS Stream"
2022-01-27T17:20:00.231 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION="8"
2022-01-27T17:20:00.232 INFO:teuthology.orchestra.run.smithi165.stdout:ID="centos"
2022-01-27T17:20:00.232 INFO:teuthology.orchestra.run.smithi165.stdout:ID_LIKE="rhel fedora"
2022-01-27T17:20:00.232 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION_ID="8"
2022-01-27T17:20:00.232 INFO:teuthology.orchestra.run.smithi165.stdout:PLATFORM_ID="platform:el8"
2022-01-27T17:20:00.232 INFO:teuthology.orchestra.run.smithi165.stdout:PRETTY_NAME="CentOS Stream 8"
2022-01-27T17:20:00.233 INFO:teuthology.orchestra.run.smithi165.stdout:ANSI_COLOR="0;31"
2022-01-27T17:20:00.233 INFO:teuthology.orchestra.run.smithi165.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-01-27T17:20:00.233 INFO:teuthology.orchestra.run.smithi165.stdout:HOME_URL="https://centos.org/"
2022-01-27T17:20:00.234 INFO:teuthology.orchestra.run.smithi165.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-01-27T17:20:00.234 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-01-27T17:20:00.234 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-01-27T17:20:00.235 INFO:teuthology.lock.ops:Updating smithi165.front.sepia.ceph.com on lock server
2022-01-27T17:20:00.329 INFO:teuthology.dispatcher.supervisor:Running job 6644460
2022-01-27T17:20:00.330 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_7c0cb8672986d9dbe53078a123af65593653ef7a/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-01-27_17:06:11-rados-wip-yuri4-testing-2022-01-26-0857-quincy-distro-default-smithi/6644460 --name yuriw-2022-01-27_17:06:11-rados-wip-yuri4-testing-2022-01-26-0857-quincy-distro-default-smithi --description rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} -- /home/teuthworker/archive/yuriw-2022-01-27_17:06:11-rados-wip-yuri4-testing-2022-01-26-0857-quincy-distro-default-smithi/6644460/orig.config.yaml
2022-01-27T17:20:00.333 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-01-27_17:06:11-rados-wip-yuri4-testing-2022-01-26-0857-quincy-distro-default-smithi/6644460
2022-01-27T17:20:00.334 INFO:teuthology.dispatcher.supervisor:Job PID: 22457
2022-01-27T17:20:00.334 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-01-27T23:50:28.958 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-01-27T23:50:29.140 INFO:teuthology.kill:Killing Pids: {22457}
2022-01-27T23:50:30.281 INFO:teuthology.task.internal:roles: ubuntu@smithi023.front.sepia.ceph.com - ['host.a', 'client.0']
2022-01-27T23:50:30.282 INFO:teuthology.task.internal:roles: ubuntu@smithi165.front.sepia.ceph.com - ['host.b', 'client.1']
2022-01-27T23:50:30.282 INFO:teuthology.misc:Compressing logs...
2022-01-27T23:50:30.283 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi023.front.sepia.ceph.com'
2022-01-27T23:50:30.468 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com'
2022-01-27T23:50:30.496 INFO:teuthology.orchestra.run.smithi023.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-01-27T23:50:30.682 INFO:teuthology.orchestra.run.smithi165.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-01-27T23:50:30.721 INFO:teuthology.orchestra.run.smithi023.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-27T23:50:30.722 INFO:teuthology.orchestra.run.smithi023.stderr:tar: Error is not recoverable: exiting now
2022-01-27T23:50:30.888 INFO:teuthology.orchestra.run.smithi165.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-27T23:50:30.888 INFO:teuthology.orchestra.run.smithi165.stderr:tar: Error is not recoverable: exiting now
2022-01-27T23:50:30.889 INFO:teuthology.misc:Compressing logs...
2022-01-27T23:50:31.288 INFO:teuthology.orchestra.run.smithi023.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-01-27T23:50:31.459 INFO:teuthology.misc:Compressing logs...
2022-01-27T23:50:33.700 INFO:teuthology.orchestra.run.smithi023.stderr:gzip: /var/log/ceph/96c92396-7f96-11ec-8c35-001a4aab830c/ceph-mgr.smithi023.celyqi.log: file size changed while zipping
2022-01-27T23:50:43.472 INFO:teuthology.orchestra.run.smithi023.stderr:gzip: /var/log/ceph/96c92396-7f96-11ec-8c35-001a4aab830c/ceph-mon.smithi023.log: file size changed while zipping
2022-01-27T23:50:47.436 INFO:teuthology.orchestra.run.smithi165.stderr:gzip: /var/log/ceph/96c92396-7f96-11ec-8c35-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-01-27T23:50:50.606 INFO:teuthology.orchestra.run.smithi165.stderr:gzip: /var/log/ceph/96c92396-7f96-11ec-8c35-001a4aab830c/ceph-mon.smithi165.log: file size changed while zipping
2022-01-27T23:50:59.900 INFO:teuthology.orchestra.run.smithi023.stderr:gzip: /var/log/ceph/96c92396-7f96-11ec-8c35-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2022-01-27T23:51:07.110 INFO:teuthology.orchestra.run.smithi165.stderr:gzip: /var/log/ceph/96c92396-7f96-11ec-8c35-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-01-27T23:51:20.128 INFO:teuthology.orchestra.run.smithi023.stderr:gzip: /var/log/ceph/96c92396-7f96-11ec-8c35-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-01-27T23:51:23.848 INFO:teuthology.orchestra.run.smithi165.stderr:gzip: /var/log/ceph/96c92396-7f96-11ec-8c35-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2022-01-27T23:51:36.153 INFO:teuthology.orchestra.run.smithi165.stderr:gzip: /var/log/ceph/96c92396-7f96-11ec-8c35-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-01-27T23:51:42.008 INFO:teuthology.orchestra.run.smithi023.stderr:gzip: /var/log/ceph/96c92396-7f96-11ec-8c35-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-01-27T23:51:59.697 INFO:teuthology.orchestra.run.smithi023.stderr:gzip: /var/log/ceph/96c92396-7f96-11ec-8c35-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-01-27T23:52:17.912 INFO:teuthology.orchestra.run.smithi023.stderr:tar: .: file changed as we read it
2022-01-27T23:52:31.661 INFO:teuthology.kill:No teuthology processes running
2022-01-27T23:52:32.832 INFO:teuthology.kill:Nuking machines: ['smithi023', 'smithi165']
2022-01-27T23:52:33.820 INFO:teuthology.kill:2022-01-27 23:52:33,820.820 INFO:teuthology.nuke:targets:
2022-01-27T23:52:33.821 INFO:teuthology.kill:  smithi023.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDI55rhDx5lPaQ8qgQgSaOVIFpMV8W4gp644O47Jbdtz1zg1p7yLgGDhGZw8bmdl5ltFm2i7IKQFtWOSHW1+GMB5TYwbPGGvI+2WavsC6crcgtkCacNouWA4HmpuqQ0RqSdawvDFbru0ylIbUCoTFvNOXZO7/1zSfXLyNUgFgooo4cK9lJwlCSVu6f2aI/jG+T8jDyYc+oozBPoXgMArEackSr6tDbjyEnrtUsgmcF77k0yxxBZrR9ZEpbsJ1uYNo1Kqtly0no82EB8ygMo9CqitNDcT3k+LxVgZ4wucCFcCepj1BNacHYJFBUwf+nfA0q2prW+7RRgnrrdHeqBQJ1vtRFIbzkEFE7odohbDR9TsI1Tz5mpsEX/rWEczqYwfSQouujhX4KuAIG/mRx1mu9T1dtUJDefxr5dfYSoEPz08RCSKAS8vZMptGPNd/bhHWGFDBqca0V20Df+q7gx872WtvNxkf6SKr7wQRPtP5uu9O7A9WlI90kL57Bhtb4mSDE=
2022-01-27T23:52:33.822 INFO:teuthology.kill:  smithi165.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0OyPC6bGgJoT9tTRcpWsBHjfeEwzCDfvLgrtbVc80EfGhCcfEAex+lOr//2jLyUaTUtQult5zhJzAd0qpT5/2CjwqS2rm3Czh8iXeW0Y9Zi7qD/Wgv7B5wZVqpxi/6wfCMDvzjdaXDf3a39uLJI6NnOdtYwaOZhjbtRjciCL0UNeV1y5gFVmTmEX4ZYbIhCBSPlA29K0Q8ftzmFLOmHZV0fnDyX10BcCCgJm9CSblAaNwFjtB2gZ+NXTpsma6ZQ/n8e+2wDJ1UNN+2XPwJw8DXAxmmHQ/wBkhWGhRVWBqwaLfXp92l/aQFhbrm5IWZD8FNca9/Ni4uUA17P/Si2cteOSoo/3BPP/qI/v9mE+9a7U5rEae4rGwPXmmR/rL5cdK7TpwphuiGpn7Hem/EqKuuJBUmLqRTHqn8FJEniFg1DZaQe76QT7xam2f/otrdcKWp7NuCqulY9FOl4JdXaFxA8AHYu9/7KO6F9e6QS7C/+ZqnP29CsAQ9F2yjHOiOPk=
2022-01-27T23:52:33.847 INFO:teuthology.kill:2022-01-27 23:52:33,847.847 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-27T23:52:33.850 INFO:teuthology.kill:2022-01-27 23:52:33,850.850 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-27T23:52:33.927 INFO:teuthology.kill:2022-01-27 23:52:33,927.927 INFO:teuthology.orchestra.console:Power off smithi165
2022-01-27T23:52:33.942 INFO:teuthology.kill:2022-01-27 23:52:33,942.942 INFO:teuthology.orchestra.console:Power off smithi023
2022-01-27T23:52:42.299 INFO:teuthology.kill:2022-01-27 23:52:42,298.298 INFO:teuthology.orchestra.console:Power off for smithi165 completed
2022-01-27T23:52:42.304 INFO:teuthology.kill:2022-01-27 23:52:42,304.304 INFO:teuthology.orchestra.console:Power off for smithi023 completed
2022-01-27T23:52:42.458 INFO:teuthology.kill:2022-01-27 23:52:42,457.457 INFO:teuthology.lock.ops:unlocked: smithi023.front.sepia.ceph.com
2022-01-27T23:52:42.460 INFO:teuthology.kill:2022-01-27 23:52:42,460.460 INFO:teuthology.lock.ops:unlocked: smithi165.front.sepia.ceph.com
2022-01-27T23:54:42.777 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-01-27T23:54:42.872 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi023 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-01-27_15:09:25-rados-wip-yuri6-testing-2022-01-26-1547-distro-default-smithi/6643853
2022-01-27T23:54:42.873 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi165 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-01-27_15:09:25-rados-wip-yuri6-testing-2022-01-26-1547-distro-default-smithi/6643852