2022-01-15T00:36:24.075 INFO:root:teuthology version: 1.1.0-3ff86a5d 2022-01-15T00:36:24.202 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi002.front.sepia.ceph.com' reimaging 2022-01-15T00:36:24.203 INFO:teuthology.lock.ops:Updating [ubuntu@smithi002.front.sepia.ceph.com]: reset os type and version on server 2022-01-15T00:36:24.204 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server 2022-01-15T00:36:24.236 INFO:teuthology.lock.ops:Node 'ubuntu@smithi002.front.sepia.ceph.com' reimaging is complete 2022-01-15T00:36:24.236 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi070.front.sepia.ceph.com' reimaging 2022-01-15T00:36:24.236 INFO:teuthology.lock.ops:Updating [ubuntu@smithi070.front.sepia.ceph.com]: reset os type and version on server 2022-01-15T00:36:24.237 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server 2022-01-15T00:36:24.262 INFO:teuthology.lock.ops:Node 'ubuntu@smithi070.front.sepia.ceph.com' reimaging is complete 2022-01-15T00:36:24.445 INFO:teuthology.provision.fog.smithi002:Scheduling deploy of centos 8.stream 2022-01-15T00:36:24.500 INFO:teuthology.provision.fog.smithi070:Scheduling deploy of centos 8.stream 2022-01-15T00:36:24.876 INFO:teuthology.orchestra.console:Power off smithi002 2022-01-15T00:36:24.919 INFO:teuthology.orchestra.console:Power off smithi070 2022-01-15T00:36:25.066 INFO:teuthology.orchestra.console:Power off for smithi070 completed 2022-01-15T00:36:25.167 INFO:teuthology.orchestra.console:Power on smithi070 2022-01-15T00:36:29.466 INFO:teuthology.orchestra.console:Power on for smithi070 completed 2022-01-15T00:36:29.567 INFO:teuthology.provision.fog.smithi070:Waiting for deploy to finish 2022-01-15T00:36:33.252 INFO:teuthology.orchestra.console:Power off for smithi002 completed 2022-01-15T00:36:33.354 INFO:teuthology.orchestra.console:Power on smithi002 2022-01-15T00:36:37.608 INFO:teuthology.orchestra.console:Power on for smithi002 completed 2022-01-15T00:36:37.709 INFO:teuthology.provision.fog.smithi002:Waiting for deploy to finish 2022-01-15T00:41:12.814 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-15T00:41:13.080 INFO:teuthology.provision.fog.smithi002:Node is ready 2022-01-15T00:41:13.098 INFO:teuthology.orchestra.run.smithi002.stdout:smithi002.front.sepia.ceph.com 2022-01-15T00:41:13.155 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2 smithi002.front.sepia.ceph.com smithi002 2022-01-15T00:41:13.502 INFO:teuthology.provision.fog.smithi002:Deploy complete! 2022-01-15T00:41:19.731 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-15T00:41:20.005 INFO:teuthology.provision.fog.smithi070:Node is ready 2022-01-15T00:41:20.021 INFO:teuthology.orchestra.run.smithi070.stdout:smithi070.front.sepia.ceph.com 2022-01-15T00:41:20.079 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70 smithi070.front.sepia.ceph.com smithi070 2022-01-15T00:41:20.399 INFO:teuthology.provision.fog.smithi070:Deploy complete! 2022-01-15T00:41:20.552 INFO:teuthology.lock.ops:Checking smithi002.front.sepia.ceph.com 2022-01-15T00:41:20.553 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-15T00:41:20.572 INFO:teuthology.lock.ops:Checking smithi070.front.sepia.ceph.com 2022-01-15T00:41:20.573 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-15T00:41:20.590 INFO:teuthology.lock.ops:Updating [smithi002.front.sepia.ceph.com]: set os type and version on server 2022-01-15T00:41:20.590 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2022-01-15T00:41:20.789 INFO:teuthology.orchestra.run.smithi002.stdout:x86_64 2022-01-15T00:41:20.847 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="CentOS Stream" 2022-01-15T00:41:20.848 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="8" 2022-01-15T00:41:20.848 INFO:teuthology.orchestra.run.smithi002.stdout:ID="centos" 2022-01-15T00:41:20.848 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="rhel fedora" 2022-01-15T00:41:20.848 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="8" 2022-01-15T00:41:20.849 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el8" 2022-01-15T00:41:20.849 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="CentOS Stream 8" 2022-01-15T00:41:20.849 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31" 2022-01-15T00:41:20.849 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-01-15T00:41:20.850 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://centos.org/" 2022-01-15T00:41:20.850 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-01-15T00:41:20.850 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-01-15T00:41:20.850 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-01-15T00:41:20.851 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server 2022-01-15T00:41:20.870 INFO:teuthology.lock.ops:Updating [smithi070.front.sepia.ceph.com]: set os type and version on server 2022-01-15T00:41:20.870 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2022-01-15T00:41:21.060 INFO:teuthology.orchestra.run.smithi070.stdout:x86_64 2022-01-15T00:41:21.116 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="CentOS Stream" 2022-01-15T00:41:21.116 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="8" 2022-01-15T00:41:21.116 INFO:teuthology.orchestra.run.smithi070.stdout:ID="centos" 2022-01-15T00:41:21.116 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE="rhel fedora" 2022-01-15T00:41:21.116 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="8" 2022-01-15T00:41:21.117 INFO:teuthology.orchestra.run.smithi070.stdout:PLATFORM_ID="platform:el8" 2022-01-15T00:41:21.117 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="CentOS Stream 8" 2022-01-15T00:41:21.117 INFO:teuthology.orchestra.run.smithi070.stdout:ANSI_COLOR="0;31" 2022-01-15T00:41:21.117 INFO:teuthology.orchestra.run.smithi070.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-01-15T00:41:21.117 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://centos.org/" 2022-01-15T00:41:21.118 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-01-15T00:41:21.118 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-01-15T00:41:21.118 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-01-15T00:41:21.119 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server 2022-01-15T00:41:21.211 INFO:teuthology.dispatcher.supervisor:Running job 6617945 2022-01-15T00:41:21.211 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_3ff86a5dbaafecdb6414fa2fea970bb44e836829/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-01-14_23:22:09-rados-wip-yuri6-testing-2022-01-14-1207-distro-default-smithi/6617945 --name yuriw-2022-01-14_23:22:09-rados-wip-yuri6-testing-2022-01-14-1207-distro-default-smithi --description rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} -- /home/teuthworker/archive/yuriw-2022-01-14_23:22:09-rados-wip-yuri6-testing-2022-01-14-1207-distro-default-smithi/6617945/orig.config.yaml 2022-01-15T00:41:21.214 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-01-14_23:22:09-rados-wip-yuri6-testing-2022-01-14-1207-distro-default-smithi/6617945 2022-01-15T00:41:21.215 INFO:teuthology.dispatcher.supervisor:Job PID: 23461 2022-01-15T00:41:21.216 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-01-15T07:11:51.507 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-01-15T07:11:51.688 INFO:teuthology.kill:Killing Pids: {23461} 2022-01-15T07:11:52.912 INFO:teuthology.task.internal:roles: ubuntu@smithi002.front.sepia.ceph.com - ['host.a', 'client.0'] 2022-01-15T07:11:52.913 INFO:teuthology.task.internal:roles: ubuntu@smithi070.front.sepia.ceph.com - ['host.b', 'client.1'] 2022-01-15T07:11:52.913 INFO:teuthology.misc:Compressing logs... 2022-01-15T07:11:52.914 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2022-01-15T07:11:53.114 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2022-01-15T07:11:53.147 INFO:teuthology.orchestra.run.smithi002.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-15T07:11:53.336 INFO:teuthology.orchestra.run.smithi070.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-15T07:11:53.385 INFO:teuthology.orchestra.run.smithi002.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-15T07:11:53.386 INFO:teuthology.orchestra.run.smithi002.stderr:tar: Error is not recoverable: exiting now 2022-01-15T07:11:53.428 INFO:teuthology.orchestra.run.smithi070.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-15T07:11:53.428 INFO:teuthology.orchestra.run.smithi070.stderr:tar: Error is not recoverable: exiting now 2022-01-15T07:11:53.429 INFO:teuthology.misc:Compressing logs... 2022-01-15T07:11:53.824 INFO:teuthology.orchestra.run.smithi002.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-01-15T07:11:54.005 INFO:teuthology.misc:Compressing logs... 2022-01-15T07:11:56.218 INFO:teuthology.orchestra.run.smithi002.stderr:gzip: /var/log/ceph/0eface18-759d-11ec-8c32-001a4aab830c/ceph-mgr.smithi002.eagwpl.log: file size changed while zipping 2022-01-15T07:12:09.788 INFO:teuthology.orchestra.run.smithi070.stderr:gzip: /var/log/ceph/0eface18-759d-11ec-8c32-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2022-01-15T07:12:13.558 INFO:teuthology.orchestra.run.smithi002.stderr:gzip: /var/log/ceph/0eface18-759d-11ec-8c32-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2022-01-15T07:12:29.220 INFO:teuthology.orchestra.run.smithi070.stderr:gzip: /var/log/ceph/0eface18-759d-11ec-8c32-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2022-01-15T07:12:35.065 INFO:teuthology.orchestra.run.smithi002.stderr:gzip: /var/log/ceph/0eface18-759d-11ec-8c32-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2022-01-15T07:12:44.864 INFO:teuthology.orchestra.run.smithi002.stderr:gzip: /var/log/ceph/0eface18-759d-11ec-8c32-001a4aab830c/ceph-mon.smithi002.log: file size changed while zipping 2022-01-15T07:12:45.024 INFO:teuthology.orchestra.run.smithi070.stderr:gzip: /var/log/ceph/0eface18-759d-11ec-8c32-001a4aab830c/ceph-osd.6.log: file size changed while zipping 2022-01-15T07:12:56.249 INFO:teuthology.orchestra.run.smithi070.stderr:gzip: /var/log/ceph/0eface18-759d-11ec-8c32-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2022-01-15T07:12:59.460 INFO:teuthology.orchestra.run.smithi070.stderr:gzip: /var/log/ceph/0eface18-759d-11ec-8c32-001a4aab830c/ceph-mon.smithi070.log: file size changed while zipping 2022-01-15T07:13:06.376 INFO:teuthology.orchestra.run.smithi002.stderr:gzip: /var/log/ceph/0eface18-759d-11ec-8c32-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2022-01-15T07:13:23.665 INFO:teuthology.orchestra.run.smithi002.stderr:gzip: /var/log/ceph/0eface18-759d-11ec-8c32-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2022-01-15T07:13:42.579 INFO:teuthology.orchestra.run.smithi002.stderr:tar: .: file changed as we read it 2022-01-15T07:13:56.435 INFO:teuthology.kill:No teuthology processes running 2022-01-15T07:13:57.609 INFO:teuthology.kill:Nuking machines: ['smithi002', 'smithi070'] 2022-01-15T07:13:58.588 INFO:teuthology.kill:2022-01-15 07:13:58,588.588 INFO:teuthology.nuke:targets: 2022-01-15T07:13:58.589 INFO:teuthology.kill: smithi002.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDG5yWkbnUT85Yb2Zb04QIkW2ql/b5FDe3muHdFAPTKxoLe59ojioXfabf0EzpFdmO3ykC8qogumsLKNyeD2p+M9t6T3kgkqjGFEkzp23cspaR9Pbm3FSEufRRrm8CQLQJGeT464kYu1/UyslIbOVLTjVoPpRs3bOMiW4lBy7uDizxzek+M4TUFGMJvoS+KsfJShpoK7kttUvFutfTlDwD1Kf/xPHTmC3nq5mGNV844XzmAiWLYMuc8Meev+IhUqarDJn+Nkvr6TbG523OV1dpJla7FCvlGE5Mwejhc9TUYpYkEf94WDAYfZTqMBKPGiTjP476PUS0uEgL/bek+fEbd03Eex2CsTzTYXP4R+pT6hyMrkJ1VN6i0byBDWkOAsTCPHDmM+cQRkFgIqa8Ft3jQw+vv9W5ZDLvMI/TNKKF90DiRWNyRnWomz8H2p5DWBMTHAJEVlqFnPM13RDVHWqpROy31jD3vLfwcdNWb1DRo5tmZdqHeZ2o7bNldLQbuHKU= 2022-01-15T07:13:58.589 INFO:teuthology.kill: smithi070.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzyJaM8mVBYJ6nxpnJlTEdt+yzw3GPNeMlCc5XCFgZ7UQDWgTrIiYbsytTSbe9HVIY9Y2J77Hz6svIY0BFQcxlxwLblBScAysZ0LeS529L4CcPx36Lm0DY40axbhtcPvnxizABZd4YvBm7Gkf2wr2mkETrAAM4HpKVJ9RYvnAb0stdnLhxa8mVvYBTSGFfhwdy1IM/g13AYes7PEzpCgOoxpk+jicowuUfGZG08CQYB93Tju2X+A5IklWsEkY8KuEEc4Gxv61I8n1kHCwAbOY0FnrIazBiW10mM/RJKJFJ83o+bYvGejzWfZ1ML14dqPfUo7Vj8qnBVYVp3p5Jd7NhOdaIF/BRTvKJd08+zPyQPF1AvxIGZldvtF8uHltRms7QqX/XVNgAfRfYlwWn1j/ZINn0uwxwD1BsE36Pw2Okg+UxfA30pA50UeyT7FlsIeRJ1aOLdRxY9Jn5BVH7SXxhnenvRtUmjrIIAEB8yizajJrR4YJhhL7hfdDXsAWsdkc= 2022-01-15T07:13:58.615 INFO:teuthology.kill:2022-01-15 07:13:58,614.614 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-15T07:13:58.618 INFO:teuthology.kill:2022-01-15 07:13:58,617.617 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-15T07:13:58.700 INFO:teuthology.kill:2022-01-15 07:13:58,699.699 INFO:teuthology.orchestra.console:Power off smithi070 2022-01-15T07:13:58.714 INFO:teuthology.kill:2022-01-15 07:13:58,713.713 INFO:teuthology.orchestra.console:Power off smithi002 2022-01-15T07:14:07.078 INFO:teuthology.kill:2022-01-15 07:14:07,077.077 INFO:teuthology.orchestra.console:Power off for smithi002 completed 2022-01-15T07:14:07.223 INFO:teuthology.kill:2022-01-15 07:14:07,222.222 INFO:teuthology.lock.ops:unlocked: smithi002.front.sepia.ceph.com 2022-01-15T07:14:11.183 INFO:teuthology.kill:2022-01-15 07:14:11,182.182 INFO:teuthology.orchestra.console:Power off for smithi070 completed 2022-01-15T07:14:11.329 INFO:teuthology.kill:2022-01-15 07:14:11,329.329 INFO:teuthology.lock.ops:unlocked: smithi070.front.sepia.ceph.com 2022-01-15T07:16:11.648 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-01-15T07:16:11.749 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi002 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-01-15_05:42:37-rados-wip-yuriw-quincy-1.14.22-distro-default-smithi/6618974 2022-01-15T07:16:11.749 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi070 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-01-15_05:42:37-rados-wip-yuriw-quincy-1.14.22-distro-default-smithi/6618975