2022-01-15T03:03:07.467 INFO:root:teuthology version: 1.1.0-3ff86a5d 2022-01-15T03:03:07.617 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi083.front.sepia.ceph.com' reimaging 2022-01-15T03:03:07.619 INFO:teuthology.lock.ops:Updating [ubuntu@smithi083.front.sepia.ceph.com]: reset os type and version on server 2022-01-15T03:03:07.619 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server 2022-01-15T03:03:07.638 INFO:teuthology.lock.ops:Node 'ubuntu@smithi083.front.sepia.ceph.com' reimaging is complete 2022-01-15T03:03:07.639 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi153.front.sepia.ceph.com' reimaging 2022-01-15T03:03:07.639 INFO:teuthology.lock.ops:Updating [ubuntu@smithi153.front.sepia.ceph.com]: reset os type and version on server 2022-01-15T03:03:07.640 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2022-01-15T03:03:07.659 INFO:teuthology.lock.ops:Node 'ubuntu@smithi153.front.sepia.ceph.com' reimaging is complete 2022-01-15T03:03:07.862 INFO:teuthology.provision.fog.smithi083:Scheduling deploy of centos 8.stream 2022-01-15T03:03:07.903 INFO:teuthology.provision.fog.smithi153:Scheduling deploy of centos 8.stream 2022-01-15T03:03:08.287 INFO:teuthology.orchestra.console:Power off smithi083 2022-01-15T03:03:08.407 INFO:teuthology.orchestra.console:Power off smithi153 2022-01-15T03:03:16.774 INFO:teuthology.orchestra.console:Power off for smithi153 completed 2022-01-15T03:03:16.876 INFO:teuthology.orchestra.console:Power on smithi153 2022-01-15T03:03:20.772 INFO:teuthology.orchestra.console:Power off for smithi083 completed 2022-01-15T03:03:20.874 INFO:teuthology.orchestra.console:Power on smithi083 2022-01-15T03:03:25.146 INFO:teuthology.orchestra.console:Power on for smithi083 completed 2022-01-15T03:03:25.247 INFO:teuthology.provision.fog.smithi083:Waiting for deploy to finish 2022-01-15T03:03:25.331 INFO:teuthology.orchestra.console:Power on for smithi153 completed 2022-01-15T03:03:25.432 INFO:teuthology.provision.fog.smithi153:Waiting for deploy to finish 2022-01-15T03:07:52.487 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-15T03:08:15.063 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-15T03:08:15.312 INFO:teuthology.provision.fog.smithi083:Node is ready 2022-01-15T03:08:15.328 INFO:teuthology.orchestra.run.smithi083.stdout:smithi083.front.sepia.ceph.com 2022-01-15T03:08:15.385 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83 smithi083.front.sepia.ceph.com smithi083 2022-01-15T03:08:15.705 INFO:teuthology.provision.fog.smithi083:Deploy complete! 2022-01-15T03:08:17.374 INFO:teuthology.provision.fog.smithi153:Node is ready 2022-01-15T03:08:17.395 INFO:teuthology.orchestra.run.smithi153.stdout:smithi153.front.sepia.ceph.com 2022-01-15T03:08:17.454 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.15.153 smithi153.front.sepia.ceph.com smithi153 2022-01-15T03:08:17.820 INFO:teuthology.provision.fog.smithi153:Deploy complete! 2022-01-15T03:08:17.969 INFO:teuthology.lock.ops:Checking smithi083.front.sepia.ceph.com 2022-01-15T03:08:17.970 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-15T03:08:17.991 INFO:teuthology.lock.ops:Checking smithi153.front.sepia.ceph.com 2022-01-15T03:08:17.991 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-15T03:08:18.010 INFO:teuthology.lock.ops:Updating [smithi083.front.sepia.ceph.com]: set os type and version on server 2022-01-15T03:08:18.010 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2022-01-15T03:08:18.206 INFO:teuthology.orchestra.run.smithi083.stdout:x86_64 2022-01-15T03:08:18.265 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="CentOS Stream" 2022-01-15T03:08:18.265 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="8" 2022-01-15T03:08:18.266 INFO:teuthology.orchestra.run.smithi083.stdout:ID="centos" 2022-01-15T03:08:18.266 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE="rhel fedora" 2022-01-15T03:08:18.266 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="8" 2022-01-15T03:08:18.267 INFO:teuthology.orchestra.run.smithi083.stdout:PLATFORM_ID="platform:el8" 2022-01-15T03:08:18.267 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="CentOS Stream 8" 2022-01-15T03:08:18.267 INFO:teuthology.orchestra.run.smithi083.stdout:ANSI_COLOR="0;31" 2022-01-15T03:08:18.268 INFO:teuthology.orchestra.run.smithi083.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-01-15T03:08:18.268 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://centos.org/" 2022-01-15T03:08:18.268 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-01-15T03:08:18.269 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-01-15T03:08:18.269 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-01-15T03:08:18.271 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server 2022-01-15T03:08:18.289 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: set os type and version on server 2022-01-15T03:08:18.289 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2022-01-15T03:08:18.489 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64 2022-01-15T03:08:18.546 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="CentOS Stream" 2022-01-15T03:08:18.546 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="8" 2022-01-15T03:08:18.547 INFO:teuthology.orchestra.run.smithi153.stdout:ID="centos" 2022-01-15T03:08:18.547 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="rhel fedora" 2022-01-15T03:08:18.547 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="8" 2022-01-15T03:08:18.547 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el8" 2022-01-15T03:08:18.548 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="CentOS Stream 8" 2022-01-15T03:08:18.548 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31" 2022-01-15T03:08:18.548 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-01-15T03:08:18.548 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://centos.org/" 2022-01-15T03:08:18.548 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-01-15T03:08:18.549 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-01-15T03:08:18.549 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-01-15T03:08:18.549 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2022-01-15T03:08:18.646 INFO:teuthology.dispatcher.supervisor:Running job 6618565 2022-01-15T03:08:18.646 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_3ff86a5dbaafecdb6414fa2fea970bb44e836829/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-01-15_01:19:49-rados-wip-yuriw-master-RC0-1.14.22-distro-default-smithi/6618565 --name yuriw-2022-01-15_01:19:49-rados-wip-yuriw-master-RC0-1.14.22-distro-default-smithi --description rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} -- /home/teuthworker/archive/yuriw-2022-01-15_01:19:49-rados-wip-yuriw-master-RC0-1.14.22-distro-default-smithi/6618565/orig.config.yaml 2022-01-15T03:08:18.652 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-01-15_01:19:49-rados-wip-yuriw-master-RC0-1.14.22-distro-default-smithi/6618565 2022-01-15T03:08:18.653 INFO:teuthology.dispatcher.supervisor:Job PID: 1568 2022-01-15T03:08:18.653 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-01-15T09:38:48.532 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-01-15T09:38:48.720 INFO:teuthology.kill:Killing Pids: {1568} 2022-01-15T09:38:49.884 INFO:teuthology.task.internal:roles: ubuntu@smithi083.front.sepia.ceph.com - ['host.a', 'client.0'] 2022-01-15T09:38:49.885 INFO:teuthology.task.internal:roles: ubuntu@smithi153.front.sepia.ceph.com - ['host.b', 'client.1'] 2022-01-15T09:38:49.885 INFO:teuthology.misc:Compressing logs... 2022-01-15T09:38:49.886 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2022-01-15T09:38:50.072 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2022-01-15T09:38:50.101 INFO:teuthology.orchestra.run.smithi083.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-15T09:38:50.287 INFO:teuthology.orchestra.run.smithi153.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-15T09:38:50.325 INFO:teuthology.orchestra.run.smithi083.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-15T09:38:50.326 INFO:teuthology.orchestra.run.smithi083.stderr:tar: Error is not recoverable: exiting now 2022-01-15T09:38:50.370 INFO:teuthology.orchestra.run.smithi153.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-15T09:38:50.370 INFO:teuthology.orchestra.run.smithi153.stderr:tar: Error is not recoverable: exiting now 2022-01-15T09:38:50.371 INFO:teuthology.misc:Compressing logs... 2022-01-15T09:38:50.840 INFO:teuthology.misc:Compressing logs... 2022-01-15T09:38:52.999 INFO:teuthology.orchestra.run.smithi083.stderr:gzip: /var/log/ceph/8fe9ac6a-75b1-11ec-8c32-001a4aab830c/ceph-mgr.smithi083.dlrfqs.log: file size changed while zipping 2022-01-15T09:38:54.213 INFO:teuthology.orchestra.run.smithi153.stderr:gzip: /var/log/ceph/8fe9ac6a-75b1-11ec-8c32-001a4aab830c/ceph-mon.smithi153.log: file size changed while zipping 2022-01-15T09:39:02.222 INFO:teuthology.orchestra.run.smithi083.stderr:gzip: /var/log/ceph/8fe9ac6a-75b1-11ec-8c32-001a4aab830c/ceph-mon.smithi083.log: file size changed while zipping 2022-01-15T09:39:10.653 INFO:teuthology.orchestra.run.smithi153.stderr:gzip: /var/log/ceph/8fe9ac6a-75b1-11ec-8c32-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2022-01-15T09:39:18.115 INFO:teuthology.orchestra.run.smithi083.stderr:gzip: /var/log/ceph/8fe9ac6a-75b1-11ec-8c32-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2022-01-15T09:39:29.758 INFO:teuthology.orchestra.run.smithi153.stderr:gzip: /var/log/ceph/8fe9ac6a-75b1-11ec-8c32-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2022-01-15T09:39:34.531 INFO:teuthology.orchestra.run.smithi083.stderr:gzip: /var/log/ceph/8fe9ac6a-75b1-11ec-8c32-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2022-01-15T09:39:47.293 INFO:teuthology.orchestra.run.smithi153.stderr:gzip: /var/log/ceph/8fe9ac6a-75b1-11ec-8c32-001a4aab830c/ceph-osd.6.log: file size changed while zipping 2022-01-15T09:39:55.537 INFO:teuthology.orchestra.run.smithi083.stderr:gzip: /var/log/ceph/8fe9ac6a-75b1-11ec-8c32-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2022-01-15T09:39:58.727 INFO:teuthology.orchestra.run.smithi153.stderr:gzip: /var/log/ceph/8fe9ac6a-75b1-11ec-8c32-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2022-01-15T09:40:11.819 INFO:teuthology.orchestra.run.smithi083.stderr:gzip: /var/log/ceph/8fe9ac6a-75b1-11ec-8c32-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2022-01-15T09:40:43.987 INFO:teuthology.kill:No teuthology processes running 2022-01-15T09:40:45.133 INFO:teuthology.kill:Nuking machines: ['smithi083', 'smithi153'] 2022-01-15T09:40:46.099 INFO:teuthology.kill:2022-01-15 09:40:46,099.099 INFO:teuthology.nuke:targets: 2022-01-15T09:40:46.100 INFO:teuthology.kill: smithi083.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4AJm1xldqx7SrxF2nUJykl3tu4UeqXDoY13nO5Ybehsg/msuDD6LiGCCuNq6ziwZKublpktpqgqts+XzBqTThSh0AjRVIRuQGcGsT5TY5BN9cSDaaXOG8CqMkCUGApkt05fj7JRMIQr23LzyGN70lbuQ6iGsBCWdkA8NoepwcX731cpF3zaCANmYCBv0fhJiDFkF2d7gYKywj5wR2hyE/Fsc8X6zjOYp6eIYsGgf4T19f5NslTbYUfV+WxHNRZAQjy6ylvjTiwrdtk9x170VpNeGkqfPBWnE0MrYSnLYvDEhOspkM+nKQ7WorGfFVDWP65yEwq+xcy7Emh5oAosrL9KhlQoC6iIQdP34fhQtHLofXqUCf/3oxyoGJF4qZ+tmRbOBm8q9LKodm2jm16u1/CmFqxmSAnK82FMve35kKhJLkJ0cSfZhWOP3l0JRCnO+pGXs/3NZrzUu+EK2nGM4UiibGbzGsT1dozr0j/GdNwK3VuVP6MAnH79oRnfxMANE= 2022-01-15T09:40:46.101 INFO:teuthology.kill: smithi153.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDjpRz8FdVCdEpd8ZgyUrvt7VWHx13/25dB33H2TyeZdU//glNVxQZIKq151ttbCRKY+DB3pVYwrn66zs+8heXR3XCC3A4cJwSD4yMQ/cB/aBLdeBXmAHCkVSzLNDtcDRUM6P+MwNZW+ESrI4n6tQ05Rj79d1PGxCLyFJAA8+3V/DJYF6Va8IDhgkc2su5rXkWzfrlfT737EjRRDe5Fs2VJkjBeJmoAEgD+wwXfHqq/brnNTbzJLy0Smgd7tcq21jaM8ZgXdVHXeFtikaQM5+2aH9x3IRz6WAElh8R6GdQwO8w1XPS9rh2HsLBPRDdE8H3tkBBtxHP5bv3ivyXkW3Tge7RHy1KBBjcG9hWwiiYdn0hBkbfINKjC8p7Fj2nYioOsw1KdgCpSDaItgJXbjOK6lFVjyPoqB768bm0KyzdXAZEOhTwlqA1bcaterd2G4jWQB06qdfT2g60PnFuiKca5Kuq/HeMPCGcYXrlAY3cBFAETci2VLhdYbYLrWjND00s= 2022-01-15T09:40:46.125 INFO:teuthology.kill:2022-01-15 09:40:46,125.125 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-15T09:40:46.130 INFO:teuthology.kill:2022-01-15 09:40:46,129.129 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-15T09:40:46.213 INFO:teuthology.kill:2022-01-15 09:40:46,213.213 INFO:teuthology.orchestra.console:Power off smithi083 2022-01-15T09:40:46.227 INFO:teuthology.kill:2022-01-15 09:40:46,227.227 INFO:teuthology.orchestra.console:Power off smithi153 2022-01-15T09:40:54.587 INFO:teuthology.kill:2022-01-15 09:40:54,586.586 INFO:teuthology.orchestra.console:Power off for smithi153 completed 2022-01-15T09:40:54.737 INFO:teuthology.kill:2022-01-15 09:40:54,736.736 INFO:teuthology.lock.ops:unlocked: smithi153.front.sepia.ceph.com 2022-01-15T09:40:58.693 INFO:teuthology.kill:2022-01-15 09:40:58,692.692 INFO:teuthology.orchestra.console:Power off for smithi083 completed 2022-01-15T09:40:58.841 INFO:teuthology.kill:2022-01-15 09:40:58,841.841 INFO:teuthology.lock.ops:unlocked: smithi083.front.sepia.ceph.com 2022-01-15T09:42:59.147 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-01-15T09:42:59.261 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi083 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-01-14_23:22:09-rados-wip-yuri6-testing-2022-01-14-1207-distro-default-smithi/6618147 2022-01-15T09:42:59.261 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi153 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-01-14_23:22:09-rados-wip-yuri6-testing-2022-01-14-1207-distro-default-smithi/6618148