2022-01-07T16:03:29.750 INFO:root:teuthology version: 1.1.0-95a7d479 2022-01-07T16:03:29.866 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi143.front.sepia.ceph.com' reimaging 2022-01-07T16:03:29.867 INFO:teuthology.lock.ops:Updating [ubuntu@smithi143.front.sepia.ceph.com]: reset os type and version on server 2022-01-07T16:03:29.867 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2022-01-07T16:03:29.885 INFO:teuthology.lock.ops:Node 'ubuntu@smithi143.front.sepia.ceph.com' reimaging is complete 2022-01-07T16:03:29.885 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi148.front.sepia.ceph.com' reimaging 2022-01-07T16:03:29.885 INFO:teuthology.lock.ops:Updating [ubuntu@smithi148.front.sepia.ceph.com]: reset os type and version on server 2022-01-07T16:03:29.886 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2022-01-07T16:03:29.904 INFO:teuthology.lock.ops:Node 'ubuntu@smithi148.front.sepia.ceph.com' reimaging is complete 2022-01-07T16:03:30.095 INFO:teuthology.provision.fog.smithi143:Scheduling deploy of centos 8.stream 2022-01-07T16:03:30.111 INFO:teuthology.provision.fog.smithi148:Scheduling deploy of centos 8.stream 2022-01-07T16:03:30.482 INFO:teuthology.orchestra.console:Power off smithi148 2022-01-07T16:03:30.518 INFO:teuthology.orchestra.console:Power off smithi143 2022-01-07T16:03:30.627 INFO:teuthology.orchestra.console:Power off for smithi148 completed 2022-01-07T16:03:30.659 INFO:teuthology.orchestra.console:Power off for smithi143 completed 2022-01-07T16:03:30.729 INFO:teuthology.orchestra.console:Power on smithi148 2022-01-07T16:03:30.760 INFO:teuthology.orchestra.console:Power on smithi143 2022-01-07T16:03:34.986 INFO:teuthology.orchestra.console:Power on for smithi148 completed 2022-01-07T16:03:35.087 INFO:teuthology.provision.fog.smithi148:Waiting for deploy to finish 2022-01-07T16:03:39.125 INFO:teuthology.orchestra.console:Power on for smithi143 completed 2022-01-07T16:03:39.226 INFO:teuthology.provision.fog.smithi143:Waiting for deploy to finish 2022-01-07T16:08:29.347 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-07T16:08:29.656 INFO:teuthology.provision.fog.smithi143:Node is ready 2022-01-07T16:08:29.673 INFO:teuthology.orchestra.run.smithi143.stdout:smithi143.front.sepia.ceph.com 2022-01-07T16:08:29.730 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.15.143 smithi143.front.sepia.ceph.com smithi143 2022-01-07T16:08:30.068 INFO:teuthology.provision.fog.smithi143:Deploy complete! 2022-01-07T16:08:55.537 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-07T16:08:55.818 INFO:teuthology.provision.fog.smithi148:Node is ready 2022-01-07T16:08:55.835 INFO:teuthology.orchestra.run.smithi148.stdout:smithi148.front.sepia.ceph.com 2022-01-07T16:08:55.893 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148 smithi148.front.sepia.ceph.com smithi148 2022-01-07T16:08:56.221 INFO:teuthology.provision.fog.smithi148:Deploy complete! 2022-01-07T16:08:56.369 INFO:teuthology.lock.ops:Checking smithi143.front.sepia.ceph.com 2022-01-07T16:08:56.370 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-07T16:08:56.390 INFO:teuthology.lock.ops:Checking smithi148.front.sepia.ceph.com 2022-01-07T16:08:56.391 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-07T16:08:56.409 INFO:teuthology.lock.ops:Updating [smithi143.front.sepia.ceph.com]: set os type and version on server 2022-01-07T16:08:56.410 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2022-01-07T16:08:56.656 INFO:teuthology.orchestra.run.smithi143.stdout:x86_64 2022-01-07T16:08:56.712 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="CentOS Stream" 2022-01-07T16:08:56.713 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="8" 2022-01-07T16:08:56.713 INFO:teuthology.orchestra.run.smithi143.stdout:ID="centos" 2022-01-07T16:08:56.713 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE="rhel fedora" 2022-01-07T16:08:56.713 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="8" 2022-01-07T16:08:56.714 INFO:teuthology.orchestra.run.smithi143.stdout:PLATFORM_ID="platform:el8" 2022-01-07T16:08:56.714 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="CentOS Stream 8" 2022-01-07T16:08:56.714 INFO:teuthology.orchestra.run.smithi143.stdout:ANSI_COLOR="0;31" 2022-01-07T16:08:56.714 INFO:teuthology.orchestra.run.smithi143.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-01-07T16:08:56.715 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://centos.org/" 2022-01-07T16:08:56.715 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-01-07T16:08:56.715 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-01-07T16:08:56.715 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-01-07T16:08:56.717 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2022-01-07T16:08:56.738 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: set os type and version on server 2022-01-07T16:08:56.739 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2022-01-07T16:08:56.927 INFO:teuthology.orchestra.run.smithi148.stdout:x86_64 2022-01-07T16:08:56.984 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="CentOS Stream" 2022-01-07T16:08:56.984 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="8" 2022-01-07T16:08:56.984 INFO:teuthology.orchestra.run.smithi148.stdout:ID="centos" 2022-01-07T16:08:56.985 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="rhel fedora" 2022-01-07T16:08:56.985 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="8" 2022-01-07T16:08:56.985 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el8" 2022-01-07T16:08:56.985 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="CentOS Stream 8" 2022-01-07T16:08:56.985 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31" 2022-01-07T16:08:56.986 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-01-07T16:08:56.986 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://centos.org/" 2022-01-07T16:08:56.986 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-01-07T16:08:56.986 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-01-07T16:08:56.987 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-01-07T16:08:56.987 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2022-01-07T16:08:57.099 INFO:teuthology.dispatcher.supervisor:Running job 6601362 2022-01-07T16:08:57.099 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-01-07_15:47:55-rados-wip-yuri8-testing-2022-01-05-1411-distro-default-smithi/6601362 --name yuriw-2022-01-07_15:47:55-rados-wip-yuri8-testing-2022-01-05-1411-distro-default-smithi --description rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} -- /home/teuthworker/archive/yuriw-2022-01-07_15:47:55-rados-wip-yuri8-testing-2022-01-05-1411-distro-default-smithi/6601362/orig.config.yaml 2022-01-07T16:08:57.103 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-01-07_15:47:55-rados-wip-yuri8-testing-2022-01-05-1411-distro-default-smithi/6601362 2022-01-07T16:08:57.104 INFO:teuthology.dispatcher.supervisor:Job PID: 9081 2022-01-07T16:08:57.105 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-01-08T04:09:51.259 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-01-08T04:09:51.406 INFO:teuthology.kill:Killing Pids: {9081} 2022-01-08T04:09:52.643 INFO:teuthology.task.internal:roles: ubuntu@smithi143.front.sepia.ceph.com - ['host.a', 'client.0'] 2022-01-08T04:09:52.644 INFO:teuthology.task.internal:roles: ubuntu@smithi148.front.sepia.ceph.com - ['host.b', 'client.1'] 2022-01-08T04:09:52.644 INFO:teuthology.misc:Compressing logs... 2022-01-08T04:09:52.645 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2022-01-08T04:09:52.828 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2022-01-08T04:09:52.854 INFO:teuthology.orchestra.run.smithi143.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-08T04:09:53.049 INFO:teuthology.orchestra.run.smithi148.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-08T04:09:53.088 INFO:teuthology.orchestra.run.smithi143.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-08T04:09:53.089 INFO:teuthology.orchestra.run.smithi143.stderr:tar: Error is not recoverable: exiting now 2022-01-08T04:09:53.249 INFO:teuthology.orchestra.run.smithi148.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-08T04:09:53.249 INFO:teuthology.orchestra.run.smithi148.stderr:tar: Error is not recoverable: exiting now 2022-01-08T04:09:53.250 INFO:teuthology.misc:Compressing logs... 2022-01-08T04:09:53.821 INFO:teuthology.misc:Compressing logs... 2022-01-08T04:09:54.397 INFO:teuthology.orchestra.run.smithi148.stderr:gzip: /var/log/ceph/505a7a34-6fd5-11ec-8c32-001a4aab830c/ceph-mon.smithi148.log: file size changed while zipping 2022-01-08T04:09:54.415 INFO:teuthology.orchestra.run.smithi143.stderr:gzip: /var/log/ceph/505a7a34-6fd5-11ec-8c32-001a4aab830c/ceph-mon.smithi143.log: file size changed while zipping 2022-01-08T04:09:55.210 INFO:teuthology.orchestra.run.smithi143.stderr:gzip: /var/log/ceph/505a7a34-6fd5-11ec-8c32-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2022-01-08T04:09:56.505 INFO:teuthology.orchestra.run.smithi143.stderr:gzip: /var/log/ceph/505a7a34-6fd5-11ec-8c32-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2022-01-08T04:09:56.607 INFO:teuthology.orchestra.run.smithi148.stderr:gzip: /var/log/ceph/505a7a34-6fd5-11ec-8c32-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2022-01-08T04:09:57.705 INFO:teuthology.orchestra.run.smithi143.stderr:gzip: /var/log/ceph/505a7a34-6fd5-11ec-8c32-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2022-01-08T04:09:58.759 INFO:teuthology.orchestra.run.smithi143.stderr:gzip: /var/log/ceph/505a7a34-6fd5-11ec-8c32-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2022-01-08T04:09:58.961 INFO:teuthology.orchestra.run.smithi148.stderr:gzip: /var/log/ceph/505a7a34-6fd5-11ec-8c32-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2022-01-08T04:10:01.611 INFO:teuthology.orchestra.run.smithi148.stderr:gzip: /var/log/ceph/505a7a34-6fd5-11ec-8c32-001a4aab830c/ceph-osd.6.log: file size changed while zipping 2022-01-08T04:10:03.708 INFO:teuthology.orchestra.run.smithi148.stderr:gzip: /var/log/ceph/505a7a34-6fd5-11ec-8c32-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2022-01-08T04:10:36.621 INFO:teuthology.orchestra.run.smithi143.stderr:tar: .: file changed as we read it 2022-01-08T04:11:03.061 INFO:teuthology.kill:No teuthology processes running 2022-01-08T04:11:04.299 INFO:teuthology.kill:Nuking machines: ['smithi143', 'smithi148'] 2022-01-08T04:11:05.332 INFO:teuthology.kill:2022-01-08 04:11:05,332.332 INFO:teuthology.nuke:targets: 2022-01-08T04:11:05.333 INFO:teuthology.kill: smithi143.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCw9JLphnZZgakEwviWh0s5yt8rqGFZsH0wihiscwQ7AwwnZ5jC9joMihOaHGzOcPahrB/ap5o9U4Vf+SKWUszh17yriVzcc7LxVXWVlZ6m0efzXAgKUDBxIvKzsTTqCXYDUS4QyMIaeyTlm1KguoiwJeDDJKU234NW0Ot+HgnoiDTvxiIfl05QXW0bi1g35yJCp/HElaxufav0X0poFp1Nm4ZU2AFeQc3mzAmoLeAS6tyjHoRhynEDIJG8CYKjZR0F135/NJYoagUdoUlUo6S8RmFcuADLxqw/IIi0lWSaTWCrtOWxPmaIJcJy4QCrdOql3QJKSst2Am/MsZUrpSG1AYXboSUniR6iEWOVlHTqo9ZVCfktEOHp/72vZb1wpJ1RcfPJsM2fXJCcUSJApOkkS1lPx4OoUqZZVHZBG1c3N6a2LzcFXuijNiB3BtXujhzDEm1Mhk0k+IFV/bx50+ZYdn9uFZYwXvQwZHOuTCW18ONhZp+91pljmONVWkCGaGs= 2022-01-08T04:11:05.333 INFO:teuthology.kill: smithi148.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDv2DRgAHtYGEpVhMnBRbQ4nkN5C+WD/ubUNxXN6rAbj+zCBk6f5/mllrNKVhxpPXgtwr072F7r8TAj9Ec8eKqdb3tlm3mF3x/6U7jdX/s0JLAPBuDW3KWxFAiPQ7SiKWcJYS1sLN5y5CLmJ5cx9cGTpdhHvd46pXgKUN6TnSICkFnZ0EQ9fIiQGBuJH+CbSbKa3CRe8QLF3ZpvMPztgMSfVFey8NYJwcoxGNt35oGICYKq6OOp2JKXJqHQQl0m3RZEulfuFeEj8kAHcXTcm4B0QCh2kVikcdm6RzFvWGgcqH9KKPAzyjmcBLNUYZRLhpmNKXHK6e5z9/ghYkl7AfEgYQJl1wkXr94wxLJ13kN5v3b23yCTyYuzwshN93e+13KBbRSFfC9SF2HsYdouZvaG02dkAvRbysPK4VjonoZyaNgXDzz6mzy0U3OkRTZw9xJelTJnNC/imvQwMJDQbjX2Tv7GfYOj9MmfoA59nJMRWa1h9qZehRKVofrSCFhS3j8= 2022-01-08T04:11:05.360 INFO:teuthology.kill:2022-01-08 04:11:05,359.359 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-08T04:11:05.363 INFO:teuthology.kill:2022-01-08 04:11:05,363.363 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-08T04:11:05.441 INFO:teuthology.kill:2022-01-08 04:11:05,440.440 INFO:teuthology.orchestra.console:Power off smithi148 2022-01-08T04:11:05.454 INFO:teuthology.kill:2022-01-08 04:11:05,454.454 INFO:teuthology.orchestra.console:Power off smithi143 2022-01-08T04:11:17.925 INFO:teuthology.kill:2022-01-08 04:11:17,924.924 INFO:teuthology.orchestra.console:Power off for smithi148 completed 2022-01-08T04:11:17.932 INFO:teuthology.kill:2022-01-08 04:11:17,932.932 INFO:teuthology.orchestra.console:Power off for smithi143 completed 2022-01-08T04:11:18.072 INFO:teuthology.kill:2022-01-08 04:11:18,071.071 INFO:teuthology.lock.ops:unlocked: smithi148.front.sepia.ceph.com 2022-01-08T04:11:18.074 INFO:teuthology.kill:2022-01-08 04:11:18,074.074 INFO:teuthology.lock.ops:unlocked: smithi143.front.sepia.ceph.com 2022-01-08T04:13:18.475 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-01-08T04:13:18.583 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi143 but it was locked by another job: /home/teuthworker/archive/mrfreezeex-2022-01-07_21:07:03-rbd:mirror-wip-53031-MrFreezeex-octopus-distro-default-smithi/6602000 2022-01-08T04:13:18.583 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi148 but it was locked by another job: /home/teuthworker/archive/mrfreezeex-2022-01-07_21:07:03-rbd:mirror-wip-53031-MrFreezeex-octopus-distro-default-smithi/6602000