2022-01-08T19:13:26.822 INFO:root:teuthology version: 1.1.0-00e09f05 2022-01-08T19:13:26.949 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi085.front.sepia.ceph.com' reimaging 2022-01-08T19:13:26.950 INFO:teuthology.lock.ops:Updating [ubuntu@smithi085.front.sepia.ceph.com]: reset os type and version on server 2022-01-08T19:13:26.950 INFO:teuthology.lock.ops:Updating smithi085.front.sepia.ceph.com on lock server 2022-01-08T19:13:26.970 INFO:teuthology.lock.ops:Node 'ubuntu@smithi085.front.sepia.ceph.com' reimaging is complete 2022-01-08T19:13:26.971 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi110.front.sepia.ceph.com' reimaging 2022-01-08T19:13:26.971 INFO:teuthology.lock.ops:Updating [ubuntu@smithi110.front.sepia.ceph.com]: reset os type and version on server 2022-01-08T19:13:26.971 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2022-01-08T19:13:26.993 INFO:teuthology.lock.ops:Node 'ubuntu@smithi110.front.sepia.ceph.com' reimaging is complete 2022-01-08T19:13:27.181 INFO:teuthology.provision.fog.smithi085:Scheduling deploy of rhel 8.4 2022-01-08T19:13:27.190 INFO:teuthology.provision.fog.smithi110:Scheduling deploy of rhel 8.4 2022-01-08T19:13:27.566 INFO:teuthology.orchestra.console:Power off smithi085 2022-01-08T19:13:27.587 INFO:teuthology.orchestra.console:Power off smithi110 2022-01-08T19:13:35.950 INFO:teuthology.orchestra.console:Power off for smithi110 completed 2022-01-08T19:13:36.051 INFO:teuthology.orchestra.console:Power on smithi110 2022-01-08T19:13:40.057 INFO:teuthology.orchestra.console:Power off for smithi085 completed 2022-01-08T19:13:40.159 INFO:teuthology.orchestra.console:Power on smithi085 2022-01-08T19:13:44.414 INFO:teuthology.orchestra.console:Power on for smithi085 completed 2022-01-08T19:13:44.419 INFO:teuthology.orchestra.console:Power on for smithi110 completed 2022-01-08T19:13:44.516 INFO:teuthology.provision.fog.smithi085:Waiting for deploy to finish 2022-01-08T19:13:44.520 INFO:teuthology.provision.fog.smithi110:Waiting for deploy to finish 2022-01-08T19:18:34.278 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-08T19:18:34.478 INFO:teuthology.provision.fog.smithi110:Node is ready 2022-01-08T19:18:34.494 INFO:teuthology.orchestra.run.smithi110.stdout:smithi110.front.sepia.ceph.com 2022-01-08T19:18:34.551 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110 smithi110.front.sepia.ceph.com smithi110 2022-01-08T19:18:34.870 INFO:teuthology.provision.fog.smithi110:Deploy complete! 2022-01-08T19:19:04.860 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-08T19:19:05.101 INFO:teuthology.provision.fog.smithi085:Node is ready 2022-01-08T19:19:05.117 INFO:teuthology.orchestra.run.smithi085.stdout:smithi085.front.sepia.ceph.com 2022-01-08T19:19:05.179 INFO:teuthology.orchestra.run.smithi085.stdout:172.21.15.85 smithi085.front.sepia.ceph.com smithi085 2022-01-08T19:19:05.503 INFO:teuthology.provision.fog.smithi085:Deploy complete! 2022-01-08T19:19:05.660 INFO:teuthology.lock.ops:Checking smithi085.front.sepia.ceph.com 2022-01-08T19:19:05.661 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-08T19:19:05.680 INFO:teuthology.lock.ops:Checking smithi110.front.sepia.ceph.com 2022-01-08T19:19:05.681 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-08T19:19:05.700 INFO:teuthology.lock.ops:Updating [smithi085.front.sepia.ceph.com]: set os type and version on server 2022-01-08T19:19:05.700 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi085.front.sepia.ceph.com' 2022-01-08T19:19:05.883 INFO:teuthology.orchestra.run.smithi085.stdout:x86_64 2022-01-08T19:19:05.938 INFO:teuthology.orchestra.run.smithi085.stdout:NAME="Red Hat Enterprise Linux" 2022-01-08T19:19:05.939 INFO:teuthology.orchestra.run.smithi085.stdout:VERSION="8.4 (Ootpa)" 2022-01-08T19:19:05.939 INFO:teuthology.orchestra.run.smithi085.stdout:ID="rhel" 2022-01-08T19:19:05.940 INFO:teuthology.orchestra.run.smithi085.stdout:ID_LIKE="fedora" 2022-01-08T19:19:05.940 INFO:teuthology.orchestra.run.smithi085.stdout:VERSION_ID="8.4" 2022-01-08T19:19:05.940 INFO:teuthology.orchestra.run.smithi085.stdout:PLATFORM_ID="platform:el8" 2022-01-08T19:19:05.941 INFO:teuthology.orchestra.run.smithi085.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2022-01-08T19:19:05.941 INFO:teuthology.orchestra.run.smithi085.stdout:ANSI_COLOR="0;31" 2022-01-08T19:19:05.941 INFO:teuthology.orchestra.run.smithi085.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2022-01-08T19:19:05.941 INFO:teuthology.orchestra.run.smithi085.stdout:HOME_URL="https://www.redhat.com/" 2022-01-08T19:19:05.941 INFO:teuthology.orchestra.run.smithi085.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-01-08T19:19:05.942 INFO:teuthology.orchestra.run.smithi085.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-01-08T19:19:05.942 INFO:teuthology.orchestra.run.smithi085.stdout: 2022-01-08T19:19:05.942 INFO:teuthology.orchestra.run.smithi085.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-01-08T19:19:05.943 INFO:teuthology.orchestra.run.smithi085.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2022-01-08T19:19:05.943 INFO:teuthology.orchestra.run.smithi085.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-01-08T19:19:05.943 INFO:teuthology.orchestra.run.smithi085.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2022-01-08T19:19:05.944 INFO:teuthology.lock.ops:Updating smithi085.front.sepia.ceph.com on lock server 2022-01-08T19:19:05.964 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: set os type and version on server 2022-01-08T19:19:05.965 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2022-01-08T19:19:06.198 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64 2022-01-08T19:19:06.254 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="Red Hat Enterprise Linux" 2022-01-08T19:19:06.254 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="8.4 (Ootpa)" 2022-01-08T19:19:06.254 INFO:teuthology.orchestra.run.smithi110.stdout:ID="rhel" 2022-01-08T19:19:06.255 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="fedora" 2022-01-08T19:19:06.255 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="8.4" 2022-01-08T19:19:06.255 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el8" 2022-01-08T19:19:06.255 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2022-01-08T19:19:06.256 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31" 2022-01-08T19:19:06.256 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2022-01-08T19:19:06.256 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://www.redhat.com/" 2022-01-08T19:19:06.256 INFO:teuthology.orchestra.run.smithi110.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-01-08T19:19:06.257 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-01-08T19:19:06.257 INFO:teuthology.orchestra.run.smithi110.stdout: 2022-01-08T19:19:06.257 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-01-08T19:19:06.257 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2022-01-08T19:19:06.258 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-01-08T19:19:06.258 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2022-01-08T19:19:06.258 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2022-01-08T19:19:06.353 INFO:teuthology.dispatcher.supervisor:Running job 6603161 2022-01-08T19:19:06.354 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_00e09f05e9fb2ab7c7f497f5e446613531743ae2/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-01-08_17:57:43-rados-wip-yuri8-testing-2022-01-07-1541-distro-default-smithi/6603161 --name yuriw-2022-01-08_17:57:43-rados-wip-yuri8-testing-2022-01-07-1541-distro-default-smithi --description rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} -- /home/teuthworker/archive/yuriw-2022-01-08_17:57:43-rados-wip-yuri8-testing-2022-01-07-1541-distro-default-smithi/6603161/orig.config.yaml 2022-01-08T19:19:06.357 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-01-08_17:57:43-rados-wip-yuri8-testing-2022-01-07-1541-distro-default-smithi/6603161 2022-01-08T19:19:06.358 INFO:teuthology.dispatcher.supervisor:Job PID: 25368 2022-01-08T19:19:06.358 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-01-09T07:19:26.847 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-01-09T07:19:27.011 INFO:teuthology.kill:Killing Pids: {25368} 2022-01-09T07:19:28.214 INFO:teuthology.task.internal:roles: ubuntu@smithi085.front.sepia.ceph.com - ['host.a', 'client.0'] 2022-01-09T07:19:28.277 INFO:teuthology.task.internal:roles: ubuntu@smithi110.front.sepia.ceph.com - ['host.b', 'client.1'] 2022-01-09T07:19:28.278 INFO:teuthology.misc:Compressing logs... 2022-01-09T07:19:28.278 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi085.front.sepia.ceph.com' 2022-01-09T07:19:28.475 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2022-01-09T07:19:28.502 INFO:teuthology.orchestra.run.smithi085.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-09T07:19:28.694 INFO:teuthology.orchestra.run.smithi110.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-09T07:19:28.737 INFO:teuthology.orchestra.run.smithi085.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-09T07:19:28.737 INFO:teuthology.orchestra.run.smithi085.stderr:tar: Error is not recoverable: exiting now 2022-01-09T07:19:28.772 INFO:teuthology.orchestra.run.smithi110.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-09T07:19:28.773 INFO:teuthology.orchestra.run.smithi110.stderr:tar: Error is not recoverable: exiting now 2022-01-09T07:19:28.774 INFO:teuthology.misc:Compressing logs... 2022-01-09T07:19:29.038 INFO:teuthology.misc:Compressing logs... 2022-01-09T07:19:39.652 INFO:teuthology.orchestra.run.smithi110.stderr:gzip: /var/log/ceph/4ee0333a-70b9-11ec-8c32-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2022-01-09T07:19:43.452 INFO:teuthology.orchestra.run.smithi085.stderr:gzip: /var/log/ceph/4ee0333a-70b9-11ec-8c32-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2022-01-09T07:19:46.345 INFO:teuthology.orchestra.run.smithi110.stderr:gzip: /var/log/ceph/4ee0333a-70b9-11ec-8c32-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2022-01-09T07:19:48.346 INFO:teuthology.orchestra.run.smithi110.stderr:gzip: /var/log/ceph/4ee0333a-70b9-11ec-8c32-001a4aab830c/ceph-mon.smithi110.log: file size changed while zipping 2022-01-09T07:19:53.189 INFO:teuthology.orchestra.run.smithi085.stderr:gzip: /var/log/ceph/4ee0333a-70b9-11ec-8c32-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2022-01-09T07:19:58.344 INFO:teuthology.orchestra.run.smithi110.stderr:gzip: /var/log/ceph/4ee0333a-70b9-11ec-8c32-001a4aab830c/ceph-osd.6.log: file size changed while zipping 2022-01-09T07:20:02.862 INFO:teuthology.orchestra.run.smithi085.stderr:gzip: /var/log/ceph/4ee0333a-70b9-11ec-8c32-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2022-01-09T07:20:08.720 INFO:teuthology.orchestra.run.smithi085.stderr:gzip: /var/log/ceph/4ee0333a-70b9-11ec-8c32-001a4aab830c/ceph-mon.smithi085.log: file size changed while zipping 2022-01-09T07:20:08.772 INFO:teuthology.orchestra.run.smithi110.stderr:gzip: /var/log/ceph/4ee0333a-70b9-11ec-8c32-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2022-01-09T07:20:23.025 INFO:teuthology.orchestra.run.smithi085.stderr:gzip: /var/log/ceph/4ee0333a-70b9-11ec-8c32-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2022-01-09T07:20:24.361 INFO:teuthology.orchestra.run.smithi085.stderr:gzip: /var/log/ceph/4ee0333a-70b9-11ec-8c32-001a4aab830c/ceph-mgr.smithi085.cqdulw.log: file size changed while zipping 2022-01-09T07:20:56.676 INFO:teuthology.orchestra.run.smithi085.stderr:tar: ./4ee0333a-70b9-11ec-8c32-001a4aab830c: file changed as we read it 2022-01-09T07:21:22.505 INFO:teuthology.kill:No teuthology processes running 2022-01-09T07:21:23.784 INFO:teuthology.kill:Nuking machines: ['smithi085', 'smithi110'] 2022-01-09T07:21:24.778 INFO:teuthology.kill:2022-01-09 07:21:24,778.778 INFO:teuthology.nuke:targets: 2022-01-09T07:21:24.779 INFO:teuthology.kill: smithi085.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDvc48KoznecxBQZpBfNmIjbLlHLqexMsh1k5Hsd733G9+KGKajGnxiWPLinJrC66bEMq/hBnVv5zCVTv57OP8N4hwNDOJiBwqI49TzuNkRzoiItrbKcQdpHyVYJ4NYtfAr739saucohjM8TpCYjbij+tkJA3jLhw/W39eWhr+KZ/xcix8BJBPBa4MeqdJqYk0Drp119nXNbCtX5tWd00V00il5yK1+HI+9knjwFBZrMfcOZAiY1Ri7vHqiXHrrPap+vqQr7uVGW6FmdWE/ZzTM8AO8Sm3pvhDJHciKe/MUJiae0avVq3iKDw0pyFNLuBP+mJG+wPBB9qFtlc1jq91tELTLpyz39ZWXeWSKAFvwg+m/FTKMTJMZLghMKpMkmC9pUNZkyxDWBfZAK3sWxF/M1BfbDtbSNgGb80UKsNXFbhRrSM4kT0yC5pu1j/SXbboIgDi/f2BtdXKzkj2zN5cDg6HG8+S+Ze8ICTPUkqrYsraSTH8sCDBylI//gX/gKIc= 2022-01-09T07:21:24.780 INFO:teuthology.kill: smithi110.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCStzU69He/RMj/CbbAexp6cI811RduEjyOCs4WHrlDJIROPy11qbko2pXMDrr/mrnA7xAmFxJAlrvKE00p+gfYKsMOuhl0YBp73rSRzhJgwRqaUL2zHiOAjr7WoIDy249aeOq+5S/FYqF7UEG+s+QCn1xSJELSzTyZI1qpXi7Ai+Uc4jzcUVOOiytqMHyisXpiYwpEDhOCbRozcqTjOaZ7RRbc4yI0J73DuRnME6QfAiWNs9nRRJqazhN/4n4EF1Z6+/XaZFFqbzdl512c0/e6Dsy53jvS7DU39iprp2sTWIbjhhzj63CvSj+3Q7N+GK5pDc2CN7FUdJ8+dMw2JVjmNYLFmbOqfaIOz9ElPdEp0UNAW4PKnhI/f4pHgft8WvyWXkJ+jg54BFw5YrPCwiIh8byVPSAL4e4SprmmUHYXy4TaYxxWtiA1gtddQgClBDcp8TdXJnfXaJBN+q6hZ9ireg3HYtEuUjprCs7J3vOSfOaKDipLyeolSUqgqgFOnX0= 2022-01-09T07:21:24.806 INFO:teuthology.kill:2022-01-09 07:21:24,805.805 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-09T07:21:24.809 INFO:teuthology.kill:2022-01-09 07:21:24,809.809 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-09T07:21:24.900 INFO:teuthology.kill:2022-01-09 07:21:24,899.899 INFO:teuthology.orchestra.console:Power off smithi110 2022-01-09T07:21:24.915 INFO:teuthology.kill:2022-01-09 07:21:24,915.915 INFO:teuthology.orchestra.console:Power off smithi085 2022-01-09T07:21:33.274 INFO:teuthology.kill:2022-01-09 07:21:33,274.274 INFO:teuthology.orchestra.console:Power off for smithi110 completed 2022-01-09T07:21:33.280 INFO:teuthology.kill:2022-01-09 07:21:33,280.280 INFO:teuthology.orchestra.console:Power off for smithi085 completed 2022-01-09T07:21:33.420 INFO:teuthology.kill:2022-01-09 07:21:33,419.419 INFO:teuthology.lock.ops:unlocked: smithi110.front.sepia.ceph.com 2022-01-09T07:21:33.423 INFO:teuthology.kill:2022-01-09 07:21:33,423.423 INFO:teuthology.lock.ops:unlocked: smithi085.front.sepia.ceph.com 2022-01-09T07:23:33.747 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-01-09T07:23:33.847 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi085 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-01-07_05:17:03-krbd-pacific-testing-default-smithi/6600798 2022-01-09T07:23:33.847 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi110 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-01-07_05:17:03-krbd-pacific-testing-default-smithi/6600798