2022-02-14T02:29:07.588 INFO:root:teuthology version: 1.1.0-7cebb3f2 2022-02-14T02:29:07.707 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi050.front.sepia.ceph.com' reimaging 2022-02-14T02:29:07.708 INFO:teuthology.lock.ops:Updating [ubuntu@smithi050.front.sepia.ceph.com]: reset os type and version on server 2022-02-14T02:29:07.709 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2022-02-14T02:29:07.727 INFO:teuthology.lock.ops:Node 'ubuntu@smithi050.front.sepia.ceph.com' reimaging is complete 2022-02-14T02:29:07.728 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi196.front.sepia.ceph.com' reimaging 2022-02-14T02:29:07.728 INFO:teuthology.lock.ops:Updating [ubuntu@smithi196.front.sepia.ceph.com]: reset os type and version on server 2022-02-14T02:29:07.729 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server 2022-02-14T02:29:07.753 INFO:teuthology.lock.ops:Node 'ubuntu@smithi196.front.sepia.ceph.com' reimaging is complete 2022-02-14T02:29:07.938 INFO:teuthology.provision.fog.smithi050:Scheduling deploy of rhel 8.4 2022-02-14T02:29:07.959 INFO:teuthology.provision.fog.smithi196:Scheduling deploy of rhel 8.4 2022-02-14T02:29:08.329 INFO:teuthology.orchestra.console:Power off smithi050 2022-02-14T02:29:08.346 INFO:teuthology.orchestra.console:Power off smithi196 2022-02-14T02:29:16.708 INFO:teuthology.orchestra.console:Power off for smithi050 completed 2022-02-14T02:29:16.713 INFO:teuthology.orchestra.console:Power off for smithi196 completed 2022-02-14T02:29:16.810 INFO:teuthology.orchestra.console:Power on smithi050 2022-02-14T02:29:16.817 INFO:teuthology.orchestra.console:Power on smithi196 2022-02-14T02:29:25.179 INFO:teuthology.orchestra.console:Power on for smithi050 completed 2022-02-14T02:29:25.183 INFO:teuthology.orchestra.console:Power on for smithi196 completed 2022-02-14T02:29:25.280 INFO:teuthology.provision.fog.smithi050:Waiting for deploy to finish 2022-02-14T02:29:25.284 INFO:teuthology.provision.fog.smithi196:Waiting for deploy to finish 2022-02-14T02:33:07.803 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-02-14T02:33:18.061 INFO:teuthology.provision.fog.smithi050:Node is ready 2022-02-14T02:33:18.117 INFO:teuthology.orchestra.run.smithi050.stdout:smithi204 2022-02-14T02:33:18.171 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.204 smithi204.front.sepia.ceph.com smithi204 2022-02-14T02:33:18.491 INFO:teuthology.provision.fog.smithi050:Deploy complete! 2022-02-14T02:33:57.316 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-02-14T02:33:57.549 INFO:teuthology.provision.fog.smithi196:Node is ready 2022-02-14T02:33:57.699 INFO:teuthology.orchestra.run.smithi196.stdout:smithi196.front.sepia.ceph.com 2022-02-14T02:33:57.755 INFO:teuthology.orchestra.run.smithi196.stdout:172.21.15.196 smithi196.front.sepia.ceph.com smithi196 2022-02-14T02:33:58.077 INFO:teuthology.provision.fog.smithi196:Deploy complete! 2022-02-14T02:33:58.231 INFO:teuthology.lock.ops:Checking smithi050.front.sepia.ceph.com 2022-02-14T02:33:58.231 INFO:teuthology.lock.ops:New key found. Updating... 2022-02-14T02:33:58.252 INFO:teuthology.lock.ops:Checking smithi196.front.sepia.ceph.com 2022-02-14T02:33:58.252 INFO:teuthology.lock.ops:New key found. Updating... 2022-02-14T02:33:58.270 INFO:teuthology.lock.ops:Updating [smithi050.front.sepia.ceph.com]: set os type and version on server 2022-02-14T02:33:58.270 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2022-02-14T02:33:58.511 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64 2022-02-14T02:33:58.566 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="Red Hat Enterprise Linux" 2022-02-14T02:33:58.567 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="8.4 (Ootpa)" 2022-02-14T02:33:58.567 INFO:teuthology.orchestra.run.smithi050.stdout:ID="rhel" 2022-02-14T02:33:58.567 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="fedora" 2022-02-14T02:33:58.567 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="8.4" 2022-02-14T02:33:58.568 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el8" 2022-02-14T02:33:58.568 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2022-02-14T02:33:58.568 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31" 2022-02-14T02:33:58.568 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2022-02-14T02:33:58.569 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://www.redhat.com/" 2022-02-14T02:33:58.569 INFO:teuthology.orchestra.run.smithi050.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-02-14T02:33:58.569 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-02-14T02:33:58.569 INFO:teuthology.orchestra.run.smithi050.stdout: 2022-02-14T02:33:58.570 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-02-14T02:33:58.570 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2022-02-14T02:33:58.570 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-02-14T02:33:58.570 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2022-02-14T02:33:58.572 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2022-02-14T02:33:58.593 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: set os type and version on server 2022-02-14T02:33:58.594 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2022-02-14T02:33:58.814 INFO:teuthology.orchestra.run.smithi196.stdout:x86_64 2022-02-14T02:33:58.867 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="Red Hat Enterprise Linux" 2022-02-14T02:33:58.868 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="8.4 (Ootpa)" 2022-02-14T02:33:58.868 INFO:teuthology.orchestra.run.smithi196.stdout:ID="rhel" 2022-02-14T02:33:58.868 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="fedora" 2022-02-14T02:33:58.868 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="8.4" 2022-02-14T02:33:58.869 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el8" 2022-02-14T02:33:58.869 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2022-02-14T02:33:58.869 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31" 2022-02-14T02:33:58.869 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2022-02-14T02:33:58.870 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://www.redhat.com/" 2022-02-14T02:33:58.870 INFO:teuthology.orchestra.run.smithi196.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-02-14T02:33:58.870 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-02-14T02:33:58.870 INFO:teuthology.orchestra.run.smithi196.stdout: 2022-02-14T02:33:58.871 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-02-14T02:33:58.871 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2022-02-14T02:33:58.871 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-02-14T02:33:58.871 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2022-02-14T02:33:58.872 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server 2022-02-14T02:33:58.959 INFO:teuthology.dispatcher.supervisor:Running job 6681142 2022-02-14T02:33:58.959 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_7cebb3f2319fd6c8340c0f7cd15a137e747fd32e/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2022-02-14_02:01:03-rbd-master-distro-default-smithi/6681142 --name teuthology-2022-02-14_02:01:03-rbd-master-distro-default-smithi --description rbd/persistent-writeback-cache/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{rhel_8} 4-pool/big-cache 5-cache-mode/rwl 6-workloads/qemu_xfstests} -- /home/teuthworker/archive/teuthology-2022-02-14_02:01:03-rbd-master-distro-default-smithi/6681142/orig.config.yaml 2022-02-14T02:33:58.963 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2022-02-14_02:01:03-rbd-master-distro-default-smithi/6681142 2022-02-14T02:33:58.963 INFO:teuthology.dispatcher.supervisor:Job PID: 10090 2022-02-14T02:33:58.964 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-02-14T09:04:26.910 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-02-14T09:04:27.072 INFO:teuthology.kill:Killing Pids: {10090} 2022-02-14T09:04:28.488 INFO:teuthology.task.internal:roles: ubuntu@smithi050.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1'] 2022-02-14T09:04:28.489 INFO:teuthology.task.internal:roles: ubuntu@smithi196.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'osd.2', 'osd.3', 'client.0'] 2022-02-14T09:04:28.490 INFO:teuthology.misc:Compressing logs... 2022-02-14T09:04:28.490 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2022-02-14T09:04:28.738 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2022-02-14T09:04:29.254 INFO:teuthology.misc:Compressing logs... 2022-02-14T09:04:29.370 INFO:teuthology.orchestra.run.smithi196.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-02-14T09:04:29.469 INFO:teuthology.misc:Compressing logs... 2022-02-14T09:06:24.561 INFO:teuthology.kill:No teuthology processes running 2022-02-14T09:06:25.683 INFO:teuthology.kill:Nuking machines: ['smithi050', 'smithi196'] 2022-02-14T09:06:26.684 INFO:teuthology.kill:2022-02-14 09:06:26,684.684 INFO:teuthology.nuke:targets: 2022-02-14T09:06:26.685 INFO:teuthology.kill: smithi050.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC2AFWR4Cz+VChPnIWDzyXUwwPXbiWge7lcaug3ft5vWbD3Itr4O62RI6bToK5/9Uz9bi/QDtiD4mShoRkTAyDmZOV0IoFBRJi8PVC2LxvH+IfxnCHJ/uaypb8l1X+uiz5CfrBsWqLxqKGkGsDU75wzxtgq25tBeS/gXtaaSG1kNXnymPyDFmFdFM+Ly3ySBf+d/FkRIClyySn1P6vLtEHc9bwW7fst/fY+qXPZKaRO5GvKv11HGZxy3LzbfEcWyo7IQEV7OI9PtrxqpFC3Lyo2oDRlAaxvZUpvr8a6dR4GWo7TTwVVhxfrSbI22Ncj+uCLs05G2BJVFcieApcXMZKl85lEYPfOHf1IH/axaW+y+6WMFNJfTLjS4oK8FRT1Wx4Lgx9YYMyP2E2W2b58cZQioAcDux6oB/80HUGvk4dO4t4iHuGp4dxRxvgtDDLO26F7ehc52AQ/Fz07gro41OcRlHFSi63hfq63ouVqjqYQNiJirrRjWJMSFQr3Hdape6M= 2022-02-14T09:06:26.685 INFO:teuthology.kill: smithi196.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCZftoCgaFgLsfAPUtdFZ7d7wXsDkcoXn9HhgNxegUU052mJ/ClkMEcCM+/WM6HWruA52KZ32xMbSatm0qpkCSr06CnsID+QFZ3RbOovCg1Lk731zV3WV3QwFkI85I1bsPy+DVaMgE7ORZqDPH15tmIe+BPaIzMkKK7Q3kHCTg9WcRK7tBEgzIwt1KvhCC+bbDIr8wYdPVguJjfDa17g8KDIKzwrE60t0yR5NvdLUljMekaBgbuOqg1mJ46HwSzGEYFdTZ/fgBA05s5hTYJ3ZuWJXtttzzrta9mpcSfRB2kC6/NWDzBZDp1ibEAY8IT1z4fGpomJQcFsLzp9UxXsI5BPSxpHfDwyXWy9nQtnc5BekEoINSGw67b3iaM6fvQTCvrPpFPnsrUs3GHi7vKq/8QthpzcYQ1+LT7KbKCGTqConbYAm1ZLiEN8ilod36bUTCOrC1546C7ZUQxSVz5q3D3gsRK/43qJgo6iSFy/7ud0HiwUfxeqOs5tXkPJwUkX0k= 2022-02-14T09:06:26.713 INFO:teuthology.kill:2022-02-14 09:06:26,713.713 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-02-14T09:06:26.716 INFO:teuthology.kill:2022-02-14 09:06:26,716.716 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-02-14T09:06:26.788 INFO:teuthology.kill:2022-02-14 09:06:26,788.788 INFO:teuthology.orchestra.console:Power off smithi050 2022-02-14T09:06:26.803 INFO:teuthology.kill:2022-02-14 09:06:26,803.803 INFO:teuthology.orchestra.console:Power off smithi196 2022-02-14T09:06:35.157 INFO:teuthology.kill:2022-02-14 09:06:35,157.157 INFO:teuthology.orchestra.console:Power off for smithi050 completed 2022-02-14T09:06:35.312 INFO:teuthology.kill:2022-02-14 09:06:35,311.311 INFO:teuthology.lock.ops:unlocked: smithi050.front.sepia.ceph.com 2022-02-14T09:06:39.278 INFO:teuthology.kill:2022-02-14 09:06:39,277.277 INFO:teuthology.orchestra.console:Power off for smithi196 completed 2022-02-14T09:06:39.424 INFO:teuthology.kill:2022-02-14 09:06:39,423.423 INFO:teuthology.lock.ops:unlocked: smithi196.front.sepia.ceph.com 2022-02-14T09:08:39.728 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-02-14T09:08:39.808 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi050 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-02-14_06:07:02-rbd-pacific-distro-default-smithi/6681591