2021-03-22T19:12:31.898 INFO:root:teuthology version: 1.1.0-6b3150e9
2021-03-22T19:12:32.007 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi031.front.sepia.ceph.com' reimaging
2021-03-22T19:12:32.008 INFO:teuthology.lock.ops:Updating [ubuntu@smithi031.front.sepia.ceph.com]: reset os type and version on server
2021-03-22T19:12:32.009 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server
2021-03-22T19:12:32.025 INFO:teuthology.lock.ops:Node 'ubuntu@smithi031.front.sepia.ceph.com' reimaging is complete
2021-03-22T19:12:32.025 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi105.front.sepia.ceph.com' reimaging
2021-03-22T19:12:32.025 INFO:teuthology.lock.ops:Updating [ubuntu@smithi105.front.sepia.ceph.com]: reset os type and version on server
2021-03-22T19:12:32.026 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server
2021-03-22T19:12:32.042 INFO:teuthology.lock.ops:Node 'ubuntu@smithi105.front.sepia.ceph.com' reimaging is complete
2021-03-22T19:12:32.225 INFO:teuthology.provision.fog.smithi031:Scheduling deploy of rhel 8.3
2021-03-22T19:12:32.243 INFO:teuthology.provision.fog.smithi105:Scheduling deploy of rhel 8.3
2021-03-22T19:12:32.530 INFO:teuthology.orchestra.console:Power off smithi031
2021-03-22T19:12:32.559 INFO:teuthology.orchestra.console:Power off smithi105
2021-03-22T19:12:40.923 INFO:teuthology.orchestra.console:Power off for smithi031 completed
2021-03-22T19:12:40.930 INFO:teuthology.orchestra.console:Power off for smithi105 completed
2021-03-22T19:12:41.024 INFO:teuthology.orchestra.console:Power on smithi031
2021-03-22T19:12:41.033 INFO:teuthology.orchestra.console:Power on smithi105
2021-03-22T19:12:49.394 INFO:teuthology.orchestra.console:Power on for smithi031 completed
2021-03-22T19:12:49.400 INFO:teuthology.orchestra.console:Power on for smithi105 completed
2021-03-22T19:12:49.496 INFO:teuthology.provision.fog.smithi031:Waiting for deploy to finish
2021-03-22T19:12:49.501 INFO:teuthology.provision.fog.smithi105:Waiting for deploy to finish
2021-03-22T19:16:57.183 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-03-22T19:16:57.519 INFO:teuthology.provision.fog.smithi031:Node is ready
2021-03-22T19:16:57.535 INFO:teuthology.orchestra.run.smithi031.stdout:smithi031.front.sepia.ceph.com
2021-03-22T19:16:57.591 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31 smithi031.front.sepia.ceph.com smithi031
2021-03-22T19:16:57.951 INFO:teuthology.provision.fog.smithi031:Deploy complete!
2021-03-22T19:17:21.297 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-03-22T19:17:21.609 INFO:teuthology.provision.fog.smithi105:Node is ready
2021-03-22T19:17:21.624 INFO:teuthology.orchestra.run.smithi105.stdout:smithi105.front.sepia.ceph.com
2021-03-22T19:17:21.679 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.15.105 smithi105.front.sepia.ceph.com smithi105
2021-03-22T19:17:22.002 INFO:teuthology.provision.fog.smithi105:Deploy complete!
2021-03-22T19:17:22.133 INFO:teuthology.lock.ops:Checking smithi031.front.sepia.ceph.com
2021-03-22T19:17:22.134 INFO:teuthology.lock.ops:New key found. Updating...
2021-03-22T19:17:22.151 INFO:teuthology.lock.ops:Checking smithi105.front.sepia.ceph.com
2021-03-22T19:17:22.152 INFO:teuthology.lock.ops:New key found. Updating...
2021-03-22T19:17:22.166 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: set os type and version on server
2021-03-22T19:17:22.166 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-03-22T19:17:22.460 INFO:teuthology.orchestra.run.smithi031.stdout:x86_64
2021-03-22T19:17:22.515 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="Red Hat Enterprise Linux"
2021-03-22T19:17:22.515 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="8.3 (Ootpa)"
2021-03-22T19:17:22.515 INFO:teuthology.orchestra.run.smithi031.stdout:ID="rhel"
2021-03-22T19:17:22.516 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="fedora"
2021-03-22T19:17:22.516 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="8.3"
2021-03-22T19:17:22.516 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el8"
2021-03-22T19:17:22.516 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)"
2021-03-22T19:17:22.516 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31"
2021-03-22T19:17:22.517 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA"
2021-03-22T19:17:22.517 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://www.redhat.com/"
2021-03-22T19:17:22.517 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-03-22T19:17:22.517 INFO:teuthology.orchestra.run.smithi031.stdout:
2021-03-22T19:17:22.517 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2021-03-22T19:17:22.518 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3
2021-03-22T19:17:22.518 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2021-03-22T19:17:22.518 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3"
2021-03-22T19:17:22.519 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server
2021-03-22T19:17:22.535 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: set os type and version on server
2021-03-22T19:17:22.535 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-03-22T19:17:22.813 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64
2021-03-22T19:17:22.867 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="Red Hat Enterprise Linux"
2021-03-22T19:17:22.868 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="8.3 (Ootpa)"
2021-03-22T19:17:22.868 INFO:teuthology.orchestra.run.smithi105.stdout:ID="rhel"
2021-03-22T19:17:22.868 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="fedora"
2021-03-22T19:17:22.869 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="8.3"
2021-03-22T19:17:22.869 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el8"
2021-03-22T19:17:22.869 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)"
2021-03-22T19:17:22.869 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31"
2021-03-22T19:17:22.869 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA"
2021-03-22T19:17:22.870 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://www.redhat.com/"
2021-03-22T19:17:22.870 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-03-22T19:17:22.870 INFO:teuthology.orchestra.run.smithi105.stdout:
2021-03-22T19:17:22.870 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2021-03-22T19:17:22.870 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3
2021-03-22T19:17:22.871 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2021-03-22T19:17:22.871 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3"
2021-03-22T19:17:22.871 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server
2021-03-22T19:17:22.943 INFO:teuthology.dispatcher.supervisor:Running job 5988923
2021-03-22T19:17:22.943 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/virtualenv/bin/teuthology -v --owner scheduled_jdillaman@cube-1 --archive /home/teuthworker/archive/jdillaman-2021-03-22_15:06:38-rbd-wip-jd-testing-distro-basic-smithi/5988923 --name jdillaman-2021-03-22_15:06:38-rbd-wip-jd-testing-distro-basic-smithi --description rbd/persistent-writeback-cache/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{rhel_8} 4-pool/cache 5-cache-mode/ssd 6-workloads/qemu_xfstests} -- /home/teuthworker/archive/jdillaman-2021-03-22_15:06:38-rbd-wip-jd-testing-distro-basic-smithi/5988923/orig.config.yaml
2021-03-22T19:17:22.946 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/jdillaman-2021-03-22_15:06:38-rbd-wip-jd-testing-distro-basic-smithi/5988923
2021-03-22T19:17:22.947 INFO:teuthology.dispatcher.supervisor:Job PID: 25969
2021-03-22T19:17:22.947 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-03-23T07:18:13.304 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-03-23T07:18:13.450 INFO:teuthology.kill:Killing Pids: {25969}
2021-03-23T07:18:14.569 INFO:teuthology.kill:Nuking machines: ['smithi031', 'smithi105']
2021-03-23T07:18:15.472 INFO:teuthology.kill:2021-03-23 07:18:15,472.472 INFO:teuthology.nuke:targets:
2021-03-23T07:18:15.473 INFO:teuthology.kill:  smithi031.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC55Uk+qxAUi81Y4BSyy1G3no2xcjeyzxnZuZWdkagrd0L8d3UlqJxGLLWLmVrcQRAu8ufZuPyJmluqeMt9XpKN/1dnaiDTMzidGlMSqzeb9KoE67ky70evl62ntLMS5I/YNojy4uSnHyMERbP/A/lpW76AfsSPRrn6uX/5hGX9u+Vqu5wDqlpdMqKRISEc1KMhzofaIvNRLtKnwi1f+R6AkWqz0IbKeOxSM6QWlVB0deCEoQZs69n8tVOKgHGzUfr3+dNi6egwebc039h7Xoee3vmnGk6+VBO5dlKGxleWcbsBZPOlk11AdkXxRwMR8Js3XwovFZ1TGXy5WuxFfh4gyYdTq24aSqR2S4rWmxUqtKpekwSLApkv+xH5lGEmbDEkVPTOIg9f5jYjp9vKtPwZzqxU6ZQWrnyd6PrGIvl27KbW8dToSFEwrRSPcfd4D3HiE+iV/5pxpNIHQfGy2r+5PUFiCHEQabGQJp2shPxGQ24d/gqY5iaoT8EfpB4Ky2k=
2021-03-23T07:18:15.473 INFO:teuthology.kill:  smithi105.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5wGvylAApNr37oADx0Q4y5j9S0X9XhKg+dAq7DVTEsYK8qfomJnYwKe80PE7MIdY8ylR11+bGVoqZKP8DSCqvPVchHTZuoH6nLbE34Eb0e4GlUQOgbYlQ4ZzD72Dbq3Cyma0fSByUTW3eb902bjDF4hvxMVMcJWCP6cB3ezPL7btMrjrid9VHUKnj+4Bt64O/DCjhXz3QQ95Cr1t8I51xvPQKjbA1MJXCc+tJGeZQR8yvz5mZf/7AutV1E7P9uHV/ZEZL7qRGZgcLwt2dmOpVTM4cJXN2N78HJuoBYQtHugFr5X8l/hofKD66PKmFT7Qc0cW7R4xlWMoiMgwcxRsnL8R1ezZpEd5naWM0RQ5XDzbbaTv+b44JfcYRZi35Le+ZNIvulymuN3J06YTKfirV3XgLZj9qfc7ef1NADZB33D64NDEJ00s8kRt7ATuV/WxMygLqRZscYH2LmCrTIbPqJa+6knfsSvk9S/ytB1E3YyjakJEYzydXe9j0ID9KtF0=
2021-03-23T07:18:15.474 INFO:teuthology.kill:2021-03-23 07:18:15,472.472 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-23T07:18:15.475 INFO:teuthology.kill:2021-03-23 07:18:15,475.475 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-23T07:18:15.536 INFO:teuthology.kill:2021-03-23 07:18:15,536.536 INFO:teuthology.orchestra.console:Power off smithi031
2021-03-23T07:18:15.549 INFO:teuthology.kill:2021-03-23 07:18:15,549.549 INFO:teuthology.orchestra.console:Power off smithi105
2021-03-23T07:18:23.911 INFO:teuthology.kill:2021-03-23 07:18:23,910.910 INFO:teuthology.orchestra.console:Power off for smithi105 completed
2021-03-23T07:18:28.018 INFO:teuthology.kill:2021-03-23 07:18:28,018.018 INFO:teuthology.orchestra.console:Power off for smithi031 completed
2021-03-23T07:18:28.230 INFO:teuthology.task.internal:roles: ubuntu@smithi031.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1']
2021-03-23T07:18:28.231 INFO:teuthology.task.internal:roles: ubuntu@smithi105.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'osd.2', 'osd.3', 'client.0']
2021-03-23T07:18:28.231 INFO:teuthology.misc:Compressing logs...
2021-03-23T07:18:28.232 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-03-23T07:19:28.296 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/misc.py", line 1374, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/orchestra/cluster.py", line 64, in <listcomp>
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/orchestra/remote.py", line 215, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/orchestra/run.py", line 434, in run
    transport = client.get_transport()
AttributeError: 'NoneType' object has no attribute 'get_transport'
2021-03-23T07:19:28.341 INFO:teuthology.kill:No teuthology processes running
2021-03-23T07:19:29.410 INFO:teuthology.kill:Nuking machines: ['smithi031', 'smithi105']
2021-03-23T07:19:30.343 INFO:teuthology.kill:2021-03-23 07:19:30,343.343 INFO:teuthology.nuke:targets:
2021-03-23T07:19:30.344 INFO:teuthology.kill:  smithi031.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC55Uk+qxAUi81Y4BSyy1G3no2xcjeyzxnZuZWdkagrd0L8d3UlqJxGLLWLmVrcQRAu8ufZuPyJmluqeMt9XpKN/1dnaiDTMzidGlMSqzeb9KoE67ky70evl62ntLMS5I/YNojy4uSnHyMERbP/A/lpW76AfsSPRrn6uX/5hGX9u+Vqu5wDqlpdMqKRISEc1KMhzofaIvNRLtKnwi1f+R6AkWqz0IbKeOxSM6QWlVB0deCEoQZs69n8tVOKgHGzUfr3+dNi6egwebc039h7Xoee3vmnGk6+VBO5dlKGxleWcbsBZPOlk11AdkXxRwMR8Js3XwovFZ1TGXy5WuxFfh4gyYdTq24aSqR2S4rWmxUqtKpekwSLApkv+xH5lGEmbDEkVPTOIg9f5jYjp9vKtPwZzqxU6ZQWrnyd6PrGIvl27KbW8dToSFEwrRSPcfd4D3HiE+iV/5pxpNIHQfGy2r+5PUFiCHEQabGQJp2shPxGQ24d/gqY5iaoT8EfpB4Ky2k=
2021-03-23T07:19:30.344 INFO:teuthology.kill:  smithi105.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5wGvylAApNr37oADx0Q4y5j9S0X9XhKg+dAq7DVTEsYK8qfomJnYwKe80PE7MIdY8ylR11+bGVoqZKP8DSCqvPVchHTZuoH6nLbE34Eb0e4GlUQOgbYlQ4ZzD72Dbq3Cyma0fSByUTW3eb902bjDF4hvxMVMcJWCP6cB3ezPL7btMrjrid9VHUKnj+4Bt64O/DCjhXz3QQ95Cr1t8I51xvPQKjbA1MJXCc+tJGeZQR8yvz5mZf/7AutV1E7P9uHV/ZEZL7qRGZgcLwt2dmOpVTM4cJXN2N78HJuoBYQtHugFr5X8l/hofKD66PKmFT7Qc0cW7R4xlWMoiMgwcxRsnL8R1ezZpEd5naWM0RQ5XDzbbaTv+b44JfcYRZi35Le+ZNIvulymuN3J06YTKfirV3XgLZj9qfc7ef1NADZB33D64NDEJ00s8kRt7ATuV/WxMygLqRZscYH2LmCrTIbPqJa+6knfsSvk9S/ytB1E3YyjakJEYzydXe9j0ID9KtF0=
2021-03-23T07:19:30.365 INFO:teuthology.kill:2021-03-23 07:19:30,365.365 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-23T07:19:30.368 INFO:teuthology.kill:2021-03-23 07:19:30,368.368 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-23T07:19:30.425 INFO:teuthology.kill:2021-03-23 07:19:30,425.425 INFO:teuthology.orchestra.console:Power off smithi031
2021-03-23T07:19:30.439 INFO:teuthology.kill:2021-03-23 07:19:30,439.439 INFO:teuthology.orchestra.console:Power off smithi105
2021-03-23T07:19:30.569 INFO:teuthology.kill:2021-03-23 07:19:30,569.569 INFO:teuthology.orchestra.console:Power off for smithi031 completed
2021-03-23T07:19:30.580 INFO:teuthology.kill:2021-03-23 07:19:30,580.580 INFO:teuthology.orchestra.console:Power off for smithi105 completed
2021-03-23T07:19:30.712 INFO:teuthology.kill:2021-03-23 07:19:30,711.711 INFO:teuthology.lock.ops:unlocked smithi031.front.sepia.ceph.com
2021-03-23T07:19:30.719 INFO:teuthology.kill:2021-03-23 07:19:30,719.719 INFO:teuthology.lock.ops:unlocked smithi105.front.sepia.ceph.com
2021-03-23T07:21:31.021 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-03-23T07:21:31.090 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2021-03-23T07:21:31.091 INFO:teuthology.nuke:Checking targets against current locks
2021-03-23T07:21:31.192 INFO:teuthology.nuke:Not nuking smithi105.front.sepia.ceph.com because description doesn't match
2021-03-23T07:21:31.192 INFO:teuthology.nuke:Not nuking smithi031.front.sepia.ceph.com because description doesn't match