2021-08-30T08:51:19.769 INFO:root:teuthology version: 1.1.0-df69d6db
2021-08-30T08:51:19.879 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi033.front.sepia.ceph.com' reimaging
2021-08-30T08:51:19.882 INFO:teuthology.lock.ops:Updating [ubuntu@smithi033.front.sepia.ceph.com]: reset os type and version on server
2021-08-30T08:51:19.882 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server
2021-08-30T08:51:19.904 INFO:teuthology.lock.ops:Node 'ubuntu@smithi033.front.sepia.ceph.com' reimaging is complete
2021-08-30T08:51:19.905 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi087.front.sepia.ceph.com' reimaging
2021-08-30T08:51:19.905 INFO:teuthology.lock.ops:Updating [ubuntu@smithi087.front.sepia.ceph.com]: reset os type and version on server
2021-08-30T08:51:19.906 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server
2021-08-30T08:51:19.924 INFO:teuthology.lock.ops:Node 'ubuntu@smithi087.front.sepia.ceph.com' reimaging is complete
2021-08-30T08:51:20.127 INFO:teuthology.provision.fog.smithi087:Scheduling deploy of rhel 8.4
2021-08-30T08:51:20.131 INFO:teuthology.provision.fog.smithi033:Scheduling deploy of rhel 8.4
2021-08-30T08:51:20.566 INFO:teuthology.orchestra.console:Power off smithi033
2021-08-30T08:51:20.991 INFO:teuthology.orchestra.console:Power off smithi087
2021-08-30T08:51:28.945 INFO:teuthology.orchestra.console:Power off for smithi033 completed
2021-08-30T08:51:29.047 INFO:teuthology.orchestra.console:Power on smithi033
2021-08-30T08:51:33.473 INFO:teuthology.orchestra.console:Power off for smithi087 completed
2021-08-30T08:51:33.575 INFO:teuthology.orchestra.console:Power on smithi087
2021-08-30T08:51:37.419 INFO:teuthology.orchestra.console:Power on for smithi033 completed
2021-08-30T08:51:37.521 INFO:teuthology.provision.fog.smithi033:Waiting for deploy to finish
2021-08-30T08:51:41.940 INFO:teuthology.orchestra.console:Power on for smithi087 completed
2021-08-30T08:51:42.041 INFO:teuthology.provision.fog.smithi087:Waiting for deploy to finish
2021-08-30T08:55:45.345 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-08-30T08:55:45.578 INFO:teuthology.provision.fog.smithi033:Node is ready
2021-08-30T08:55:45.594 INFO:teuthology.orchestra.run.smithi033.stdout:smithi033.front.sepia.ceph.com
2021-08-30T08:55:45.650 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33 smithi033.front.sepia.ceph.com smithi033
2021-08-30T08:55:45.985 INFO:teuthology.provision.fog.smithi033:Deploy complete!
2021-08-30T08:56:23.167 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-08-30T08:56:23.419 INFO:teuthology.provision.fog.smithi087:Node is ready
2021-08-30T08:56:23.436 INFO:teuthology.orchestra.run.smithi087.stdout:smithi087.front.sepia.ceph.com
2021-08-30T08:56:23.491 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87 smithi087.front.sepia.ceph.com smithi087
2021-08-30T08:56:23.820 INFO:teuthology.provision.fog.smithi087:Deploy complete!
2021-08-30T08:56:23.965 INFO:teuthology.lock.ops:Checking smithi033.front.sepia.ceph.com
2021-08-30T08:56:23.966 INFO:teuthology.lock.ops:New key found. Updating...
2021-08-30T08:56:23.984 INFO:teuthology.lock.ops:Checking smithi087.front.sepia.ceph.com
2021-08-30T08:56:23.984 INFO:teuthology.lock.ops:New key found. Updating...
2021-08-30T08:56:23.999 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: set os type and version on server
2021-08-30T08:56:24.000 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-08-30T08:56:24.244 INFO:teuthology.orchestra.run.smithi033.stdout:x86_64
2021-08-30T08:56:24.301 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="Red Hat Enterprise Linux"
2021-08-30T08:56:24.301 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="8.4 (Ootpa)"
2021-08-30T08:56:24.301 INFO:teuthology.orchestra.run.smithi033.stdout:ID="rhel"
2021-08-30T08:56:24.302 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="fedora"
2021-08-30T08:56:24.302 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="8.4"
2021-08-30T08:56:24.302 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el8"
2021-08-30T08:56:24.302 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2021-08-30T08:56:24.303 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31"
2021-08-30T08:56:24.303 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2021-08-30T08:56:24.303 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://www.redhat.com/"
2021-08-30T08:56:24.303 INFO:teuthology.orchestra.run.smithi033.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2021-08-30T08:56:24.304 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-08-30T08:56:24.304 INFO:teuthology.orchestra.run.smithi033.stdout:
2021-08-30T08:56:24.304 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2021-08-30T08:56:24.304 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2021-08-30T08:56:24.304 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2021-08-30T08:56:24.305 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2021-08-30T08:56:24.306 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server
2021-08-30T08:56:24.321 INFO:teuthology.lock.ops:Updating [smithi087.front.sepia.ceph.com]: set os type and version on server
2021-08-30T08:56:24.322 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-08-30T08:56:24.546 INFO:teuthology.orchestra.run.smithi087.stdout:x86_64
2021-08-30T08:56:24.599 INFO:teuthology.orchestra.run.smithi087.stdout:NAME="Red Hat Enterprise Linux"
2021-08-30T08:56:24.600 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION="8.4 (Ootpa)"
2021-08-30T08:56:24.600 INFO:teuthology.orchestra.run.smithi087.stdout:ID="rhel"
2021-08-30T08:56:24.600 INFO:teuthology.orchestra.run.smithi087.stdout:ID_LIKE="fedora"
2021-08-30T08:56:24.600 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_ID="8.4"
2021-08-30T08:56:24.601 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM_ID="platform:el8"
2021-08-30T08:56:24.601 INFO:teuthology.orchestra.run.smithi087.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2021-08-30T08:56:24.601 INFO:teuthology.orchestra.run.smithi087.stdout:ANSI_COLOR="0;31"
2021-08-30T08:56:24.601 INFO:teuthology.orchestra.run.smithi087.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2021-08-30T08:56:24.602 INFO:teuthology.orchestra.run.smithi087.stdout:HOME_URL="https://www.redhat.com/"
2021-08-30T08:56:24.602 INFO:teuthology.orchestra.run.smithi087.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2021-08-30T08:56:24.602 INFO:teuthology.orchestra.run.smithi087.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-08-30T08:56:24.602 INFO:teuthology.orchestra.run.smithi087.stdout:
2021-08-30T08:56:24.602 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2021-08-30T08:56:24.603 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2021-08-30T08:56:24.603 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2021-08-30T08:56:24.603 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2021-08-30T08:56:24.604 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server
2021-08-30T08:56:24.680 INFO:teuthology.dispatcher.supervisor:Running job 6366468
2021-08-30T08:56:24.680 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_df69d6db9d68f5492f47c1dee57bca3b0a385796/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2021-08-30_06:07:02-rbd-pacific-distro-basic-smithi/6366468 --name teuthology-2021-08-30_06:07:02-rbd-pacific-distro-basic-smithi --description rbd/persistent-writeback-cache/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{rhel_8} 4-pool/cache 5-cache-mode/rwl 6-workloads/qemu_xfstests} -- /home/teuthworker/archive/teuthology-2021-08-30_06:07:02-rbd-pacific-distro-basic-smithi/6366468/orig.config.yaml
2021-08-30T08:56:24.684 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2021-08-30_06:07:02-rbd-pacific-distro-basic-smithi/6366468
2021-08-30T08:56:24.684 INFO:teuthology.dispatcher.supervisor:Job PID: 21624
2021-08-30T08:56:24.685 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-08-30T20:57:17.003 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-08-30T20:57:17.180 INFO:teuthology.kill:Killing Pids: {21624}
2021-08-30T20:57:18.283 INFO:teuthology.kill:Nuking machines: ['smithi033', 'smithi087']
2021-08-30T20:57:19.228 INFO:teuthology.kill:2021-08-30 20:57:19,228.228 INFO:teuthology.nuke:targets:
2021-08-30T20:57:19.229 INFO:teuthology.kill:  smithi033.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFB5QJvFNwdtoSMhvKknnjcJTCNtmfQaFaJwPbDv4jHP8rvhT08VFqvIII9zfscWhe8EMG09l+rHiEEGGCTarZ6zu9TfpnahuOaO/NZpFFPHHMrdCnLYPFk8yHcVqkS4NIB86kY4kd/rpaOYPFWj1esgaf/SNEbZX8Ciht5oRB1xFEmSRjG2BLQnA/aKZwNvmE+Cx+LTBWDkgHEFZRaItHRMS/ZefpunDlZcZSfW1ZR3kubrARAAOArthDvyn181GkBG33VCDA17VqrWDejj0t4z3LkNPSAQX9noVnR5dLFD2T9xHKNcR/pW7cdgvcx4ELZBnbjpECoMRfYWQEqWk3VlfP9jqu14fpJoVKgk08fAoJz+++I0GXzZs2M67sqA+uki7XK9i9y3YnZOIK34rBOXHyzAv8KhdO4GPXwPCVPmHElbIWO1lPzoScmv8XZ/jdMLbj0OeAs+WJYuNg/yVlTKRAwkOO9hwkvW0NwpK/ncmv/EPJIT7Hoz3x9VpO1Ic=
2021-08-30T20:57:19.230 INFO:teuthology.kill:  smithi087.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDB0HbM53iiQQgyv/jR4tU1GMZ5f3Df4Ujv/pexuxuD1/IUf+mIezzCcvOmmHdYC1WJS5HaZ5txh5nd8E6+Wuw26Nalvb7xKjQy0ZSHbeGT2safw4V9V4Z0mPpCOJbHMA9wAjtLYNwk+YxLOpWZj3IwVQmlgyaGiK4JhAGNf8uoL9S8waFBtChGJtwvB7AJ3d/RARxuft9uw+EP4NgDNxnV+4DeFEcHjqjqL2s1HdC7GEl5Od58gmkCpRXXzVLHw5rpvapqTaiMS664EYSiNiYvDT40lKn/85+ADV7PENdpdpDbcTy2a+0okeRmym53B2XBQkTgBtllFA1MauIO3QcORH+fEesOKrU9bmtK/enSx8Vr5IxcjmLA0RpiAjB+nyE5G6Q/ZaYlzOojj6rYE+mb018S76sXPaIcprqlP0oK9bIAgzWUnEflNCSFYT9ycB6eDsa1wW5TtG0deuplkbKZtYlSnirsudpwXVlYOittGwSMwgFp7BddOrTFmPNMQBc=
2021-08-30T20:57:19.230 INFO:teuthology.kill:2021-08-30 20:57:19,228.228 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-08-30T20:57:19.231 INFO:teuthology.kill:2021-08-30 20:57:19,231.231 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-08-30T20:57:19.290 INFO:teuthology.kill:2021-08-30 20:57:19,290.290 INFO:teuthology.orchestra.console:Power off smithi087
2021-08-30T20:57:19.303 INFO:teuthology.kill:2021-08-30 20:57:19,303.303 INFO:teuthology.orchestra.console:Power off smithi033
2021-08-30T20:57:27.667 INFO:teuthology.kill:2021-08-30 20:57:27,667.667 INFO:teuthology.orchestra.console:Power off for smithi033 completed
2021-08-30T20:57:31.769 INFO:teuthology.kill:2021-08-30 20:57:31,768.768 INFO:teuthology.orchestra.console:Power off for smithi087 completed
2021-08-30T20:57:31.972 INFO:teuthology.task.internal:roles: ubuntu@smithi033.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1']
2021-08-30T20:57:31.973 INFO:teuthology.task.internal:roles: ubuntu@smithi087.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'osd.2', 'osd.3', 'client.0']
2021-08-30T20:57:31.973 INFO:teuthology.misc:Compressing logs...
2021-08-30T20:57:31.974 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-08-30T20:58:32.025 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_df69d6db9d68f5492f47c1dee57bca3b0a385796/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_df69d6db9d68f5492f47c1dee57bca3b0a385796/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_df69d6db9d68f5492f47c1dee57bca3b0a385796/teuthology/misc.py", line 1378, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_df69d6db9d68f5492f47c1dee57bca3b0a385796/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_df69d6db9d68f5492f47c1dee57bca3b0a385796/teuthology/orchestra/cluster.py", line 64, in <listcomp>
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_df69d6db9d68f5492f47c1dee57bca3b0a385796/teuthology/orchestra/remote.py", line 509, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_df69d6db9d68f5492f47c1dee57bca3b0a385796/teuthology/orchestra/run.py", line 434, in run
    transport = client.get_transport()
AttributeError: 'NoneType' object has no attribute 'get_transport'
2021-08-30T20:58:32.065 INFO:teuthology.kill:No teuthology processes running
2021-08-30T20:58:33.209 INFO:teuthology.kill:Nuking machines: ['smithi033', 'smithi087']
2021-08-30T20:58:34.154 INFO:teuthology.kill:2021-08-30 20:58:34,154.154 INFO:teuthology.nuke:targets:
2021-08-30T20:58:34.155 INFO:teuthology.kill:  smithi033.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFB5QJvFNwdtoSMhvKknnjcJTCNtmfQaFaJwPbDv4jHP8rvhT08VFqvIII9zfscWhe8EMG09l+rHiEEGGCTarZ6zu9TfpnahuOaO/NZpFFPHHMrdCnLYPFk8yHcVqkS4NIB86kY4kd/rpaOYPFWj1esgaf/SNEbZX8Ciht5oRB1xFEmSRjG2BLQnA/aKZwNvmE+Cx+LTBWDkgHEFZRaItHRMS/ZefpunDlZcZSfW1ZR3kubrARAAOArthDvyn181GkBG33VCDA17VqrWDejj0t4z3LkNPSAQX9noVnR5dLFD2T9xHKNcR/pW7cdgvcx4ELZBnbjpECoMRfYWQEqWk3VlfP9jqu14fpJoVKgk08fAoJz+++I0GXzZs2M67sqA+uki7XK9i9y3YnZOIK34rBOXHyzAv8KhdO4GPXwPCVPmHElbIWO1lPzoScmv8XZ/jdMLbj0OeAs+WJYuNg/yVlTKRAwkOO9hwkvW0NwpK/ncmv/EPJIT7Hoz3x9VpO1Ic=
2021-08-30T20:58:34.155 INFO:teuthology.kill:  smithi087.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDB0HbM53iiQQgyv/jR4tU1GMZ5f3Df4Ujv/pexuxuD1/IUf+mIezzCcvOmmHdYC1WJS5HaZ5txh5nd8E6+Wuw26Nalvb7xKjQy0ZSHbeGT2safw4V9V4Z0mPpCOJbHMA9wAjtLYNwk+YxLOpWZj3IwVQmlgyaGiK4JhAGNf8uoL9S8waFBtChGJtwvB7AJ3d/RARxuft9uw+EP4NgDNxnV+4DeFEcHjqjqL2s1HdC7GEl5Od58gmkCpRXXzVLHw5rpvapqTaiMS664EYSiNiYvDT40lKn/85+ADV7PENdpdpDbcTy2a+0okeRmym53B2XBQkTgBtllFA1MauIO3QcORH+fEesOKrU9bmtK/enSx8Vr5IxcjmLA0RpiAjB+nyE5G6Q/ZaYlzOojj6rYE+mb018S76sXPaIcprqlP0oK9bIAgzWUnEflNCSFYT9ycB6eDsa1wW5TtG0deuplkbKZtYlSnirsudpwXVlYOittGwSMwgFp7BddOrTFmPNMQBc=
2021-08-30T20:58:34.176 INFO:teuthology.kill:2021-08-30 20:58:34,176.176 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-08-30T20:58:34.179 INFO:teuthology.kill:2021-08-30 20:58:34,179.179 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-08-30T20:58:34.233 INFO:teuthology.kill:2021-08-30 20:58:34,232.232 INFO:teuthology.orchestra.console:Power off smithi087
2021-08-30T20:58:34.245 INFO:teuthology.kill:2021-08-30 20:58:34,245.245 INFO:teuthology.orchestra.console:Power off smithi033
2021-08-30T20:58:34.373 INFO:teuthology.kill:2021-08-30 20:58:34,373.373 INFO:teuthology.orchestra.console:Power off for smithi087 completed
2021-08-30T20:58:34.389 INFO:teuthology.kill:2021-08-30 20:58:34,388.388 INFO:teuthology.orchestra.console:Power off for smithi033 completed
2021-08-30T20:58:34.514 INFO:teuthology.kill:2021-08-30 20:58:34,513.513 INFO:teuthology.lock.ops:unlocked smithi087.front.sepia.ceph.com
2021-08-30T20:58:34.528 INFO:teuthology.kill:2021-08-30 20:58:34,528.528 INFO:teuthology.lock.ops:unlocked smithi033.front.sepia.ceph.com
2021-08-30T21:00:34.812 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15