2021-03-01T10:42:12.915 INFO:root:teuthology version: 1.1.0-3082387b
2021-03-01T10:42:13.009 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba002.front.sepia.ceph.com' reimaging
2021-03-01T10:42:13.011 INFO:teuthology.lock.ops:Updating [ubuntu@gibba002.front.sepia.ceph.com]: reset os type and version on server
2021-03-01T10:42:13.011 INFO:teuthology.lock.ops:Updating gibba002.front.sepia.ceph.com on lock server
2021-03-01T10:42:13.073 INFO:teuthology.lock.ops:Node 'ubuntu@gibba002.front.sepia.ceph.com' reimaging is complete
2021-03-01T10:42:13.073 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba024.front.sepia.ceph.com' reimaging
2021-03-01T10:42:13.074 INFO:teuthology.lock.ops:Updating [ubuntu@gibba024.front.sepia.ceph.com]: reset os type and version on server
2021-03-01T10:42:13.074 INFO:teuthology.lock.ops:Updating gibba024.front.sepia.ceph.com on lock server
2021-03-01T10:42:13.095 INFO:teuthology.lock.ops:Node 'ubuntu@gibba024.front.sepia.ceph.com' reimaging is complete
2021-03-01T10:42:13.295 INFO:teuthology.provision.fog.gibba002:Scheduling deploy of rhel 8.3
2021-03-01T10:42:13.319 INFO:teuthology.provision.fog.gibba024:Scheduling deploy of rhel 8.3
2021-03-01T10:42:13.629 INFO:teuthology.orchestra.console:Power off gibba002
2021-03-01T10:42:13.698 INFO:teuthology.orchestra.console:Power off gibba024
2021-03-01T10:42:13.780 INFO:teuthology.orchestra.console:Power off for gibba002 completed
2021-03-01T10:42:13.870 INFO:teuthology.orchestra.console:Power off for gibba024 completed
2021-03-01T10:42:13.882 INFO:teuthology.orchestra.console:Power on gibba002
2021-03-01T10:42:13.971 INFO:teuthology.orchestra.console:Power on gibba024
2021-03-01T10:42:22.265 INFO:teuthology.orchestra.console:Power on for gibba002 completed
2021-03-01T10:42:22.365 INFO:teuthology.orchestra.console:Power on for gibba024 completed
2021-03-01T10:42:22.367 INFO:teuthology.provision.fog.gibba002:Waiting for deploy to finish
2021-03-01T10:42:22.466 INFO:teuthology.provision.fog.gibba024:Waiting for deploy to finish
2021-03-01T10:46:21.838 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-03-01T10:46:37.638 INFO:teuthology.provision.fog.gibba024:Node is ready
2021-03-01T10:46:37.651 INFO:teuthology.orchestra.run.gibba024.stdout:gibba024.front.sepia.ceph.com
2021-03-01T10:46:37.703 INFO:teuthology.orchestra.run.gibba024.stdout:172.21.2.124 gibba024.front.sepia.ceph.com gibba024
2021-03-01T10:46:38.025 INFO:teuthology.provision.fog.gibba024:Deploy complete!
2021-03-01T10:46:48.006 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-03-01T10:46:48.239 INFO:teuthology.provision.fog.gibba002:Node is ready
2021-03-01T10:46:48.250 INFO:teuthology.orchestra.run.gibba002.stdout:gibba002.front.sepia.ceph.com
2021-03-01T10:46:48.302 INFO:teuthology.orchestra.run.gibba002.stdout:172.21.2.102 gibba002.front.sepia.ceph.com gibba002
2021-03-01T10:46:48.622 INFO:teuthology.provision.fog.gibba002:Deploy complete!
2021-03-01T10:46:48.737 INFO:teuthology.lock.ops:Checking gibba002.front.sepia.ceph.com
2021-03-01T10:46:48.738 INFO:teuthology.lock.ops:New key found. Updating...
2021-03-01T10:46:48.754 INFO:teuthology.lock.ops:Checking gibba024.front.sepia.ceph.com
2021-03-01T10:46:48.754 INFO:teuthology.lock.ops:New key found. Updating...
2021-03-01T10:46:48.768 INFO:teuthology.lock.ops:Updating [gibba002.front.sepia.ceph.com]: set os type and version on server
2021-03-01T10:46:48.769 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-03-01T10:46:49.016 INFO:teuthology.orchestra.run.gibba002.stdout:x86_64
2021-03-01T10:46:49.068 INFO:teuthology.orchestra.run.gibba002.stdout:NAME="Red Hat Enterprise Linux"
2021-03-01T10:46:49.068 INFO:teuthology.orchestra.run.gibba002.stdout:VERSION="8.3 (Ootpa)"
2021-03-01T10:46:49.069 INFO:teuthology.orchestra.run.gibba002.stdout:ID="rhel"
2021-03-01T10:46:49.069 INFO:teuthology.orchestra.run.gibba002.stdout:ID_LIKE="fedora"
2021-03-01T10:46:49.069 INFO:teuthology.orchestra.run.gibba002.stdout:VERSION_ID="8.3"
2021-03-01T10:46:49.069 INFO:teuthology.orchestra.run.gibba002.stdout:PLATFORM_ID="platform:el8"
2021-03-01T10:46:49.070 INFO:teuthology.orchestra.run.gibba002.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)"
2021-03-01T10:46:49.070 INFO:teuthology.orchestra.run.gibba002.stdout:ANSI_COLOR="0;31"
2021-03-01T10:46:49.070 INFO:teuthology.orchestra.run.gibba002.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA"
2021-03-01T10:46:49.070 INFO:teuthology.orchestra.run.gibba002.stdout:HOME_URL="https://www.redhat.com/"
2021-03-01T10:46:49.071 INFO:teuthology.orchestra.run.gibba002.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-03-01T10:46:49.071 INFO:teuthology.orchestra.run.gibba002.stdout:
2021-03-01T10:46:49.071 INFO:teuthology.orchestra.run.gibba002.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2021-03-01T10:46:49.071 INFO:teuthology.orchestra.run.gibba002.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3
2021-03-01T10:46:49.072 INFO:teuthology.orchestra.run.gibba002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2021-03-01T10:46:49.072 INFO:teuthology.orchestra.run.gibba002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3"
2021-03-01T10:46:49.073 INFO:teuthology.lock.ops:Updating gibba002.front.sepia.ceph.com on lock server
2021-03-01T10:46:49.088 INFO:teuthology.lock.ops:Updating [gibba024.front.sepia.ceph.com]: set os type and version on server
2021-03-01T10:46:49.088 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-03-01T10:46:49.334 INFO:teuthology.orchestra.run.gibba024.stdout:x86_64
2021-03-01T10:46:49.385 INFO:teuthology.orchestra.run.gibba024.stdout:NAME="Red Hat Enterprise Linux"
2021-03-01T10:46:49.386 INFO:teuthology.orchestra.run.gibba024.stdout:VERSION="8.3 (Ootpa)"
2021-03-01T10:46:49.386 INFO:teuthology.orchestra.run.gibba024.stdout:ID="rhel"
2021-03-01T10:46:49.386 INFO:teuthology.orchestra.run.gibba024.stdout:ID_LIKE="fedora"
2021-03-01T10:46:49.387 INFO:teuthology.orchestra.run.gibba024.stdout:VERSION_ID="8.3"
2021-03-01T10:46:49.387 INFO:teuthology.orchestra.run.gibba024.stdout:PLATFORM_ID="platform:el8"
2021-03-01T10:46:49.387 INFO:teuthology.orchestra.run.gibba024.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)"
2021-03-01T10:46:49.387 INFO:teuthology.orchestra.run.gibba024.stdout:ANSI_COLOR="0;31"
2021-03-01T10:46:49.388 INFO:teuthology.orchestra.run.gibba024.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA"
2021-03-01T10:46:49.388 INFO:teuthology.orchestra.run.gibba024.stdout:HOME_URL="https://www.redhat.com/"
2021-03-01T10:46:49.388 INFO:teuthology.orchestra.run.gibba024.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-03-01T10:46:49.388 INFO:teuthology.orchestra.run.gibba024.stdout:
2021-03-01T10:46:49.389 INFO:teuthology.orchestra.run.gibba024.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2021-03-01T10:46:49.389 INFO:teuthology.orchestra.run.gibba024.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3
2021-03-01T10:46:49.389 INFO:teuthology.orchestra.run.gibba024.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2021-03-01T10:46:49.389 INFO:teuthology.orchestra.run.gibba024.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3"
2021-03-01T10:46:49.390 INFO:teuthology.lock.ops:Updating gibba024.front.sepia.ceph.com on lock server
2021-03-01T10:46:49.478 INFO:teuthology.dispatcher.supervisor:Running job 5921717
2021-03-01T10:46:49.479 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2021-03-01_02:01:03-rbd-master-distro-basic-gibba/5921717 --name teuthology-2021-03-01_02:01:03-rbd-master-distro-basic-gibba --description rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} -- /home/teuthworker/archive/teuthology-2021-03-01_02:01:03-rbd-master-distro-basic-gibba/5921717/orig.config.yaml
2021-03-01T10:46:49.483 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2021-03-01_02:01:03-rbd-master-distro-basic-gibba/5921717
2021-03-01T10:46:49.483 INFO:teuthology.dispatcher.supervisor:Job PID: 8032
2021-03-01T10:46:49.484 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-03-01T22:47:39.958 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-03-01T22:47:47.399 INFO:teuthology.kill:Killing Pids: {8032}
2021-03-01T22:47:48.774 INFO:teuthology.kill:Nuking machines: ['gibba002', 'gibba024']
2021-03-01T22:47:49.763 INFO:teuthology.kill:2021-03-01 22:47:49,762.762 INFO:teuthology.nuke:targets:
2021-03-01T22:47:49.763 INFO:teuthology.kill:  gibba002.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDXI+R0ONTI6O0TM37GM/OjaCxWBhX7VYB4NkR3s3RSQ4FivOws4kqd8KkMxkRqO3R1GGOj02pBqFerBApZ+eoSa8XCwXNS4z0u5CU2/QgLICeiXHa8k9MkUp4Y8lvJByogia/mxIUbxAGJQuB0CuwXSXlxoHfDG+LC4ATpS2Q0mZWudgI1wF8+tuF9wpJQ4Amk2SiZVObvzcL/avv5hDYtk+B2NPR1p7U+fhrgQFwWqirBDubVYQziYriGhWMCsnScl1/cIdEpInUcRTZWHbvE0xO8MD1puHRLVDe/iYCGed/s7zQmok1PfsDlr6rRWnAwwWE59j6U5AX1WyLV+P0rdKooMHFe4mYxlNTYUJdxisBUBlYToLo2cxRaTYZe6nfDEjUbqZL0N61BidMW7LIO+/DjyIYWeHO1AnZGbWbIsombFYVox2iZXovIoltWRV1ksf08thd0PFlL7jmY+G2WQuf9Ity5lAKdZPYoJjLc1qL8+E1/JNCUHs6ymsGi5zs=
2021-03-01T22:47:49.765 INFO:teuthology.kill:  gibba024.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8dZDPbFLRFO555SJtNp5BG7su7iCOIB6FiuyRhyyepON/lfNkJXDnzioFgk+MuFrilyeqAzL6UT5RCE6PDIjzWtwqAmiYsy4woGPRN60l5TNfdSbpnUfGe6eZiXvR8fu/NlqpnpE4cHIjArrWaQzXHjLowQ80C/E+UhEQ43Que70AjVRTEeuv/kZYKfr+Sv39cI2MdzaRO6FCAsAeh76JDVE5uRxIXU2TO8iQCEYtfavBzDIDGMIXhOeIGE4490aPBbLRol6PUz+aKPXIfmXp5dEzwQWt/F/lPYMo/WQFWHpkOwzWqjQuULF93FFSKasBUSjWqizSoUO0/Pub2kDtkZFubySWz5H5AhcVk3BLETGIKyKTcOXlaIekQLz6XkRXtGzZZV/Duijf0IRkmoQtR0vBwCmlwNaTmtqZ/TtTAFL/EYHrOsBAudt75sNQHHve/biFnqYkj5ebNIBcbRaDUZZP6NK0SqREM/6uNNgiSmWH+Mb6+bg68Xz28vuVO40=
2021-03-01T22:47:49.766 INFO:teuthology.kill:2021-03-01 22:47:49,763.763 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-01T22:47:49.767 INFO:teuthology.kill:2021-03-01 22:47:49,765.765 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-01T22:47:49.830 INFO:teuthology.kill:2021-03-01 22:47:49,830.830 INFO:teuthology.orchestra.console:Power off gibba024
2021-03-01T22:47:49.847 INFO:teuthology.kill:2021-03-01 22:47:49,847.847 INFO:teuthology.orchestra.console:Power off gibba002
2021-03-01T22:47:58.307 INFO:teuthology.kill:2021-03-01 22:47:58,306.306 INFO:teuthology.orchestra.console:Power off for gibba002 completed
2021-03-01T22:48:02.324 INFO:teuthology.kill:2021-03-01 22:48:02,323.323 INFO:teuthology.orchestra.console:Power off for gibba024 completed
2021-03-01T22:48:02.803 INFO:teuthology.task.internal:roles: ubuntu@gibba002.front.sepia.ceph.com - ['cluster1.mon.a', 'cluster1.mgr.x', 'cluster2.mgr.x', 'cluster1.osd.0', 'cluster1.osd.1', 'cluster1.osd.2', 'cluster1.client.0', 'cluster2.client.0']
2021-03-01T22:48:02.808 INFO:teuthology.task.internal:roles: ubuntu@gibba024.front.sepia.ceph.com - ['cluster2.mon.a', 'cluster2.osd.0', 'cluster2.osd.1', 'cluster2.osd.2', 'cluster1.client.mirror', 'cluster1.client.mirror.0', 'cluster1.client.mirror.1', 'cluster1.client.mirror.2', 'cluster1.client.mirror.3', 'cluster1.client.mirror.4', 'cluster1.client.mirror.5', 'cluster1.client.mirror.6', 'cluster2.client.mirror', 'cluster2.client.mirror.0', 'cluster2.client.mirror.1', 'cluster2.client.mirror.2', 'cluster2.client.mirror.3', 'cluster2.client.mirror.4', 'cluster2.client.mirror.5', 'cluster2.client.mirror.6']
2021-03-01T22:48:02.815 INFO:teuthology.misc:Compressing logs...
2021-03-01T22:48:02.827 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-03-01T22:49:02.989 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/teuthology/misc.py", line 1374, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/teuthology/orchestra/cluster.py", line 64, in <listcomp>
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/teuthology/orchestra/remote.py", line 215, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/teuthology/orchestra/run.py", line 434, in run
    transport = client.get_transport()
AttributeError: 'NoneType' object has no attribute 'get_transport'
2021-03-01T22:49:03.101 INFO:teuthology.kill:No teuthology processes running
2021-03-01T22:49:04.169 INFO:teuthology.kill:Nuking machines: ['gibba002', 'gibba024']
2021-03-01T22:49:05.092 INFO:teuthology.kill:2021-03-01 22:49:05,092.092 INFO:teuthology.nuke:targets:
2021-03-01T22:49:05.093 INFO:teuthology.kill:  gibba002.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDXI+R0ONTI6O0TM37GM/OjaCxWBhX7VYB4NkR3s3RSQ4FivOws4kqd8KkMxkRqO3R1GGOj02pBqFerBApZ+eoSa8XCwXNS4z0u5CU2/QgLICeiXHa8k9MkUp4Y8lvJByogia/mxIUbxAGJQuB0CuwXSXlxoHfDG+LC4ATpS2Q0mZWudgI1wF8+tuF9wpJQ4Amk2SiZVObvzcL/avv5hDYtk+B2NPR1p7U+fhrgQFwWqirBDubVYQziYriGhWMCsnScl1/cIdEpInUcRTZWHbvE0xO8MD1puHRLVDe/iYCGed/s7zQmok1PfsDlr6rRWnAwwWE59j6U5AX1WyLV+P0rdKooMHFe4mYxlNTYUJdxisBUBlYToLo2cxRaTYZe6nfDEjUbqZL0N61BidMW7LIO+/DjyIYWeHO1AnZGbWbIsombFYVox2iZXovIoltWRV1ksf08thd0PFlL7jmY+G2WQuf9Ity5lAKdZPYoJjLc1qL8+E1/JNCUHs6ymsGi5zs=
2021-03-01T22:49:05.097 INFO:teuthology.kill:  gibba024.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8dZDPbFLRFO555SJtNp5BG7su7iCOIB6FiuyRhyyepON/lfNkJXDnzioFgk+MuFrilyeqAzL6UT5RCE6PDIjzWtwqAmiYsy4woGPRN60l5TNfdSbpnUfGe6eZiXvR8fu/NlqpnpE4cHIjArrWaQzXHjLowQ80C/E+UhEQ43Que70AjVRTEeuv/kZYKfr+Sv39cI2MdzaRO6FCAsAeh76JDVE5uRxIXU2TO8iQCEYtfavBzDIDGMIXhOeIGE4490aPBbLRol6PUz+aKPXIfmXp5dEzwQWt/F/lPYMo/WQFWHpkOwzWqjQuULF93FFSKasBUSjWqizSoUO0/Pub2kDtkZFubySWz5H5AhcVk3BLETGIKyKTcOXlaIekQLz6XkRXtGzZZV/Duijf0IRkmoQtR0vBwCmlwNaTmtqZ/TtTAFL/EYHrOsBAudt75sNQHHve/biFnqYkj5ebNIBcbRaDUZZP6NK0SqREM/6uNNgiSmWH+Mb6+bg68Xz28vuVO40=
2021-03-01T22:49:05.114 INFO:teuthology.kill:2021-03-01 22:49:05,114.114 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-01T22:49:05.117 INFO:teuthology.kill:2021-03-01 22:49:05,117.117 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-01T22:49:05.175 INFO:teuthology.kill:2021-03-01 22:49:05,175.175 INFO:teuthology.orchestra.console:Power off gibba024
2021-03-01T22:49:05.189 INFO:teuthology.kill:2021-03-01 22:49:05,189.189 INFO:teuthology.orchestra.console:Power off gibba002
2021-03-01T22:49:05.324 INFO:teuthology.kill:2021-03-01 22:49:05,324.324 INFO:teuthology.orchestra.console:Power off for gibba024 completed
2021-03-01T22:49:05.341 INFO:teuthology.kill:2021-03-01 22:49:05,341.341 INFO:teuthology.orchestra.console:Power off for gibba002 completed
2021-03-01T22:49:05.470 INFO:teuthology.kill:2021-03-01 22:49:05,469.469 INFO:teuthology.lock.ops:unlocked gibba024.front.sepia.ceph.com
2021-03-01T22:49:05.485 INFO:teuthology.kill:2021-03-01 22:49:05,485.485 INFO:teuthology.lock.ops:unlocked gibba002.front.sepia.ceph.com
2021-03-01T22:51:05.812 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-03-01T22:51:05.940 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2021-03-01T22:51:05.944 INFO:teuthology.nuke:Checking targets against current locks
2021-03-01T22:51:06.163 INFO:teuthology.nuke:Not nuking gibba024.front.sepia.ceph.com because description doesn't match
2021-03-01T22:51:06.164 INFO:teuthology.nuke:Not nuking gibba002.front.sepia.ceph.com because description doesn't match