2021-02-27T23:34:50.636 INFO:root:teuthology version: 1.1.0-3082387b
2021-02-27T23:34:50.771 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi007.front.sepia.ceph.com' reimaging
2021-02-27T23:34:50.776 INFO:teuthology.lock.ops:Updating [ubuntu@smithi007.front.sepia.ceph.com]: reset os type and version on server
2021-02-27T23:34:50.777 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server
2021-02-27T23:34:50.800 INFO:teuthology.lock.ops:Node 'ubuntu@smithi007.front.sepia.ceph.com' reimaging is complete
2021-02-27T23:34:50.800 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi156.front.sepia.ceph.com' reimaging
2021-02-27T23:34:50.801 INFO:teuthology.lock.ops:Updating [ubuntu@smithi156.front.sepia.ceph.com]: reset os type and version on server
2021-02-27T23:34:50.801 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server
2021-02-27T23:34:50.826 INFO:teuthology.lock.ops:Node 'ubuntu@smithi156.front.sepia.ceph.com' reimaging is complete
2021-02-27T23:34:51.070 INFO:teuthology.provision.fog.smithi007:Scheduling deploy of rhel 8.3
2021-02-27T23:34:51.171 INFO:teuthology.provision.fog.smithi156:Scheduling deploy of rhel 8.3
2021-02-27T23:34:51.550 INFO:teuthology.orchestra.console:Power off smithi007
2021-02-27T23:34:51.637 INFO:teuthology.orchestra.console:Power off smithi156
2021-02-27T23:34:59.968 INFO:teuthology.orchestra.console:Power off for smithi007 completed
2021-02-27T23:35:00.032 INFO:teuthology.orchestra.console:Power off for smithi156 completed
2021-02-27T23:35:00.070 INFO:teuthology.orchestra.console:Power on smithi007
2021-02-27T23:35:00.134 INFO:teuthology.orchestra.console:Power on smithi156
2021-02-27T23:35:08.444 INFO:teuthology.orchestra.console:Power on for smithi007 completed
2021-02-27T23:35:08.497 INFO:teuthology.orchestra.console:Power on for smithi156 completed
2021-02-27T23:35:08.546 INFO:teuthology.provision.fog.smithi007:Waiting for deploy to finish
2021-02-27T23:35:08.598 INFO:teuthology.provision.fog.smithi156:Waiting for deploy to finish
2021-02-27T23:39:16.528 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-02-27T23:39:16.832 INFO:teuthology.provision.fog.smithi007:Node is ready
2021-02-27T23:39:16.847 INFO:teuthology.orchestra.run.smithi007.stdout:smithi007.front.sepia.ceph.com
2021-02-27T23:39:16.900 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7 smithi007.front.sepia.ceph.com smithi007
2021-02-27T23:39:17.229 INFO:teuthology.provision.fog.smithi007:Deploy complete!
2021-02-27T23:40:04.904 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-02-27T23:40:05.212 INFO:teuthology.provision.fog.smithi156:Node is ready
2021-02-27T23:40:05.227 INFO:teuthology.orchestra.run.smithi156.stdout:smithi156.front.sepia.ceph.com
2021-02-27T23:40:05.281 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156 smithi156.front.sepia.ceph.com smithi156
2021-02-27T23:40:05.610 INFO:teuthology.provision.fog.smithi156:Deploy complete!
2021-02-27T23:40:05.731 INFO:teuthology.lock.ops:Checking smithi007.front.sepia.ceph.com
2021-02-27T23:40:05.732 INFO:teuthology.lock.ops:New key found. Updating...
2021-02-27T23:40:05.749 INFO:teuthology.lock.ops:Checking smithi156.front.sepia.ceph.com
2021-02-27T23:40:05.749 INFO:teuthology.lock.ops:New key found. Updating...
2021-02-27T23:40:05.762 INFO:teuthology.lock.ops:Updating [smithi007.front.sepia.ceph.com]: set os type and version on server
2021-02-27T23:40:05.763 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-02-27T23:40:06.061 INFO:teuthology.orchestra.run.smithi007.stdout:x86_64
2021-02-27T23:40:06.115 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="Red Hat Enterprise Linux"
2021-02-27T23:40:06.116 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="8.3 (Ootpa)"
2021-02-27T23:40:06.116 INFO:teuthology.orchestra.run.smithi007.stdout:ID="rhel"
2021-02-27T23:40:06.116 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE="fedora"
2021-02-27T23:40:06.116 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="8.3"
2021-02-27T23:40:06.117 INFO:teuthology.orchestra.run.smithi007.stdout:PLATFORM_ID="platform:el8"
2021-02-27T23:40:06.117 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)"
2021-02-27T23:40:06.117 INFO:teuthology.orchestra.run.smithi007.stdout:ANSI_COLOR="0;31"
2021-02-27T23:40:06.117 INFO:teuthology.orchestra.run.smithi007.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA"
2021-02-27T23:40:06.117 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://www.redhat.com/"
2021-02-27T23:40:06.118 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-02-27T23:40:06.118 INFO:teuthology.orchestra.run.smithi007.stdout:
2021-02-27T23:40:06.118 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2021-02-27T23:40:06.118 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3
2021-02-27T23:40:06.118 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2021-02-27T23:40:06.119 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3"
2021-02-27T23:40:06.120 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server
2021-02-27T23:40:06.136 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: set os type and version on server
2021-02-27T23:40:06.136 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-02-27T23:40:06.424 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64
2021-02-27T23:40:06.478 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="Red Hat Enterprise Linux"
2021-02-27T23:40:06.478 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="8.3 (Ootpa)"
2021-02-27T23:40:06.478 INFO:teuthology.orchestra.run.smithi156.stdout:ID="rhel"
2021-02-27T23:40:06.479 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="fedora"
2021-02-27T23:40:06.479 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="8.3"
2021-02-27T23:40:06.479 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el8"
2021-02-27T23:40:06.479 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)"
2021-02-27T23:40:06.480 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31"
2021-02-27T23:40:06.480 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA"
2021-02-27T23:40:06.480 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://www.redhat.com/"
2021-02-27T23:40:06.481 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-02-27T23:40:06.481 INFO:teuthology.orchestra.run.smithi156.stdout:
2021-02-27T23:40:06.482 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2021-02-27T23:40:06.482 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3
2021-02-27T23:40:06.482 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2021-02-27T23:40:06.483 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3"
2021-02-27T23:40:06.483 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server
2021-02-27T23:40:06.560 INFO:teuthology.dispatcher.supervisor:Running job 5919550
2021-02-27T23:40:06.560 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/virtualenv/bin/teuthology -v --owner scheduled_sage@teuthology --archive /home/teuthworker/archive/sage-2021-02-27_23:33:35-rados-pacific-distro-basic-smithi/5919550 --name sage-2021-02-27_23:33:35-rados-pacific-distro-basic-smithi --description rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} -- /home/teuthworker/archive/sage-2021-02-27_23:33:35-rados-pacific-distro-basic-smithi/5919550/orig.config.yaml
2021-02-27T23:40:06.565 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/sage-2021-02-27_23:33:35-rados-pacific-distro-basic-smithi/5919550
2021-02-27T23:40:06.567 INFO:teuthology.dispatcher.supervisor:Job PID: 29795
2021-02-27T23:40:06.567 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-02-28T11:40:57.267 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-02-28T11:40:57.538 INFO:teuthology.kill:Killing Pids: {29795}
2021-02-28T11:40:59.575 INFO:teuthology.kill:Nuking machines: ['smithi007', 'smithi156']
2021-02-28T11:41:01.237 INFO:teuthology.kill:2021-02-28 11:41:01,236.236 INFO:teuthology.nuke:targets:
2021-02-28T11:41:01.240 INFO:teuthology.kill:  smithi007.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLGbMv6IqaN+Zqpa/7WwW3hqco0g7dZDftWPjoSeANh+wUl+R/EVjpGpELEZc/knZrcA6wJygf5tDHYJQ9Kd7eGDhZe0bUnY0tDS+0r3njMjmY0BkmJUaPEZozagJXb2TWYfhd/3ZbQbEo31FUU962m/4kzs2xb1svLr1WRg1wlUlppjfyX0+RbJ3H5a4BQkdEU05FyfthqIABae06QDX7/DR7qaNMipr1TVeos6+F5OR2kIId459MQsVcmrat63Q9fUhX6sqT83cKaKbm+G1xj0HBe0oLFk+lBCo4wIxiJ1w1VLcxxeWBEdKf4oRhCaZpsFG6c1zokxA3Rwda/eZySQVHSTTodGX1Wl3KeV2waOpQFxLhZFfJoBXDLbphBGL9UXWnfB/TWwOUhjK6JFialslu0iVnQCyYf+KfRlT3IxTq4ul/dvZJH0w/YFB1Ov+Ec9lb6+ywQOHBZGDwlIr9F7qUYg/FnneqAaKTCttkGeBx4pXNbsrIO9KS9GZ7cqk=
2021-02-28T11:41:01.240 INFO:teuthology.kill:  smithi156.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCnI2Yltn/5Lh7Ha8nJ9vgQ5SlKY6PnYE6jz8V+uzLb+CRApz2DbW7GhnBqjNh1hytMZOoVFPnzbwtMWY/1cLrh0tt67juI4NLorxyAi/45Wfq6QxQqE06YEz2Ay6nmH7IsWpDdYtHQiVDB1VNHRJLGjGHG2MZLlBq3fWwHyD/s1+ghiNsDQtPhIG0K+5Fpk3OeuWHDETHKPFpfIamynxemlv94yXg65cR0uTqTqyNtwmdRdbpRGP/XdNPDcWbHsND09p8hfjrFpEpuZvUiU9GhisKSE7+BPkUlOFX4AqeZt+ZwVp5iMrzEjo9iW4MNWacElOE2m4LEA+wPVxHqG55VdHgeQKGL1GxfbKqF0YBfJkMNFcCrOLSsCQyD4NCrPhFWt/2EkI3ukGShak0J47ubbruLbWmbfnF2bMgNuakSPyprNHbaVZTSXbp5E/2qVcLqLUWsduFoWi3h7Ywh4w0aP5lnDZthBV/rzX5FN8AW8s9N4MK9lTTQnf7k/oo5Ens=
2021-02-28T11:41:01.241 INFO:teuthology.kill:2021-02-28 11:41:01,237.237 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-02-28T11:41:01.241 INFO:teuthology.kill:2021-02-28 11:41:01,241.241 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-02-28T11:41:01.307 INFO:teuthology.kill:2021-02-28 11:41:01,307.307 INFO:teuthology.orchestra.console:Power off smithi156
2021-02-28T11:41:01.325 INFO:teuthology.kill:2021-02-28 11:41:01,324.324 INFO:teuthology.orchestra.console:Power off smithi007
2021-02-28T11:41:09.689 INFO:teuthology.kill:2021-02-28 11:41:09,688.688 INFO:teuthology.orchestra.console:Power off for smithi156 completed
2021-02-28T11:41:09.700 INFO:teuthology.kill:2021-02-28 11:41:09,700.700 INFO:teuthology.orchestra.console:Power off for smithi007 completed
2021-02-28T11:41:09.963 INFO:teuthology.task.internal:roles: ubuntu@smithi007.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2021-02-28T11:41:09.964 INFO:teuthology.task.internal:roles: ubuntu@smithi156.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2021-02-28T11:41:09.965 INFO:teuthology.misc:Compressing logs...
2021-02-28T11:41:09.965 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-02-28T11:42:10.027 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/teuthology/misc.py", line 1374, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/teuthology/orchestra/cluster.py", line 64, in <listcomp>
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/teuthology/orchestra/remote.py", line 215, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/teuthology/orchestra/run.py", line 434, in run
    transport = client.get_transport()
AttributeError: 'NoneType' object has no attribute 'get_transport'
2021-02-28T11:42:10.099 INFO:teuthology.kill:No teuthology processes running
2021-02-28T11:42:12.117 INFO:teuthology.kill:Nuking machines: ['smithi007', 'smithi156']
2021-02-28T11:42:14.310 INFO:teuthology.kill:2021-02-28 11:42:14,309.309 INFO:teuthology.nuke:targets:
2021-02-28T11:42:14.314 INFO:teuthology.kill:  smithi007.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLGbMv6IqaN+Zqpa/7WwW3hqco0g7dZDftWPjoSeANh+wUl+R/EVjpGpELEZc/knZrcA6wJygf5tDHYJQ9Kd7eGDhZe0bUnY0tDS+0r3njMjmY0BkmJUaPEZozagJXb2TWYfhd/3ZbQbEo31FUU962m/4kzs2xb1svLr1WRg1wlUlppjfyX0+RbJ3H5a4BQkdEU05FyfthqIABae06QDX7/DR7qaNMipr1TVeos6+F5OR2kIId459MQsVcmrat63Q9fUhX6sqT83cKaKbm+G1xj0HBe0oLFk+lBCo4wIxiJ1w1VLcxxeWBEdKf4oRhCaZpsFG6c1zokxA3Rwda/eZySQVHSTTodGX1Wl3KeV2waOpQFxLhZFfJoBXDLbphBGL9UXWnfB/TWwOUhjK6JFialslu0iVnQCyYf+KfRlT3IxTq4ul/dvZJH0w/YFB1Ov+Ec9lb6+ywQOHBZGDwlIr9F7qUYg/FnneqAaKTCttkGeBx4pXNbsrIO9KS9GZ7cqk=
2021-02-28T11:42:14.314 INFO:teuthology.kill:  smithi156.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCnI2Yltn/5Lh7Ha8nJ9vgQ5SlKY6PnYE6jz8V+uzLb+CRApz2DbW7GhnBqjNh1hytMZOoVFPnzbwtMWY/1cLrh0tt67juI4NLorxyAi/45Wfq6QxQqE06YEz2Ay6nmH7IsWpDdYtHQiVDB1VNHRJLGjGHG2MZLlBq3fWwHyD/s1+ghiNsDQtPhIG0K+5Fpk3OeuWHDETHKPFpfIamynxemlv94yXg65cR0uTqTqyNtwmdRdbpRGP/XdNPDcWbHsND09p8hfjrFpEpuZvUiU9GhisKSE7+BPkUlOFX4AqeZt+ZwVp5iMrzEjo9iW4MNWacElOE2m4LEA+wPVxHqG55VdHgeQKGL1GxfbKqF0YBfJkMNFcCrOLSsCQyD4NCrPhFWt/2EkI3ukGShak0J47ubbruLbWmbfnF2bMgNuakSPyprNHbaVZTSXbp5E/2qVcLqLUWsduFoWi3h7Ywh4w0aP5lnDZthBV/rzX5FN8AW8s9N4MK9lTTQnf7k/oo5Ens=
2021-02-28T11:42:14.336 INFO:teuthology.kill:2021-02-28 11:42:14,335.335 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-02-28T11:42:14.339 INFO:teuthology.kill:2021-02-28 11:42:14,339.339 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-02-28T11:42:14.408 INFO:teuthology.kill:2021-02-28 11:42:14,408.408 INFO:teuthology.orchestra.console:Power off smithi007
2021-02-28T11:42:14.433 INFO:teuthology.kill:2021-02-28 11:42:14,433.433 INFO:teuthology.orchestra.console:Power off smithi156
2021-02-28T11:42:14.589 INFO:teuthology.kill:2021-02-28 11:42:14,589.589 INFO:teuthology.orchestra.console:Power off for smithi007 completed
2021-02-28T11:42:14.598 INFO:teuthology.kill:2021-02-28 11:42:14,597.597 INFO:teuthology.orchestra.console:Power off for smithi156 completed
2021-02-28T11:42:14.734 INFO:teuthology.kill:2021-02-28 11:42:14,733.733 INFO:teuthology.lock.ops:unlocked smithi007.front.sepia.ceph.com
2021-02-28T11:42:14.738 INFO:teuthology.kill:2021-02-28 11:42:14,738.738 INFO:teuthology.lock.ops:unlocked smithi156.front.sepia.ceph.com
2021-02-28T11:44:15.044 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-02-28T11:44:15.147 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2021-02-28T11:44:15.147 INFO:teuthology.nuke:Checking targets against current locks
2021-02-28T11:44:15.240 INFO:teuthology.nuke:Not nuking smithi007.front.sepia.ceph.com because description doesn't match
2021-02-28T11:44:15.241 INFO:teuthology.nuke:Not nuking smithi156.front.sepia.ceph.com because description doesn't match