2021-07-21T19:31:59.672 INFO:root:teuthology version: 1.1.0-b6f3efab
2021-07-21T19:31:59.775 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi117.front.sepia.ceph.com' reimaging
2021-07-21T19:31:59.776 INFO:teuthology.lock.ops:Updating [ubuntu@smithi117.front.sepia.ceph.com]: reset os type and version on server
2021-07-21T19:31:59.777 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server
2021-07-21T19:31:59.793 INFO:teuthology.lock.ops:Node 'ubuntu@smithi117.front.sepia.ceph.com' reimaging is complete
2021-07-21T19:31:59.794 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi184.front.sepia.ceph.com' reimaging
2021-07-21T19:31:59.794 INFO:teuthology.lock.ops:Updating [ubuntu@smithi184.front.sepia.ceph.com]: reset os type and version on server
2021-07-21T19:31:59.795 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server
2021-07-21T19:31:59.810 INFO:teuthology.lock.ops:Node 'ubuntu@smithi184.front.sepia.ceph.com' reimaging is complete
2021-07-21T19:31:59.994 INFO:teuthology.provision.fog.smithi117:Scheduling deploy of ubuntu 20.04
2021-07-21T19:32:00.031 INFO:teuthology.provision.fog.smithi184:Scheduling deploy of ubuntu 20.04
2021-07-21T19:32:00.342 INFO:teuthology.orchestra.console:Power off smithi117
2021-07-21T19:32:00.356 INFO:teuthology.orchestra.console:Power off smithi184
2021-07-21T19:32:08.720 INFO:teuthology.orchestra.console:Power off for smithi117 completed
2021-07-21T19:32:08.729 INFO:teuthology.orchestra.console:Power off for smithi184 completed
2021-07-21T19:32:08.822 INFO:teuthology.orchestra.console:Power on smithi117
2021-07-21T19:32:08.831 INFO:teuthology.orchestra.console:Power on smithi184
2021-07-21T19:32:17.194 INFO:teuthology.orchestra.console:Power on for smithi117 completed
2021-07-21T19:32:17.204 INFO:teuthology.orchestra.console:Power on for smithi184 completed
2021-07-21T19:32:17.296 INFO:teuthology.provision.fog.smithi117:Waiting for deploy to finish
2021-07-21T19:32:17.306 INFO:teuthology.provision.fog.smithi184:Waiting for deploy to finish
2021-07-21T19:37:12.681 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-07-21T19:37:13.100 INFO:teuthology.provision.fog.smithi117:Node is ready
2021-07-21T19:37:13.108 INFO:teuthology.orchestra.run.smithi117.stdout:smithi117.front.sepia.ceph.com
2021-07-21T19:37:13.159 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117 smithi117.front.sepia.ceph.com smithi117
2021-07-21T19:37:13.392 INFO:teuthology.provision.fog.smithi117:Deploy complete!
2021-07-21T19:37:15.687 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-07-21T19:37:16.115 INFO:teuthology.provision.fog.smithi184:Node is ready
2021-07-21T19:37:16.167 INFO:teuthology.orchestra.run.smithi184.stdout:smithi184.front.sepia.ceph.com
2021-07-21T19:37:16.177 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.15.184 smithi184.front.sepia.ceph.com smithi184
2021-07-21T19:37:16.393 INFO:teuthology.provision.fog.smithi184:Deploy complete!
2021-07-21T19:37:16.585 INFO:teuthology.lock.ops:Checking smithi117.front.sepia.ceph.com
2021-07-21T19:37:16.586 INFO:teuthology.lock.ops:New key found. Updating...
2021-07-21T19:37:16.604 INFO:teuthology.lock.ops:Checking smithi184.front.sepia.ceph.com
2021-07-21T19:37:16.604 INFO:teuthology.lock.ops:New key found. Updating...
2021-07-21T19:37:16.621 INFO:teuthology.lock.ops:Updating [smithi117.front.sepia.ceph.com]: set os type and version on server
2021-07-21T19:37:16.622 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-07-21T19:37:16.808 INFO:teuthology.orchestra.run.smithi117.stdout:x86_64
2021-07-21T19:37:16.813 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="Ubuntu"
2021-07-21T19:37:16.813 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="20.04.2 LTS (Focal Fossa)"
2021-07-21T19:37:16.814 INFO:teuthology.orchestra.run.smithi117.stdout:ID=ubuntu
2021-07-21T19:37:16.814 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE=debian
2021-07-21T19:37:16.814 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS"
2021-07-21T19:37:16.814 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="20.04"
2021-07-21T19:37:16.815 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://www.ubuntu.com/"
2021-07-21T19:37:16.815 INFO:teuthology.orchestra.run.smithi117.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-07-21T19:37:16.815 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-07-21T19:37:16.815 INFO:teuthology.orchestra.run.smithi117.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-07-21T19:37:16.816 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_CODENAME=focal
2021-07-21T19:37:16.816 INFO:teuthology.orchestra.run.smithi117.stdout:UBUNTU_CODENAME=focal
2021-07-21T19:37:16.818 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server
2021-07-21T19:37:16.841 INFO:teuthology.lock.ops:Updating [smithi184.front.sepia.ceph.com]: set os type and version on server
2021-07-21T19:37:16.842 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-07-21T19:37:17.029 INFO:teuthology.orchestra.run.smithi184.stdout:x86_64
2021-07-21T19:37:17.078 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="Ubuntu"
2021-07-21T19:37:17.078 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="20.04.2 LTS (Focal Fossa)"
2021-07-21T19:37:17.079 INFO:teuthology.orchestra.run.smithi184.stdout:ID=ubuntu
2021-07-21T19:37:17.080 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE=debian
2021-07-21T19:37:17.080 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS"
2021-07-21T19:37:17.080 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="20.04"
2021-07-21T19:37:17.080 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://www.ubuntu.com/"
2021-07-21T19:37:17.080 INFO:teuthology.orchestra.run.smithi184.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-07-21T19:37:17.081 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-07-21T19:37:17.081 INFO:teuthology.orchestra.run.smithi184.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-07-21T19:37:17.081 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_CODENAME=focal
2021-07-21T19:37:17.081 INFO:teuthology.orchestra.run.smithi184.stdout:UBUNTU_CODENAME=focal
2021-07-21T19:37:17.082 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server
2021-07-21T19:37:17.191 INFO:teuthology.dispatcher.supervisor:Running job 6285637
2021-07-21T19:37:17.191 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_b6f3efab84b70e18e86ec271a07564aeb4ed3bac/virtualenv/bin/teuthology -v --owner scheduled_rfriedma@teuthology --archive /home/teuthworker/archive/rfriedma-2021-07-21_19:22:49-rados:thrash-wip-ronenf-scrub-sch-bug1-distro-basic-smithi/6285637 --name rfriedma-2021-07-21_19:22:49-rados:thrash-wip-ronenf-scrub-sch-bug1-distro-basic-smithi --description rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/redirect} -- /home/teuthworker/archive/rfriedma-2021-07-21_19:22:49-rados:thrash-wip-ronenf-scrub-sch-bug1-distro-basic-smithi/6285637/orig.config.yaml
2021-07-21T19:37:17.200 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rfriedma-2021-07-21_19:22:49-rados:thrash-wip-ronenf-scrub-sch-bug1-distro-basic-smithi/6285637
2021-07-21T19:37:17.201 INFO:teuthology.dispatcher.supervisor:Job PID: 16472
2021-07-21T19:37:17.201 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-07-22T07:38:07.530 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-07-22T07:38:07.705 INFO:teuthology.kill:Killing Pids: {16472}
2021-07-22T07:38:08.679 INFO:teuthology.kill:Nuking machines: ['smithi117', 'smithi184']
2021-07-22T07:38:09.505 INFO:teuthology.kill:2021-07-22 07:38:09,504.504 INFO:teuthology.nuke:targets:
2021-07-22T07:38:09.505 INFO:teuthology.kill:  smithi117.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDPXJD0mSgcxnGQFLbJV4y0OIIHQ2lcfnbIj4GjF/0TGtwbJEQe2TVsHy9Nq5XqZp//ZVugqidlIOZyJkEwglTPC/i2p1B8pT4HfdCF7srNDQ2PYM9x80qjoQBgLfPoQLCCjyKOu1d7CDXRsEg1IK1nN8CaDaxIgAUJ+h7IXQrh0CoBLiqNcxgWyCnvlNKCYksOpmLow1Ok/zItTwYvIGXcTjvq7nQA2PY+mT3B3xDMbNqdJE1Hrj0V3ZXMhz4hoXCwZzGM+lfnLVHB9zNjILdhaOHFxfCUJaOe8W2o/ZcBXwQL65JiAZ2L3zYBSx3gxRDsPXtX7ie1HHW0GqfFu0ASxUqulMZH4Fy6u59amP6S7Tt78w1JI3bWG8IqgWyHu+MEgpVNeZ9Eq+OwQn2iDXMNCj2W5mjqxMfFc+2yIKhE+UUhkeyide7VwHugYJulYmT7vdLo8B/58JIT3HqwtQf6mW8AvVFXXr8sd9jFscp/oFu8Bbbnt7BfDtKYvAc7j+0=
2021-07-22T07:38:09.506 INFO:teuthology.kill:  smithi184.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDWRfMKVGo1maKoZoH6blT+yDMZ9Dygh1P5efopZp5A+2F6SIO2AF1L5DDJiA36dx1z7j1F5Wl/dSEWax7vP3igXSL6n8DxsjGf91B/97hDbKW7UP0L/Nz1Hm2HjKk0Tlam1qWYn8BxixVscMptz6nF1wTLUC25ZGlJ/vn2ZHZ/eztn1kKSdCRH0NvQXC9XKcCOR09HgbEtn3ZVZ+CVUZe0SKyx+HiB6gd6QfWJmMDKjNI09Gtl1ck9MVGcyfjFMaRNNAtGIS50SBZNnO0poBPaSE2dtvLSURuKsLrH91zBKk2usZ7eGTkRpxPBYN4AlyMbf6o0L1AP3t2K+vI1YeP9dDABuPHaH168Pt92fH0zzX/advS/XUQutfpQGhyTRQrinR1GDODWkYmDUngG+IKuDWQJ3MkEip+QlIGyjMruENM90PpZXqyWsnpDFt5bFyGFBMGARQNx7lhw+sPvEg2f0Wrkq66y38EyjBLpVxmDzgYAZhHNqbLsaYKLChDNZls=
2021-07-22T07:38:09.506 INFO:teuthology.kill:2021-07-22 07:38:09,505.505 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-07-22T07:38:09.507 INFO:teuthology.kill:2021-07-22 07:38:09,507.507 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-07-22T07:38:09.565 INFO:teuthology.kill:2021-07-22 07:38:09,565.565 INFO:teuthology.orchestra.console:Power off smithi184
2021-07-22T07:38:09.576 INFO:teuthology.kill:2021-07-22 07:38:09,576.576 INFO:teuthology.orchestra.console:Power off smithi117
2021-07-22T07:38:17.935 INFO:teuthology.kill:2021-07-22 07:38:17,935.935 INFO:teuthology.orchestra.console:Power off for smithi184 completed
2021-07-22T07:38:17.941 INFO:teuthology.kill:2021-07-22 07:38:17,941.941 INFO:teuthology.orchestra.console:Power off for smithi117 completed
2021-07-22T07:38:18.145 INFO:teuthology.task.internal:roles: ubuntu@smithi117.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2021-07-22T07:38:18.146 INFO:teuthology.task.internal:roles: ubuntu@smithi184.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2021-07-22T07:38:18.146 INFO:teuthology.misc:Compressing logs...
2021-07-22T07:38:18.147 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-07-22T07:39:18.171 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b6f3efab84b70e18e86ec271a07564aeb4ed3bac/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b6f3efab84b70e18e86ec271a07564aeb4ed3bac/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b6f3efab84b70e18e86ec271a07564aeb4ed3bac/teuthology/misc.py", line 1378, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b6f3efab84b70e18e86ec271a07564aeb4ed3bac/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b6f3efab84b70e18e86ec271a07564aeb4ed3bac/teuthology/orchestra/cluster.py", line 64, in <listcomp>
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b6f3efab84b70e18e86ec271a07564aeb4ed3bac/teuthology/orchestra/remote.py", line 509, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b6f3efab84b70e18e86ec271a07564aeb4ed3bac/teuthology/orchestra/run.py", line 434, in run
    transport = client.get_transport()
AttributeError: 'NoneType' object has no attribute 'get_transport'
2021-07-22T07:39:18.227 INFO:teuthology.kill:No teuthology processes running
2021-07-22T07:39:19.221 INFO:teuthology.kill:Nuking machines: ['smithi117', 'smithi184']
2021-07-22T07:39:20.093 INFO:teuthology.kill:2021-07-22 07:39:20,093.093 INFO:teuthology.nuke:targets:
2021-07-22T07:39:20.094 INFO:teuthology.kill:  smithi117.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDPXJD0mSgcxnGQFLbJV4y0OIIHQ2lcfnbIj4GjF/0TGtwbJEQe2TVsHy9Nq5XqZp//ZVugqidlIOZyJkEwglTPC/i2p1B8pT4HfdCF7srNDQ2PYM9x80qjoQBgLfPoQLCCjyKOu1d7CDXRsEg1IK1nN8CaDaxIgAUJ+h7IXQrh0CoBLiqNcxgWyCnvlNKCYksOpmLow1Ok/zItTwYvIGXcTjvq7nQA2PY+mT3B3xDMbNqdJE1Hrj0V3ZXMhz4hoXCwZzGM+lfnLVHB9zNjILdhaOHFxfCUJaOe8W2o/ZcBXwQL65JiAZ2L3zYBSx3gxRDsPXtX7ie1HHW0GqfFu0ASxUqulMZH4Fy6u59amP6S7Tt78w1JI3bWG8IqgWyHu+MEgpVNeZ9Eq+OwQn2iDXMNCj2W5mjqxMfFc+2yIKhE+UUhkeyide7VwHugYJulYmT7vdLo8B/58JIT3HqwtQf6mW8AvVFXXr8sd9jFscp/oFu8Bbbnt7BfDtKYvAc7j+0=
2021-07-22T07:39:20.094 INFO:teuthology.kill:  smithi184.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDWRfMKVGo1maKoZoH6blT+yDMZ9Dygh1P5efopZp5A+2F6SIO2AF1L5DDJiA36dx1z7j1F5Wl/dSEWax7vP3igXSL6n8DxsjGf91B/97hDbKW7UP0L/Nz1Hm2HjKk0Tlam1qWYn8BxixVscMptz6nF1wTLUC25ZGlJ/vn2ZHZ/eztn1kKSdCRH0NvQXC9XKcCOR09HgbEtn3ZVZ+CVUZe0SKyx+HiB6gd6QfWJmMDKjNI09Gtl1ck9MVGcyfjFMaRNNAtGIS50SBZNnO0poBPaSE2dtvLSURuKsLrH91zBKk2usZ7eGTkRpxPBYN4AlyMbf6o0L1AP3t2K+vI1YeP9dDABuPHaH168Pt92fH0zzX/advS/XUQutfpQGhyTRQrinR1GDODWkYmDUngG+IKuDWQJ3MkEip+QlIGyjMruENM90PpZXqyWsnpDFt5bFyGFBMGARQNx7lhw+sPvEg2f0Wrkq66y38EyjBLpVxmDzgYAZhHNqbLsaYKLChDNZls=
2021-07-22T07:39:20.113 INFO:teuthology.kill:2021-07-22 07:39:20,113.113 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-07-22T07:39:20.114 INFO:teuthology.kill:2021-07-22 07:39:20,114.114 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-07-22T07:39:20.169 INFO:teuthology.kill:2021-07-22 07:39:20,169.169 INFO:teuthology.orchestra.console:Power off smithi117
2021-07-22T07:39:20.182 INFO:teuthology.kill:2021-07-22 07:39:20,182.182 INFO:teuthology.orchestra.console:Power off smithi184
2021-07-22T07:39:20.309 INFO:teuthology.kill:2021-07-22 07:39:20,309.309 INFO:teuthology.orchestra.console:Power off for smithi117 completed
2021-07-22T07:39:20.319 INFO:teuthology.kill:2021-07-22 07:39:20,319.319 INFO:teuthology.orchestra.console:Power off for smithi184 completed
2021-07-22T07:39:20.448 INFO:teuthology.kill:2021-07-22 07:39:20,447.447 INFO:teuthology.lock.ops:unlocked smithi117.front.sepia.ceph.com
2021-07-22T07:39:20.453 INFO:teuthology.kill:2021-07-22 07:39:20,453.453 INFO:teuthology.lock.ops:unlocked smithi184.front.sepia.ceph.com
2021-07-22T07:41:20.715 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15