2021-06-30T16:02:11.454 INFO:root:teuthology version: 1.1.0-26631ede
2021-06-30T16:02:11.595 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi175.front.sepia.ceph.com' reimaging
2021-06-30T16:02:11.596 INFO:teuthology.lock.ops:Updating [ubuntu@smithi175.front.sepia.ceph.com]: reset os type and version on server
2021-06-30T16:02:11.596 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server
2021-06-30T16:02:11.614 INFO:teuthology.lock.ops:Node 'ubuntu@smithi175.front.sepia.ceph.com' reimaging is complete
2021-06-30T16:02:11.614 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi205.front.sepia.ceph.com' reimaging
2021-06-30T16:02:11.615 INFO:teuthology.lock.ops:Updating [ubuntu@smithi205.front.sepia.ceph.com]: reset os type and version on server
2021-06-30T16:02:11.615 INFO:teuthology.lock.ops:Updating smithi205.front.sepia.ceph.com on lock server
2021-06-30T16:02:11.631 INFO:teuthology.lock.ops:Node 'ubuntu@smithi205.front.sepia.ceph.com' reimaging is complete
2021-06-30T16:02:11.846 INFO:teuthology.provision.fog.smithi175:Scheduling deploy of ubuntu 20.04
2021-06-30T16:02:11.880 INFO:teuthology.provision.fog.smithi205:Scheduling deploy of ubuntu 20.04
2021-06-30T16:02:12.345 INFO:teuthology.orchestra.console:Power off smithi175
2021-06-30T16:02:12.367 INFO:teuthology.orchestra.console:Power off smithi205
2021-06-30T16:02:20.748 INFO:teuthology.orchestra.console:Power off for smithi205 completed
2021-06-30T16:02:20.850 INFO:teuthology.orchestra.console:Power on smithi205
2021-06-30T16:02:24.883 INFO:teuthology.orchestra.console:Power off for smithi175 completed
2021-06-30T16:02:24.985 INFO:teuthology.orchestra.console:Power on smithi175
2021-06-30T16:02:29.428 INFO:teuthology.orchestra.console:Power on for smithi205 completed
2021-06-30T16:02:29.530 INFO:teuthology.provision.fog.smithi205:Waiting for deploy to finish
2021-06-30T16:02:33.494 INFO:teuthology.orchestra.console:Power on for smithi175 completed
2021-06-30T16:02:33.598 INFO:teuthology.provision.fog.smithi175:Waiting for deploy to finish
2021-06-30T16:07:26.611 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-06-30T16:07:27.076 INFO:teuthology.provision.fog.smithi175:Node is ready
2021-06-30T16:07:27.084 INFO:teuthology.orchestra.run.smithi175.stdout:smithi175.front.sepia.ceph.com
2021-06-30T16:07:27.134 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.15.175 smithi175.front.sepia.ceph.com smithi175
2021-06-30T16:07:27.165 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-06-30T16:07:27.330 INFO:teuthology.provision.fog.smithi175:Deploy complete!
2021-06-30T16:07:27.612 INFO:teuthology.provision.fog.smithi205:Node is ready
2021-06-30T16:07:27.662 INFO:teuthology.orchestra.run.smithi205.stdout:smithi205.front.sepia.ceph.com
2021-06-30T16:07:27.689 INFO:teuthology.orchestra.run.smithi205.stdout:172.21.15.205 smithi205.front.sepia.ceph.com smithi205
2021-06-30T16:07:27.811 INFO:teuthology.provision.fog.smithi205:Deploy complete!
2021-06-30T16:07:28.019 INFO:teuthology.lock.ops:Checking smithi175.front.sepia.ceph.com
2021-06-30T16:07:28.020 INFO:teuthology.lock.ops:New key found. Updating...
2021-06-30T16:07:28.035 INFO:teuthology.lock.ops:Checking smithi205.front.sepia.ceph.com
2021-06-30T16:07:28.036 INFO:teuthology.lock.ops:New key found. Updating...
2021-06-30T16:07:28.063 INFO:teuthology.lock.ops:Updating [smithi175.front.sepia.ceph.com]: set os type and version on server
2021-06-30T16:07:28.063 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-06-30T16:07:28.232 INFO:teuthology.orchestra.run.smithi175.stdout:x86_64
2021-06-30T16:07:28.241 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="Ubuntu"
2021-06-30T16:07:28.241 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="20.04.2 LTS (Focal Fossa)"
2021-06-30T16:07:28.241 INFO:teuthology.orchestra.run.smithi175.stdout:ID=ubuntu
2021-06-30T16:07:28.242 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE=debian
2021-06-30T16:07:28.242 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS"
2021-06-30T16:07:28.242 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="20.04"
2021-06-30T16:07:28.242 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://www.ubuntu.com/"
2021-06-30T16:07:28.243 INFO:teuthology.orchestra.run.smithi175.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-06-30T16:07:28.243 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-06-30T16:07:28.246 INFO:teuthology.orchestra.run.smithi175.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-06-30T16:07:28.248 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_CODENAME=focal
2021-06-30T16:07:28.248 INFO:teuthology.orchestra.run.smithi175.stdout:UBUNTU_CODENAME=focal
2021-06-30T16:07:28.249 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server
2021-06-30T16:07:28.295 INFO:teuthology.lock.ops:Updating [smithi205.front.sepia.ceph.com]: set os type and version on server
2021-06-30T16:07:28.296 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-06-30T16:07:28.487 INFO:teuthology.orchestra.run.smithi205.stdout:x86_64
2021-06-30T16:07:28.493 INFO:teuthology.orchestra.run.smithi205.stdout:NAME="Ubuntu"
2021-06-30T16:07:28.493 INFO:teuthology.orchestra.run.smithi205.stdout:VERSION="20.04.2 LTS (Focal Fossa)"
2021-06-30T16:07:28.493 INFO:teuthology.orchestra.run.smithi205.stdout:ID=ubuntu
2021-06-30T16:07:28.494 INFO:teuthology.orchestra.run.smithi205.stdout:ID_LIKE=debian
2021-06-30T16:07:28.494 INFO:teuthology.orchestra.run.smithi205.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS"
2021-06-30T16:07:28.494 INFO:teuthology.orchestra.run.smithi205.stdout:VERSION_ID="20.04"
2021-06-30T16:07:28.494 INFO:teuthology.orchestra.run.smithi205.stdout:HOME_URL="https://www.ubuntu.com/"
2021-06-30T16:07:28.495 INFO:teuthology.orchestra.run.smithi205.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-06-30T16:07:28.495 INFO:teuthology.orchestra.run.smithi205.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-06-30T16:07:28.495 INFO:teuthology.orchestra.run.smithi205.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-06-30T16:07:28.495 INFO:teuthology.orchestra.run.smithi205.stdout:VERSION_CODENAME=focal
2021-06-30T16:07:28.496 INFO:teuthology.orchestra.run.smithi205.stdout:UBUNTU_CODENAME=focal
2021-06-30T16:07:28.496 INFO:teuthology.lock.ops:Updating smithi205.front.sepia.ceph.com on lock server
2021-06-30T16:07:28.637 INFO:teuthology.dispatcher.supervisor:Running job 6211359
2021-06-30T16:07:28.638 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/bin/teuthology -v --owner scheduled_rfriedma@teuthology --archive /home/teuthworker/archive/rfriedma-2021-06-26_19:32:15-rados-wip-ronenf-scrubs-config-distro-basic-smithi/6211359 --name rfriedma-2021-06-26_19:32:15-rados-wip-ronenf-scrubs-config-distro-basic-smithi --description rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps} -- /home/teuthworker/archive/rfriedma-2021-06-26_19:32:15-rados-wip-ronenf-scrubs-config-distro-basic-smithi/6211359/orig.config.yaml
2021-06-30T16:07:28.642 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rfriedma-2021-06-26_19:32:15-rados-wip-ronenf-scrubs-config-distro-basic-smithi/6211359
2021-06-30T16:07:28.643 INFO:teuthology.dispatcher.supervisor:Job PID: 31089
2021-06-30T16:07:28.644 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-07-01T04:08:26.680 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-07-01T04:08:26.920 INFO:teuthology.kill:Killing Pids: {31089}
2021-07-01T04:08:28.160 INFO:teuthology.kill:Nuking machines: ['smithi175', 'smithi205']
2021-07-01T04:08:29.286 INFO:teuthology.kill:2021-07-01 04:08:29,286.286 INFO:teuthology.nuke:targets:
2021-07-01T04:08:29.287 INFO:teuthology.kill:  smithi175.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCSI3rFQjnIhLOzMxwGGYy6lFo5Bifuy4OKUbKNfUQkxA6OJxBZZ1a2I9n7jUeROUCcAfDM7MMO8EjD2ldHCRCxHfhqxmQWMjBSufI1JKaUkehQp1QNgnR6iZ5TzHzEYKg5stNxmdejkkFNk5Txm0ZKydM5T4ku7yMaiNKi9gMm7qgvz7aVpYQAP7UPtz/ggb7AoGOAhZGNVHI+H2ld8aH+4XLmBoKk0eai7+M+e0yWprAkTnKZrEbMq+qVxHz0ByeF6dserNonqEnA+j9cmFePYqrUdaWmHPyUPdeEBa/tZfBBz+gF6cVKx6nc+1NnEpCkux7dDYQm8lJefltmjPAQnYW0pBYiBqvSnlRDcQlzAuhyWS17x+f3u4R6yvRM7UUpz82vQwkGC4F6atdAIMIcMbzsjDDa00QlAfOL/o0VBSBVJqt9qGFVGHXDS0cnQg+kijV+ULJleCKvWq5ISBuyGFzpqYKovwUKi16eMeuV9Pifb+G0Hn0B+mhft/+AsOc=
2021-07-01T04:08:29.287 INFO:teuthology.kill:  smithi205.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+BlLwWpXB6dqhknQojXn3+Qmd12FFEmbKkNSq5WliETbb1GeTaCDvvNo95ZZyqthJZYIsJci+9WYRV8me5dSKyHCl69naxzGV/t1OUb/sxXj31ZsWO7mK1x7vGtgM/1aq09uYG3WLdyIuvSUO/WEKBWdpDHe2P4VsdazB4meHiaYLbqTGJB579Piaap/aWS97X3dTd/wuxWMsTm7HbzGNRQn6jsMPmumSbO/f8vSPbu7z5iM8XMlSceG+JWGcr3R+kblOcDkWhcu4Z/9rTfx1/3uFLvcMspoV7QJ3dm6gQU72uYZcSayJuVwMGH/bp3008bpzf9mE3VRZMu8odrSIMBvh08I5PVUO+yqLzWOTAMHC6MBEvcXk8eywXO9dB9hxKiwYwHkvyqGhXfY4tREIKC/IXte6tEGx25n9r+9+B81Ek9S5d+bHsANY5rGBLe7nkmmMREzGmqc9yY/6G5aebyUU7wLbCFoowUKo+wYiEY9LTtmBLaawkL2TPoPi1/c=
2021-07-01T04:08:29.288 INFO:teuthology.kill:2021-07-01 04:08:29,286.286 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-07-01T04:08:29.289 INFO:teuthology.kill:2021-07-01 04:08:29,289.289 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-07-01T04:08:29.353 INFO:teuthology.kill:2021-07-01 04:08:29,352.352 INFO:teuthology.orchestra.console:Power off smithi205
2021-07-01T04:08:29.369 INFO:teuthology.kill:2021-07-01 04:08:29,368.368 INFO:teuthology.orchestra.console:Power off smithi175
2021-07-01T04:08:37.737 INFO:teuthology.kill:2021-07-01 04:08:37,737.737 INFO:teuthology.orchestra.console:Power off for smithi205 completed
2021-07-01T04:08:37.744 INFO:teuthology.kill:2021-07-01 04:08:37,744.744 INFO:teuthology.orchestra.console:Power off for smithi175 completed
2021-07-01T04:08:38.062 INFO:teuthology.task.internal:roles: ubuntu@smithi175.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2021-07-01T04:08:38.063 INFO:teuthology.task.internal:roles: ubuntu@smithi205.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2021-07-01T04:08:38.064 INFO:teuthology.misc:Compressing logs...
2021-07-01T04:08:38.065 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-07-01T04:09:38.132 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/misc.py", line 1378, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/orchestra/cluster.py", line 64, in <listcomp>
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/orchestra/remote.py", line 509, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/orchestra/run.py", line 434, in run
    transport = client.get_transport()
AttributeError: 'NoneType' object has no attribute 'get_transport'
2021-07-01T04:09:38.217 INFO:teuthology.kill:No teuthology processes running
2021-07-01T04:09:39.680 INFO:teuthology.kill:Nuking machines: ['smithi175', 'smithi205']
2021-07-01T04:09:40.990 INFO:teuthology.kill:2021-07-01 04:09:40,990.990 INFO:teuthology.nuke:targets:
2021-07-01T04:09:40.992 INFO:teuthology.kill:  smithi175.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCSI3rFQjnIhLOzMxwGGYy6lFo5Bifuy4OKUbKNfUQkxA6OJxBZZ1a2I9n7jUeROUCcAfDM7MMO8EjD2ldHCRCxHfhqxmQWMjBSufI1JKaUkehQp1QNgnR6iZ5TzHzEYKg5stNxmdejkkFNk5Txm0ZKydM5T4ku7yMaiNKi9gMm7qgvz7aVpYQAP7UPtz/ggb7AoGOAhZGNVHI+H2ld8aH+4XLmBoKk0eai7+M+e0yWprAkTnKZrEbMq+qVxHz0ByeF6dserNonqEnA+j9cmFePYqrUdaWmHPyUPdeEBa/tZfBBz+gF6cVKx6nc+1NnEpCkux7dDYQm8lJefltmjPAQnYW0pBYiBqvSnlRDcQlzAuhyWS17x+f3u4R6yvRM7UUpz82vQwkGC4F6atdAIMIcMbzsjDDa00QlAfOL/o0VBSBVJqt9qGFVGHXDS0cnQg+kijV+ULJleCKvWq5ISBuyGFzpqYKovwUKi16eMeuV9Pifb+G0Hn0B+mhft/+AsOc=
2021-07-01T04:09:40.992 INFO:teuthology.kill:  smithi205.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+BlLwWpXB6dqhknQojXn3+Qmd12FFEmbKkNSq5WliETbb1GeTaCDvvNo95ZZyqthJZYIsJci+9WYRV8me5dSKyHCl69naxzGV/t1OUb/sxXj31ZsWO7mK1x7vGtgM/1aq09uYG3WLdyIuvSUO/WEKBWdpDHe2P4VsdazB4meHiaYLbqTGJB579Piaap/aWS97X3dTd/wuxWMsTm7HbzGNRQn6jsMPmumSbO/f8vSPbu7z5iM8XMlSceG+JWGcr3R+kblOcDkWhcu4Z/9rTfx1/3uFLvcMspoV7QJ3dm6gQU72uYZcSayJuVwMGH/bp3008bpzf9mE3VRZMu8odrSIMBvh08I5PVUO+yqLzWOTAMHC6MBEvcXk8eywXO9dB9hxKiwYwHkvyqGhXfY4tREIKC/IXte6tEGx25n9r+9+B81Ek9S5d+bHsANY5rGBLe7nkmmMREzGmqc9yY/6G5aebyUU7wLbCFoowUKo+wYiEY9LTtmBLaawkL2TPoPi1/c=
2021-07-01T04:09:41.017 INFO:teuthology.kill:2021-07-01 04:09:41,017.017 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-07-01T04:09:41.021 INFO:teuthology.kill:2021-07-01 04:09:41,021.021 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-07-01T04:09:41.093 INFO:teuthology.kill:2021-07-01 04:09:41,092.092 INFO:teuthology.orchestra.console:Power off smithi175
2021-07-01T04:09:41.155 INFO:teuthology.kill:2021-07-01 04:09:41,154.154 INFO:teuthology.orchestra.console:Power off smithi205
2021-07-01T04:09:41.269 INFO:teuthology.kill:2021-07-01 04:09:41,268.268 INFO:teuthology.orchestra.console:Power off for smithi175 completed
2021-07-01T04:09:41.307 INFO:teuthology.kill:2021-07-01 04:09:41,306.306 INFO:teuthology.orchestra.console:Power off for smithi205 completed
2021-07-01T04:09:41.416 INFO:teuthology.kill:2021-07-01 04:09:41,416.416 INFO:teuthology.lock.ops:unlocked smithi175.front.sepia.ceph.com
2021-07-01T04:09:41.448 INFO:teuthology.kill:2021-07-01 04:09:41,448.448 INFO:teuthology.lock.ops:unlocked smithi205.front.sepia.ceph.com
2021-07-01T04:11:41.793 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-07-01T04:11:41.899 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2021-07-01T04:11:41.899 INFO:teuthology.nuke:Checking targets against current locks
2021-07-01T04:11:41.969 INFO:teuthology.nuke:Not nuking smithi175.front.sepia.ceph.com because description doesn't match
2021-07-01T04:11:41.970 INFO:teuthology.nuke:Not nuking smithi205.front.sepia.ceph.com because description doesn't match