2021-07-22T18:12:50.891 INFO:root:teuthology version: 1.1.0-b6f3efab
2021-07-22T18:12:51.181 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi140.front.sepia.ceph.com' reimaging
2021-07-22T18:12:51.183 INFO:teuthology.lock.ops:Updating [ubuntu@smithi140.front.sepia.ceph.com]: reset os type and version on server
2021-07-22T18:12:51.184 INFO:teuthology.lock.ops:Updating smithi140.front.sepia.ceph.com on lock server
2021-07-22T18:12:51.200 INFO:teuthology.lock.ops:Node 'ubuntu@smithi140.front.sepia.ceph.com' reimaging is complete
2021-07-22T18:12:51.201 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi143.front.sepia.ceph.com' reimaging
2021-07-22T18:12:51.207 INFO:teuthology.lock.ops:Updating [ubuntu@smithi143.front.sepia.ceph.com]: reset os type and version on server
2021-07-22T18:12:51.207 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server
2021-07-22T18:12:51.272 INFO:teuthology.lock.ops:Node 'ubuntu@smithi143.front.sepia.ceph.com' reimaging is complete
2021-07-22T18:12:51.535 INFO:teuthology.provision.fog.smithi143:Scheduling deploy of ubuntu 20.04
2021-07-22T18:12:51.550 INFO:teuthology.provision.fog.smithi140:Scheduling deploy of ubuntu 20.04
2021-07-22T18:12:52.331 INFO:teuthology.orchestra.console:Power off smithi143
2021-07-22T18:12:52.614 INFO:teuthology.orchestra.console:Power off smithi140
2021-07-22T18:13:01.079 INFO:teuthology.orchestra.console:Power off for smithi143 completed
2021-07-22T18:13:01.114 INFO:teuthology.orchestra.console:Power off for smithi140 completed
2021-07-22T18:13:01.188 INFO:teuthology.orchestra.console:Power on smithi143
2021-07-22T18:13:01.216 INFO:teuthology.orchestra.console:Power on smithi140
2021-07-22T18:13:09.652 INFO:teuthology.orchestra.console:Power on for smithi143 completed
2021-07-22T18:13:09.665 INFO:teuthology.orchestra.console:Power on for smithi140 completed
2021-07-22T18:13:09.759 INFO:teuthology.provision.fog.smithi143:Waiting for deploy to finish
2021-07-22T18:13:09.766 INFO:teuthology.provision.fog.smithi140:Waiting for deploy to finish
2021-07-22T18:18:08.734 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-07-22T18:18:09.211 INFO:teuthology.provision.fog.smithi143:Node is ready
2021-07-22T18:18:09.219 INFO:teuthology.orchestra.run.smithi143.stdout:smithi143.front.sepia.ceph.com
2021-07-22T18:18:09.267 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.15.143 smithi143.front.sepia.ceph.com smithi143
2021-07-22T18:18:09.459 INFO:teuthology.provision.fog.smithi143:Deploy complete!
2021-07-22T18:18:36.441 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-07-22T18:18:36.925 INFO:teuthology.provision.fog.smithi140:Node is ready
2021-07-22T18:18:36.975 INFO:teuthology.orchestra.run.smithi140.stdout:smithi140.front.sepia.ceph.com
2021-07-22T18:18:36.983 INFO:teuthology.orchestra.run.smithi140.stdout:172.21.15.140 smithi140.front.sepia.ceph.com smithi140
2021-07-22T18:18:37.159 INFO:teuthology.provision.fog.smithi140:Deploy complete!
2021-07-22T18:18:37.316 INFO:teuthology.lock.ops:Checking smithi140.front.sepia.ceph.com
2021-07-22T18:18:37.317 INFO:teuthology.lock.ops:New key found. Updating...
2021-07-22T18:18:37.338 INFO:teuthology.lock.ops:Checking smithi143.front.sepia.ceph.com
2021-07-22T18:18:37.339 INFO:teuthology.lock.ops:New key found. Updating...
2021-07-22T18:18:37.355 INFO:teuthology.lock.ops:Updating [smithi140.front.sepia.ceph.com]: set os type and version on server
2021-07-22T18:18:37.356 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-07-22T18:18:37.567 INFO:teuthology.orchestra.run.smithi140.stdout:x86_64
2021-07-22T18:18:37.576 INFO:teuthology.orchestra.run.smithi140.stdout:NAME="Ubuntu"
2021-07-22T18:18:37.576 INFO:teuthology.orchestra.run.smithi140.stdout:VERSION="20.04.2 LTS (Focal Fossa)"
2021-07-22T18:18:37.577 INFO:teuthology.orchestra.run.smithi140.stdout:ID=ubuntu
2021-07-22T18:18:37.577 INFO:teuthology.orchestra.run.smithi140.stdout:ID_LIKE=debian
2021-07-22T18:18:37.577 INFO:teuthology.orchestra.run.smithi140.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS"
2021-07-22T18:18:37.577 INFO:teuthology.orchestra.run.smithi140.stdout:VERSION_ID="20.04"
2021-07-22T18:18:37.578 INFO:teuthology.orchestra.run.smithi140.stdout:HOME_URL="https://www.ubuntu.com/"
2021-07-22T18:18:37.578 INFO:teuthology.orchestra.run.smithi140.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-07-22T18:18:37.578 INFO:teuthology.orchestra.run.smithi140.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-07-22T18:18:37.578 INFO:teuthology.orchestra.run.smithi140.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-07-22T18:18:37.578 INFO:teuthology.orchestra.run.smithi140.stdout:VERSION_CODENAME=focal
2021-07-22T18:18:37.579 INFO:teuthology.orchestra.run.smithi140.stdout:UBUNTU_CODENAME=focal
2021-07-22T18:18:37.580 INFO:teuthology.lock.ops:Updating smithi140.front.sepia.ceph.com on lock server
2021-07-22T18:18:37.597 INFO:teuthology.lock.ops:Updating [smithi143.front.sepia.ceph.com]: set os type and version on server
2021-07-22T18:18:37.597 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-07-22T18:18:37.769 INFO:teuthology.orchestra.run.smithi143.stdout:x86_64
2021-07-22T18:18:37.775 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="Ubuntu"
2021-07-22T18:18:37.776 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="20.04.2 LTS (Focal Fossa)"
2021-07-22T18:18:37.776 INFO:teuthology.orchestra.run.smithi143.stdout:ID=ubuntu
2021-07-22T18:18:37.776 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE=debian
2021-07-22T18:18:37.776 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS"
2021-07-22T18:18:37.777 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="20.04"
2021-07-22T18:18:37.777 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://www.ubuntu.com/"
2021-07-22T18:18:37.777 INFO:teuthology.orchestra.run.smithi143.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-07-22T18:18:37.777 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-07-22T18:18:37.778 INFO:teuthology.orchestra.run.smithi143.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-07-22T18:18:37.778 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_CODENAME=focal
2021-07-22T18:18:37.778 INFO:teuthology.orchestra.run.smithi143.stdout:UBUNTU_CODENAME=focal
2021-07-22T18:18:37.779 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server
2021-07-22T18:18:37.859 INFO:teuthology.dispatcher.supervisor:Running job 6287301
2021-07-22T18:18:37.859 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_b6f3efab84b70e18e86ec271a07564aeb4ed3bac/virtualenv/bin/teuthology -v --owner scheduled_nojha@teuthology --archive /home/teuthworker/archive/nojha-2021-07-22_18:00:50-rados-wip-sseshasa-testing-2021-07-14-1320-distro-basic-smithi/6287301 --name nojha-2021-07-22_18:00:50-rados-wip-sseshasa-testing-2021-07-14-1320-distro-basic-smithi --description rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/snaps-few-objects} -- /home/teuthworker/archive/nojha-2021-07-22_18:00:50-rados-wip-sseshasa-testing-2021-07-14-1320-distro-basic-smithi/6287301/orig.config.yaml
2021-07-22T18:18:37.862 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/nojha-2021-07-22_18:00:50-rados-wip-sseshasa-testing-2021-07-14-1320-distro-basic-smithi/6287301
2021-07-22T18:18:37.863 INFO:teuthology.dispatcher.supervisor:Job PID: 14661
2021-07-22T18:18:37.863 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-07-23T06:19:26.442 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-07-23T06:19:26.630 INFO:teuthology.kill:Killing Pids: {14661}
2021-07-23T06:19:27.694 INFO:teuthology.kill:Nuking machines: ['smithi140', 'smithi143']
2021-07-23T06:19:28.614 INFO:teuthology.kill:2021-07-23 06:19:28,614.614 INFO:teuthology.nuke:targets:
2021-07-23T06:19:28.615 INFO:teuthology.kill:  smithi140.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCbYmeXN0i+mJr0e/OK80eYKs6qkLbXVAfNNoqBxVa83gcQSdWvo7uBdNupwh4tbFTI9aFs3KhYQOvwaZFDPqKo9BGG2h1f1yCg7zNc45aK6sO2ex6IxOWxJFaB98LALEPDNrYrSaPYoLaeSl8T5D/P4pOqmObdQvUm1xIKjs6cTxmTi0DC3PfG1sktb/fGC6ntb6iGv+zB/V4X7xrk+XTNxai28fA/Tdq/JCqXhUPxHY8YkS7QK3SQxR4FkmmGEcsET113MUYCR29vU4i4w8xEY7dpAXls7eOCz6vw3xDPBu2hXkqo/GAbdXjF0GYaiuiJH3xnXITEyRoKSLDCq1y6mMMiDytseHTAjVHRRzlSGcUsBPeNWGOvQfn8lMk78pKlphbB/04cjF7IVadRigdooJjaNvWnMaKjCWLnnjRg0StiUP9TFEBnmLu+eERVj7+pIN77Kqdnjgrdhba+BdoLNX3pM2BCyxc+8iZw5pHl/xtD/rNfrgc/spPWV3QbUU0=
2021-07-23T06:19:28.616 INFO:teuthology.kill:  smithi143.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDZBNwKY8L204Tm5+qbH7L3z7aeQKngx0zmhCTkj+sSs3A3LtO2Skii4miCPw7yQMyQcCtNen8BolBPjZ+kmc+YtqF6AwNHQymQLxhs/IA0m0w+vGyxFEEGFdgTHvvpWrWFGZf6A3U+dbjSHs7eQw91dth+5kySzIQwq8orRdy9B/Jdj7VqOh7ce+udRjA1ERdO7xRtdWZCCAQIDGe6xIhBFIzgL26iY8H1bA/0VbziMorKQqE5rdWcabAF4auRyt5vKne6SDar5ZT+jFaip9CEBjvGf8Z9D9pVwrEoMsf1ih1QJM3vQ0tutwK36sHPCZ7ckt5Dg99ceL42ge/nb8ldr3cnW0cDfpMizwCyt/p765J3wY76kYywYdJ55bVeRmDi5sduUpvPtotmurdwO/XSONABfQdzS4kfgVmG9g3/OFcQWmUBeF26rjlHlXAwA98yuspQdcn0BatR3sJaow6346E1FqmGQH6M/LLww/v17NzLOQX/S4Y6hfY91uprCdk=
2021-07-23T06:19:28.616 INFO:teuthology.kill:2021-07-23 06:19:28,615.615 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-07-23T06:19:28.617 INFO:teuthology.kill:2021-07-23 06:19:28,617.617 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-07-23T06:19:28.676 INFO:teuthology.kill:2021-07-23 06:19:28,675.675 INFO:teuthology.orchestra.console:Power off smithi140
2021-07-23T06:19:28.689 INFO:teuthology.kill:2021-07-23 06:19:28,689.689 INFO:teuthology.orchestra.console:Power off smithi143
2021-07-23T06:19:37.045 INFO:teuthology.kill:2021-07-23 06:19:37,045.045 INFO:teuthology.orchestra.console:Power off for smithi140 completed
2021-07-23T06:19:41.160 INFO:teuthology.kill:2021-07-23 06:19:41,159.159 INFO:teuthology.orchestra.console:Power off for smithi143 completed
2021-07-23T06:19:41.399 INFO:teuthology.task.internal:roles: ubuntu@smithi140.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mon.d', 'mon.e', 'osd.0', 'osd.1', 'osd.2']
2021-07-23T06:19:41.400 INFO:teuthology.task.internal:roles: ubuntu@smithi143.front.sepia.ceph.com - ['mon.f', 'mon.g', 'mon.h', 'mon.i', 'mgr.x', 'osd.3', 'osd.4', 'osd.5', 'client.0']
2021-07-23T06:19:41.400 INFO:teuthology.misc:Compressing logs...
2021-07-23T06:19:41.401 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-07-23T06:19:59.822 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b6f3efab84b70e18e86ec271a07564aeb4ed3bac/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b6f3efab84b70e18e86ec271a07564aeb4ed3bac/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b6f3efab84b70e18e86ec271a07564aeb4ed3bac/teuthology/misc.py", line 1378, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b6f3efab84b70e18e86ec271a07564aeb4ed3bac/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b6f3efab84b70e18e86ec271a07564aeb4ed3bac/teuthology/orchestra/cluster.py", line 64, in <listcomp>
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b6f3efab84b70e18e86ec271a07564aeb4ed3bac/teuthology/orchestra/remote.py", line 509, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b6f3efab84b70e18e86ec271a07564aeb4ed3bac/teuthology/orchestra/run.py", line 434, in run
    transport = client.get_transport()
AttributeError: 'NoneType' object has no attribute 'get_transport'
2021-07-23T06:19:59.873 INFO:teuthology.kill:No teuthology processes running
2021-07-23T06:20:00.885 INFO:teuthology.kill:Nuking machines: ['smithi140', 'smithi143']
2021-07-23T06:20:01.741 INFO:teuthology.kill:2021-07-23 06:20:01,740.740 INFO:teuthology.nuke:targets:
2021-07-23T06:20:01.742 INFO:teuthology.kill:  smithi140.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCbYmeXN0i+mJr0e/OK80eYKs6qkLbXVAfNNoqBxVa83gcQSdWvo7uBdNupwh4tbFTI9aFs3KhYQOvwaZFDPqKo9BGG2h1f1yCg7zNc45aK6sO2ex6IxOWxJFaB98LALEPDNrYrSaPYoLaeSl8T5D/P4pOqmObdQvUm1xIKjs6cTxmTi0DC3PfG1sktb/fGC6ntb6iGv+zB/V4X7xrk+XTNxai28fA/Tdq/JCqXhUPxHY8YkS7QK3SQxR4FkmmGEcsET113MUYCR29vU4i4w8xEY7dpAXls7eOCz6vw3xDPBu2hXkqo/GAbdXjF0GYaiuiJH3xnXITEyRoKSLDCq1y6mMMiDytseHTAjVHRRzlSGcUsBPeNWGOvQfn8lMk78pKlphbB/04cjF7IVadRigdooJjaNvWnMaKjCWLnnjRg0StiUP9TFEBnmLu+eERVj7+pIN77Kqdnjgrdhba+BdoLNX3pM2BCyxc+8iZw5pHl/xtD/rNfrgc/spPWV3QbUU0=
2021-07-23T06:20:01.742 INFO:teuthology.kill:  smithi143.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDZBNwKY8L204Tm5+qbH7L3z7aeQKngx0zmhCTkj+sSs3A3LtO2Skii4miCPw7yQMyQcCtNen8BolBPjZ+kmc+YtqF6AwNHQymQLxhs/IA0m0w+vGyxFEEGFdgTHvvpWrWFGZf6A3U+dbjSHs7eQw91dth+5kySzIQwq8orRdy9B/Jdj7VqOh7ce+udRjA1ERdO7xRtdWZCCAQIDGe6xIhBFIzgL26iY8H1bA/0VbziMorKQqE5rdWcabAF4auRyt5vKne6SDar5ZT+jFaip9CEBjvGf8Z9D9pVwrEoMsf1ih1QJM3vQ0tutwK36sHPCZ7ckt5Dg99ceL42ge/nb8ldr3cnW0cDfpMizwCyt/p765J3wY76kYywYdJ55bVeRmDi5sduUpvPtotmurdwO/XSONABfQdzS4kfgVmG9g3/OFcQWmUBeF26rjlHlXAwA98yuspQdcn0BatR3sJaow6346E1FqmGQH6M/LLww/v17NzLOQX/S4Y6hfY91uprCdk=
2021-07-23T06:20:01.761 INFO:teuthology.kill:2021-07-23 06:20:01,760.760 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-07-23T06:20:01.763 INFO:teuthology.kill:2021-07-23 06:20:01,763.763 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-07-23T06:20:01.817 INFO:teuthology.kill:2021-07-23 06:20:01,817.817 INFO:teuthology.orchestra.console:Power off smithi143
2021-07-23T06:20:01.829 INFO:teuthology.kill:2021-07-23 06:20:01,828.828 INFO:teuthology.orchestra.console:Power off smithi140
2021-07-23T06:20:01.958 INFO:teuthology.kill:2021-07-23 06:20:01,958.958 INFO:teuthology.orchestra.console:Power off for smithi143 completed
2021-07-23T06:20:01.970 INFO:teuthology.kill:2021-07-23 06:20:01,970.970 INFO:teuthology.orchestra.console:Power off for smithi140 completed
2021-07-23T06:20:02.105 INFO:teuthology.kill:2021-07-23 06:20:02,105.105 ERROR:teuthology.lock.ops:failed to unlock smithi140.front.sepia.ceph.com. reason: 500
2021-07-23T06:20:02.126 INFO:teuthology.kill:2021-07-23 06:20:02,125.125 INFO:teuthology.lock.ops:unlocked smithi143.front.sepia.ceph.com
2021-07-23T06:22:02.394 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-07-23T06:22:02.478 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2021-07-23T06:22:02.478 INFO:teuthology.nuke:Checking targets against current locks
2021-07-23T06:22:02.548 INFO:teuthology.nuke:Not nuking smithi143.front.sepia.ceph.com because description doesn't match
2021-07-23T06:22:02.564 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-07-23T06:22:02.619 INFO:teuthology.orchestra.console:Power off smithi140
2021-07-23T06:22:02.761 INFO:teuthology.orchestra.console:Power off for smithi140 completed
2021-07-23T06:22:02.905 INFO:teuthology.lock.ops:unlocked smithi140.front.sepia.ceph.com