2021-08-24T04:58:33.875 INFO:root:teuthology version: 1.1.0-321319b1 2021-08-24T04:58:33.999 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi170.front.sepia.ceph.com' reimaging 2021-08-24T04:58:34.000 INFO:teuthology.lock.ops:Updating [ubuntu@smithi170.front.sepia.ceph.com]: reset os type and version on server 2021-08-24T04:58:34.000 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2021-08-24T04:58:34.019 INFO:teuthology.lock.ops:Node 'ubuntu@smithi170.front.sepia.ceph.com' reimaging is complete 2021-08-24T04:58:34.020 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi176.front.sepia.ceph.com' reimaging 2021-08-24T04:58:34.020 INFO:teuthology.lock.ops:Updating [ubuntu@smithi176.front.sepia.ceph.com]: reset os type and version on server 2021-08-24T04:58:34.021 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server 2021-08-24T04:58:34.037 INFO:teuthology.lock.ops:Node 'ubuntu@smithi176.front.sepia.ceph.com' reimaging is complete 2021-08-24T04:58:34.224 INFO:teuthology.provision.fog.smithi170:Scheduling deploy of ubuntu 20.04 2021-08-24T04:58:34.232 INFO:teuthology.provision.fog.smithi176:Scheduling deploy of ubuntu 20.04 2021-08-24T04:58:34.569 INFO:teuthology.orchestra.console:Power off smithi170 2021-08-24T04:58:34.605 INFO:teuthology.orchestra.console:Power off smithi176 2021-08-24T04:58:47.056 INFO:teuthology.orchestra.console:Power off for smithi170 completed 2021-08-24T04:58:47.077 INFO:teuthology.orchestra.console:Power off for smithi176 completed 2021-08-24T04:58:47.158 INFO:teuthology.orchestra.console:Power on smithi170 2021-08-24T04:58:47.183 INFO:teuthology.orchestra.console:Power on smithi176 2021-08-24T04:58:51.407 INFO:teuthology.orchestra.console:Power on for smithi170 completed 2021-08-24T04:58:51.509 INFO:teuthology.provision.fog.smithi170:Waiting for deploy to finish 2021-08-24T04:58:55.544 INFO:teuthology.orchestra.console:Power on for smithi176 completed 2021-08-24T04:58:55.645 INFO:teuthology.provision.fog.smithi176:Waiting for deploy to finish 2021-08-24T05:03:44.518 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-08-24T05:03:44.965 INFO:teuthology.provision.fog.smithi170:Node is ready 2021-08-24T05:03:44.972 INFO:teuthology.orchestra.run.smithi170.stdout:smithi170.front.sepia.ceph.com 2021-08-24T05:03:44.979 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170 smithi170.front.sepia.ceph.com smithi170 2021-08-24T05:03:45.092 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-08-24T05:03:45.256 INFO:teuthology.provision.fog.smithi170:Deploy complete! 2021-08-24T05:03:45.583 INFO:teuthology.provision.fog.smithi176:Node is ready 2021-08-24T05:03:45.630 INFO:teuthology.orchestra.run.smithi176.stdout:smithi176.front.sepia.ceph.com 2021-08-24T05:03:45.637 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.15.176 smithi176.front.sepia.ceph.com smithi176 2021-08-24T05:03:45.794 INFO:teuthology.provision.fog.smithi176:Deploy complete! 2021-08-24T05:03:45.965 INFO:teuthology.lock.ops:Checking smithi170.front.sepia.ceph.com 2021-08-24T05:03:45.966 INFO:teuthology.lock.ops:New key found. Updating... 2021-08-24T05:03:45.984 INFO:teuthology.lock.ops:Checking smithi176.front.sepia.ceph.com 2021-08-24T05:03:45.985 INFO:teuthology.lock.ops:New key found. Updating... 2021-08-24T05:03:45.999 INFO:teuthology.lock.ops:Updating [smithi170.front.sepia.ceph.com]: set os type and version on server 2021-08-24T05:03:46.000 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-08-24T05:03:46.169 INFO:teuthology.orchestra.run.smithi170.stdout:x86_64 2021-08-24T05:03:46.175 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="Ubuntu" 2021-08-24T05:03:46.176 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="20.04.2 LTS (Focal Fossa)" 2021-08-24T05:03:46.176 INFO:teuthology.orchestra.run.smithi170.stdout:ID=ubuntu 2021-08-24T05:03:46.176 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE=debian 2021-08-24T05:03:46.177 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS" 2021-08-24T05:03:46.177 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="20.04" 2021-08-24T05:03:46.177 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://www.ubuntu.com/" 2021-08-24T05:03:46.177 INFO:teuthology.orchestra.run.smithi170.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-08-24T05:03:46.178 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-08-24T05:03:46.178 INFO:teuthology.orchestra.run.smithi170.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-08-24T05:03:46.178 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_CODENAME=focal 2021-08-24T05:03:46.178 INFO:teuthology.orchestra.run.smithi170.stdout:UBUNTU_CODENAME=focal 2021-08-24T05:03:46.179 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2021-08-24T05:03:46.194 INFO:teuthology.lock.ops:Updating [smithi176.front.sepia.ceph.com]: set os type and version on server 2021-08-24T05:03:46.195 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-08-24T05:03:46.366 INFO:teuthology.orchestra.run.smithi176.stdout:x86_64 2021-08-24T05:03:46.418 INFO:teuthology.orchestra.run.smithi176.stdout:NAME="Ubuntu" 2021-08-24T05:03:46.418 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION="20.04.2 LTS (Focal Fossa)" 2021-08-24T05:03:46.418 INFO:teuthology.orchestra.run.smithi176.stdout:ID=ubuntu 2021-08-24T05:03:46.419 INFO:teuthology.orchestra.run.smithi176.stdout:ID_LIKE=debian 2021-08-24T05:03:46.419 INFO:teuthology.orchestra.run.smithi176.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS" 2021-08-24T05:03:46.419 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_ID="20.04" 2021-08-24T05:03:46.419 INFO:teuthology.orchestra.run.smithi176.stdout:HOME_URL="https://www.ubuntu.com/" 2021-08-24T05:03:46.420 INFO:teuthology.orchestra.run.smithi176.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-08-24T05:03:46.420 INFO:teuthology.orchestra.run.smithi176.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-08-24T05:03:46.420 INFO:teuthology.orchestra.run.smithi176.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-08-24T05:03:46.420 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_CODENAME=focal 2021-08-24T05:03:46.420 INFO:teuthology.orchestra.run.smithi176.stdout:UBUNTU_CODENAME=focal 2021-08-24T05:03:46.421 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server 2021-08-24T05:03:46.498 INFO:teuthology.dispatcher.supervisor:Running job 6354118 2021-08-24T05:03:46.498 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_321319b12ea4ff9b63c7655015a3156de2c3b279/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2021-08-23_19:24:05-rados-wip-yuri4-testing-2021-08-23-0812-pacific-distro-basic-smithi/6354118 --name yuriw-2021-08-23_19:24:05-rados-wip-yuri4-testing-2021-08-23-0812-pacific-distro-basic-smithi --description rados/singleton/{all/thrash-eio mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} -- /home/teuthworker/archive/yuriw-2021-08-23_19:24:05-rados-wip-yuri4-testing-2021-08-23-0812-pacific-distro-basic-smithi/6354118/orig.config.yaml 2021-08-24T05:03:46.501 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2021-08-23_19:24:05-rados-wip-yuri4-testing-2021-08-23-0812-pacific-distro-basic-smithi/6354118 2021-08-24T05:03:46.502 INFO:teuthology.dispatcher.supervisor:Job PID: 9080 2021-08-24T05:03:46.502 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-08-24T17:04:38.119 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-08-24T17:04:38.321 INFO:teuthology.kill:Killing Pids: {9080} 2021-08-24T17:04:39.574 INFO:teuthology.kill:Nuking machines: ['smithi170', 'smithi176'] 2021-08-24T17:04:40.614 INFO:teuthology.kill:2021-08-24 17:04:40,613.613 INFO:teuthology.nuke:targets: 2021-08-24T17:04:40.615 INFO:teuthology.kill: smithi170.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDn/17WrJVHMgiPYLQM/QAI4qf3kiW/EXt/VlKmyHDRE1M9KcNxsvFRCpwp4cTJPY6gF2tTfo9PnqbUj45n5X9eiq3RhncKgpKx3/qJRKq/wVrD3hccXVh0so73iETbFAsAt6cZ5V/yu4vHcdVS2R6BRmonragjzfiuViv3IlE9/CwXdHEDGnNc8fG2LfiAOuNhwgr/JEEOnsFqhDMQlHZDm57UBKx1xYQTVK+R4Rd2c6Csprgaw0XisnIe2L0o30EkOpfnJugGYqOdBdBJQl4sOgth49HvnEIsHb3+GiGGcTMXZyGW0WUx2K8qLi7Qay8wfXwAN+GVtamWjhiDlSlfyR5Ibr62O/XT1C7awD67lgduLMbakyM36tOSFmKe+ncl9ZBtxusP5RR4DkVan8IxRvk2e/Yvvw829lt7OVqAcGBfvyduVeDYxc/0e4Pfc+Y3poS/696/Nk0wCTViEm+f+tUPM0MbLEC/YWph0N7YxemKweX4cLC/lryTJ4bKBtk= 2021-08-24T17:04:40.615 INFO:teuthology.kill: smithi176.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDPTmVU7AARfmLsoncgZp7jLzYEYrmyfiSe3DD4jHVi3Jq8pkgmkTR+CCXCEDEnpEs97fdeAMvJY/rpWYfvKzNBDDeEgIgLOV1ToSuDMziL/BUUbDqaEzE9tzowqG3zyapRyrl7punP8N66MtEogQEvZqQFZ38re3TZx/QbjhJbpZo2MO/m6Jb+X0KAOcd/yw7VaTuRxKBdLnl+mqZY0CsxzabCFo+Rtm7q0H7UdnPU4HHDmJFYgnig7aEwGg4nWKxgltxZFInRtR4uR0sYhracnzeaXwmB7AiNX32Lvsd8WgI5Kfui/xAt5Inp1J0Ae/S1M0/2mc64WUhC3fhbuoLBfLZ5ZwAnBH192hrc6Bi2nP3jFG+bTlvsQZfZB1JDNRKo4l3hRY3wmCAyRrTPIh1GNE0c/poF5oE8ut1FY4H4p01jqlusNR4HgB/3JsAjpNeltocj2aEl9269f593TYkm8GW7Qu+dXNSt7xHjSgl31RSKnw2BOTkkClSMe/60JBE= 2021-08-24T17:04:40.615 INFO:teuthology.kill:2021-08-24 17:04:40,614.614 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-08-24T17:04:40.616 INFO:teuthology.kill:2021-08-24 17:04:40,616.616 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-08-24T17:04:40.681 INFO:teuthology.kill:2021-08-24 17:04:40,681.681 INFO:teuthology.orchestra.console:Power off smithi170 2021-08-24T17:04:40.696 INFO:teuthology.kill:2021-08-24 17:04:40,696.696 INFO:teuthology.orchestra.console:Power off smithi176 2021-08-24T17:04:49.057 INFO:teuthology.kill:2021-08-24 17:04:49,056.056 INFO:teuthology.orchestra.console:Power off for smithi170 completed 2021-08-24T17:04:53.174 INFO:teuthology.kill:2021-08-24 17:04:53,172.172 INFO:teuthology.orchestra.console:Power off for smithi176 completed 2021-08-24T17:04:53.409 INFO:teuthology.task.internal:roles: ubuntu@smithi170.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2'] 2021-08-24T17:04:53.410 INFO:teuthology.task.internal:roles: ubuntu@smithi176.front.sepia.ceph.com - ['osd.3', 'osd.4', 'osd.5', 'client.0'] 2021-08-24T17:04:53.410 INFO:teuthology.misc:Compressing logs... 2021-08-24T17:04:53.411 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-08-24T17:05:53.471 ERROR:teuthology.dispatcher.supervisor:Could not save logs Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_321319b12ea4ff9b63c7655015a3156de2c3b279/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog teuth_config.archive_base, job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_321319b12ea4ff9b63c7655015a3156de2c3b279/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives compress_logs(ctx, log_path) File "/home/teuthworker/src/git.ceph.com_git_teuthology_321319b12ea4ff9b63c7655015a3156de2c3b279/teuthology/misc.py", line 1378, in compress_logs wait=False, File "/home/teuthworker/src/git.ceph.com_git_teuthology_321319b12ea4ff9b63c7655015a3156de2c3b279/teuthology/orchestra/cluster.py", line 64, in run return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_321319b12ea4ff9b63c7655015a3156de2c3b279/teuthology/orchestra/cluster.py", line 64, in return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_321319b12ea4ff9b63c7655015a3156de2c3b279/teuthology/orchestra/remote.py", line 509, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_321319b12ea4ff9b63c7655015a3156de2c3b279/teuthology/orchestra/run.py", line 434, in run transport = client.get_transport() AttributeError: 'NoneType' object has no attribute 'get_transport' 2021-08-24T17:05:53.530 INFO:teuthology.kill:No teuthology processes running 2021-08-24T17:05:54.692 INFO:teuthology.kill:Nuking machines: ['smithi170', 'smithi176'] 2021-08-24T17:05:55.740 INFO:teuthology.kill:2021-08-24 17:05:55,740.740 INFO:teuthology.nuke:targets: 2021-08-24T17:05:55.741 INFO:teuthology.kill: smithi170.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDn/17WrJVHMgiPYLQM/QAI4qf3kiW/EXt/VlKmyHDRE1M9KcNxsvFRCpwp4cTJPY6gF2tTfo9PnqbUj45n5X9eiq3RhncKgpKx3/qJRKq/wVrD3hccXVh0so73iETbFAsAt6cZ5V/yu4vHcdVS2R6BRmonragjzfiuViv3IlE9/CwXdHEDGnNc8fG2LfiAOuNhwgr/JEEOnsFqhDMQlHZDm57UBKx1xYQTVK+R4Rd2c6Csprgaw0XisnIe2L0o30EkOpfnJugGYqOdBdBJQl4sOgth49HvnEIsHb3+GiGGcTMXZyGW0WUx2K8qLi7Qay8wfXwAN+GVtamWjhiDlSlfyR5Ibr62O/XT1C7awD67lgduLMbakyM36tOSFmKe+ncl9ZBtxusP5RR4DkVan8IxRvk2e/Yvvw829lt7OVqAcGBfvyduVeDYxc/0e4Pfc+Y3poS/696/Nk0wCTViEm+f+tUPM0MbLEC/YWph0N7YxemKweX4cLC/lryTJ4bKBtk= 2021-08-24T17:05:55.742 INFO:teuthology.kill: smithi176.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDPTmVU7AARfmLsoncgZp7jLzYEYrmyfiSe3DD4jHVi3Jq8pkgmkTR+CCXCEDEnpEs97fdeAMvJY/rpWYfvKzNBDDeEgIgLOV1ToSuDMziL/BUUbDqaEzE9tzowqG3zyapRyrl7punP8N66MtEogQEvZqQFZ38re3TZx/QbjhJbpZo2MO/m6Jb+X0KAOcd/yw7VaTuRxKBdLnl+mqZY0CsxzabCFo+Rtm7q0H7UdnPU4HHDmJFYgnig7aEwGg4nWKxgltxZFInRtR4uR0sYhracnzeaXwmB7AiNX32Lvsd8WgI5Kfui/xAt5Inp1J0Ae/S1M0/2mc64WUhC3fhbuoLBfLZ5ZwAnBH192hrc6Bi2nP3jFG+bTlvsQZfZB1JDNRKo4l3hRY3wmCAyRrTPIh1GNE0c/poF5oE8ut1FY4H4p01jqlusNR4HgB/3JsAjpNeltocj2aEl9269f593TYkm8GW7Qu+dXNSt7xHjSgl31RSKnw2BOTkkClSMe/60JBE= 2021-08-24T17:05:55.762 INFO:teuthology.kill:2021-08-24 17:05:55,762.762 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-08-24T17:05:55.766 INFO:teuthology.kill:2021-08-24 17:05:55,765.765 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-08-24T17:05:55.830 INFO:teuthology.kill:2021-08-24 17:05:55,830.830 INFO:teuthology.orchestra.console:Power off smithi170 2021-08-24T17:05:55.849 INFO:teuthology.kill:2021-08-24 17:05:55,846.846 INFO:teuthology.orchestra.console:Power off smithi176 2021-08-24T17:05:55.986 INFO:teuthology.kill:2021-08-24 17:05:55,985.985 INFO:teuthology.orchestra.console:Power off for smithi170 completed 2021-08-24T17:05:55.993 INFO:teuthology.kill:2021-08-24 17:05:55,993.993 INFO:teuthology.orchestra.console:Power off for smithi176 completed 2021-08-24T17:05:56.130 INFO:teuthology.kill:2021-08-24 17:05:56,129.129 INFO:teuthology.lock.ops:unlocked smithi170.front.sepia.ceph.com 2021-08-24T17:05:56.134 INFO:teuthology.kill:2021-08-24 17:05:56,134.134 ERROR:teuthology.lock.ops:failed to unlock smithi176.front.sepia.ceph.com. reason: 500 2021-08-24T17:07:56.476 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-08-24T17:07:56.564 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2021-08-24T17:07:56.565 INFO:teuthology.nuke:Checking targets against current locks 2021-08-24T17:07:56.662 INFO:teuthology.nuke:Not nuking smithi170.front.sepia.ceph.com because description doesn't match 2021-08-24T17:07:56.687 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-08-24T17:07:56.751 INFO:teuthology.orchestra.console:Power off smithi176 2021-08-24T17:07:56.909 INFO:teuthology.orchestra.console:Power off for smithi176 completed 2021-08-24T17:07:57.054 INFO:teuthology.lock.ops:unlocked smithi176.front.sepia.ceph.com