2021-05-25T17:16:54.809 INFO:root:teuthology version: 1.1.0-0c70841a
2021-05-25T17:16:54.897 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi002.front.sepia.ceph.com' reimaging
2021-05-25T17:16:54.898 INFO:teuthology.lock.ops:Updating [ubuntu@smithi002.front.sepia.ceph.com]: reset os type and version on server
2021-05-25T17:16:54.899 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server
2021-05-25T17:16:54.915 INFO:teuthology.lock.ops:Node 'ubuntu@smithi002.front.sepia.ceph.com' reimaging is complete
2021-05-25T17:16:54.916 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi143.front.sepia.ceph.com' reimaging
2021-05-25T17:16:54.917 INFO:teuthology.lock.ops:Updating [ubuntu@smithi143.front.sepia.ceph.com]: reset os type and version on server
2021-05-25T17:16:54.917 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server
2021-05-25T17:16:54.933 INFO:teuthology.lock.ops:Node 'ubuntu@smithi143.front.sepia.ceph.com' reimaging is complete
2021-05-25T17:16:55.118 INFO:teuthology.provision.fog.smithi002:Scheduling deploy of ubuntu 20.04
2021-05-25T17:16:55.132 INFO:teuthology.provision.fog.smithi143:Scheduling deploy of ubuntu 20.04
2021-05-25T17:16:55.444 INFO:teuthology.orchestra.console:Power off smithi002
2021-05-25T17:16:55.458 INFO:teuthology.orchestra.console:Power off smithi143
2021-05-25T17:17:03.813 INFO:teuthology.orchestra.console:Power off for smithi002 completed
2021-05-25T17:17:03.914 INFO:teuthology.orchestra.console:Power on smithi002
2021-05-25T17:17:07.930 INFO:teuthology.orchestra.console:Power off for smithi143 completed
2021-05-25T17:17:08.031 INFO:teuthology.orchestra.console:Power on smithi143
2021-05-25T17:17:12.273 INFO:teuthology.orchestra.console:Power on for smithi002 completed
2021-05-25T17:17:12.280 INFO:teuthology.orchestra.console:Power on for smithi143 completed
2021-05-25T17:17:12.374 INFO:teuthology.provision.fog.smithi002:Waiting for deploy to finish
2021-05-25T17:17:12.380 INFO:teuthology.provision.fog.smithi143:Waiting for deploy to finish
2021-05-25T17:21:29.941 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-05-25T17:21:30.408 INFO:teuthology.provision.fog.smithi002:Node is ready
2021-05-25T17:21:30.415 INFO:teuthology.orchestra.run.smithi002.stdout:smithi002.front.sepia.ceph.com
2021-05-25T17:21:30.422 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2 smithi002.front.sepia.ceph.com smithi002
2021-05-25T17:21:30.642 INFO:teuthology.provision.fog.smithi002:Deploy complete!
2021-05-25T17:22:15.816 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-05-25T17:22:16.235 INFO:teuthology.provision.fog.smithi143:Node is ready
2021-05-25T17:22:16.242 INFO:teuthology.orchestra.run.smithi143.stdout:smithi143.front.sepia.ceph.com
2021-05-25T17:22:16.290 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.15.143 smithi143.front.sepia.ceph.com smithi143
2021-05-25T17:22:16.510 INFO:teuthology.provision.fog.smithi143:Deploy complete!
2021-05-25T17:22:16.655 INFO:teuthology.lock.ops:Checking smithi002.front.sepia.ceph.com
2021-05-25T17:22:16.656 INFO:teuthology.lock.ops:New key found. Updating...
2021-05-25T17:22:16.671 INFO:teuthology.lock.ops:Checking smithi143.front.sepia.ceph.com
2021-05-25T17:22:16.672 INFO:teuthology.lock.ops:New key found. Updating...
2021-05-25T17:22:16.685 INFO:teuthology.lock.ops:Updating [smithi002.front.sepia.ceph.com]: set os type and version on server
2021-05-25T17:22:16.685 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-05-25T17:22:16.949 INFO:teuthology.orchestra.run.smithi002.stdout:x86_64
2021-05-25T17:22:16.956 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="Ubuntu"
2021-05-25T17:22:16.956 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="20.04.2 LTS (Focal Fossa)"
2021-05-25T17:22:16.956 INFO:teuthology.orchestra.run.smithi002.stdout:ID=ubuntu
2021-05-25T17:22:16.957 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE=debian
2021-05-25T17:22:16.957 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS"
2021-05-25T17:22:16.957 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="20.04"
2021-05-25T17:22:16.957 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://www.ubuntu.com/"
2021-05-25T17:22:16.957 INFO:teuthology.orchestra.run.smithi002.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-05-25T17:22:16.958 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-05-25T17:22:16.958 INFO:teuthology.orchestra.run.smithi002.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-05-25T17:22:16.958 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_CODENAME=focal
2021-05-25T17:22:16.958 INFO:teuthology.orchestra.run.smithi002.stdout:UBUNTU_CODENAME=focal
2021-05-25T17:22:16.959 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server
2021-05-25T17:22:16.974 INFO:teuthology.lock.ops:Updating [smithi143.front.sepia.ceph.com]: set os type and version on server
2021-05-25T17:22:16.974 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-05-25T17:22:17.138 INFO:teuthology.orchestra.run.smithi143.stdout:x86_64
2021-05-25T17:22:17.144 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="Ubuntu"
2021-05-25T17:22:17.144 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="20.04.2 LTS (Focal Fossa)"
2021-05-25T17:22:17.144 INFO:teuthology.orchestra.run.smithi143.stdout:ID=ubuntu
2021-05-25T17:22:17.144 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE=debian
2021-05-25T17:22:17.144 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS"
2021-05-25T17:22:17.145 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="20.04"
2021-05-25T17:22:17.145 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://www.ubuntu.com/"
2021-05-25T17:22:17.145 INFO:teuthology.orchestra.run.smithi143.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-05-25T17:22:17.145 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-05-25T17:22:17.145 INFO:teuthology.orchestra.run.smithi143.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-05-25T17:22:17.146 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_CODENAME=focal
2021-05-25T17:22:17.146 INFO:teuthology.orchestra.run.smithi143.stdout:UBUNTU_CODENAME=focal
2021-05-25T17:22:17.146 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server
2021-05-25T17:22:17.214 INFO:teuthology.dispatcher.supervisor:Running job 6134140
2021-05-25T17:22:17.214 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_0c70841acf4fb31ca05cdbebbd295620aac53ce4/virtualenv/bin/teuthology -v --owner scheduled_khiremat@teuthology --archive /home/teuthworker/archive/khiremat-2021-05-25_17:01:51-fs-wip-khiremat-39910-mgr-hang-osd-full-testing-41-distro-basic-smithi/6134140 --name khiremat-2021-05-25_17:01:51-fs-wip-khiremat-39910-mgr-hang-osd-full-testing-41-distro-basic-smithi --description fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mds-full} -- /home/teuthworker/archive/khiremat-2021-05-25_17:01:51-fs-wip-khiremat-39910-mgr-hang-osd-full-testing-41-distro-basic-smithi/6134140/orig.config.yaml
2021-05-25T17:22:17.218 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/khiremat-2021-05-25_17:01:51-fs-wip-khiremat-39910-mgr-hang-osd-full-testing-41-distro-basic-smithi/6134140
2021-05-25T17:22:17.219 INFO:teuthology.dispatcher.supervisor:Job PID: 4043
2021-05-25T17:22:17.219 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-05-26T05:23:05.975 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-05-26T05:23:06.241 INFO:teuthology.kill:Killing Pids: {4043}
2021-05-26T05:23:07.336 INFO:teuthology.kill:Nuking machines: ['smithi002', 'smithi143']
2021-05-26T05:23:08.293 INFO:teuthology.kill:2021-05-26 05:23:08,292.292 INFO:teuthology.nuke:targets:
2021-05-26T05:23:08.294 INFO:teuthology.kill:  smithi002.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCo0lbwup9V72gaWejavCavYwIti3FwckIPZ2QE60twRPBT6nWWu1SPcJFqDw7qUfz16+xfZAE1bz7RIVFLfVTKhRpOKnQJh0RgIAGitgJBqbcSW0Ex4SfUS39bwq1LKBogEkX/sJO/J25H6DPGr0dXcgT9C61FtnEKvZUB9VR15mOVJlDAGon7QIR7zacUa4j7sHkTYzHTUA4t50/d5Is2eDmJcZva7ndoC8DHUHF/hfALAQ7g76Pvbm0QNQ+UJ6jHg9vTI4pRnVGsqCoRZgsiIyjgCEYaC+m0ZhOsxvQhO1tH8ipfyxJwV4xIIve3zfHkojce2n+WQiKeHPyMs1PGXFw6mQF3Hi3PosqJqwycoyvkCy6/e8GRvNwVL9YdMm3fwXeDl+aItTVVY4mUHJzg6z3t0LlD4j095CatwnQL7gCv7cFazz52XjKuUKwdcxkBakjIDyVOqHaM6RxlpaqFAOXG26UbahSIXeJ476sENlRGT69Yfa/9fTEpF7gY+0k=
2021-05-26T05:23:08.294 INFO:teuthology.kill:  smithi143.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDXCbYhHWtfjeFL+ii+ffXXa+dNvlDJsCF0pya9POQyUeQYJ3F3WtRJQQoyejgAT/4+RfsNOdyHqQHnFzmsBjo04KreELvbMNeLqYFg8MduPTwhOFvrKTT9HKPFf3GVaNCnbCP3NsWmSu70PQZ6eEg3U9xqecLLJqEYVdsRcN7+u/J3kNG46N0oXb34xBGLoYKHZbb/qfuodN26avBehJn8kTHgzqzQlfrQDuna03I+LFw4gdjHeQaIVku3mAmc2TdqAewRJSU6+1TYlxrKXMeY+TWTIG1NCsEncTWgk4c4rb1tAHuhMSq4PEwZ8sEHmeOX8ZBI8hZQJOtfUyNVrY+rn5lEE9I+8YgWBL8N6Zxk7ckfVp7g5QNmwaOWhG5y0ApBCUPWFMuxgnm4TzLL8KQlJRvUlP23rp1J3DFQWJgOjgRrjL86jJDzxx0ewLoehHiVLqADdHxEjzqcykEzq21gTgwcwOoZ8tll0uO+aGCeSGNf2TIpu5B7vSbrcIk8WJk=
2021-05-26T05:23:08.295 INFO:teuthology.kill:2021-05-26 05:23:08,293.293 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-05-26T05:23:08.295 INFO:teuthology.kill:2021-05-26 05:23:08,295.295 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-05-26T05:23:08.353 INFO:teuthology.kill:2021-05-26 05:23:08,352.352 INFO:teuthology.orchestra.console:Power off smithi143
2021-05-26T05:23:08.365 INFO:teuthology.kill:2021-05-26 05:23:08,365.365 INFO:teuthology.orchestra.console:Power off smithi002
2021-05-26T05:23:16.721 INFO:teuthology.kill:2021-05-26 05:23:16,721.721 INFO:teuthology.orchestra.console:Power off for smithi143 completed
2021-05-26T05:23:20.841 INFO:teuthology.kill:2021-05-26 05:23:20,841.841 INFO:teuthology.orchestra.console:Power off for smithi002 completed
2021-05-26T05:23:21.102 INFO:teuthology.task.internal:roles: ubuntu@smithi002.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2']
2021-05-26T05:23:21.103 INFO:teuthology.task.internal:roles: ubuntu@smithi143.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']
2021-05-26T05:23:21.103 INFO:teuthology.misc:Compressing logs...
2021-05-26T05:23:21.104 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-05-26T05:24:21.167 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_0c70841acf4fb31ca05cdbebbd295620aac53ce4/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_0c70841acf4fb31ca05cdbebbd295620aac53ce4/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_0c70841acf4fb31ca05cdbebbd295620aac53ce4/teuthology/misc.py", line 1378, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_0c70841acf4fb31ca05cdbebbd295620aac53ce4/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_0c70841acf4fb31ca05cdbebbd295620aac53ce4/teuthology/orchestra/cluster.py", line 64, in <listcomp>
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_0c70841acf4fb31ca05cdbebbd295620aac53ce4/teuthology/orchestra/remote.py", line 509, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_0c70841acf4fb31ca05cdbebbd295620aac53ce4/teuthology/orchestra/run.py", line 434, in run
    transport = client.get_transport()
AttributeError: 'NoneType' object has no attribute 'get_transport'
2021-05-26T05:24:21.240 INFO:teuthology.kill:No teuthology processes running
2021-05-26T05:24:22.304 INFO:teuthology.kill:Nuking machines: ['smithi002', 'smithi143']
2021-05-26T05:24:23.286 INFO:teuthology.kill:2021-05-26 05:24:23,285.285 INFO:teuthology.nuke:targets:
2021-05-26T05:24:23.287 INFO:teuthology.kill:  smithi002.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCo0lbwup9V72gaWejavCavYwIti3FwckIPZ2QE60twRPBT6nWWu1SPcJFqDw7qUfz16+xfZAE1bz7RIVFLfVTKhRpOKnQJh0RgIAGitgJBqbcSW0Ex4SfUS39bwq1LKBogEkX/sJO/J25H6DPGr0dXcgT9C61FtnEKvZUB9VR15mOVJlDAGon7QIR7zacUa4j7sHkTYzHTUA4t50/d5Is2eDmJcZva7ndoC8DHUHF/hfALAQ7g76Pvbm0QNQ+UJ6jHg9vTI4pRnVGsqCoRZgsiIyjgCEYaC+m0ZhOsxvQhO1tH8ipfyxJwV4xIIve3zfHkojce2n+WQiKeHPyMs1PGXFw6mQF3Hi3PosqJqwycoyvkCy6/e8GRvNwVL9YdMm3fwXeDl+aItTVVY4mUHJzg6z3t0LlD4j095CatwnQL7gCv7cFazz52XjKuUKwdcxkBakjIDyVOqHaM6RxlpaqFAOXG26UbahSIXeJ476sENlRGT69Yfa/9fTEpF7gY+0k=
2021-05-26T05:24:23.287 INFO:teuthology.kill:  smithi143.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDXCbYhHWtfjeFL+ii+ffXXa+dNvlDJsCF0pya9POQyUeQYJ3F3WtRJQQoyejgAT/4+RfsNOdyHqQHnFzmsBjo04KreELvbMNeLqYFg8MduPTwhOFvrKTT9HKPFf3GVaNCnbCP3NsWmSu70PQZ6eEg3U9xqecLLJqEYVdsRcN7+u/J3kNG46N0oXb34xBGLoYKHZbb/qfuodN26avBehJn8kTHgzqzQlfrQDuna03I+LFw4gdjHeQaIVku3mAmc2TdqAewRJSU6+1TYlxrKXMeY+TWTIG1NCsEncTWgk4c4rb1tAHuhMSq4PEwZ8sEHmeOX8ZBI8hZQJOtfUyNVrY+rn5lEE9I+8YgWBL8N6Zxk7ckfVp7g5QNmwaOWhG5y0ApBCUPWFMuxgnm4TzLL8KQlJRvUlP23rp1J3DFQWJgOjgRrjL86jJDzxx0ewLoehHiVLqADdHxEjzqcykEzq21gTgwcwOoZ8tll0uO+aGCeSGNf2TIpu5B7vSbrcIk8WJk=
2021-05-26T05:24:23.306 INFO:teuthology.kill:2021-05-26 05:24:23,305.305 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-05-26T05:24:23.311 INFO:teuthology.kill:2021-05-26 05:24:23,311.311 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-05-26T05:24:23.372 INFO:teuthology.kill:2021-05-26 05:24:23,372.372 INFO:teuthology.orchestra.console:Power off smithi002
2021-05-26T05:24:23.387 INFO:teuthology.kill:2021-05-26 05:24:23,386.386 INFO:teuthology.orchestra.console:Power off smithi143
2021-05-26T05:24:23.515 INFO:teuthology.kill:2021-05-26 05:24:23,515.515 INFO:teuthology.orchestra.console:Power off for smithi002 completed
2021-05-26T05:24:23.527 INFO:teuthology.kill:2021-05-26 05:24:23,526.526 INFO:teuthology.orchestra.console:Power off for smithi143 completed
2021-05-26T05:24:23.659 INFO:teuthology.kill:2021-05-26 05:24:23,659.659 INFO:teuthology.lock.ops:unlocked smithi002.front.sepia.ceph.com
2021-05-26T05:24:23.668 INFO:teuthology.kill:2021-05-26 05:24:23,668.668 INFO:teuthology.lock.ops:unlocked smithi143.front.sepia.ceph.com
2021-05-26T05:26:23.958 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-05-26T05:26:24.080 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2021-05-26T05:26:24.081 INFO:teuthology.nuke:Checking targets against current locks
2021-05-26T05:26:24.155 INFO:teuthology.nuke:Not nuking smithi143.front.sepia.ceph.com because description doesn't match
2021-05-26T05:26:24.156 INFO:teuthology.nuke:Not nuking smithi002.front.sepia.ceph.com because description doesn't match