2021-05-22T16:29:03.641 INFO:root:teuthology version: 1.1.0-d92ec140
2021-05-22T16:29:03.738 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi018.front.sepia.ceph.com' reimaging
2021-05-22T16:29:03.739 INFO:teuthology.lock.ops:Updating [ubuntu@smithi018.front.sepia.ceph.com]: reset os type and version on server
2021-05-22T16:29:03.739 INFO:teuthology.lock.ops:Updating smithi018.front.sepia.ceph.com on lock server
2021-05-22T16:29:03.753 INFO:teuthology.lock.ops:Node 'ubuntu@smithi018.front.sepia.ceph.com' reimaging is complete
2021-05-22T16:29:03.753 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi087.front.sepia.ceph.com' reimaging
2021-05-22T16:29:03.754 INFO:teuthology.lock.ops:Updating [ubuntu@smithi087.front.sepia.ceph.com]: reset os type and version on server
2021-05-22T16:29:03.754 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server
2021-05-22T16:29:03.772 INFO:teuthology.lock.ops:Node 'ubuntu@smithi087.front.sepia.ceph.com' reimaging is complete
2021-05-22T16:29:03.959 INFO:teuthology.provision.fog.smithi018:Scheduling deploy of centos 8.3
2021-05-22T16:29:03.975 INFO:teuthology.provision.fog.smithi087:Scheduling deploy of centos 8.3
2021-05-22T16:29:04.306 INFO:teuthology.orchestra.console:Power off smithi018
2021-05-22T16:29:04.341 INFO:teuthology.orchestra.console:Power off smithi087
2021-05-22T16:29:12.679 INFO:teuthology.orchestra.console:Power off for smithi018 completed
2021-05-22T16:29:12.780 INFO:teuthology.orchestra.console:Power on smithi018
2021-05-22T16:29:16.815 INFO:teuthology.orchestra.console:Power off for smithi087 completed
2021-05-22T16:29:16.917 INFO:teuthology.orchestra.console:Power on smithi087
2021-05-22T16:29:21.146 INFO:teuthology.orchestra.console:Power on for smithi018 completed
2021-05-22T16:29:21.247 INFO:teuthology.provision.fog.smithi018:Waiting for deploy to finish
2021-05-22T16:29:25.281 INFO:teuthology.orchestra.console:Power on for smithi087 completed
2021-05-22T16:29:25.382 INFO:teuthology.provision.fog.smithi087:Waiting for deploy to finish
2021-05-22T16:33:03.423 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-05-22T16:33:19.043 INFO:teuthology.provision.fog.smithi018:Node is ready
2021-05-22T16:33:19.063 INFO:teuthology.orchestra.run.smithi018.stdout:smithi018.front.sepia.ceph.com
2021-05-22T16:33:19.120 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18 smithi018.front.sepia.ceph.com smithi018
2021-05-22T16:33:19.486 INFO:teuthology.provision.fog.smithi018:Deploy complete!
2021-05-22T16:34:06.341 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-05-22T16:34:06.715 INFO:teuthology.provision.fog.smithi087:Node is ready
2021-05-22T16:34:06.730 INFO:teuthology.orchestra.run.smithi087.stdout:smithi087.front.sepia.ceph.com
2021-05-22T16:34:06.786 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87 smithi087.front.sepia.ceph.com smithi087
2021-05-22T16:34:07.110 INFO:teuthology.provision.fog.smithi087:Deploy complete!
2021-05-22T16:34:07.226 INFO:teuthology.lock.ops:Checking smithi018.front.sepia.ceph.com
2021-05-22T16:34:07.227 INFO:teuthology.lock.ops:New key found. Updating...
2021-05-22T16:34:07.251 INFO:teuthology.lock.ops:Checking smithi087.front.sepia.ceph.com
2021-05-22T16:34:07.251 INFO:teuthology.lock.ops:New key found. Updating...
2021-05-22T16:34:07.269 INFO:teuthology.lock.ops:Updating [smithi018.front.sepia.ceph.com]: set os type and version on server
2021-05-22T16:34:07.270 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-05-22T16:34:07.564 INFO:teuthology.orchestra.run.smithi018.stdout:x86_64
2021-05-22T16:34:07.619 INFO:teuthology.orchestra.run.smithi018.stdout:NAME="CentOS Linux"
2021-05-22T16:34:07.619 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION="8"
2021-05-22T16:34:07.620 INFO:teuthology.orchestra.run.smithi018.stdout:ID="centos"
2021-05-22T16:34:07.620 INFO:teuthology.orchestra.run.smithi018.stdout:ID_LIKE="rhel fedora"
2021-05-22T16:34:07.620 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION_ID="8"
2021-05-22T16:34:07.620 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM_ID="platform:el8"
2021-05-22T16:34:07.621 INFO:teuthology.orchestra.run.smithi018.stdout:PRETTY_NAME="CentOS Linux 8"
2021-05-22T16:34:07.621 INFO:teuthology.orchestra.run.smithi018.stdout:ANSI_COLOR="0;31"
2021-05-22T16:34:07.621 INFO:teuthology.orchestra.run.smithi018.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-05-22T16:34:07.621 INFO:teuthology.orchestra.run.smithi018.stdout:HOME_URL="https://centos.org/"
2021-05-22T16:34:07.621 INFO:teuthology.orchestra.run.smithi018.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-05-22T16:34:07.622 INFO:teuthology.orchestra.run.smithi018.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-05-22T16:34:07.622 INFO:teuthology.orchestra.run.smithi018.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-05-22T16:34:07.623 INFO:teuthology.lock.ops:Updating smithi018.front.sepia.ceph.com on lock server
2021-05-22T16:34:07.639 INFO:teuthology.lock.ops:Updating [smithi087.front.sepia.ceph.com]: set os type and version on server
2021-05-22T16:34:07.639 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-05-22T16:34:07.909 INFO:teuthology.orchestra.run.smithi087.stdout:x86_64
2021-05-22T16:34:07.963 INFO:teuthology.orchestra.run.smithi087.stdout:NAME="CentOS Linux"
2021-05-22T16:34:07.964 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION="8"
2021-05-22T16:34:07.964 INFO:teuthology.orchestra.run.smithi087.stdout:ID="centos"
2021-05-22T16:34:07.964 INFO:teuthology.orchestra.run.smithi087.stdout:ID_LIKE="rhel fedora"
2021-05-22T16:34:07.964 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_ID="8"
2021-05-22T16:34:07.965 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM_ID="platform:el8"
2021-05-22T16:34:07.965 INFO:teuthology.orchestra.run.smithi087.stdout:PRETTY_NAME="CentOS Linux 8"
2021-05-22T16:34:07.965 INFO:teuthology.orchestra.run.smithi087.stdout:ANSI_COLOR="0;31"
2021-05-22T16:34:07.965 INFO:teuthology.orchestra.run.smithi087.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-05-22T16:34:07.965 INFO:teuthology.orchestra.run.smithi087.stdout:HOME_URL="https://centos.org/"
2021-05-22T16:34:07.966 INFO:teuthology.orchestra.run.smithi087.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-05-22T16:34:07.966 INFO:teuthology.orchestra.run.smithi087.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-05-22T16:34:07.966 INFO:teuthology.orchestra.run.smithi087.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-05-22T16:34:07.967 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server
2021-05-22T16:34:08.041 INFO:teuthology.dispatcher.supervisor:Running job 6129035
2021-05-22T16:34:08.041 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_d92ec1407c30d60262a45a2844110a5c94d567cc/virtualenv/bin/teuthology -v --owner scheduled_khiremat@teuthology --archive /home/teuthworker/archive/khiremat-2021-05-22_16:20:11-fs-wip-khiremat-39910-mgr-hang-osd-full-testing-40-distro-basic-smithi/6129035 --name khiremat-2021-05-22_16:20:11-fs-wip-khiremat-39910-mgr-hang-osd-full-testing-40-distro-basic-smithi --description fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mds-full} -- /home/teuthworker/archive/khiremat-2021-05-22_16:20:11-fs-wip-khiremat-39910-mgr-hang-osd-full-testing-40-distro-basic-smithi/6129035/orig.config.yaml
2021-05-22T16:34:08.045 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/khiremat-2021-05-22_16:20:11-fs-wip-khiremat-39910-mgr-hang-osd-full-testing-40-distro-basic-smithi/6129035
2021-05-22T16:34:08.045 INFO:teuthology.dispatcher.supervisor:Job PID: 5573
2021-05-22T16:34:08.046 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-05-23T04:34:55.360 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-05-23T04:34:55.516 INFO:teuthology.kill:Killing Pids: {5573}
2021-05-23T04:34:56.500 INFO:teuthology.kill:Nuking machines: ['smithi018', 'smithi087']
2021-05-23T04:34:57.399 INFO:teuthology.kill:2021-05-23 04:34:57,399.399 INFO:teuthology.nuke:targets:
2021-05-23T04:34:57.400 INFO:teuthology.kill:  smithi018.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJnm6NSOOs+1n4ACs3Qk6auEX3Yko6d+MLvaAMq8Gzg2aGIL+KfqVnRphkR1+FqiCZpGeQLYi6lHJpv0k3cCbMvua7brZ7geZI7LgOc/ozwUO1wTBdNG0QwponC6qG/94+Rqyk7k7legssMSehgznmvT6SAUkWO3T4wwgQpTx35tMpLV6W2fudEaLUvosEdlcgrP0FlffoK2axuSVmfxLqCQdLlBFPAjMJzF33HxVehocywU6YKzC/fs8df4Nj+Ga11GJ8BeUsO1oFlZnngHUcxHx6RdVVGTbgRYFgiFh4q2Tn8mM53p9EDh5RBaIibkQgJu8atoG++YjxeIzERCKSV/izpicawN+96vIFD1LlyKSVw70WMDS62pJAAfErmXMhqONZ7b7P5beAiSs6mmuU0G1YD6XVkIBpauEZD/CbdfYwtkGiiO3zUrKitnOblcTbDQx8yTS4TDr9YCCfTOryJtiGJW01vFAfeJe+nIQylnVmnA1vZfTF84Q9jyQbgO8=
2021-05-23T04:34:57.400 INFO:teuthology.kill:  smithi087.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDdjkgiQtXCdDXwoJRepEWxo8+uBPaH9hDL5Vk8od/tXoI0+ToCQbqCvVVraU6pw2SpuQTeiv44eh7gYdIJr19dwY4fknxw9wV7pfW2Bddhe2P3b8SH51tM5EL0MM5YYzLP4TEpEdIJGeCjCX+q38WQr1sEWNC6GdTyxCQbAYyzKOI/Qe8S8bePBfRjmvB8BGODfTMs6jXV5/jLex9ZMVN+z4mJQc0f1hL8EwdRGv/KiRj/4r8cCJWNpW99BtLxArt7lZ6FEcrCu8fFZXvrVu1GsUSsUqt97Zv/QZLd8IQMJOVSDvw70iAdE1HbuDEW1AnYJeZmiPnSZDyXifG/hkoAoxoRKDbx6LMjckWv4qmQ6hZdpsKaQL3+5AC4J7F1zpwcs8pWur412aTs5dDXXGTZ2NDlLo8omjiJ2Q2oxXa68JrBvgz5FD2t1JWGhAUyOqriYy5KvTjq9dMTKcI0CxBb4P4G2sH8lmIf6hg8Meev7reR6b9xMYsgMq8IxjLZdac=
2021-05-23T04:34:57.401 INFO:teuthology.kill:2021-05-23 04:34:57,399.399 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-05-23T04:34:57.401 INFO:teuthology.kill:2021-05-23 04:34:57,401.401 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-05-23T04:34:57.457 INFO:teuthology.kill:2021-05-23 04:34:57,456.456 INFO:teuthology.orchestra.console:Power off smithi018
2021-05-23T04:34:57.468 INFO:teuthology.kill:2021-05-23 04:34:57,468.468 INFO:teuthology.orchestra.console:Power off smithi087
2021-05-23T04:35:05.826 INFO:teuthology.kill:2021-05-23 04:35:05,826.826 INFO:teuthology.orchestra.console:Power off for smithi087 completed
2021-05-23T04:35:09.934 INFO:teuthology.kill:2021-05-23 04:35:09,934.934 INFO:teuthology.orchestra.console:Power off for smithi018 completed
2021-05-23T04:35:10.161 INFO:teuthology.task.internal:roles: ubuntu@smithi018.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2']
2021-05-23T04:35:10.162 INFO:teuthology.task.internal:roles: ubuntu@smithi087.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']
2021-05-23T04:35:10.163 INFO:teuthology.misc:Compressing logs...
2021-05-23T04:35:10.163 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-05-23T04:35:28.587 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_d92ec1407c30d60262a45a2844110a5c94d567cc/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_d92ec1407c30d60262a45a2844110a5c94d567cc/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_d92ec1407c30d60262a45a2844110a5c94d567cc/teuthology/misc.py", line 1378, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_d92ec1407c30d60262a45a2844110a5c94d567cc/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_d92ec1407c30d60262a45a2844110a5c94d567cc/teuthology/orchestra/cluster.py", line 64, in <listcomp>
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_d92ec1407c30d60262a45a2844110a5c94d567cc/teuthology/orchestra/remote.py", line 509, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_d92ec1407c30d60262a45a2844110a5c94d567cc/teuthology/orchestra/run.py", line 434, in run
    transport = client.get_transport()
AttributeError: 'NoneType' object has no attribute 'get_transport'
2021-05-23T04:35:28.656 INFO:teuthology.kill:No teuthology processes running
2021-05-23T04:35:29.708 INFO:teuthology.kill:Nuking machines: ['smithi018', 'smithi087']
2021-05-23T04:35:30.650 INFO:teuthology.kill:2021-05-23 04:35:30,649.649 INFO:teuthology.nuke:targets:
2021-05-23T04:35:30.651 INFO:teuthology.kill:  smithi018.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJnm6NSOOs+1n4ACs3Qk6auEX3Yko6d+MLvaAMq8Gzg2aGIL+KfqVnRphkR1+FqiCZpGeQLYi6lHJpv0k3cCbMvua7brZ7geZI7LgOc/ozwUO1wTBdNG0QwponC6qG/94+Rqyk7k7legssMSehgznmvT6SAUkWO3T4wwgQpTx35tMpLV6W2fudEaLUvosEdlcgrP0FlffoK2axuSVmfxLqCQdLlBFPAjMJzF33HxVehocywU6YKzC/fs8df4Nj+Ga11GJ8BeUsO1oFlZnngHUcxHx6RdVVGTbgRYFgiFh4q2Tn8mM53p9EDh5RBaIibkQgJu8atoG++YjxeIzERCKSV/izpicawN+96vIFD1LlyKSVw70WMDS62pJAAfErmXMhqONZ7b7P5beAiSs6mmuU0G1YD6XVkIBpauEZD/CbdfYwtkGiiO3zUrKitnOblcTbDQx8yTS4TDr9YCCfTOryJtiGJW01vFAfeJe+nIQylnVmnA1vZfTF84Q9jyQbgO8=
2021-05-23T04:35:30.651 INFO:teuthology.kill:  smithi087.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDdjkgiQtXCdDXwoJRepEWxo8+uBPaH9hDL5Vk8od/tXoI0+ToCQbqCvVVraU6pw2SpuQTeiv44eh7gYdIJr19dwY4fknxw9wV7pfW2Bddhe2P3b8SH51tM5EL0MM5YYzLP4TEpEdIJGeCjCX+q38WQr1sEWNC6GdTyxCQbAYyzKOI/Qe8S8bePBfRjmvB8BGODfTMs6jXV5/jLex9ZMVN+z4mJQc0f1hL8EwdRGv/KiRj/4r8cCJWNpW99BtLxArt7lZ6FEcrCu8fFZXvrVu1GsUSsUqt97Zv/QZLd8IQMJOVSDvw70iAdE1HbuDEW1AnYJeZmiPnSZDyXifG/hkoAoxoRKDbx6LMjckWv4qmQ6hZdpsKaQL3+5AC4J7F1zpwcs8pWur412aTs5dDXXGTZ2NDlLo8omjiJ2Q2oxXa68JrBvgz5FD2t1JWGhAUyOqriYy5KvTjq9dMTKcI0CxBb4P4G2sH8lmIf6hg8Meev7reR6b9xMYsgMq8IxjLZdac=
2021-05-23T04:35:30.670 INFO:teuthology.kill:2021-05-23 04:35:30,670.670 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-05-23T04:35:30.673 INFO:teuthology.kill:2021-05-23 04:35:30,672.672 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-05-23T04:35:30.726 INFO:teuthology.kill:2021-05-23 04:35:30,726.726 INFO:teuthology.orchestra.console:Power off smithi087
2021-05-23T04:35:30.740 INFO:teuthology.kill:2021-05-23 04:35:30,740.740 INFO:teuthology.orchestra.console:Power off smithi018
2021-05-23T04:35:30.876 INFO:teuthology.kill:2021-05-23 04:35:30,876.876 INFO:teuthology.orchestra.console:Power off for smithi087 completed
2021-05-23T04:35:30.889 INFO:teuthology.kill:2021-05-23 04:35:30,888.888 INFO:teuthology.orchestra.console:Power off for smithi018 completed
2021-05-23T04:35:31.015 INFO:teuthology.kill:2021-05-23 04:35:31,014.014 INFO:teuthology.lock.ops:unlocked smithi087.front.sepia.ceph.com
2021-05-23T04:35:31.025 INFO:teuthology.kill:2021-05-23 04:35:31,025.025 INFO:teuthology.lock.ops:unlocked smithi018.front.sepia.ceph.com
2021-05-23T04:37:31.285 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-05-23T04:37:31.421 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2021-05-23T04:37:31.422 INFO:teuthology.nuke:Checking targets against current locks
2021-05-23T04:37:31.491 INFO:teuthology.nuke:Not nuking smithi087.front.sepia.ceph.com because description doesn't match
2021-05-23T04:37:31.492 INFO:teuthology.nuke:Not nuking smithi018.front.sepia.ceph.com because description doesn't match