2021-05-22T16:30:44.218 INFO:root:teuthology version: 1.1.0-d92ec140
2021-05-22T16:30:44.322 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi058.front.sepia.ceph.com' reimaging
2021-05-22T16:30:44.323 INFO:teuthology.lock.ops:Updating [ubuntu@smithi058.front.sepia.ceph.com]: reset os type and version on server
2021-05-22T16:30:44.324 INFO:teuthology.lock.ops:Updating smithi058.front.sepia.ceph.com on lock server
2021-05-22T16:30:44.339 INFO:teuthology.lock.ops:Node 'ubuntu@smithi058.front.sepia.ceph.com' reimaging is complete
2021-05-22T16:30:44.339 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi107.front.sepia.ceph.com' reimaging
2021-05-22T16:30:44.339 INFO:teuthology.lock.ops:Updating [ubuntu@smithi107.front.sepia.ceph.com]: reset os type and version on server
2021-05-22T16:30:44.340 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server
2021-05-22T16:30:44.355 INFO:teuthology.lock.ops:Node 'ubuntu@smithi107.front.sepia.ceph.com' reimaging is complete
2021-05-22T16:30:44.532 INFO:teuthology.provision.fog.smithi058:Scheduling deploy of centos 8.3
2021-05-22T16:30:44.553 INFO:teuthology.provision.fog.smithi107:Scheduling deploy of centos 8.3
2021-05-22T16:30:44.866 INFO:teuthology.orchestra.console:Power off smithi058
2021-05-22T16:30:44.901 INFO:teuthology.orchestra.console:Power off smithi107
2021-05-22T16:30:57.348 INFO:teuthology.orchestra.console:Power off for smithi058 completed
2021-05-22T16:30:57.367 INFO:teuthology.orchestra.console:Power off for smithi107 completed
2021-05-22T16:30:57.450 INFO:teuthology.orchestra.console:Power on smithi058
2021-05-22T16:30:57.468 INFO:teuthology.orchestra.console:Power on smithi107
2021-05-22T16:31:01.709 INFO:teuthology.orchestra.console:Power on for smithi058 completed
2021-05-22T16:31:01.717 INFO:teuthology.orchestra.console:Power on for smithi107 completed
2021-05-22T16:31:01.811 INFO:teuthology.provision.fog.smithi058:Waiting for deploy to finish
2021-05-22T16:31:01.818 INFO:teuthology.provision.fog.smithi107:Waiting for deploy to finish
2021-05-22T16:35:15.689 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-05-22T16:35:15.989 INFO:teuthology.provision.fog.smithi058:Node is ready
2021-05-22T16:35:16.004 INFO:teuthology.orchestra.run.smithi058.stdout:smithi058.front.sepia.ceph.com
2021-05-22T16:35:16.059 INFO:teuthology.orchestra.run.smithi058.stdout:172.21.15.58 smithi058.front.sepia.ceph.com smithi058
2021-05-22T16:35:16.380 INFO:teuthology.provision.fog.smithi058:Deploy complete!
2021-05-22T16:35:42.739 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-05-22T16:35:43.090 INFO:teuthology.provision.fog.smithi107:Node is ready
2021-05-22T16:35:43.105 INFO:teuthology.orchestra.run.smithi107.stdout:smithi107.front.sepia.ceph.com
2021-05-22T16:35:43.161 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107 smithi107.front.sepia.ceph.com smithi107
2021-05-22T16:35:43.481 INFO:teuthology.provision.fog.smithi107:Deploy complete!
2021-05-22T16:35:43.599 INFO:teuthology.lock.ops:Checking smithi058.front.sepia.ceph.com
2021-05-22T16:35:43.600 INFO:teuthology.lock.ops:New key found. Updating...
2021-05-22T16:35:43.615 INFO:teuthology.lock.ops:Checking smithi107.front.sepia.ceph.com
2021-05-22T16:35:43.616 INFO:teuthology.lock.ops:New key found. Updating...
2021-05-22T16:35:43.630 INFO:teuthology.lock.ops:Updating [smithi058.front.sepia.ceph.com]: set os type and version on server
2021-05-22T16:35:43.630 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-05-22T16:35:43.927 INFO:teuthology.orchestra.run.smithi058.stdout:x86_64
2021-05-22T16:35:43.982 INFO:teuthology.orchestra.run.smithi058.stdout:NAME="CentOS Linux"
2021-05-22T16:35:43.983 INFO:teuthology.orchestra.run.smithi058.stdout:VERSION="8"
2021-05-22T16:35:43.983 INFO:teuthology.orchestra.run.smithi058.stdout:ID="centos"
2021-05-22T16:35:43.983 INFO:teuthology.orchestra.run.smithi058.stdout:ID_LIKE="rhel fedora"
2021-05-22T16:35:43.983 INFO:teuthology.orchestra.run.smithi058.stdout:VERSION_ID="8"
2021-05-22T16:35:43.984 INFO:teuthology.orchestra.run.smithi058.stdout:PLATFORM_ID="platform:el8"
2021-05-22T16:35:43.984 INFO:teuthology.orchestra.run.smithi058.stdout:PRETTY_NAME="CentOS Linux 8"
2021-05-22T16:35:43.984 INFO:teuthology.orchestra.run.smithi058.stdout:ANSI_COLOR="0;31"
2021-05-22T16:35:43.984 INFO:teuthology.orchestra.run.smithi058.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-05-22T16:35:43.984 INFO:teuthology.orchestra.run.smithi058.stdout:HOME_URL="https://centos.org/"
2021-05-22T16:35:43.985 INFO:teuthology.orchestra.run.smithi058.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-05-22T16:35:43.985 INFO:teuthology.orchestra.run.smithi058.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-05-22T16:35:43.985 INFO:teuthology.orchestra.run.smithi058.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-05-22T16:35:43.986 INFO:teuthology.lock.ops:Updating smithi058.front.sepia.ceph.com on lock server
2021-05-22T16:35:44.002 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: set os type and version on server
2021-05-22T16:35:44.002 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-05-22T16:35:44.278 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64
2021-05-22T16:35:44.332 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="CentOS Linux"
2021-05-22T16:35:44.333 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="8"
2021-05-22T16:35:44.333 INFO:teuthology.orchestra.run.smithi107.stdout:ID="centos"
2021-05-22T16:35:44.333 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="rhel fedora"
2021-05-22T16:35:44.333 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="8"
2021-05-22T16:35:44.333 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el8"
2021-05-22T16:35:44.334 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="CentOS Linux 8"
2021-05-22T16:35:44.334 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31"
2021-05-22T16:35:44.334 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-05-22T16:35:44.334 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://centos.org/"
2021-05-22T16:35:44.335 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-05-22T16:35:44.335 INFO:teuthology.orchestra.run.smithi107.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-05-22T16:35:44.335 INFO:teuthology.orchestra.run.smithi107.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-05-22T16:35:44.336 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server
2021-05-22T16:35:44.417 INFO:teuthology.dispatcher.supervisor:Running job 6129037
2021-05-22T16:35:44.418 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_d92ec1407c30d60262a45a2844110a5c94d567cc/virtualenv/bin/teuthology -v --owner scheduled_khiremat@teuthology --archive /home/teuthworker/archive/khiremat-2021-05-22_16:20:11-fs-wip-khiremat-39910-mgr-hang-osd-full-testing-40-distro-basic-smithi/6129037 --name khiremat-2021-05-22_16:20:11-fs-wip-khiremat-39910-mgr-hang-osd-full-testing-40-distro-basic-smithi --description fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mds-full} -- /home/teuthworker/archive/khiremat-2021-05-22_16:20:11-fs-wip-khiremat-39910-mgr-hang-osd-full-testing-40-distro-basic-smithi/6129037/orig.config.yaml
2021-05-22T16:35:44.421 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/khiremat-2021-05-22_16:20:11-fs-wip-khiremat-39910-mgr-hang-osd-full-testing-40-distro-basic-smithi/6129037
2021-05-22T16:35:44.422 INFO:teuthology.dispatcher.supervisor:Job PID: 7318
2021-05-22T16:35:44.422 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-05-23T04:36:31.764 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-05-23T04:36:32.269 INFO:teuthology.kill:Killing Pids: {7318}
2021-05-23T04:36:33.330 INFO:teuthology.kill:Nuking machines: ['smithi058', 'smithi107']
2021-05-23T04:36:34.313 INFO:teuthology.kill:2021-05-23 04:36:34,313.313 INFO:teuthology.nuke:targets:
2021-05-23T04:36:34.314 INFO:teuthology.kill:  smithi058.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDv5zi+tU1KaMte8Ieq7/L8bL9a1vmuqSHeKw9PDsjohBJaUNHrVBAXbJd27QL1QbpCpA5QxbD2GXh7yvYWNPKWBp1p2iHHqimGCqGbVoz/3hGPBM25EjtN2IqfhBoSA/WVGuncOxr2OI1nqLWTwTRhpF7Q7IVF4Y+DKtJuHAvKlxmJ3I8iNddBh5hHYaEakax53lmfJ+g7xIt5T80OcbovE8Py4IGpaffVhn2hhaUeEtig6BQlONjTwj3YmjObBy7SmoNFCrECOf+f1nkVgkVXMFcbnUDk/76tLpCnymHkhqStW0dQKxtqZA6RbviGElYMg4wz7uU6E/QL3n1v5j1fT0G5i/AYMApw35SiMs6SvjS0W9etN2Wr+fGDEolFY0i838Xmp8EoW/774a0SaC5UDhJIkBnVz/C1ZO5mMyF21GdXFZyrf6yY5aabFz6Taeq0UpcHqbODxw7nH81OSJswu9YLYj1IG1UBGe+xpFLc5au9LdhcIT+nISmYGqbs1k=
2021-05-23T04:36:34.314 INFO:teuthology.kill:  smithi107.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCcXWe+PVBCc8D/Ky3nodePSSsBYAwqJIx39TMR+189hEm4uPBVI4VeSoh1M/5hL+qWYLNndbSqqmqyFau+NH9NiKYuoYskQBNp2NmPsD/L7e6AjPlgd8H3aad1mGgtBmSpZIxwaBCS+mjqGH/Bgx72UKOoDgHNs/edsJmpcsqWG3Oq5GQxBjBJyIofiQpTut+YyEiVdRGD/4jLmTzcNs//OnPVKz+5gbMKM7TDUg+/alMyMJMltaeEggF8pMQQofhB8RaFutSmWO0ThFvj7YTtJdnTpaWxmIaBfOxpzhLfUmgBee47cj2K8MAOq7oXMsNpzyW80ToHAEIdmgmuAdkrw1mG5uy/LidIF57lN57HM+n/EGXRvOwim+2nrB8BCbkzNhafnbv9dX+PvzqViR6NDDdRWFbvw4mySeeFumhA5yrSGcZ5QVOghU4Db99BpVOe7mQdpwO4h1lStXOM4cN9fQvCBFg0nnoVNJoh6HILOKsvEZlfwKnPEpOLfYsU7Bc=
2021-05-23T04:36:34.315 INFO:teuthology.kill:2021-05-23 04:36:34,313.313 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-05-23T04:36:34.316 INFO:teuthology.kill:2021-05-23 04:36:34,315.315 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-05-23T04:36:34.376 INFO:teuthology.kill:2021-05-23 04:36:34,376.376 INFO:teuthology.orchestra.console:Power off smithi107
2021-05-23T04:36:34.387 INFO:teuthology.kill:2021-05-23 04:36:34,387.387 INFO:teuthology.orchestra.console:Power off smithi058
2021-05-23T04:36:42.754 INFO:teuthology.kill:2021-05-23 04:36:42,753.753 INFO:teuthology.orchestra.console:Power off for smithi058 completed
2021-05-23T04:36:42.765 INFO:teuthology.kill:2021-05-23 04:36:42,765.765 INFO:teuthology.orchestra.console:Power off for smithi107 completed
2021-05-23T04:36:42.996 INFO:teuthology.task.internal:roles: ubuntu@smithi058.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2']
2021-05-23T04:36:42.997 INFO:teuthology.task.internal:roles: ubuntu@smithi107.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']
2021-05-23T04:36:42.997 INFO:teuthology.misc:Compressing logs...
2021-05-23T04:36:42.998 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-05-23T04:37:43.059 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_d92ec1407c30d60262a45a2844110a5c94d567cc/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_d92ec1407c30d60262a45a2844110a5c94d567cc/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_d92ec1407c30d60262a45a2844110a5c94d567cc/teuthology/misc.py", line 1378, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_d92ec1407c30d60262a45a2844110a5c94d567cc/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_d92ec1407c30d60262a45a2844110a5c94d567cc/teuthology/orchestra/cluster.py", line 64, in <listcomp>
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_d92ec1407c30d60262a45a2844110a5c94d567cc/teuthology/orchestra/remote.py", line 509, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_d92ec1407c30d60262a45a2844110a5c94d567cc/teuthology/orchestra/run.py", line 434, in run
    transport = client.get_transport()
AttributeError: 'NoneType' object has no attribute 'get_transport'
2021-05-23T04:37:43.143 INFO:teuthology.kill:No teuthology processes running
2021-05-23T04:37:44.212 INFO:teuthology.kill:Nuking machines: ['smithi058', 'smithi107']
2021-05-23T04:37:45.166 INFO:teuthology.kill:2021-05-23 04:37:45,166.166 INFO:teuthology.nuke:targets:
2021-05-23T04:37:45.167 INFO:teuthology.kill:  smithi058.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDv5zi+tU1KaMte8Ieq7/L8bL9a1vmuqSHeKw9PDsjohBJaUNHrVBAXbJd27QL1QbpCpA5QxbD2GXh7yvYWNPKWBp1p2iHHqimGCqGbVoz/3hGPBM25EjtN2IqfhBoSA/WVGuncOxr2OI1nqLWTwTRhpF7Q7IVF4Y+DKtJuHAvKlxmJ3I8iNddBh5hHYaEakax53lmfJ+g7xIt5T80OcbovE8Py4IGpaffVhn2hhaUeEtig6BQlONjTwj3YmjObBy7SmoNFCrECOf+f1nkVgkVXMFcbnUDk/76tLpCnymHkhqStW0dQKxtqZA6RbviGElYMg4wz7uU6E/QL3n1v5j1fT0G5i/AYMApw35SiMs6SvjS0W9etN2Wr+fGDEolFY0i838Xmp8EoW/774a0SaC5UDhJIkBnVz/C1ZO5mMyF21GdXFZyrf6yY5aabFz6Taeq0UpcHqbODxw7nH81OSJswu9YLYj1IG1UBGe+xpFLc5au9LdhcIT+nISmYGqbs1k=
2021-05-23T04:37:45.168 INFO:teuthology.kill:  smithi107.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCcXWe+PVBCc8D/Ky3nodePSSsBYAwqJIx39TMR+189hEm4uPBVI4VeSoh1M/5hL+qWYLNndbSqqmqyFau+NH9NiKYuoYskQBNp2NmPsD/L7e6AjPlgd8H3aad1mGgtBmSpZIxwaBCS+mjqGH/Bgx72UKOoDgHNs/edsJmpcsqWG3Oq5GQxBjBJyIofiQpTut+YyEiVdRGD/4jLmTzcNs//OnPVKz+5gbMKM7TDUg+/alMyMJMltaeEggF8pMQQofhB8RaFutSmWO0ThFvj7YTtJdnTpaWxmIaBfOxpzhLfUmgBee47cj2K8MAOq7oXMsNpzyW80ToHAEIdmgmuAdkrw1mG5uy/LidIF57lN57HM+n/EGXRvOwim+2nrB8BCbkzNhafnbv9dX+PvzqViR6NDDdRWFbvw4mySeeFumhA5yrSGcZ5QVOghU4Db99BpVOe7mQdpwO4h1lStXOM4cN9fQvCBFg0nnoVNJoh6HILOKsvEZlfwKnPEpOLfYsU7Bc=
2021-05-23T04:37:45.187 INFO:teuthology.kill:2021-05-23 04:37:45,186.186 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-05-23T04:37:45.190 INFO:teuthology.kill:2021-05-23 04:37:45,190.190 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-05-23T04:37:45.245 INFO:teuthology.kill:2021-05-23 04:37:45,245.245 INFO:teuthology.orchestra.console:Power off smithi107
2021-05-23T04:37:45.280 INFO:teuthology.kill:2021-05-23 04:37:45,279.279 INFO:teuthology.orchestra.console:Power off smithi058
2021-05-23T04:37:45.389 INFO:teuthology.kill:2021-05-23 04:37:45,389.389 INFO:teuthology.orchestra.console:Power off for smithi107 completed
2021-05-23T04:37:45.424 INFO:teuthology.kill:2021-05-23 04:37:45,424.424 INFO:teuthology.orchestra.console:Power off for smithi058 completed
2021-05-23T04:37:45.530 INFO:teuthology.kill:2021-05-23 04:37:45,530.530 INFO:teuthology.lock.ops:unlocked smithi107.front.sepia.ceph.com
2021-05-23T04:37:45.563 INFO:teuthology.kill:2021-05-23 04:37:45,563.563 INFO:teuthology.lock.ops:unlocked smithi058.front.sepia.ceph.com
2021-05-23T04:39:45.847 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-05-23T04:39:45.948 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2021-05-23T04:39:45.948 INFO:teuthology.nuke:Checking targets against current locks
2021-05-23T04:39:46.019 INFO:teuthology.nuke:Not nuking smithi058.front.sepia.ceph.com because description doesn't match
2021-05-23T04:39:46.020 INFO:teuthology.nuke:Not nuking smithi107.front.sepia.ceph.com because description doesn't match