2021-06-08T04:18:17.420 INFO:root:teuthology version: 1.1.0-f359b10d
2021-06-08T04:18:17.512 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi037.front.sepia.ceph.com' reimaging
2021-06-08T04:18:17.514 INFO:teuthology.lock.ops:Updating [ubuntu@smithi037.front.sepia.ceph.com]: reset os type and version on server
2021-06-08T04:18:17.514 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server
2021-06-08T04:18:17.532 INFO:teuthology.lock.ops:Node 'ubuntu@smithi037.front.sepia.ceph.com' reimaging is complete
2021-06-08T04:18:17.532 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi195.front.sepia.ceph.com' reimaging
2021-06-08T04:18:17.533 INFO:teuthology.lock.ops:Updating [ubuntu@smithi195.front.sepia.ceph.com]: reset os type and version on server
2021-06-08T04:18:17.533 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server
2021-06-08T04:18:17.549 INFO:teuthology.lock.ops:Node 'ubuntu@smithi195.front.sepia.ceph.com' reimaging is complete
2021-06-08T04:18:17.774 INFO:teuthology.provision.fog.smithi195:Scheduling deploy of ubuntu 20.04
2021-06-08T04:18:17.787 INFO:teuthology.provision.fog.smithi037:Scheduling deploy of ubuntu 20.04
2021-06-08T04:18:18.197 INFO:teuthology.orchestra.console:Power off smithi037
2021-06-08T04:18:18.212 INFO:teuthology.orchestra.console:Power off smithi195
2021-06-08T04:18:26.566 INFO:teuthology.orchestra.console:Power off for smithi037 completed
2021-06-08T04:18:26.667 INFO:teuthology.orchestra.console:Power on smithi037
2021-06-08T04:18:30.685 INFO:teuthology.orchestra.console:Power off for smithi195 completed
2021-06-08T04:18:30.787 INFO:teuthology.orchestra.console:Power on smithi195
2021-06-08T04:18:35.030 INFO:teuthology.orchestra.console:Power on for smithi037 completed
2021-06-08T04:18:35.037 INFO:teuthology.orchestra.console:Power on for smithi195 completed
2021-06-08T04:18:35.132 INFO:teuthology.provision.fog.smithi037:Waiting for deploy to finish
2021-06-08T04:18:35.138 INFO:teuthology.provision.fog.smithi195:Waiting for deploy to finish
2021-06-08T04:23:16.390 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-06-08T04:23:16.882 INFO:teuthology.provision.fog.smithi037:Node is ready
2021-06-08T04:23:16.888 INFO:teuthology.orchestra.run.smithi037.stdout:smithi037.front.sepia.ceph.com
2021-06-08T04:23:16.895 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37 smithi037.front.sepia.ceph.com smithi037
2021-06-08T04:23:17.074 INFO:teuthology.provision.fog.smithi037:Deploy complete!
2021-06-08T04:23:44.637 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-06-08T04:23:45.136 INFO:teuthology.provision.fog.smithi195:Node is ready
2021-06-08T04:23:45.143 INFO:teuthology.orchestra.run.smithi195.stdout:smithi195.front.sepia.ceph.com
2021-06-08T04:23:45.149 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.15.195 smithi195.front.sepia.ceph.com smithi195
2021-06-08T04:23:45.451 INFO:teuthology.provision.fog.smithi195:Deploy complete!
2021-06-08T04:23:45.599 INFO:teuthology.lock.ops:Checking smithi037.front.sepia.ceph.com
2021-06-08T04:23:45.600 INFO:teuthology.lock.ops:New key found. Updating...
2021-06-08T04:23:45.614 INFO:teuthology.lock.ops:Checking smithi195.front.sepia.ceph.com
2021-06-08T04:23:45.614 INFO:teuthology.lock.ops:New key found. Updating...
2021-06-08T04:23:45.627 INFO:teuthology.lock.ops:Updating [smithi037.front.sepia.ceph.com]: set os type and version on server
2021-06-08T04:23:45.628 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-06-08T04:23:45.841 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64
2021-06-08T04:23:45.847 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="Ubuntu"
2021-06-08T04:23:45.847 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="20.04.2 LTS (Focal Fossa)"
2021-06-08T04:23:45.848 INFO:teuthology.orchestra.run.smithi037.stdout:ID=ubuntu
2021-06-08T04:23:45.848 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE=debian
2021-06-08T04:23:45.848 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS"
2021-06-08T04:23:45.848 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="20.04"
2021-06-08T04:23:45.848 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://www.ubuntu.com/"
2021-06-08T04:23:45.849 INFO:teuthology.orchestra.run.smithi037.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-06-08T04:23:45.849 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-06-08T04:23:45.849 INFO:teuthology.orchestra.run.smithi037.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-06-08T04:23:45.849 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_CODENAME=focal
2021-06-08T04:23:45.850 INFO:teuthology.orchestra.run.smithi037.stdout:UBUNTU_CODENAME=focal
2021-06-08T04:23:45.851 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server
2021-06-08T04:23:45.867 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: set os type and version on server
2021-06-08T04:23:45.867 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-06-08T04:23:46.034 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64
2021-06-08T04:23:46.083 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="Ubuntu"
2021-06-08T04:23:46.084 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="20.04.2 LTS (Focal Fossa)"
2021-06-08T04:23:46.084 INFO:teuthology.orchestra.run.smithi195.stdout:ID=ubuntu
2021-06-08T04:23:46.084 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE=debian
2021-06-08T04:23:46.084 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS"
2021-06-08T04:23:46.084 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="20.04"
2021-06-08T04:23:46.085 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://www.ubuntu.com/"
2021-06-08T04:23:46.085 INFO:teuthology.orchestra.run.smithi195.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-06-08T04:23:46.085 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-06-08T04:23:46.085 INFO:teuthology.orchestra.run.smithi195.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-06-08T04:23:46.086 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_CODENAME=focal
2021-06-08T04:23:46.086 INFO:teuthology.orchestra.run.smithi195.stdout:UBUNTU_CODENAME=focal
2021-06-08T04:23:46.086 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server
2021-06-08T04:23:46.162 INFO:teuthology.dispatcher.supervisor:Running job 6158722
2021-06-08T04:23:46.162 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2021-06-08_04:17:01-fs-pacific-distro-basic-smithi/6158722 --name teuthology-2021-06-08_04:17:01-fs-pacific-distro-basic-smithi --description fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client-limits} -- /home/teuthworker/archive/teuthology-2021-06-08_04:17:01-fs-pacific-distro-basic-smithi/6158722/orig.config.yaml
2021-06-08T04:23:46.165 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2021-06-08_04:17:01-fs-pacific-distro-basic-smithi/6158722
2021-06-08T04:23:46.166 INFO:teuthology.dispatcher.supervisor:Job PID: 18618
2021-06-08T04:23:46.166 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-06-08T16:24:36.863 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-06-08T16:24:37.073 INFO:teuthology.kill:Killing Pids: {18618}
2021-06-08T16:24:38.157 INFO:teuthology.kill:Nuking machines: ['smithi037', 'smithi195']
2021-06-08T16:24:39.119 INFO:teuthology.kill:2021-06-08 16:24:39,118.118 INFO:teuthology.nuke:targets:
2021-06-08T16:24:39.120 INFO:teuthology.kill:  smithi037.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpQUWgZAmaL8LfCr9zstAzeYAeYZBRyKlAZKbVOtN5tNCZODaKzyU2tWok+Xvi91Yev28AdD2aqq7Wgaf0zE5rqBhudGrI2A9fWsCOgV4cImWIdjKgh8sEVZBRfTmlzFGGvMprfQdLJ18HQq2UnHLk0ykVgzwz3U6pFcOpYW2UosG6cZzroOQIPSAfHu2E2b38D3SFs0n0HojkvbtL2Ms/YYkycaReY3Hn7/xKqCEiIUPbnh5Zhn0YoT9V4Oxl9PSAk/qBhhPyMxWcZNU2khoB70Thjn5QVJqQybF3Nt/ZCkM22AGVTXBZ0ArF9zL36q1svqSLO2Hq7ZD4ZE57kOASL6M8pk6iOykuspetVQ5Z7gZu4sL37ifwJRntctHTnp+z8EHhYGD4RaNhq0wtUUQX6yUud+7Tg4lZBoCHQ/MJ97jJ2m73SAr8npz5TyCG92mNsj/mOZeG+5R45v54YpN5h4v1Vix43/bCzyz9yiwmlGY2p2ZoPqVDA2+MVnz0gDs=
2021-06-08T16:24:39.120 INFO:teuthology.kill:  smithi195.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDsxoL0Pdib7Laawdhz+OhajbDheJ3Z6yG/uiQVsm1xTO+ob/49eUupNyHUUy3cRMEFfhwy0DYGitbuijvSNclQyJ0LsznuhOZbi3/9hqFXqxyGDXgq3rv1VFIhZAXSdgyjroZy1H9t22OoBvqDc8S0BMY6lp3i8K6a9OKqJXi6w83Oh+/VOBw8RjIkUgrcoOMOFlYzxkX/J2aYihL43wQ+0C/qor3jPSQ7YPfYsaTSvQXpIMNGOvBTnB4JOYRcmFudhOFIH9/vgceumqCdTzmL7KkyFUPuj/RQjWXG7LBTZPcGjs2wkwyEcYTFMratKSOYlq2folT56Xl24IALakesyosV20dRW7uj0K29lBjhs2BY9Fa30HEfDAkNc8psRPkr989RktSyR/2ImslmYsGOBSZinrGhoZthm0qMelhSKDiFIGrCNRLv3NI8QSN8MrnL4jqDIz0qIOtnhR8jJbRL9MwSfxcQDVnN9ZsL/PQVsVBIXXZS8PvD/X324t+4iXU=
2021-06-08T16:24:39.120 INFO:teuthology.kill:2021-06-08 16:24:39,119.119 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-06-08T16:24:39.121 INFO:teuthology.kill:2021-06-08 16:24:39,121.121 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-06-08T16:24:39.182 INFO:teuthology.kill:2021-06-08 16:24:39,182.182 INFO:teuthology.orchestra.console:Power off smithi037
2021-06-08T16:24:39.194 INFO:teuthology.kill:2021-06-08 16:24:39,193.193 INFO:teuthology.orchestra.console:Power off smithi195
2021-06-08T16:24:47.548 INFO:teuthology.kill:2021-06-08 16:24:47,547.547 INFO:teuthology.orchestra.console:Power off for smithi037 completed
2021-06-08T16:24:51.669 INFO:teuthology.kill:2021-06-08 16:24:51,668.668 INFO:teuthology.orchestra.console:Power off for smithi195 completed
2021-06-08T16:24:51.937 INFO:teuthology.task.internal:roles: ubuntu@smithi037.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2']
2021-06-08T16:24:51.938 INFO:teuthology.task.internal:roles: ubuntu@smithi195.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']
2021-06-08T16:24:51.938 INFO:teuthology.misc:Compressing logs...
2021-06-08T16:24:51.939 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-06-08T16:25:51.999 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/misc.py", line 1378, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/orchestra/cluster.py", line 64, in <listcomp>
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/orchestra/remote.py", line 509, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/orchestra/run.py", line 434, in run
    transport = client.get_transport()
AttributeError: 'NoneType' object has no attribute 'get_transport'
2021-06-08T16:25:52.066 INFO:teuthology.kill:No teuthology processes running
2021-06-08T16:25:53.179 INFO:teuthology.kill:Nuking machines: ['smithi037', 'smithi195']
2021-06-08T16:25:54.201 INFO:teuthology.kill:2021-06-08 16:25:54,200.200 INFO:teuthology.nuke:targets:
2021-06-08T16:25:54.202 INFO:teuthology.kill:  smithi037.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpQUWgZAmaL8LfCr9zstAzeYAeYZBRyKlAZKbVOtN5tNCZODaKzyU2tWok+Xvi91Yev28AdD2aqq7Wgaf0zE5rqBhudGrI2A9fWsCOgV4cImWIdjKgh8sEVZBRfTmlzFGGvMprfQdLJ18HQq2UnHLk0ykVgzwz3U6pFcOpYW2UosG6cZzroOQIPSAfHu2E2b38D3SFs0n0HojkvbtL2Ms/YYkycaReY3Hn7/xKqCEiIUPbnh5Zhn0YoT9V4Oxl9PSAk/qBhhPyMxWcZNU2khoB70Thjn5QVJqQybF3Nt/ZCkM22AGVTXBZ0ArF9zL36q1svqSLO2Hq7ZD4ZE57kOASL6M8pk6iOykuspetVQ5Z7gZu4sL37ifwJRntctHTnp+z8EHhYGD4RaNhq0wtUUQX6yUud+7Tg4lZBoCHQ/MJ97jJ2m73SAr8npz5TyCG92mNsj/mOZeG+5R45v54YpN5h4v1Vix43/bCzyz9yiwmlGY2p2ZoPqVDA2+MVnz0gDs=
2021-06-08T16:25:54.202 INFO:teuthology.kill:  smithi195.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDsxoL0Pdib7Laawdhz+OhajbDheJ3Z6yG/uiQVsm1xTO+ob/49eUupNyHUUy3cRMEFfhwy0DYGitbuijvSNclQyJ0LsznuhOZbi3/9hqFXqxyGDXgq3rv1VFIhZAXSdgyjroZy1H9t22OoBvqDc8S0BMY6lp3i8K6a9OKqJXi6w83Oh+/VOBw8RjIkUgrcoOMOFlYzxkX/J2aYihL43wQ+0C/qor3jPSQ7YPfYsaTSvQXpIMNGOvBTnB4JOYRcmFudhOFIH9/vgceumqCdTzmL7KkyFUPuj/RQjWXG7LBTZPcGjs2wkwyEcYTFMratKSOYlq2folT56Xl24IALakesyosV20dRW7uj0K29lBjhs2BY9Fa30HEfDAkNc8psRPkr989RktSyR/2ImslmYsGOBSZinrGhoZthm0qMelhSKDiFIGrCNRLv3NI8QSN8MrnL4jqDIz0qIOtnhR8jJbRL9MwSfxcQDVnN9ZsL/PQVsVBIXXZS8PvD/X324t+4iXU=
2021-06-08T16:25:54.221 INFO:teuthology.kill:2021-06-08 16:25:54,221.221 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-06-08T16:25:54.224 INFO:teuthology.kill:2021-06-08 16:25:54,224.224 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-06-08T16:25:54.285 INFO:teuthology.kill:2021-06-08 16:25:54,284.284 INFO:teuthology.orchestra.console:Power off smithi037
2021-06-08T16:25:54.298 INFO:teuthology.kill:2021-06-08 16:25:54,298.298 INFO:teuthology.orchestra.console:Power off smithi195
2021-06-08T16:25:54.428 INFO:teuthology.kill:2021-06-08 16:25:54,428.428 INFO:teuthology.orchestra.console:Power off for smithi037 completed
2021-06-08T16:25:54.439 INFO:teuthology.kill:2021-06-08 16:25:54,439.439 INFO:teuthology.orchestra.console:Power off for smithi195 completed
2021-06-08T16:25:54.567 INFO:teuthology.kill:2021-06-08 16:25:54,566.566 INFO:teuthology.lock.ops:unlocked smithi037.front.sepia.ceph.com
2021-06-08T16:25:54.577 INFO:teuthology.kill:2021-06-08 16:25:54,576.576 INFO:teuthology.lock.ops:unlocked smithi195.front.sepia.ceph.com
2021-06-08T16:27:54.866 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-06-08T16:27:54.967 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2021-06-08T16:27:54.967 INFO:teuthology.nuke:Checking targets against current locks
2021-06-08T16:27:55.037 INFO:teuthology.nuke:Not nuking smithi195.front.sepia.ceph.com because description doesn't match
2021-06-08T16:27:55.037 INFO:teuthology.nuke:Not nuking smithi037.front.sepia.ceph.com because description doesn't match