2021-05-23T02:10:31.542 INFO:root:teuthology version: 1.1.0-d92ec140 2021-05-23T02:10:31.653 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi142.front.sepia.ceph.com' reimaging 2021-05-23T02:10:31.656 INFO:teuthology.lock.ops:Updating [ubuntu@smithi142.front.sepia.ceph.com]: reset os type and version on server 2021-05-23T02:10:31.657 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2021-05-23T02:10:31.673 INFO:teuthology.lock.ops:Node 'ubuntu@smithi142.front.sepia.ceph.com' reimaging is complete 2021-05-23T02:10:31.675 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi145.front.sepia.ceph.com' reimaging 2021-05-23T02:10:31.675 INFO:teuthology.lock.ops:Updating [ubuntu@smithi145.front.sepia.ceph.com]: reset os type and version on server 2021-05-23T02:10:31.675 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2021-05-23T02:10:31.692 INFO:teuthology.lock.ops:Node 'ubuntu@smithi145.front.sepia.ceph.com' reimaging is complete 2021-05-23T02:10:31.902 INFO:teuthology.provision.fog.smithi142:Scheduling deploy of centos 8.3 2021-05-23T02:10:31.910 INFO:teuthology.provision.fog.smithi145:Scheduling deploy of centos 8.3 2021-05-23T02:10:32.250 INFO:teuthology.orchestra.console:Power off smithi142 2021-05-23T02:10:32.276 INFO:teuthology.orchestra.console:Power off smithi145 2021-05-23T02:10:40.635 INFO:teuthology.orchestra.console:Power off for smithi142 completed 2021-05-23T02:10:40.736 INFO:teuthology.orchestra.console:Power on smithi142 2021-05-23T02:10:44.755 INFO:teuthology.orchestra.console:Power off for smithi145 completed 2021-05-23T02:10:44.857 INFO:teuthology.orchestra.console:Power on smithi145 2021-05-23T02:10:49.119 INFO:teuthology.orchestra.console:Power on for smithi142 completed 2021-05-23T02:10:49.220 INFO:teuthology.provision.fog.smithi142:Waiting for deploy to finish 2021-05-23T02:10:53.226 INFO:teuthology.orchestra.console:Power on for smithi145 completed 2021-05-23T02:10:53.328 INFO:teuthology.provision.fog.smithi145:Waiting for deploy to finish 2021-05-23T02:14:59.822 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-05-23T02:15:20.464 INFO:teuthology.provision.fog.smithi145:Node is ready 2021-05-23T02:15:20.483 INFO:teuthology.orchestra.run.smithi145.stdout:smithi145.front.sepia.ceph.com 2021-05-23T02:15:20.540 INFO:teuthology.orchestra.run.smithi145.stdout:172.21.15.145 smithi145.front.sepia.ceph.com smithi145 2021-05-23T02:15:20.895 INFO:teuthology.provision.fog.smithi145:Deploy complete! 2021-05-23T02:15:30.257 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-05-23T02:15:30.573 INFO:teuthology.provision.fog.smithi142:Node is ready 2021-05-23T02:15:30.587 INFO:teuthology.orchestra.run.smithi142.stdout:smithi142.front.sepia.ceph.com 2021-05-23T02:15:30.642 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142 smithi142.front.sepia.ceph.com smithi142 2021-05-23T02:15:30.954 INFO:teuthology.provision.fog.smithi142:Deploy complete! 2021-05-23T02:15:31.097 INFO:teuthology.lock.ops:Checking smithi142.front.sepia.ceph.com 2021-05-23T02:15:31.098 INFO:teuthology.lock.ops:New key found. Updating... 2021-05-23T02:15:31.119 INFO:teuthology.lock.ops:Checking smithi145.front.sepia.ceph.com 2021-05-23T02:15:31.119 INFO:teuthology.lock.ops:New key found. Updating... 2021-05-23T02:15:31.135 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: set os type and version on server 2021-05-23T02:15:31.135 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-05-23T02:15:31.415 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2021-05-23T02:15:31.468 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Linux" 2021-05-23T02:15:31.469 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="8" 2021-05-23T02:15:31.469 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos" 2021-05-23T02:15:31.469 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora" 2021-05-23T02:15:31.469 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="8" 2021-05-23T02:15:31.470 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el8" 2021-05-23T02:15:31.470 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Linux 8" 2021-05-23T02:15:31.470 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2021-05-23T02:15:31.470 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-05-23T02:15:31.470 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/" 2021-05-23T02:15:31.471 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-05-23T02:15:31.471 INFO:teuthology.orchestra.run.smithi142.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-05-23T02:15:31.471 INFO:teuthology.orchestra.run.smithi142.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-05-23T02:15:31.472 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2021-05-23T02:15:31.488 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: set os type and version on server 2021-05-23T02:15:31.489 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-05-23T02:15:31.783 INFO:teuthology.orchestra.run.smithi145.stdout:x86_64 2021-05-23T02:15:31.837 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="CentOS Linux" 2021-05-23T02:15:31.837 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="8" 2021-05-23T02:15:31.838 INFO:teuthology.orchestra.run.smithi145.stdout:ID="centos" 2021-05-23T02:15:31.838 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="rhel fedora" 2021-05-23T02:15:31.838 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="8" 2021-05-23T02:15:31.838 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el8" 2021-05-23T02:15:31.839 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="CentOS Linux 8" 2021-05-23T02:15:31.839 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31" 2021-05-23T02:15:31.839 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-05-23T02:15:31.839 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://centos.org/" 2021-05-23T02:15:31.840 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-05-23T02:15:31.840 INFO:teuthology.orchestra.run.smithi145.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-05-23T02:15:31.840 INFO:teuthology.orchestra.run.smithi145.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-05-23T02:15:31.841 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2021-05-23T02:15:31.922 INFO:teuthology.dispatcher.supervisor:Running job 6129243 2021-05-23T02:15:31.923 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_d92ec1407c30d60262a45a2844110a5c94d567cc/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2021-05-23_00:57:16-fs-wip-kefu-testing-2021-05-22-2207-distro-basic-smithi/6129243 --name pdonnell-2021-05-23_00:57:16-fs-wip-kefu-testing-2021-05-22-2207-distro-basic-smithi --description fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/clone}} -- /home/teuthworker/archive/pdonnell-2021-05-23_00:57:16-fs-wip-kefu-testing-2021-05-22-2207-distro-basic-smithi/6129243/orig.config.yaml 2021-05-23T02:15:31.926 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2021-05-23_00:57:16-fs-wip-kefu-testing-2021-05-22-2207-distro-basic-smithi/6129243 2021-05-23T02:15:31.927 INFO:teuthology.dispatcher.supervisor:Job PID: 12667 2021-05-23T02:15:31.928 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-05-23T14:16:22.831 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-05-23T14:16:23.030 INFO:teuthology.kill:Killing Pids: {12667} 2021-05-23T14:16:24.179 INFO:teuthology.kill:Nuking machines: ['smithi142', 'smithi145'] 2021-05-23T14:16:25.083 INFO:teuthology.kill:2021-05-23 14:16:25,083.083 INFO:teuthology.nuke:targets: 2021-05-23T14:16:25.085 INFO:teuthology.kill: smithi142.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDeVF/u/JxEmPYR3pSH8S4URt9mRVGC16aLIplCuWXCmk8sDtAw+ynvyMywK7WrDCuGtTbR6/bvKmMmuj+y0zgKEUvkN268UMZzcOWA3Aalbmdkv/zhyQrrKLSqtSkM8Mws2nTaI4dl4IsWlWRR+VGhItt3AwxFTei39Ov53yNjn6mkiQRBRxyn/Y+eg7OsxepOTk9kMkyqnho7U266S2Ne14vl+pPqOM3pfPv9/SzYOOUa3RXu8NMFbrQKh7wBkdW90Atby9UMoW62KX5GPNewqskhOQ3cd+Av5KRfRTvP08M7r04oPszKARuvRQ+tNuozNhXXFUUyNMDatS/DLNVdbABcf7LQQ3DAmh7owozqzUCEWdej2J0oHy7fJJt0VKDAEO2sKyHCai7E67r0lUWX65gX9Rn2k9TP6D4Hr269mpmGgUw/QbGldIne+FNhdIhk5ud2Ef2oRbwDw04f3Np9sZroA+/uZJQg0WOKmv5z9/Gtw6Dx+U3yOjLWiwuFdq8= 2021-05-23T14:16:25.085 INFO:teuthology.kill: smithi145.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGUczhUTTKbqwBitLlNf3zShbH+7y5CJkmxcmtLGOKKGP3YtDljw716OkYh7sPdO4FbU6T/q0tQjfKck8PHb3J/68QE/Au4t3drVc/b9a/64f0OYAwrdtkc3fk4fTbyWTlosURjdQwiJU2CtPj+uCIhHaeiLWqedcyLj43PyettkkfbsZOJ1yyRR6gj+VSuI+llr66WRR7ZBIM3sN6pDYRGlQKVyCAysr6XVm2Log85RDiMaesJMLwDZrNUwM0xIzddxRqPelcAfUnMNYcs2K6dXKWhcSHvFfPr1yjHoY48LMqiXheB5mmuZ6lL6jSXdyEUU8EwZpWn8ZJ5ulWPyK/WAdf+4FhIj6D9rbw5mttr5EPmHdJIH7/gd+OSVkO0ijxbQdnkr7sRjB9EkG3N9hgp7M1QckF/H9XdcG+9ob3FC3KTnNG/w6PXaaEJRGVVVhX6Tj1DoKn9RuznF2tBwy0zJA0gLOrbefJLSUcJNPh+2IWDPu0QOZdI4qbGZL408M= 2021-05-23T14:16:25.086 INFO:teuthology.kill:2021-05-23 14:16:25,083.083 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-05-23T14:16:25.086 INFO:teuthology.kill:2021-05-23 14:16:25,086.086 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-05-23T14:16:25.143 INFO:teuthology.kill:2021-05-23 14:16:25,143.143 INFO:teuthology.orchestra.console:Power off smithi145 2021-05-23T14:16:25.156 INFO:teuthology.kill:2021-05-23 14:16:25,155.155 INFO:teuthology.orchestra.console:Power off smithi142 2021-05-23T14:16:37.621 INFO:teuthology.kill:2021-05-23 14:16:37,621.621 INFO:teuthology.orchestra.console:Power off for smithi145 completed 2021-05-23T14:16:37.626 INFO:teuthology.kill:2021-05-23 14:16:37,626.626 INFO:teuthology.orchestra.console:Power off for smithi142 completed 2021-05-23T14:16:37.849 INFO:teuthology.task.internal:roles: ubuntu@smithi142.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2021-05-23T14:16:37.849 INFO:teuthology.task.internal:roles: ubuntu@smithi145.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2021-05-23T14:16:37.850 INFO:teuthology.misc:Compressing logs... 2021-05-23T14:16:37.850 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-05-23T14:17:37.889 ERROR:teuthology.dispatcher.supervisor:Could not save logs Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_d92ec1407c30d60262a45a2844110a5c94d567cc/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog teuth_config.archive_base, job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d92ec1407c30d60262a45a2844110a5c94d567cc/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives compress_logs(ctx, log_path) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d92ec1407c30d60262a45a2844110a5c94d567cc/teuthology/misc.py", line 1378, in compress_logs wait=False, File "/home/teuthworker/src/git.ceph.com_git_teuthology_d92ec1407c30d60262a45a2844110a5c94d567cc/teuthology/orchestra/cluster.py", line 64, in run return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_d92ec1407c30d60262a45a2844110a5c94d567cc/teuthology/orchestra/cluster.py", line 64, in return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_d92ec1407c30d60262a45a2844110a5c94d567cc/teuthology/orchestra/remote.py", line 509, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d92ec1407c30d60262a45a2844110a5c94d567cc/teuthology/orchestra/run.py", line 434, in run transport = client.get_transport() AttributeError: 'NoneType' object has no attribute 'get_transport' 2021-05-23T14:17:37.957 INFO:teuthology.kill:No teuthology processes running 2021-05-23T14:17:38.980 INFO:teuthology.kill:Nuking machines: ['smithi142', 'smithi145'] 2021-05-23T14:17:39.858 INFO:teuthology.kill:2021-05-23 14:17:39,857.857 INFO:teuthology.nuke:targets: 2021-05-23T14:17:39.858 INFO:teuthology.kill: smithi142.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDeVF/u/JxEmPYR3pSH8S4URt9mRVGC16aLIplCuWXCmk8sDtAw+ynvyMywK7WrDCuGtTbR6/bvKmMmuj+y0zgKEUvkN268UMZzcOWA3Aalbmdkv/zhyQrrKLSqtSkM8Mws2nTaI4dl4IsWlWRR+VGhItt3AwxFTei39Ov53yNjn6mkiQRBRxyn/Y+eg7OsxepOTk9kMkyqnho7U266S2Ne14vl+pPqOM3pfPv9/SzYOOUa3RXu8NMFbrQKh7wBkdW90Atby9UMoW62KX5GPNewqskhOQ3cd+Av5KRfRTvP08M7r04oPszKARuvRQ+tNuozNhXXFUUyNMDatS/DLNVdbABcf7LQQ3DAmh7owozqzUCEWdej2J0oHy7fJJt0VKDAEO2sKyHCai7E67r0lUWX65gX9Rn2k9TP6D4Hr269mpmGgUw/QbGldIne+FNhdIhk5ud2Ef2oRbwDw04f3Np9sZroA+/uZJQg0WOKmv5z9/Gtw6Dx+U3yOjLWiwuFdq8= 2021-05-23T14:17:39.859 INFO:teuthology.kill: smithi145.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGUczhUTTKbqwBitLlNf3zShbH+7y5CJkmxcmtLGOKKGP3YtDljw716OkYh7sPdO4FbU6T/q0tQjfKck8PHb3J/68QE/Au4t3drVc/b9a/64f0OYAwrdtkc3fk4fTbyWTlosURjdQwiJU2CtPj+uCIhHaeiLWqedcyLj43PyettkkfbsZOJ1yyRR6gj+VSuI+llr66WRR7ZBIM3sN6pDYRGlQKVyCAysr6XVm2Log85RDiMaesJMLwDZrNUwM0xIzddxRqPelcAfUnMNYcs2K6dXKWhcSHvFfPr1yjHoY48LMqiXheB5mmuZ6lL6jSXdyEUU8EwZpWn8ZJ5ulWPyK/WAdf+4FhIj6D9rbw5mttr5EPmHdJIH7/gd+OSVkO0ijxbQdnkr7sRjB9EkG3N9hgp7M1QckF/H9XdcG+9ob3FC3KTnNG/w6PXaaEJRGVVVhX6Tj1DoKn9RuznF2tBwy0zJA0gLOrbefJLSUcJNPh+2IWDPu0QOZdI4qbGZL408M= 2021-05-23T14:17:39.877 INFO:teuthology.kill:2021-05-23 14:17:39,877.877 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-05-23T14:17:39.880 INFO:teuthology.kill:2021-05-23 14:17:39,879.879 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-05-23T14:17:39.929 INFO:teuthology.kill:2021-05-23 14:17:39,928.928 INFO:teuthology.orchestra.console:Power off smithi142 2021-05-23T14:17:39.941 INFO:teuthology.kill:2021-05-23 14:17:39,941.941 INFO:teuthology.orchestra.console:Power off smithi145 2021-05-23T14:17:40.070 INFO:teuthology.kill:2021-05-23 14:17:40,069.069 INFO:teuthology.orchestra.console:Power off for smithi142 completed 2021-05-23T14:17:40.080 INFO:teuthology.kill:2021-05-23 14:17:40,080.080 INFO:teuthology.orchestra.console:Power off for smithi145 completed 2021-05-23T14:17:40.207 INFO:teuthology.kill:2021-05-23 14:17:40,206.206 INFO:teuthology.lock.ops:unlocked smithi142.front.sepia.ceph.com 2021-05-23T14:17:40.217 INFO:teuthology.kill:2021-05-23 14:17:40,217.217 INFO:teuthology.lock.ops:unlocked smithi145.front.sepia.ceph.com 2021-05-23T14:19:40.469 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15