2021-05-31T16:50:19.976 INFO:root:teuthology version: 1.1.0-f359b10d 2021-05-31T16:50:20.101 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi173.front.sepia.ceph.com' reimaging 2021-05-31T16:50:20.102 INFO:teuthology.lock.ops:Updating [ubuntu@smithi173.front.sepia.ceph.com]: reset os type and version on server 2021-05-31T16:50:20.103 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2021-05-31T16:50:20.120 INFO:teuthology.lock.ops:Node 'ubuntu@smithi173.front.sepia.ceph.com' reimaging is complete 2021-05-31T16:50:20.121 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi191.front.sepia.ceph.com' reimaging 2021-05-31T16:50:20.121 INFO:teuthology.lock.ops:Updating [ubuntu@smithi191.front.sepia.ceph.com]: reset os type and version on server 2021-05-31T16:50:20.122 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2021-05-31T16:50:20.138 INFO:teuthology.lock.ops:Node 'ubuntu@smithi191.front.sepia.ceph.com' reimaging is complete 2021-05-31T16:50:20.331 INFO:teuthology.provision.fog.smithi173:Scheduling deploy of ubuntu 20.04 2021-05-31T16:50:20.356 INFO:teuthology.provision.fog.smithi191:Scheduling deploy of ubuntu 20.04 2021-05-31T16:50:20.932 INFO:teuthology.orchestra.console:Power off smithi173 2021-05-31T16:50:21.020 INFO:teuthology.orchestra.console:Power off smithi191 2021-05-31T16:50:21.080 INFO:teuthology.orchestra.console:Power off for smithi173 completed 2021-05-31T16:50:21.163 INFO:teuthology.orchestra.console:Power off for smithi191 completed 2021-05-31T16:50:21.182 INFO:teuthology.orchestra.console:Power on smithi173 2021-05-31T16:50:21.265 INFO:teuthology.orchestra.console:Power on smithi191 2021-05-31T16:50:29.553 INFO:teuthology.orchestra.console:Power on for smithi173 completed 2021-05-31T16:50:29.634 INFO:teuthology.orchestra.console:Power on for smithi191 completed 2021-05-31T16:50:29.655 INFO:teuthology.provision.fog.smithi173:Waiting for deploy to finish 2021-05-31T16:50:29.736 INFO:teuthology.provision.fog.smithi191:Waiting for deploy to finish 2021-05-31T16:55:19.412 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-05-31T16:55:19.809 INFO:teuthology.provision.fog.smithi173:Node is ready 2021-05-31T16:55:19.856 INFO:teuthology.orchestra.run.smithi173.stdout:smithi173.front.sepia.ceph.com 2021-05-31T16:55:19.865 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.15.173 smithi173.front.sepia.ceph.com smithi173 2021-05-31T16:55:20.055 INFO:teuthology.provision.fog.smithi173:Deploy complete! 2021-05-31T16:55:26.659 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-05-31T16:55:27.086 INFO:teuthology.provision.fog.smithi191:Node is ready 2021-05-31T16:55:27.094 INFO:teuthology.orchestra.run.smithi191.stdout:smithi191.front.sepia.ceph.com 2021-05-31T16:55:27.147 INFO:teuthology.orchestra.run.smithi191.stdout:172.21.15.191 smithi191.front.sepia.ceph.com smithi191 2021-05-31T16:55:27.333 INFO:teuthology.provision.fog.smithi191:Deploy complete! 2021-05-31T16:55:27.485 INFO:teuthology.lock.ops:Checking smithi173.front.sepia.ceph.com 2021-05-31T16:55:27.486 INFO:teuthology.lock.ops:New key found. Updating... 2021-05-31T16:55:27.505 INFO:teuthology.lock.ops:Checking smithi191.front.sepia.ceph.com 2021-05-31T16:55:27.506 INFO:teuthology.lock.ops:New key found. Updating... 2021-05-31T16:55:27.522 INFO:teuthology.lock.ops:Updating [smithi173.front.sepia.ceph.com]: set os type and version on server 2021-05-31T16:55:27.522 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-05-31T16:55:27.704 INFO:teuthology.orchestra.run.smithi173.stdout:x86_64 2021-05-31T16:55:27.752 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="Ubuntu" 2021-05-31T16:55:27.753 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="20.04.2 LTS (Focal Fossa)" 2021-05-31T16:55:27.753 INFO:teuthology.orchestra.run.smithi173.stdout:ID=ubuntu 2021-05-31T16:55:27.753 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE=debian 2021-05-31T16:55:27.754 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS" 2021-05-31T16:55:27.754 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="20.04" 2021-05-31T16:55:27.754 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://www.ubuntu.com/" 2021-05-31T16:55:27.754 INFO:teuthology.orchestra.run.smithi173.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-05-31T16:55:27.754 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-05-31T16:55:27.755 INFO:teuthology.orchestra.run.smithi173.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-05-31T16:55:27.755 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_CODENAME=focal 2021-05-31T16:55:27.755 INFO:teuthology.orchestra.run.smithi173.stdout:UBUNTU_CODENAME=focal 2021-05-31T16:55:27.756 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2021-05-31T16:55:27.772 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: set os type and version on server 2021-05-31T16:55:27.773 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-05-31T16:55:27.934 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64 2021-05-31T16:55:27.941 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="Ubuntu" 2021-05-31T16:55:27.941 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="20.04.2 LTS (Focal Fossa)" 2021-05-31T16:55:27.942 INFO:teuthology.orchestra.run.smithi191.stdout:ID=ubuntu 2021-05-31T16:55:27.942 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE=debian 2021-05-31T16:55:27.942 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS" 2021-05-31T16:55:27.943 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="20.04" 2021-05-31T16:55:27.943 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://www.ubuntu.com/" 2021-05-31T16:55:27.944 INFO:teuthology.orchestra.run.smithi191.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-05-31T16:55:27.944 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-05-31T16:55:27.945 INFO:teuthology.orchestra.run.smithi191.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-05-31T16:55:27.945 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_CODENAME=focal 2021-05-31T16:55:27.946 INFO:teuthology.orchestra.run.smithi191.stdout:UBUNTU_CODENAME=focal 2021-05-31T16:55:27.947 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2021-05-31T16:55:28.040 INFO:teuthology.dispatcher.supervisor:Running job 6143801 2021-05-31T16:55:28.041 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2021-05-31_16:14:32-fs-wip-yuri4-testing-2021-05-31-0658-pacific-distro-basic-smithi/6143801 --name yuriw-2021-05-31_16:14:32-fs-wip-yuri4-testing-2021-05-31-0658-pacific-distro-basic-smithi --description fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{frag_enable osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_untarbuild_blogbench} -- /home/teuthworker/archive/yuriw-2021-05-31_16:14:32-fs-wip-yuri4-testing-2021-05-31-0658-pacific-distro-basic-smithi/6143801/orig.config.yaml 2021-05-31T16:55:28.045 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2021-05-31_16:14:32-fs-wip-yuri4-testing-2021-05-31-0658-pacific-distro-basic-smithi/6143801 2021-05-31T16:55:28.046 INFO:teuthology.dispatcher.supervisor:Job PID: 16993 2021-05-31T16:55:28.047 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-06-01T04:56:16.451 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-06-01T04:56:16.637 INFO:teuthology.kill:Killing Pids: {16993} 2021-06-01T04:56:17.759 INFO:teuthology.kill:Nuking machines: ['smithi173', 'smithi191'] 2021-06-01T04:56:18.729 INFO:teuthology.kill:2021-06-01 04:56:18,729.729 INFO:teuthology.nuke:targets: 2021-06-01T04:56:18.730 INFO:teuthology.kill: smithi173.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCxBToBIv8OaYCoyUnDckVmnv8rbLsBZ4aZgzYHlmepsEo/4mN5sBev9QNbp2sLfM/BIXiILkPMc9LgGqdWYZpiOM3xpSfyRfaBevrPW6rxBkU1en4Qg0nSfgmBoh2UdsrN5Hg7kHD7AdnnLrJqz/sdbYtJ1lHGnMKxUiqZI917lp3QnOd75QJkA4R+/JsQtxnfafN8OrKQ/4Rvvhd+FEjNozUD3KpVZIQoSpaJdl9wmIU9EY+7kmXPvofv7yuXRaSmNHkvyVNb5EDfwXr6jjWN5Zb2kb+0Tf14WUgK/p97coY0MbTqCmXh6Wb0Q5hzhu7oJGDyAIaMrfYn46pbmj2GICKFtSLhEPa3xu4o700BHiWkB1C9F9/bvt6GZ8s+bmIGxST7beuLVJSP6FVpiavUK7+1VYHVA6VfF+D/M8u5MXx4+hwqQ56uFMzXgxCbk2Kby2+MRbUxqehGJB6VmRNK17xiq8SvkLYuxhmWe23sYx8h07E/KIoEsRjnme5AzJs= 2021-06-01T04:56:18.731 INFO:teuthology.kill: smithi191.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDO5+eDcJ8+WE8L77f/luud4J3TKw8VJ6OfQEiGBSWxfmtYLAY6JXQApxyMyV+8zbOhNAGhePZSH2HGFB1YW9k/YGAOlCn9L/a6pwYC8QW9nnv3ITOGZa2xIpJQIOf2Ww0dpCjFjbKulvaoMILpBUquMrBMKtb9Y53vQk2oK+GweKmOurBNeKKwOCC7gXLD3FDMiljChIdrlqzmbKLbFT2Ou1Nz8djRGM2XGAMVPoyei9jB38yXc791Onx3utnlkW3k5dBpmM1QWUHkhQY+BtwpqT0g8YYnF/oZke91vRpp1aJW0OI4PwsH/vg7X5FjuIxBPxg2R7qOolcEW2Mytu11cPRtAg/iycnGYbo4imqaxjpkivID/Ag/JSbDCsO6qMhdbxpneYJTA2a/9nXXRCk7cE6BzADpgpZUYru0EJzp7nF6UyHiO0tj4XlRDI7gL0JAYcg9Dn0rjedSxWvS/ymf/9693BRTDGBUCcFlm5ii+AwuQe+4sjNCtLJUivISBXk= 2021-06-01T04:56:18.731 INFO:teuthology.kill:2021-06-01 04:56:18,729.729 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-06-01T04:56:18.732 INFO:teuthology.kill:2021-06-01 04:56:18,732.732 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-06-01T04:56:18.788 INFO:teuthology.kill:2021-06-01 04:56:18,788.788 INFO:teuthology.orchestra.console:Power off smithi191 2021-06-01T04:56:18.800 INFO:teuthology.kill:2021-06-01 04:56:18,800.800 INFO:teuthology.orchestra.console:Power off smithi173 2021-06-01T04:56:27.155 INFO:teuthology.kill:2021-06-01 04:56:27,154.154 INFO:teuthology.orchestra.console:Power off for smithi173 completed 2021-06-01T04:56:31.260 INFO:teuthology.kill:2021-06-01 04:56:31,259.259 INFO:teuthology.orchestra.console:Power off for smithi191 completed 2021-06-01T04:56:31.495 INFO:teuthology.task.internal:roles: ubuntu@smithi173.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2021-06-01T04:56:31.496 INFO:teuthology.task.internal:roles: ubuntu@smithi191.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2021-06-01T04:56:31.496 INFO:teuthology.misc:Compressing logs... 2021-06-01T04:56:31.497 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-06-01T04:57:05.999 ERROR:teuthology.dispatcher.supervisor:Could not save logs Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog teuth_config.archive_base, job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives compress_logs(ctx, log_path) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/misc.py", line 1378, in compress_logs wait=False, File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/orchestra/cluster.py", line 64, in run return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/orchestra/cluster.py", line 64, in return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/orchestra/remote.py", line 509, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/orchestra/run.py", line 434, in run transport = client.get_transport() AttributeError: 'NoneType' object has no attribute 'get_transport' 2021-06-01T04:57:06.066 INFO:teuthology.kill:No teuthology processes running 2021-06-01T04:57:07.087 INFO:teuthology.kill:Nuking machines: ['smithi173', 'smithi191'] 2021-06-01T04:57:08.030 INFO:teuthology.kill:2021-06-01 04:57:08,030.030 INFO:teuthology.nuke:targets: 2021-06-01T04:57:08.031 INFO:teuthology.kill: smithi173.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCxBToBIv8OaYCoyUnDckVmnv8rbLsBZ4aZgzYHlmepsEo/4mN5sBev9QNbp2sLfM/BIXiILkPMc9LgGqdWYZpiOM3xpSfyRfaBevrPW6rxBkU1en4Qg0nSfgmBoh2UdsrN5Hg7kHD7AdnnLrJqz/sdbYtJ1lHGnMKxUiqZI917lp3QnOd75QJkA4R+/JsQtxnfafN8OrKQ/4Rvvhd+FEjNozUD3KpVZIQoSpaJdl9wmIU9EY+7kmXPvofv7yuXRaSmNHkvyVNb5EDfwXr6jjWN5Zb2kb+0Tf14WUgK/p97coY0MbTqCmXh6Wb0Q5hzhu7oJGDyAIaMrfYn46pbmj2GICKFtSLhEPa3xu4o700BHiWkB1C9F9/bvt6GZ8s+bmIGxST7beuLVJSP6FVpiavUK7+1VYHVA6VfF+D/M8u5MXx4+hwqQ56uFMzXgxCbk2Kby2+MRbUxqehGJB6VmRNK17xiq8SvkLYuxhmWe23sYx8h07E/KIoEsRjnme5AzJs= 2021-06-01T04:57:08.031 INFO:teuthology.kill: smithi191.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDO5+eDcJ8+WE8L77f/luud4J3TKw8VJ6OfQEiGBSWxfmtYLAY6JXQApxyMyV+8zbOhNAGhePZSH2HGFB1YW9k/YGAOlCn9L/a6pwYC8QW9nnv3ITOGZa2xIpJQIOf2Ww0dpCjFjbKulvaoMILpBUquMrBMKtb9Y53vQk2oK+GweKmOurBNeKKwOCC7gXLD3FDMiljChIdrlqzmbKLbFT2Ou1Nz8djRGM2XGAMVPoyei9jB38yXc791Onx3utnlkW3k5dBpmM1QWUHkhQY+BtwpqT0g8YYnF/oZke91vRpp1aJW0OI4PwsH/vg7X5FjuIxBPxg2R7qOolcEW2Mytu11cPRtAg/iycnGYbo4imqaxjpkivID/Ag/JSbDCsO6qMhdbxpneYJTA2a/9nXXRCk7cE6BzADpgpZUYru0EJzp7nF6UyHiO0tj4XlRDI7gL0JAYcg9Dn0rjedSxWvS/ymf/9693BRTDGBUCcFlm5ii+AwuQe+4sjNCtLJUivISBXk= 2021-06-01T04:57:08.050 INFO:teuthology.kill:2021-06-01 04:57:08,049.049 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-06-01T04:57:08.052 INFO:teuthology.kill:2021-06-01 04:57:08,052.052 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-06-01T04:57:08.102 INFO:teuthology.kill:2021-06-01 04:57:08,102.102 INFO:teuthology.orchestra.console:Power off smithi191 2021-06-01T04:57:08.116 INFO:teuthology.kill:2021-06-01 04:57:08,116.116 INFO:teuthology.orchestra.console:Power off smithi173 2021-06-01T04:57:08.246 INFO:teuthology.kill:2021-06-01 04:57:08,245.245 INFO:teuthology.orchestra.console:Power off for smithi191 completed 2021-06-01T04:57:08.254 INFO:teuthology.kill:2021-06-01 04:57:08,254.254 INFO:teuthology.orchestra.console:Power off for smithi173 completed 2021-06-01T04:57:08.383 INFO:teuthology.kill:2021-06-01 04:57:08,382.382 INFO:teuthology.lock.ops:unlocked smithi191.front.sepia.ceph.com 2021-06-01T04:57:08.389 INFO:teuthology.kill:2021-06-01 04:57:08,389.389 INFO:teuthology.lock.ops:unlocked smithi173.front.sepia.ceph.com 2021-06-01T04:59:09.590 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-06-01T04:59:09.680 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2021-06-01T04:59:09.680 INFO:teuthology.nuke:Checking targets against current locks 2021-06-01T04:59:09.746 INFO:teuthology.nuke:Not nuking smithi173.front.sepia.ceph.com because description doesn't match 2021-06-01T04:59:09.747 INFO:teuthology.nuke:Not nuking smithi191.front.sepia.ceph.com because description doesn't match