2021-05-26T05:59:01.525 INFO:root:teuthology version: 1.1.0-0c70841a 2021-05-26T05:59:01.615 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi046.front.sepia.ceph.com' reimaging 2021-05-26T05:59:01.616 INFO:teuthology.lock.ops:Updating [ubuntu@smithi046.front.sepia.ceph.com]: reset os type and version on server 2021-05-26T05:59:01.616 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2021-05-26T05:59:01.634 INFO:teuthology.lock.ops:Node 'ubuntu@smithi046.front.sepia.ceph.com' reimaging is complete 2021-05-26T05:59:01.635 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi071.front.sepia.ceph.com' reimaging 2021-05-26T05:59:01.635 INFO:teuthology.lock.ops:Updating [ubuntu@smithi071.front.sepia.ceph.com]: reset os type and version on server 2021-05-26T05:59:01.635 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2021-05-26T05:59:01.654 INFO:teuthology.lock.ops:Node 'ubuntu@smithi071.front.sepia.ceph.com' reimaging is complete 2021-05-26T05:59:01.844 INFO:teuthology.provision.fog.smithi046:Scheduling deploy of ubuntu 20.04 2021-05-26T05:59:01.861 INFO:teuthology.provision.fog.smithi071:Scheduling deploy of ubuntu 20.04 2021-05-26T05:59:02.218 INFO:teuthology.orchestra.console:Power off smithi046 2021-05-26T05:59:02.233 INFO:teuthology.orchestra.console:Power off smithi071 2021-05-26T05:59:02.362 INFO:teuthology.orchestra.console:Power off for smithi046 completed 2021-05-26T05:59:02.374 INFO:teuthology.orchestra.console:Power off for smithi071 completed 2021-05-26T05:59:02.464 INFO:teuthology.orchestra.console:Power on smithi046 2021-05-26T05:59:02.476 INFO:teuthology.orchestra.console:Power on smithi071 2021-05-26T05:59:06.720 INFO:teuthology.orchestra.console:Power on for smithi046 completed 2021-05-26T05:59:06.821 INFO:teuthology.provision.fog.smithi046:Waiting for deploy to finish 2021-05-26T05:59:10.839 INFO:teuthology.orchestra.console:Power on for smithi071 completed 2021-05-26T05:59:10.940 INFO:teuthology.provision.fog.smithi071:Waiting for deploy to finish 2021-05-26T06:03:59.750 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-05-26T06:04:00.225 INFO:teuthology.provision.fog.smithi046:Node is ready 2021-05-26T06:04:00.232 INFO:teuthology.orchestra.run.smithi046.stdout:smithi046.front.sepia.ceph.com 2021-05-26T06:04:00.281 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2021-05-26T06:04:00.410 INFO:teuthology.provision.fog.smithi046:Deploy complete! 2021-05-26T06:04:11.539 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-05-26T06:04:12.266 INFO:teuthology.provision.fog.smithi071:Node is ready 2021-05-26T06:04:12.272 INFO:teuthology.orchestra.run.smithi071.stdout:smithi071.front.sepia.ceph.com 2021-05-26T06:04:12.321 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71 smithi071.front.sepia.ceph.com smithi071 2021-05-26T06:04:12.508 INFO:teuthology.provision.fog.smithi071:Deploy complete! 2021-05-26T06:04:12.679 INFO:teuthology.lock.ops:Checking smithi046.front.sepia.ceph.com 2021-05-26T06:04:12.680 INFO:teuthology.lock.ops:New key found. Updating... 2021-05-26T06:04:12.702 INFO:teuthology.lock.ops:Checking smithi071.front.sepia.ceph.com 2021-05-26T06:04:12.702 INFO:teuthology.lock.ops:New key found. Updating... 2021-05-26T06:04:12.721 INFO:teuthology.lock.ops:Updating [smithi046.front.sepia.ceph.com]: set os type and version on server 2021-05-26T06:04:12.722 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-05-26T06:04:12.982 INFO:teuthology.orchestra.run.smithi046.stdout:x86_64 2021-05-26T06:04:12.989 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="Ubuntu" 2021-05-26T06:04:12.989 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="20.04.2 LTS (Focal Fossa)" 2021-05-26T06:04:12.989 INFO:teuthology.orchestra.run.smithi046.stdout:ID=ubuntu 2021-05-26T06:04:12.989 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE=debian 2021-05-26T06:04:12.990 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS" 2021-05-26T06:04:12.990 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="20.04" 2021-05-26T06:04:12.990 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://www.ubuntu.com/" 2021-05-26T06:04:12.991 INFO:teuthology.orchestra.run.smithi046.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-05-26T06:04:12.991 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-05-26T06:04:12.991 INFO:teuthology.orchestra.run.smithi046.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-05-26T06:04:12.991 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_CODENAME=focal 2021-05-26T06:04:12.991 INFO:teuthology.orchestra.run.smithi046.stdout:UBUNTU_CODENAME=focal 2021-05-26T06:04:12.992 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2021-05-26T06:04:13.011 INFO:teuthology.lock.ops:Updating [smithi071.front.sepia.ceph.com]: set os type and version on server 2021-05-26T06:04:13.011 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-05-26T06:04:13.182 INFO:teuthology.orchestra.run.smithi071.stdout:x86_64 2021-05-26T06:04:13.188 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="Ubuntu" 2021-05-26T06:04:13.188 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="20.04.2 LTS (Focal Fossa)" 2021-05-26T06:04:13.189 INFO:teuthology.orchestra.run.smithi071.stdout:ID=ubuntu 2021-05-26T06:04:13.189 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE=debian 2021-05-26T06:04:13.189 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS" 2021-05-26T06:04:13.190 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="20.04" 2021-05-26T06:04:13.190 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://www.ubuntu.com/" 2021-05-26T06:04:13.190 INFO:teuthology.orchestra.run.smithi071.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-05-26T06:04:13.190 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-05-26T06:04:13.191 INFO:teuthology.orchestra.run.smithi071.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-05-26T06:04:13.191 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_CODENAME=focal 2021-05-26T06:04:13.191 INFO:teuthology.orchestra.run.smithi071.stdout:UBUNTU_CODENAME=focal 2021-05-26T06:04:13.191 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2021-05-26T06:04:13.273 INFO:teuthology.dispatcher.supervisor:Running job 6134862 2021-05-26T06:04:13.273 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_0c70841acf4fb31ca05cdbebbd295620aac53ce4/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2021-05-25_19:30:22-fs-wip-yuri4-testing-2021-05-25-0940-pacific-distro-basic-smithi/6134862 --name yuriw-2021-05-25_19:30:22-fs-wip-yuri4-testing-2021-05-25-0940-pacific-distro-basic-smithi --description fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down} tasks/failover} -- /home/teuthworker/archive/yuriw-2021-05-25_19:30:22-fs-wip-yuri4-testing-2021-05-25-0940-pacific-distro-basic-smithi/6134862/orig.config.yaml 2021-05-26T06:04:13.277 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2021-05-25_19:30:22-fs-wip-yuri4-testing-2021-05-25-0940-pacific-distro-basic-smithi/6134862 2021-05-26T06:04:13.278 INFO:teuthology.dispatcher.supervisor:Job PID: 5950 2021-05-26T06:04:13.278 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-05-26T18:05:02.759 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-05-26T18:05:02.968 INFO:teuthology.kill:Killing Pids: {5950} 2021-05-26T18:05:04.097 INFO:teuthology.kill:Nuking machines: ['smithi046', 'smithi071'] 2021-05-26T18:05:05.055 INFO:teuthology.kill:2021-05-26 18:05:05,055.055 INFO:teuthology.nuke:targets: 2021-05-26T18:05:05.056 INFO:teuthology.kill: smithi046.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCtas/uf9szC39MbKBCPH4gEAUiulDM37+fYiO4ueTUzaVSYt27zTQi4sXHBa+dQmtNfFQQtE9+OIPcs6mPWaaJaCbjipdQ7xZXZlhr2Gvb/pjOQf6G+Xt2FFbYwZ/x6INpUMEmoVkiOQj7wdDFAxiAj3WG4lQfGZgubKb8lxxSlaSG1IhJNzUVgQmf3FvJsUDzFfPq0r8yZsWEfpBI8NU4jKH3LOS3c4ofTXDMvzYO57Hfdgad710HFs6A+9IQ5SkuZ/Bfhs2A/vAvCQH9v+Pc5ivftPALnRMUFmBVPXitDRJM5qDWKSuRc43bYLjLKS1OdpUU7cv+MoyG+9gZvISv4sS/mhz2q7l3Agv4/P6dF0N4c+oPe2r6IpPOZrvZBQW0MBgc9zMiGB+WxCv+EfCrlwN0m++sYabn3PEIeVqGRT4NOTyqbEBBvS0QPJueEXL6tgmeaRnA4K5WOA6/145U3Oq/XkiaH/NL3WqFFdvSNBLYfysCybNkW/54EGdYtD8= 2021-05-26T18:05:05.056 INFO:teuthology.kill: smithi071.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDsyTnvbs2IT8C12T65q5cHVZ2lQItCP7Gs5UObYraaVXG+uR+oJ50Msd6W/SiD6fsxtBseLqiwGG4BhqZNbAFuL+j2qINWvY71dbtItu86s7x2gvTENhgSMRblYBs/xw/n3i2v6K6nU9uQtXap3F4u4E5wXKSBxhG7pZvk2JhgpW0wsU9KEfuGhtV9UxreKY9Zii8RZ9YQxsgbeOIew0nFK+GVJZaJd+1xNheM0657KovIOZ/GAEBROqwZy7CrPX3bjDwqqotrjTNKiCjODQ08nBD2FpJIWYpqE5GKARf0W/yzkYGMkT/7YryUzmcF8gOSs2ueLzXtl0kjWYgovjLPnhGWKkS77rKjLZ1c5iYmG8wGa7hvQ6XMY6tG/dXNKmgLEhQqNh77GR2F4on7PqzoDKxtk10+ftCxOoAfDYmpnntKvt6e+aog1AXUUV7O0cC+jdMg3fyIo6YrbUfc3Y5VyL5w1m8e6DotH6fF6Og1r753Qj8hTxtZ3Lce3cd5QeU= 2021-05-26T18:05:05.057 INFO:teuthology.kill:2021-05-26 18:05:05,055.055 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-05-26T18:05:05.057 INFO:teuthology.kill:2021-05-26 18:05:05,057.057 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-05-26T18:05:05.113 INFO:teuthology.kill:2021-05-26 18:05:05,113.113 INFO:teuthology.orchestra.console:Power off smithi071 2021-05-26T18:05:05.127 INFO:teuthology.kill:2021-05-26 18:05:05,127.127 INFO:teuthology.orchestra.console:Power off smithi046 2021-05-26T18:05:13.483 INFO:teuthology.kill:2021-05-26 18:05:13,483.483 INFO:teuthology.orchestra.console:Power off for smithi071 completed 2021-05-26T18:05:17.600 INFO:teuthology.kill:2021-05-26 18:05:17,599.599 INFO:teuthology.orchestra.console:Power off for smithi046 completed 2021-05-26T18:05:17.848 INFO:teuthology.task.internal:roles: ubuntu@smithi046.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2021-05-26T18:05:17.849 INFO:teuthology.task.internal:roles: ubuntu@smithi071.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2021-05-26T18:05:17.849 INFO:teuthology.misc:Compressing logs... 2021-05-26T18:05:17.850 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-05-26T18:06:17.912 ERROR:teuthology.dispatcher.supervisor:Could not save logs Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_0c70841acf4fb31ca05cdbebbd295620aac53ce4/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog teuth_config.archive_base, job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0c70841acf4fb31ca05cdbebbd295620aac53ce4/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives compress_logs(ctx, log_path) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0c70841acf4fb31ca05cdbebbd295620aac53ce4/teuthology/misc.py", line 1378, in compress_logs wait=False, File "/home/teuthworker/src/git.ceph.com_git_teuthology_0c70841acf4fb31ca05cdbebbd295620aac53ce4/teuthology/orchestra/cluster.py", line 64, in run return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_0c70841acf4fb31ca05cdbebbd295620aac53ce4/teuthology/orchestra/cluster.py", line 64, in return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_0c70841acf4fb31ca05cdbebbd295620aac53ce4/teuthology/orchestra/remote.py", line 509, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0c70841acf4fb31ca05cdbebbd295620aac53ce4/teuthology/orchestra/run.py", line 434, in run transport = client.get_transport() AttributeError: 'NoneType' object has no attribute 'get_transport' 2021-05-26T18:06:17.992 INFO:teuthology.kill:No teuthology processes running 2021-05-26T18:06:19.247 INFO:teuthology.kill:Nuking machines: ['smithi046', 'smithi071'] 2021-05-26T18:06:20.223 INFO:teuthology.kill:2021-05-26 18:06:20,223.223 INFO:teuthology.nuke:targets: 2021-05-26T18:06:20.225 INFO:teuthology.kill: smithi046.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCtas/uf9szC39MbKBCPH4gEAUiulDM37+fYiO4ueTUzaVSYt27zTQi4sXHBa+dQmtNfFQQtE9+OIPcs6mPWaaJaCbjipdQ7xZXZlhr2Gvb/pjOQf6G+Xt2FFbYwZ/x6INpUMEmoVkiOQj7wdDFAxiAj3WG4lQfGZgubKb8lxxSlaSG1IhJNzUVgQmf3FvJsUDzFfPq0r8yZsWEfpBI8NU4jKH3LOS3c4ofTXDMvzYO57Hfdgad710HFs6A+9IQ5SkuZ/Bfhs2A/vAvCQH9v+Pc5ivftPALnRMUFmBVPXitDRJM5qDWKSuRc43bYLjLKS1OdpUU7cv+MoyG+9gZvISv4sS/mhz2q7l3Agv4/P6dF0N4c+oPe2r6IpPOZrvZBQW0MBgc9zMiGB+WxCv+EfCrlwN0m++sYabn3PEIeVqGRT4NOTyqbEBBvS0QPJueEXL6tgmeaRnA4K5WOA6/145U3Oq/XkiaH/NL3WqFFdvSNBLYfysCybNkW/54EGdYtD8= 2021-05-26T18:06:20.225 INFO:teuthology.kill: smithi071.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDsyTnvbs2IT8C12T65q5cHVZ2lQItCP7Gs5UObYraaVXG+uR+oJ50Msd6W/SiD6fsxtBseLqiwGG4BhqZNbAFuL+j2qINWvY71dbtItu86s7x2gvTENhgSMRblYBs/xw/n3i2v6K6nU9uQtXap3F4u4E5wXKSBxhG7pZvk2JhgpW0wsU9KEfuGhtV9UxreKY9Zii8RZ9YQxsgbeOIew0nFK+GVJZaJd+1xNheM0657KovIOZ/GAEBROqwZy7CrPX3bjDwqqotrjTNKiCjODQ08nBD2FpJIWYpqE5GKARf0W/yzkYGMkT/7YryUzmcF8gOSs2ueLzXtl0kjWYgovjLPnhGWKkS77rKjLZ1c5iYmG8wGa7hvQ6XMY6tG/dXNKmgLEhQqNh77GR2F4on7PqzoDKxtk10+ftCxOoAfDYmpnntKvt6e+aog1AXUUV7O0cC+jdMg3fyIo6YrbUfc3Y5VyL5w1m8e6DotH6fF6Og1r753Qj8hTxtZ3Lce3cd5QeU= 2021-05-26T18:06:20.244 INFO:teuthology.kill:2021-05-26 18:06:20,244.244 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-05-26T18:06:20.248 INFO:teuthology.kill:2021-05-26 18:06:20,248.248 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-05-26T18:06:20.307 INFO:teuthology.kill:2021-05-26 18:06:20,306.306 INFO:teuthology.orchestra.console:Power off smithi046 2021-05-26T18:06:20.332 INFO:teuthology.kill:2021-05-26 18:06:20,331.331 INFO:teuthology.orchestra.console:Power off smithi071 2021-05-26T18:06:20.461 INFO:teuthology.kill:2021-05-26 18:06:20,461.461 INFO:teuthology.orchestra.console:Power off for smithi046 completed 2021-05-26T18:06:20.474 INFO:teuthology.kill:2021-05-26 18:06:20,474.474 INFO:teuthology.orchestra.console:Power off for smithi071 completed 2021-05-26T18:06:20.604 INFO:teuthology.kill:2021-05-26 18:06:20,603.603 INFO:teuthology.lock.ops:unlocked smithi046.front.sepia.ceph.com 2021-05-26T18:06:20.612 INFO:teuthology.kill:2021-05-26 18:06:20,612.612 INFO:teuthology.lock.ops:unlocked smithi071.front.sepia.ceph.com 2021-05-26T18:08:20.918 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-05-26T18:08:21.008 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2021-05-26T18:08:21.009 INFO:teuthology.nuke:Checking targets against current locks 2021-05-26T18:08:21.074 INFO:teuthology.nuke:Not nuking smithi071.front.sepia.ceph.com because description doesn't match 2021-05-26T18:08:21.074 INFO:teuthology.nuke:Not nuking smithi046.front.sepia.ceph.com because description doesn't match