2021-06-02T20:53:45.799 INFO:root:teuthology version: 1.1.0-f359b10d 2021-06-02T20:53:45.945 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi095.front.sepia.ceph.com' reimaging 2021-06-02T20:53:45.947 INFO:teuthology.lock.ops:Updating [ubuntu@smithi095.front.sepia.ceph.com]: reset os type and version on server 2021-06-02T20:53:45.947 INFO:teuthology.lock.ops:Updating smithi095.front.sepia.ceph.com on lock server 2021-06-02T20:53:45.970 INFO:teuthology.lock.ops:Node 'ubuntu@smithi095.front.sepia.ceph.com' reimaging is complete 2021-06-02T20:53:45.971 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi173.front.sepia.ceph.com' reimaging 2021-06-02T20:53:45.972 INFO:teuthology.lock.ops:Updating [ubuntu@smithi173.front.sepia.ceph.com]: reset os type and version on server 2021-06-02T20:53:45.974 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2021-06-02T20:53:45.993 INFO:teuthology.lock.ops:Node 'ubuntu@smithi173.front.sepia.ceph.com' reimaging is complete 2021-06-02T20:53:46.176 INFO:teuthology.provision.fog.smithi095:Scheduling deploy of ubuntu 20.04 2021-06-02T20:53:46.182 INFO:teuthology.provision.fog.smithi173:Scheduling deploy of ubuntu 20.04 2021-06-02T20:53:46.558 INFO:teuthology.orchestra.console:Power off smithi095 2021-06-02T20:53:46.631 INFO:teuthology.orchestra.console:Power off smithi173 2021-06-02T20:53:55.018 INFO:teuthology.orchestra.console:Power off for smithi173 completed 2021-06-02T20:53:55.119 INFO:teuthology.orchestra.console:Power on smithi173 2021-06-02T20:53:59.091 INFO:teuthology.orchestra.console:Power off for smithi095 completed 2021-06-02T20:53:59.198 INFO:teuthology.orchestra.console:Power on smithi095 2021-06-02T20:54:03.462 INFO:teuthology.orchestra.console:Power on for smithi095 completed 2021-06-02T20:54:03.511 INFO:teuthology.orchestra.console:Power on for smithi173 completed 2021-06-02T20:54:03.563 INFO:teuthology.provision.fog.smithi095:Waiting for deploy to finish 2021-06-02T20:54:03.613 INFO:teuthology.provision.fog.smithi173:Waiting for deploy to finish 2021-06-02T20:58:58.464 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-06-02T20:58:58.515 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-06-02T20:58:58.874 INFO:teuthology.provision.fog.smithi095:Node is ready 2021-06-02T20:58:58.882 INFO:teuthology.orchestra.run.smithi095.stdout:smithi095.front.sepia.ceph.com 2021-06-02T20:58:58.929 INFO:teuthology.orchestra.run.smithi095.stdout:172.21.15.95 smithi095.front.sepia.ceph.com smithi095 2021-06-02T20:58:58.943 INFO:teuthology.provision.fog.smithi173:Node is ready 2021-06-02T20:58:58.954 INFO:teuthology.orchestra.run.smithi173.stdout:smithi173.front.sepia.ceph.com 2021-06-02T20:58:59.001 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.15.173 smithi173.front.sepia.ceph.com smithi173 2021-06-02T20:58:59.142 INFO:teuthology.provision.fog.smithi095:Deploy complete! 2021-06-02T20:58:59.204 INFO:teuthology.provision.fog.smithi173:Deploy complete! 2021-06-02T20:58:59.373 INFO:teuthology.lock.ops:Checking smithi095.front.sepia.ceph.com 2021-06-02T20:58:59.374 INFO:teuthology.lock.ops:New key found. Updating... 2021-06-02T20:58:59.394 INFO:teuthology.lock.ops:Checking smithi173.front.sepia.ceph.com 2021-06-02T20:58:59.395 INFO:teuthology.lock.ops:New key found. Updating... 2021-06-02T20:58:59.409 INFO:teuthology.lock.ops:Updating [smithi095.front.sepia.ceph.com]: set os type and version on server 2021-06-02T20:58:59.409 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-06-02T20:58:59.578 INFO:teuthology.orchestra.run.smithi095.stdout:x86_64 2021-06-02T20:58:59.629 INFO:teuthology.orchestra.run.smithi095.stdout:NAME="Ubuntu" 2021-06-02T20:58:59.630 INFO:teuthology.orchestra.run.smithi095.stdout:VERSION="20.04.2 LTS (Focal Fossa)" 2021-06-02T20:58:59.631 INFO:teuthology.orchestra.run.smithi095.stdout:ID=ubuntu 2021-06-02T20:58:59.631 INFO:teuthology.orchestra.run.smithi095.stdout:ID_LIKE=debian 2021-06-02T20:58:59.631 INFO:teuthology.orchestra.run.smithi095.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS" 2021-06-02T20:58:59.631 INFO:teuthology.orchestra.run.smithi095.stdout:VERSION_ID="20.04" 2021-06-02T20:58:59.632 INFO:teuthology.orchestra.run.smithi095.stdout:HOME_URL="https://www.ubuntu.com/" 2021-06-02T20:58:59.632 INFO:teuthology.orchestra.run.smithi095.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-06-02T20:58:59.632 INFO:teuthology.orchestra.run.smithi095.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-06-02T20:58:59.632 INFO:teuthology.orchestra.run.smithi095.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-06-02T20:58:59.632 INFO:teuthology.orchestra.run.smithi095.stdout:VERSION_CODENAME=focal 2021-06-02T20:58:59.633 INFO:teuthology.orchestra.run.smithi095.stdout:UBUNTU_CODENAME=focal 2021-06-02T20:58:59.634 INFO:teuthology.lock.ops:Updating smithi095.front.sepia.ceph.com on lock server 2021-06-02T20:58:59.650 INFO:teuthology.lock.ops:Updating [smithi173.front.sepia.ceph.com]: set os type and version on server 2021-06-02T20:58:59.650 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-06-02T20:58:59.815 INFO:teuthology.orchestra.run.smithi173.stdout:x86_64 2021-06-02T20:58:59.824 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="Ubuntu" 2021-06-02T20:58:59.824 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="20.04.2 LTS (Focal Fossa)" 2021-06-02T20:58:59.824 INFO:teuthology.orchestra.run.smithi173.stdout:ID=ubuntu 2021-06-02T20:58:59.825 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE=debian 2021-06-02T20:58:59.825 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS" 2021-06-02T20:58:59.825 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="20.04" 2021-06-02T20:58:59.826 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://www.ubuntu.com/" 2021-06-02T20:58:59.826 INFO:teuthology.orchestra.run.smithi173.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-06-02T20:58:59.826 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-06-02T20:58:59.826 INFO:teuthology.orchestra.run.smithi173.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-06-02T20:58:59.827 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_CODENAME=focal 2021-06-02T20:58:59.827 INFO:teuthology.orchestra.run.smithi173.stdout:UBUNTU_CODENAME=focal 2021-06-02T20:58:59.827 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2021-06-02T20:58:59.917 INFO:teuthology.dispatcher.supervisor:Running job 6146460 2021-06-02T20:58:59.918 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/virtualenv/bin/teuthology -v --owner scheduled_sage@teuthology --archive /home/teuthworker/archive/sage-2021-06-02_18:04:29-rados-wip-sage-testing-2021-06-02-1138-distro-basic-smithi/6146460 --name sage-2021-06-02_18:04:29-rados-wip-sage-testing-2021-06-02-1138-distro-basic-smithi --description rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/nfs-ingress 3-final} -- /home/teuthworker/archive/sage-2021-06-02_18:04:29-rados-wip-sage-testing-2021-06-02-1138-distro-basic-smithi/6146460/orig.config.yaml 2021-06-02T20:58:59.921 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/sage-2021-06-02_18:04:29-rados-wip-sage-testing-2021-06-02-1138-distro-basic-smithi/6146460 2021-06-02T20:58:59.921 INFO:teuthology.dispatcher.supervisor:Job PID: 5396 2021-06-02T20:58:59.922 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-06-03T08:59:50.849 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-06-03T08:59:51.266 INFO:teuthology.kill:Killing Pids: {5396} 2021-06-03T08:59:52.793 INFO:teuthology.kill:Nuking machines: ['smithi095', 'smithi173'] 2021-06-03T08:59:54.399 INFO:teuthology.kill:2021-06-03 08:59:54,395.395 INFO:teuthology.nuke:targets: 2021-06-03T08:59:54.401 INFO:teuthology.kill: smithi095.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCr7qzIg1Wu48kWCao3TpELCSf4MD1IgRfWImStcq2Zua4YdfhIKKKJ1sjuLM2FlTgnEdZSKOdrt+UmNRqegdylVlcYHfCvMfzoZ7ET/IdaCI+++0SoqYWmSoimdL5BYCcXiJBLVesEUyzl4rnWT31FJGv0G01pSvpOoikYWjMUBYh0xLM9Mk3PIG1SwVu/mEhuZsw6lJfwOlGUF6gXIKhujb9HIu1ZmYgrbr33QvYAwH3ffPfi4hbZO/8BFogfjKlGCJYsDIp3tziK0pSc6faml1N1ZLhybm6e9p1m75+M6L3P0u4B8jfs9gmNp2SDdeKW/NkDAntgZ1Fw1QDcDUWAVbYw1/mLAhxFZomX2cHnLXAi9G/EfkPtC5UNJECSvBSWYgR7xE/2+0fCuywWktMxmC0w/i/Upaakl/d7yu0FN2ta9c5TtsgR/Xku35uSoX/QHfvfVN8Cjj6c2XCs3OFO6zAFM1MmXCEtEPRXg5pBW+avr+lpKvGnwpwSFle6FV8= 2021-06-03T08:59:54.401 INFO:teuthology.kill: smithi173.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCvAIv2wYO8ATsq5BAEdBVBChuqdcdDdMc9Ih6kBBJdr+s1E2vHs7oVxAYm2AIikQw4BBMH294Qg8ZcbUOrBshKQmCOWk+4EJaj+KcjDv2lf+7uaiX/adN71EROXE2caA0FsNMzcCmXe8u23Birot/OoSHd2UFML/bEDy05K9BGwnmyQ/nQf9qvGhkgz1pUUmeTwjSOViDimSnMXmoIJUihVy79XkNxwC2CZtgjbTF5DJA9j6MQj2EDKBLqwxH53J5rA5ldTWw60lrH/zwvywQlJL0FC7QyuC3u0wJks/pytzdhe6FqfGRSNaX0iAwP66ghPITUOlgn2YgiZ3Ni/7Sv0hUpguJCzXSHnWj8T10yMmXdqarMtpoqHWHtroYBXJNVRXUleKYYo+EzzkgbOewGlSKaFGxHWJ0CM6hhID/LwQtbau0dzmMGaTPD1sqGpETRe02qF8ujPFsSnqmKjaOolaxKm6UTKwIb/A/bVLvGy5hG39jGu2qNmTsYQ2FgIb0= 2021-06-03T08:59:54.402 INFO:teuthology.kill:2021-06-03 08:59:54,396.396 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-06-03T08:59:54.408 INFO:teuthology.kill:2021-06-03 08:59:54,398.398 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-06-03T08:59:54.557 INFO:teuthology.kill:2021-06-03 08:59:54,556.556 INFO:teuthology.orchestra.console:Power off smithi173 2021-06-03T08:59:54.613 INFO:teuthology.kill:2021-06-03 08:59:54,612.612 INFO:teuthology.orchestra.console:Power off smithi095 2021-06-03T09:00:03.070 INFO:teuthology.kill:2021-06-03 09:00:03,069.069 INFO:teuthology.orchestra.console:Power off for smithi173 completed 2021-06-03T09:00:07.223 INFO:teuthology.kill:2021-06-03 09:00:07,223.223 INFO:teuthology.orchestra.console:Power off for smithi095 completed 2021-06-03T09:00:07.546 INFO:teuthology.task.internal:roles: ubuntu@smithi095.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2021-06-03T09:00:07.547 INFO:teuthology.task.internal:roles: ubuntu@smithi173.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2021-06-03T09:00:07.547 INFO:teuthology.misc:Compressing logs... 2021-06-03T09:00:07.550 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-06-03T09:01:07.611 ERROR:teuthology.dispatcher.supervisor:Could not save logs Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog teuth_config.archive_base, job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives compress_logs(ctx, log_path) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/misc.py", line 1378, in compress_logs wait=False, File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/orchestra/cluster.py", line 64, in run return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/orchestra/cluster.py", line 64, in return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/orchestra/remote.py", line 509, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/orchestra/run.py", line 434, in run transport = client.get_transport() AttributeError: 'NoneType' object has no attribute 'get_transport' 2021-06-03T09:01:07.662 INFO:teuthology.kill:No teuthology processes running 2021-06-03T09:01:08.849 INFO:teuthology.kill:Nuking machines: ['smithi095', 'smithi173'] 2021-06-03T09:01:09.844 INFO:teuthology.kill:2021-06-03 09:01:09,844.844 INFO:teuthology.nuke:targets: 2021-06-03T09:01:09.845 INFO:teuthology.kill: smithi095.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCr7qzIg1Wu48kWCao3TpELCSf4MD1IgRfWImStcq2Zua4YdfhIKKKJ1sjuLM2FlTgnEdZSKOdrt+UmNRqegdylVlcYHfCvMfzoZ7ET/IdaCI+++0SoqYWmSoimdL5BYCcXiJBLVesEUyzl4rnWT31FJGv0G01pSvpOoikYWjMUBYh0xLM9Mk3PIG1SwVu/mEhuZsw6lJfwOlGUF6gXIKhujb9HIu1ZmYgrbr33QvYAwH3ffPfi4hbZO/8BFogfjKlGCJYsDIp3tziK0pSc6faml1N1ZLhybm6e9p1m75+M6L3P0u4B8jfs9gmNp2SDdeKW/NkDAntgZ1Fw1QDcDUWAVbYw1/mLAhxFZomX2cHnLXAi9G/EfkPtC5UNJECSvBSWYgR7xE/2+0fCuywWktMxmC0w/i/Upaakl/d7yu0FN2ta9c5TtsgR/Xku35uSoX/QHfvfVN8Cjj6c2XCs3OFO6zAFM1MmXCEtEPRXg5pBW+avr+lpKvGnwpwSFle6FV8= 2021-06-03T09:01:09.846 INFO:teuthology.kill: smithi173.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCvAIv2wYO8ATsq5BAEdBVBChuqdcdDdMc9Ih6kBBJdr+s1E2vHs7oVxAYm2AIikQw4BBMH294Qg8ZcbUOrBshKQmCOWk+4EJaj+KcjDv2lf+7uaiX/adN71EROXE2caA0FsNMzcCmXe8u23Birot/OoSHd2UFML/bEDy05K9BGwnmyQ/nQf9qvGhkgz1pUUmeTwjSOViDimSnMXmoIJUihVy79XkNxwC2CZtgjbTF5DJA9j6MQj2EDKBLqwxH53J5rA5ldTWw60lrH/zwvywQlJL0FC7QyuC3u0wJks/pytzdhe6FqfGRSNaX0iAwP66ghPITUOlgn2YgiZ3Ni/7Sv0hUpguJCzXSHnWj8T10yMmXdqarMtpoqHWHtroYBXJNVRXUleKYYo+EzzkgbOewGlSKaFGxHWJ0CM6hhID/LwQtbau0dzmMGaTPD1sqGpETRe02qF8ujPFsSnqmKjaOolaxKm6UTKwIb/A/bVLvGy5hG39jGu2qNmTsYQ2FgIb0= 2021-06-03T09:01:09.865 INFO:teuthology.kill:2021-06-03 09:01:09,865.865 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-06-03T09:01:09.868 INFO:teuthology.kill:2021-06-03 09:01:09,868.868 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-06-03T09:01:09.930 INFO:teuthology.kill:2021-06-03 09:01:09,929.929 INFO:teuthology.orchestra.console:Power off smithi095 2021-06-03T09:01:09.949 INFO:teuthology.kill:2021-06-03 09:01:09,948.948 INFO:teuthology.orchestra.console:Power off smithi173 2021-06-03T09:01:10.081 INFO:teuthology.kill:2021-06-03 09:01:10,080.080 INFO:teuthology.orchestra.console:Power off for smithi095 completed 2021-06-03T09:01:10.093 INFO:teuthology.kill:2021-06-03 09:01:10,092.092 INFO:teuthology.orchestra.console:Power off for smithi173 completed 2021-06-03T09:01:10.222 INFO:teuthology.kill:2021-06-03 09:01:10,221.221 INFO:teuthology.lock.ops:unlocked smithi095.front.sepia.ceph.com 2021-06-03T09:01:10.232 INFO:teuthology.kill:2021-06-03 09:01:10,232.232 INFO:teuthology.lock.ops:unlocked smithi173.front.sepia.ceph.com 2021-06-03T09:03:10.535 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-06-03T09:03:10.620 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2021-06-03T09:03:10.620 INFO:teuthology.nuke:Checking targets against current locks 2021-06-03T09:03:10.703 INFO:teuthology.nuke:Not nuking smithi173.front.sepia.ceph.com because description doesn't match 2021-06-03T09:03:10.704 INFO:teuthology.nuke:Not nuking smithi095.front.sepia.ceph.com because description doesn't match