2021-05-20T10:47:24.100 INFO:root:teuthology version: 1.1.0-471a2f1e 2021-05-20T10:47:24.198 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi043.front.sepia.ceph.com' reimaging 2021-05-20T10:47:24.199 INFO:teuthology.lock.ops:Updating [ubuntu@smithi043.front.sepia.ceph.com]: reset os type and version on server 2021-05-20T10:47:24.200 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server 2021-05-20T10:47:24.217 INFO:teuthology.lock.ops:Node 'ubuntu@smithi043.front.sepia.ceph.com' reimaging is complete 2021-05-20T10:47:24.217 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi049.front.sepia.ceph.com' reimaging 2021-05-20T10:47:24.218 INFO:teuthology.lock.ops:Updating [ubuntu@smithi049.front.sepia.ceph.com]: reset os type and version on server 2021-05-20T10:47:24.218 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server 2021-05-20T10:47:24.233 INFO:teuthology.lock.ops:Node 'ubuntu@smithi049.front.sepia.ceph.com' reimaging is complete 2021-05-20T10:47:24.422 INFO:teuthology.provision.fog.smithi043:Scheduling deploy of rhel 8.3 2021-05-20T10:47:24.443 INFO:teuthology.provision.fog.smithi049:Scheduling deploy of rhel 8.3 2021-05-20T10:47:24.838 INFO:teuthology.orchestra.console:Power off smithi043 2021-05-20T10:47:24.851 INFO:teuthology.orchestra.console:Power off smithi049 2021-05-20T10:47:33.224 INFO:teuthology.orchestra.console:Power off for smithi049 completed 2021-05-20T10:47:33.230 INFO:teuthology.orchestra.console:Power off for smithi043 completed 2021-05-20T10:47:33.326 INFO:teuthology.orchestra.console:Power on smithi049 2021-05-20T10:47:33.335 INFO:teuthology.orchestra.console:Power on smithi043 2021-05-20T10:47:41.693 INFO:teuthology.orchestra.console:Power on for smithi049 completed 2021-05-20T10:47:41.700 INFO:teuthology.orchestra.console:Power on for smithi043 completed 2021-05-20T10:47:41.794 INFO:teuthology.provision.fog.smithi049:Waiting for deploy to finish 2021-05-20T10:47:41.801 INFO:teuthology.provision.fog.smithi043:Waiting for deploy to finish 2021-05-20T10:51:58.945 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-05-20T10:51:59.237 INFO:teuthology.provision.fog.smithi043:Node is ready 2021-05-20T10:51:59.252 INFO:teuthology.orchestra.run.smithi043.stdout:smithi043.front.sepia.ceph.com 2021-05-20T10:51:59.307 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43 smithi043.front.sepia.ceph.com smithi043 2021-05-20T10:51:59.623 INFO:teuthology.provision.fog.smithi043:Deploy complete! 2021-05-20T10:52:13.940 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-05-20T10:52:14.255 INFO:teuthology.provision.fog.smithi049:Node is ready 2021-05-20T10:52:14.270 INFO:teuthology.orchestra.run.smithi049.stdout:smithi049.front.sepia.ceph.com 2021-05-20T10:52:14.325 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49 smithi049.front.sepia.ceph.com smithi049 2021-05-20T10:52:14.656 INFO:teuthology.provision.fog.smithi049:Deploy complete! 2021-05-20T10:52:14.785 INFO:teuthology.lock.ops:Checking smithi043.front.sepia.ceph.com 2021-05-20T10:52:14.786 INFO:teuthology.lock.ops:New key found. Updating... 2021-05-20T10:52:14.807 INFO:teuthology.lock.ops:Checking smithi049.front.sepia.ceph.com 2021-05-20T10:52:14.808 INFO:teuthology.lock.ops:New key found. Updating... 2021-05-20T10:52:14.823 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: set os type and version on server 2021-05-20T10:52:14.824 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-05-20T10:52:15.121 INFO:teuthology.orchestra.run.smithi043.stdout:x86_64 2021-05-20T10:52:15.176 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="Red Hat Enterprise Linux" 2021-05-20T10:52:15.176 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="8.3 (Ootpa)" 2021-05-20T10:52:15.177 INFO:teuthology.orchestra.run.smithi043.stdout:ID="rhel" 2021-05-20T10:52:15.177 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="fedora" 2021-05-20T10:52:15.177 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="8.3" 2021-05-20T10:52:15.177 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el8" 2021-05-20T10:52:15.178 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2021-05-20T10:52:15.178 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31" 2021-05-20T10:52:15.178 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2021-05-20T10:52:15.179 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://www.redhat.com/" 2021-05-20T10:52:15.179 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-05-20T10:52:15.179 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-05-20T10:52:15.179 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-05-20T10:52:15.180 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2021-05-20T10:52:15.180 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-05-20T10:52:15.180 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2021-05-20T10:52:15.181 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server 2021-05-20T10:52:15.197 INFO:teuthology.lock.ops:Updating [smithi049.front.sepia.ceph.com]: set os type and version on server 2021-05-20T10:52:15.197 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-05-20T10:52:15.483 INFO:teuthology.orchestra.run.smithi049.stdout:x86_64 2021-05-20T10:52:15.537 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="Red Hat Enterprise Linux" 2021-05-20T10:52:15.538 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="8.3 (Ootpa)" 2021-05-20T10:52:15.538 INFO:teuthology.orchestra.run.smithi049.stdout:ID="rhel" 2021-05-20T10:52:15.538 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE="fedora" 2021-05-20T10:52:15.539 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="8.3" 2021-05-20T10:52:15.539 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM_ID="platform:el8" 2021-05-20T10:52:15.539 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2021-05-20T10:52:15.539 INFO:teuthology.orchestra.run.smithi049.stdout:ANSI_COLOR="0;31" 2021-05-20T10:52:15.540 INFO:teuthology.orchestra.run.smithi049.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2021-05-20T10:52:15.540 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://www.redhat.com/" 2021-05-20T10:52:15.540 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-05-20T10:52:15.540 INFO:teuthology.orchestra.run.smithi049.stdout: 2021-05-20T10:52:15.540 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-05-20T10:52:15.541 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2021-05-20T10:52:15.541 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-05-20T10:52:15.541 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2021-05-20T10:52:15.542 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server 2021-05-20T10:52:16.776 INFO:teuthology.dispatcher.supervisor:Running job 6124751 2021-05-20T10:52:16.776 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_471a2f1efab907807e62c17be86bf6fb1a2f4522/virtualenv/bin/teuthology -v --owner scheduled_benhanokh@teuthology --archive /home/teuthworker/archive/benhanokh-2021-05-20_07:52:50-rados-wip_gbenhano_ncb3-distro-basic-smithi/6124751 --name benhanokh-2021-05-20_07:52:50-rados-wip_gbenhano_ncb3-distro-basic-smithi --description rados/cephadm/smoke-roleless/{0-distro/rhel_8.3_kubic_stable 1-start 2-services/rgw-ingress 3-final} -- /home/teuthworker/archive/benhanokh-2021-05-20_07:52:50-rados-wip_gbenhano_ncb3-distro-basic-smithi/6124751/orig.config.yaml 2021-05-20T10:52:16.779 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/benhanokh-2021-05-20_07:52:50-rados-wip_gbenhano_ncb3-distro-basic-smithi/6124751 2021-05-20T10:52:16.780 INFO:teuthology.dispatcher.supervisor:Job PID: 21645 2021-05-20T10:52:16.780 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-05-20T22:53:04.567 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-05-20T22:53:04.766 INFO:teuthology.kill:Killing Pids: {21645} 2021-05-20T22:53:05.863 INFO:teuthology.kill:Nuking machines: ['smithi043', 'smithi049'] 2021-05-20T22:53:06.823 INFO:teuthology.kill:2021-05-20 22:53:06,823.823 INFO:teuthology.nuke:targets: 2021-05-20T22:53:06.824 INFO:teuthology.kill: smithi043.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJrzYauF7W0VPvOsiy2XTdPiNePFgrsO2m+RmBxiFK6LY+LN8fsRZBTYQkb28jwpWU/RVd/IKcrSOu3jlMPHKvl/9xYftgP4hSk90RRXXlbiNSgX6ahiSLeLs3XTkcBUfuEtc47oQceFirL5rt5wGhBRrlPxk9Cl6lZJpLV5RhHMnoQWSHXqMBUnsCqdIdSna9jfKvmuJ2Z1g/hrXx4BneIVuZWZi8vG62d4RWMz1+zhdDmlOGJY4GGPzj2NGIye5IP2Zmw98GALtnfUwEtMo5yZeGSDF1uzXxrGXwpe6RyfTHFMTOSN2JBaXX399i1SlYJ0CrQb5HGqh38gRv6icksOszhlLlQ8hHoVnqZCcQCDKFttdVtf/6N2/gFw9Jf/FitKqPehuh1ld0xgM6R6pNv3SpZ/jQf+zMhVARHdCG86Zt/ac5OKdJJedVjEXhitpwyS7Fop0go7WA0T7w3k1jWH8nQJV35/GWxqzaRjspI35EYKZpmNwiYQBajbMqeqs= 2021-05-20T22:53:06.824 INFO:teuthology.kill: smithi049.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDB0f63Ws6beY5HJeyolBhQBszWzboWD70NtZeOEvAOPbJHQefEVjOxMnux4+TVsB7T0HckcbOqN63qIPhwVKdpzWdLaXs8/lWN80jD3dwIR6OVPCdlUfWn22m6RV1ezAqh6KxP/ntX7/I5e3Y2+LijQz23kzFxTSOzIkPMH1mD/hzLiHb+IZ6WvPDZGWutMM3XYNgBTNcazQlAMXkNl9z/GEa1gGYZynE2RDDe2f7FjRR93psq/aemUI1hVaduhStHBImqAIrFrjB4leV+XLbZ/wqrgcfL5hY5qaiNkJv7SFfjgdDPdaSggfWTBQ6REbE2mcZOvi3myOAo6Cit5qp7Sp4v/COeuuH1CsDEfmKXDCQKY6ac44LcRsrkSeCb9XDYBYzDJWmDBF5ZBLNiO+66BXbWhV6VhKEQqKEruo7zUns+Pa6me5Bipnw+SRfiMKNgVNrkl6WCNagVpJC6vzvL7LsmDnLn++lJh1T0I8LGQ1TjZTYPlDFQfaQK5pXQCl8= 2021-05-20T22:53:06.824 INFO:teuthology.kill:2021-05-20 22:53:06,823.823 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-05-20T22:53:06.825 INFO:teuthology.kill:2021-05-20 22:53:06,825.825 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-05-20T22:53:06.888 INFO:teuthology.kill:2021-05-20 22:53:06,887.887 INFO:teuthology.orchestra.console:Power off smithi043 2021-05-20T22:53:06.899 INFO:teuthology.kill:2021-05-20 22:53:06,899.899 INFO:teuthology.orchestra.console:Power off smithi049 2021-05-20T22:53:19.372 INFO:teuthology.kill:2021-05-20 22:53:19,372.372 INFO:teuthology.orchestra.console:Power off for smithi043 completed 2021-05-20T22:53:19.378 INFO:teuthology.kill:2021-05-20 22:53:19,378.378 INFO:teuthology.orchestra.console:Power off for smithi049 completed 2021-05-20T22:53:19.633 INFO:teuthology.task.internal:roles: ubuntu@smithi043.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2021-05-20T22:53:19.633 INFO:teuthology.task.internal:roles: ubuntu@smithi049.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2021-05-20T22:53:19.634 INFO:teuthology.misc:Compressing logs... 2021-05-20T22:53:19.634 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-05-20T22:53:38.127 ERROR:teuthology.dispatcher.supervisor:Could not save logs Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_471a2f1efab907807e62c17be86bf6fb1a2f4522/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog teuth_config.archive_base, job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_471a2f1efab907807e62c17be86bf6fb1a2f4522/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives compress_logs(ctx, log_path) File "/home/teuthworker/src/git.ceph.com_git_teuthology_471a2f1efab907807e62c17be86bf6fb1a2f4522/teuthology/misc.py", line 1378, in compress_logs wait=False, File "/home/teuthworker/src/git.ceph.com_git_teuthology_471a2f1efab907807e62c17be86bf6fb1a2f4522/teuthology/orchestra/cluster.py", line 64, in run return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_471a2f1efab907807e62c17be86bf6fb1a2f4522/teuthology/orchestra/cluster.py", line 64, in return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_471a2f1efab907807e62c17be86bf6fb1a2f4522/teuthology/orchestra/remote.py", line 509, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_471a2f1efab907807e62c17be86bf6fb1a2f4522/teuthology/orchestra/run.py", line 434, in run transport = client.get_transport() AttributeError: 'NoneType' object has no attribute 'get_transport' 2021-05-20T22:53:38.187 INFO:teuthology.kill:No teuthology processes running 2021-05-20T22:53:39.304 INFO:teuthology.kill:Nuking machines: ['smithi043', 'smithi049'] 2021-05-20T22:53:40.369 INFO:teuthology.kill:2021-05-20 22:53:40,368.368 INFO:teuthology.nuke:targets: 2021-05-20T22:53:40.369 INFO:teuthology.kill: smithi043.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJrzYauF7W0VPvOsiy2XTdPiNePFgrsO2m+RmBxiFK6LY+LN8fsRZBTYQkb28jwpWU/RVd/IKcrSOu3jlMPHKvl/9xYftgP4hSk90RRXXlbiNSgX6ahiSLeLs3XTkcBUfuEtc47oQceFirL5rt5wGhBRrlPxk9Cl6lZJpLV5RhHMnoQWSHXqMBUnsCqdIdSna9jfKvmuJ2Z1g/hrXx4BneIVuZWZi8vG62d4RWMz1+zhdDmlOGJY4GGPzj2NGIye5IP2Zmw98GALtnfUwEtMo5yZeGSDF1uzXxrGXwpe6RyfTHFMTOSN2JBaXX399i1SlYJ0CrQb5HGqh38gRv6icksOszhlLlQ8hHoVnqZCcQCDKFttdVtf/6N2/gFw9Jf/FitKqPehuh1ld0xgM6R6pNv3SpZ/jQf+zMhVARHdCG86Zt/ac5OKdJJedVjEXhitpwyS7Fop0go7WA0T7w3k1jWH8nQJV35/GWxqzaRjspI35EYKZpmNwiYQBajbMqeqs= 2021-05-20T22:53:40.370 INFO:teuthology.kill: smithi049.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDB0f63Ws6beY5HJeyolBhQBszWzboWD70NtZeOEvAOPbJHQefEVjOxMnux4+TVsB7T0HckcbOqN63qIPhwVKdpzWdLaXs8/lWN80jD3dwIR6OVPCdlUfWn22m6RV1ezAqh6KxP/ntX7/I5e3Y2+LijQz23kzFxTSOzIkPMH1mD/hzLiHb+IZ6WvPDZGWutMM3XYNgBTNcazQlAMXkNl9z/GEa1gGYZynE2RDDe2f7FjRR93psq/aemUI1hVaduhStHBImqAIrFrjB4leV+XLbZ/wqrgcfL5hY5qaiNkJv7SFfjgdDPdaSggfWTBQ6REbE2mcZOvi3myOAo6Cit5qp7Sp4v/COeuuH1CsDEfmKXDCQKY6ac44LcRsrkSeCb9XDYBYzDJWmDBF5ZBLNiO+66BXbWhV6VhKEQqKEruo7zUns+Pa6me5Bipnw+SRfiMKNgVNrkl6WCNagVpJC6vzvL7LsmDnLn++lJh1T0I8LGQ1TjZTYPlDFQfaQK5pXQCl8= 2021-05-20T22:53:40.390 INFO:teuthology.kill:2021-05-20 22:53:40,390.390 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-05-20T22:53:40.393 INFO:teuthology.kill:2021-05-20 22:53:40,393.393 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-05-20T22:53:40.450 INFO:teuthology.kill:2021-05-20 22:53:40,449.449 INFO:teuthology.orchestra.console:Power off smithi049 2021-05-20T22:53:40.469 INFO:teuthology.kill:2021-05-20 22:53:40,468.468 INFO:teuthology.orchestra.console:Power off smithi043 2021-05-20T22:53:40.602 INFO:teuthology.kill:2021-05-20 22:53:40,602.602 INFO:teuthology.orchestra.console:Power off for smithi049 completed 2021-05-20T22:53:40.614 INFO:teuthology.kill:2021-05-20 22:53:40,614.614 INFO:teuthology.orchestra.console:Power off for smithi043 completed 2021-05-20T22:53:40.742 INFO:teuthology.kill:2021-05-20 22:53:40,742.742 INFO:teuthology.lock.ops:unlocked smithi049.front.sepia.ceph.com 2021-05-20T22:53:40.750 INFO:teuthology.kill:2021-05-20 22:53:40,750.750 INFO:teuthology.lock.ops:unlocked smithi043.front.sepia.ceph.com 2021-05-20T22:55:41.026 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-05-20T22:55:41.117 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2021-05-20T22:55:41.118 INFO:teuthology.nuke:Checking targets against current locks 2021-05-20T22:55:41.193 INFO:teuthology.nuke:Not nuking smithi049.front.sepia.ceph.com because description doesn't match 2021-05-20T22:55:41.194 INFO:teuthology.nuke:Not nuking smithi043.front.sepia.ceph.com because description doesn't match