2021-05-21T00:35:00.260 INFO:root:teuthology version: 1.1.0-471a2f1e 2021-05-21T00:35:00.404 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi008.front.sepia.ceph.com' reimaging 2021-05-21T00:35:00.405 INFO:teuthology.lock.ops:Updating [ubuntu@smithi008.front.sepia.ceph.com]: reset os type and version on server 2021-05-21T00:35:00.405 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2021-05-21T00:35:00.422 INFO:teuthology.lock.ops:Node 'ubuntu@smithi008.front.sepia.ceph.com' reimaging is complete 2021-05-21T00:35:00.423 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi093.front.sepia.ceph.com' reimaging 2021-05-21T00:35:00.423 INFO:teuthology.lock.ops:Updating [ubuntu@smithi093.front.sepia.ceph.com]: reset os type and version on server 2021-05-21T00:35:00.424 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server 2021-05-21T00:35:00.445 INFO:teuthology.lock.ops:Node 'ubuntu@smithi093.front.sepia.ceph.com' reimaging is complete 2021-05-21T00:35:00.672 INFO:teuthology.provision.fog.smithi008:Scheduling deploy of rhel 8.3 2021-05-21T00:35:00.717 INFO:teuthology.provision.fog.smithi093:Scheduling deploy of rhel 8.3 2021-05-21T00:35:01.137 INFO:teuthology.orchestra.console:Power off smithi093 2021-05-21T00:35:01.181 INFO:teuthology.orchestra.console:Power off smithi008 2021-05-21T00:35:09.577 INFO:teuthology.orchestra.console:Power off for smithi008 completed 2021-05-21T00:35:09.678 INFO:teuthology.orchestra.console:Power on smithi008 2021-05-21T00:35:13.629 INFO:teuthology.orchestra.console:Power off for smithi093 completed 2021-05-21T00:35:13.735 INFO:teuthology.orchestra.console:Power on smithi093 2021-05-21T00:35:17.991 INFO:teuthology.orchestra.console:Power on for smithi093 completed 2021-05-21T00:35:18.046 INFO:teuthology.orchestra.console:Power on for smithi008 completed 2021-05-21T00:35:18.093 INFO:teuthology.provision.fog.smithi093:Waiting for deploy to finish 2021-05-21T00:35:18.147 INFO:teuthology.provision.fog.smithi008:Waiting for deploy to finish 2021-05-21T00:39:50.407 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-05-21T00:39:50.748 INFO:teuthology.provision.fog.smithi008:Node is ready 2021-05-21T00:39:50.765 INFO:teuthology.orchestra.run.smithi008.stdout:smithi008.front.sepia.ceph.com 2021-05-21T00:39:50.822 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8 smithi008.front.sepia.ceph.com smithi008 2021-05-21T00:39:51.177 INFO:teuthology.provision.fog.smithi008:Deploy complete! 2021-05-21T00:39:59.413 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-05-21T00:39:59.739 INFO:teuthology.provision.fog.smithi093:Node is ready 2021-05-21T00:39:59.754 INFO:teuthology.orchestra.run.smithi093.stdout:smithi093.front.sepia.ceph.com 2021-05-21T00:39:59.808 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93 smithi093.front.sepia.ceph.com smithi093 2021-05-21T00:40:00.135 INFO:teuthology.provision.fog.smithi093:Deploy complete! 2021-05-21T00:40:00.254 INFO:teuthology.lock.ops:Checking smithi008.front.sepia.ceph.com 2021-05-21T00:40:00.255 INFO:teuthology.lock.ops:New key found. Updating... 2021-05-21T00:40:00.271 INFO:teuthology.lock.ops:Checking smithi093.front.sepia.ceph.com 2021-05-21T00:40:00.272 INFO:teuthology.lock.ops:New key found. Updating... 2021-05-21T00:40:00.285 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: set os type and version on server 2021-05-21T00:40:00.286 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-05-21T00:40:00.580 INFO:teuthology.orchestra.run.smithi008.stdout:x86_64 2021-05-21T00:40:00.634 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="Red Hat Enterprise Linux" 2021-05-21T00:40:00.634 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="8.3 (Ootpa)" 2021-05-21T00:40:00.634 INFO:teuthology.orchestra.run.smithi008.stdout:ID="rhel" 2021-05-21T00:40:00.634 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="fedora" 2021-05-21T00:40:00.635 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="8.3" 2021-05-21T00:40:00.635 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el8" 2021-05-21T00:40:00.635 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2021-05-21T00:40:00.635 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31" 2021-05-21T00:40:00.636 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2021-05-21T00:40:00.636 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://www.redhat.com/" 2021-05-21T00:40:00.636 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-05-21T00:40:00.636 INFO:teuthology.orchestra.run.smithi008.stdout: 2021-05-21T00:40:00.636 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-05-21T00:40:00.637 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2021-05-21T00:40:00.637 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-05-21T00:40:00.637 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2021-05-21T00:40:00.638 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2021-05-21T00:40:00.657 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: set os type and version on server 2021-05-21T00:40:00.658 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-05-21T00:40:00.939 INFO:teuthology.orchestra.run.smithi093.stdout:x86_64 2021-05-21T00:40:00.993 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="Red Hat Enterprise Linux" 2021-05-21T00:40:00.994 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="8.3 (Ootpa)" 2021-05-21T00:40:00.994 INFO:teuthology.orchestra.run.smithi093.stdout:ID="rhel" 2021-05-21T00:40:00.994 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE="fedora" 2021-05-21T00:40:00.995 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="8.3" 2021-05-21T00:40:00.995 INFO:teuthology.orchestra.run.smithi093.stdout:PLATFORM_ID="platform:el8" 2021-05-21T00:40:00.995 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2021-05-21T00:40:00.995 INFO:teuthology.orchestra.run.smithi093.stdout:ANSI_COLOR="0;31" 2021-05-21T00:40:00.996 INFO:teuthology.orchestra.run.smithi093.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2021-05-21T00:40:00.997 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://www.redhat.com/" 2021-05-21T00:40:00.997 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-05-21T00:40:00.998 INFO:teuthology.orchestra.run.smithi093.stdout: 2021-05-21T00:40:00.998 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-05-21T00:40:00.998 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2021-05-21T00:40:00.999 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-05-21T00:40:00.999 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2021-05-21T00:40:01.000 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server 2021-05-21T00:40:01.072 INFO:teuthology.dispatcher.supervisor:Running job 6125646 2021-05-21T00:40:01.073 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_471a2f1efab907807e62c17be86bf6fb1a2f4522/virtualenv/bin/teuthology -v --owner scheduled_sage@teuthology --archive /home/teuthworker/archive/sage-2021-05-21_00:32:11-orch-wip-sage-testing-2021-05-20-1858-distro-basic-smithi/6125646 --name sage-2021-05-21_00:32:11-orch-wip-sage-testing-2021-05-20-1858-distro-basic-smithi --description orch/cephadm/smoke-roleless/{0-distro/rhel_8.3_kubic_stable 1-start 2-services/rgw-ingress 3-final} -- /home/teuthworker/archive/sage-2021-05-21_00:32:11-orch-wip-sage-testing-2021-05-20-1858-distro-basic-smithi/6125646/orig.config.yaml 2021-05-21T00:40:01.076 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/sage-2021-05-21_00:32:11-orch-wip-sage-testing-2021-05-20-1858-distro-basic-smithi/6125646 2021-05-21T00:40:01.077 INFO:teuthology.dispatcher.supervisor:Job PID: 13723 2021-05-21T00:40:01.077 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-05-21T12:40:47.426 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-05-21T12:40:47.637 INFO:teuthology.kill:Killing Pids: {13723} 2021-05-21T12:40:48.659 INFO:teuthology.kill:Nuking machines: ['smithi008', 'smithi093'] 2021-05-21T12:40:49.509 INFO:teuthology.kill:2021-05-21 12:40:49,508.508 INFO:teuthology.nuke:targets: 2021-05-21T12:40:49.509 INFO:teuthology.kill: smithi008.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDlmdyaKuovT65Zg+p1lc/YSZgxs11c37GzzJMIiyLHdKh84/DDVr4miFi1s/EEAHmQBOhotD5q3HKonW5HZaqgDq6U79hmzo2oEYSvy1lXHukpvlTIuLp51m15qGkMbke2yJHtpFSKOUNj7QVetS7icJiiptUQ2JrnxsaPhg7qE87lDzCnBZLKj+3XLeRLtWaQS5haJyvznNYBmSCrVgCdKf634Wy1TWzdj7f1Zs4JUicoYYL6gKu7i/54eGDn+Qemf9BiVLjmvj5CyAA8XWpcqCKJ9xJu82oDoBtGn08dcu27aWLzwghykrxinR3kVwwaTnE83zniwixOG027ySLQbCXO+yXaeThktnwc9ow6JkFK73Sv2psvlSyAUDdQbCj25Z4WDu1Y1IExb3VrTEpyGg3cgNZICjzzLRBn+qOxPYSb7emmOSUPiiYxCy6gS+DP4la9U0ZmRbzRbHpE6+FObkTeOXo/ZlrTYquVhDr1vfHDIEWTtDMJWQyIpTcmB+0= 2021-05-21T12:40:49.510 INFO:teuthology.kill: smithi093.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHdzjBCd1MPMG6DQGvrMSol2VmoHRa1xGrjiUfIaaM3Hvj0OSqaxr8ux7H0tF45qtUytpn+y89vGr6z8x7kFt1QyW+RdEe4DKKyR4iZL5keqLCI4iWdtNnRk8zuN+Dps+I10W6Ou+Z4oyl5lwY/GQs0QYeKah4lz6inC9Iyzcm8nr8wh225QUAkKunupUkjl+O8zvv/1q+obkx0ejSW/CeNTLUTSJaQFW21F3jXd1tE2uXVCBShKALsE7mznilfly8OWUUsxdvulnBb04caCLWiWiezZwzRgci9CEikiX6436HKDRPxQ1U2Wy6sJsBEp7zCpvZAFIK2vYnRqsgFZliNLu3FYFmW+HSzYKC1/FhFRfhr7KNwHU6cOAl+Xydlh41jmfdeKyapOaAPsvy63eCWHVx2TVZePyRNuGFkwzcZSj8A73zzZoL4hY8NfrPVB3AdsLgqaDboOQYb+/uNe/20EoNufSa5twXzHlIEzUhjypG56NHuRPvPUnyliAQ2gs= 2021-05-21T12:40:49.510 INFO:teuthology.kill:2021-05-21 12:40:49,509.509 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-05-21T12:40:49.511 INFO:teuthology.kill:2021-05-21 12:40:49,511.511 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-05-21T12:40:49.563 INFO:teuthology.kill:2021-05-21 12:40:49,563.563 INFO:teuthology.orchestra.console:Power off smithi008 2021-05-21T12:40:49.577 INFO:teuthology.kill:2021-05-21 12:40:49,576.576 INFO:teuthology.orchestra.console:Power off smithi093 2021-05-21T12:40:57.933 INFO:teuthology.kill:2021-05-21 12:40:57,932.932 INFO:teuthology.orchestra.console:Power off for smithi008 completed 2021-05-21T12:40:57.938 INFO:teuthology.kill:2021-05-21 12:40:57,938.938 INFO:teuthology.orchestra.console:Power off for smithi093 completed 2021-05-21T12:40:58.153 INFO:teuthology.task.internal:roles: ubuntu@smithi008.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2021-05-21T12:40:58.154 INFO:teuthology.task.internal:roles: ubuntu@smithi093.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2021-05-21T12:40:58.154 INFO:teuthology.misc:Compressing logs... 2021-05-21T12:40:58.155 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-05-21T12:41:16.491 ERROR:teuthology.dispatcher.supervisor:Could not save logs Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_471a2f1efab907807e62c17be86bf6fb1a2f4522/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog teuth_config.archive_base, job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_471a2f1efab907807e62c17be86bf6fb1a2f4522/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives compress_logs(ctx, log_path) File "/home/teuthworker/src/git.ceph.com_git_teuthology_471a2f1efab907807e62c17be86bf6fb1a2f4522/teuthology/misc.py", line 1378, in compress_logs wait=False, File "/home/teuthworker/src/git.ceph.com_git_teuthology_471a2f1efab907807e62c17be86bf6fb1a2f4522/teuthology/orchestra/cluster.py", line 64, in run return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_471a2f1efab907807e62c17be86bf6fb1a2f4522/teuthology/orchestra/cluster.py", line 64, in return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_471a2f1efab907807e62c17be86bf6fb1a2f4522/teuthology/orchestra/remote.py", line 509, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_471a2f1efab907807e62c17be86bf6fb1a2f4522/teuthology/orchestra/run.py", line 434, in run transport = client.get_transport() AttributeError: 'NoneType' object has no attribute 'get_transport' 2021-05-21T12:41:16.539 INFO:teuthology.kill:No teuthology processes running 2021-05-21T12:41:17.565 INFO:teuthology.kill:Nuking machines: ['smithi008', 'smithi093'] 2021-05-21T12:41:18.463 INFO:teuthology.kill:2021-05-21 12:41:18,462.462 INFO:teuthology.nuke:targets: 2021-05-21T12:41:18.464 INFO:teuthology.kill: smithi008.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDlmdyaKuovT65Zg+p1lc/YSZgxs11c37GzzJMIiyLHdKh84/DDVr4miFi1s/EEAHmQBOhotD5q3HKonW5HZaqgDq6U79hmzo2oEYSvy1lXHukpvlTIuLp51m15qGkMbke2yJHtpFSKOUNj7QVetS7icJiiptUQ2JrnxsaPhg7qE87lDzCnBZLKj+3XLeRLtWaQS5haJyvznNYBmSCrVgCdKf634Wy1TWzdj7f1Zs4JUicoYYL6gKu7i/54eGDn+Qemf9BiVLjmvj5CyAA8XWpcqCKJ9xJu82oDoBtGn08dcu27aWLzwghykrxinR3kVwwaTnE83zniwixOG027ySLQbCXO+yXaeThktnwc9ow6JkFK73Sv2psvlSyAUDdQbCj25Z4WDu1Y1IExb3VrTEpyGg3cgNZICjzzLRBn+qOxPYSb7emmOSUPiiYxCy6gS+DP4la9U0ZmRbzRbHpE6+FObkTeOXo/ZlrTYquVhDr1vfHDIEWTtDMJWQyIpTcmB+0= 2021-05-21T12:41:18.464 INFO:teuthology.kill: smithi093.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHdzjBCd1MPMG6DQGvrMSol2VmoHRa1xGrjiUfIaaM3Hvj0OSqaxr8ux7H0tF45qtUytpn+y89vGr6z8x7kFt1QyW+RdEe4DKKyR4iZL5keqLCI4iWdtNnRk8zuN+Dps+I10W6Ou+Z4oyl5lwY/GQs0QYeKah4lz6inC9Iyzcm8nr8wh225QUAkKunupUkjl+O8zvv/1q+obkx0ejSW/CeNTLUTSJaQFW21F3jXd1tE2uXVCBShKALsE7mznilfly8OWUUsxdvulnBb04caCLWiWiezZwzRgci9CEikiX6436HKDRPxQ1U2Wy6sJsBEp7zCpvZAFIK2vYnRqsgFZliNLu3FYFmW+HSzYKC1/FhFRfhr7KNwHU6cOAl+Xydlh41jmfdeKyapOaAPsvy63eCWHVx2TVZePyRNuGFkwzcZSj8A73zzZoL4hY8NfrPVB3AdsLgqaDboOQYb+/uNe/20EoNufSa5twXzHlIEzUhjypG56NHuRPvPUnyliAQ2gs= 2021-05-21T12:41:18.481 INFO:teuthology.kill:2021-05-21 12:41:18,481.481 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-05-21T12:41:18.484 INFO:teuthology.kill:2021-05-21 12:41:18,484.484 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-05-21T12:41:18.535 INFO:teuthology.kill:2021-05-21 12:41:18,534.534 INFO:teuthology.orchestra.console:Power off smithi093 2021-05-21T12:41:18.547 INFO:teuthology.kill:2021-05-21 12:41:18,546.546 INFO:teuthology.orchestra.console:Power off smithi008 2021-05-21T12:41:18.674 INFO:teuthology.kill:2021-05-21 12:41:18,673.673 INFO:teuthology.orchestra.console:Power off for smithi093 completed 2021-05-21T12:41:18.685 INFO:teuthology.kill:2021-05-21 12:41:18,685.685 INFO:teuthology.orchestra.console:Power off for smithi008 completed 2021-05-21T12:41:18.813 INFO:teuthology.kill:2021-05-21 12:41:18,812.812 INFO:teuthology.lock.ops:unlocked smithi093.front.sepia.ceph.com 2021-05-21T12:41:18.820 INFO:teuthology.kill:2021-05-21 12:41:18,820.820 INFO:teuthology.lock.ops:unlocked smithi008.front.sepia.ceph.com 2021-05-21T12:43:19.067 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15