2021-04-24T16:00:16.605 INFO:root:teuthology version: 1.1.0-2713a3cd 2021-04-24T16:01:13.190 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi050.front.sepia.ceph.com' reimaging 2021-04-24T16:01:13.191 INFO:teuthology.lock.ops:Updating [ubuntu@smithi050.front.sepia.ceph.com]: reset os type and version on server 2021-04-24T16:01:13.191 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2021-04-24T16:01:13.266 INFO:teuthology.lock.ops:Node 'ubuntu@smithi050.front.sepia.ceph.com' reimaging is complete 2021-04-24T16:01:13.267 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi159.front.sepia.ceph.com' reimaging 2021-04-24T16:01:13.267 INFO:teuthology.lock.ops:Updating [ubuntu@smithi159.front.sepia.ceph.com]: reset os type and version on server 2021-04-24T16:01:13.267 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server 2021-04-24T16:01:13.306 INFO:teuthology.lock.ops:Node 'ubuntu@smithi159.front.sepia.ceph.com' reimaging is complete 2021-04-24T16:01:13.468 INFO:teuthology.provision.fog.smithi050:Scheduling deploy of rhel 8.3 2021-04-24T16:01:13.558 INFO:teuthology.provision.fog.smithi159:Scheduling deploy of rhel 8.3 2021-04-24T16:01:13.911 INFO:teuthology.orchestra.console:Power off smithi159 2021-04-24T16:01:13.947 INFO:teuthology.orchestra.console:Power off smithi050 2021-04-24T16:01:22.314 INFO:teuthology.orchestra.console:Power off for smithi050 completed 2021-04-24T16:01:22.415 INFO:teuthology.orchestra.console:Power on smithi050 2021-04-24T16:01:26.392 INFO:teuthology.orchestra.console:Power off for smithi159 completed 2021-04-24T16:01:26.494 INFO:teuthology.orchestra.console:Power on smithi159 2021-04-24T16:01:30.749 INFO:teuthology.orchestra.console:Power on for smithi159 completed 2021-04-24T16:01:30.850 INFO:teuthology.provision.fog.smithi159:Waiting for deploy to finish 2021-04-24T16:01:30.856 INFO:teuthology.orchestra.console:Power on for smithi050 completed 2021-04-24T16:01:30.957 INFO:teuthology.provision.fog.smithi050:Waiting for deploy to finish 2021-04-24T16:05:38.657 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-04-24T16:05:38.968 INFO:teuthology.provision.fog.smithi050:Node is ready 2021-04-24T16:05:38.982 INFO:teuthology.orchestra.run.smithi050.stdout:smithi050.front.sepia.ceph.com 2021-04-24T16:05:39.037 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50 smithi050.front.sepia.ceph.com smithi050 2021-04-24T16:05:39.357 INFO:teuthology.provision.fog.smithi050:Deploy complete! 2021-04-24T16:06:17.775 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-04-24T16:06:18.061 INFO:teuthology.provision.fog.smithi159:Node is ready 2021-04-24T16:06:18.075 INFO:teuthology.orchestra.run.smithi159.stdout:smithi159.front.sepia.ceph.com 2021-04-24T16:06:18.130 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159 smithi159.front.sepia.ceph.com smithi159 2021-04-24T16:06:18.452 INFO:teuthology.provision.fog.smithi159:Deploy complete! 2021-04-24T16:06:18.583 INFO:teuthology.lock.ops:Checking smithi050.front.sepia.ceph.com 2021-04-24T16:06:18.583 INFO:teuthology.lock.ops:New key found. Updating... 2021-04-24T16:06:18.601 INFO:teuthology.lock.ops:Checking smithi159.front.sepia.ceph.com 2021-04-24T16:06:18.601 INFO:teuthology.lock.ops:New key found. Updating... 2021-04-24T16:06:18.613 INFO:teuthology.lock.ops:Updating [smithi050.front.sepia.ceph.com]: set os type and version on server 2021-04-24T16:06:18.614 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-24T16:06:18.913 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64 2021-04-24T16:06:18.969 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="Red Hat Enterprise Linux" 2021-04-24T16:06:18.969 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="8.3 (Ootpa)" 2021-04-24T16:06:18.969 INFO:teuthology.orchestra.run.smithi050.stdout:ID="rhel" 2021-04-24T16:06:18.969 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="fedora" 2021-04-24T16:06:18.969 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="8.3" 2021-04-24T16:06:18.969 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el8" 2021-04-24T16:06:18.969 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2021-04-24T16:06:18.969 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31" 2021-04-24T16:06:18.969 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2021-04-24T16:06:18.969 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://www.redhat.com/" 2021-04-24T16:06:18.970 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-04-24T16:06:18.970 INFO:teuthology.orchestra.run.smithi050.stdout: 2021-04-24T16:06:18.970 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-04-24T16:06:18.970 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2021-04-24T16:06:18.970 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-04-24T16:06:18.970 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2021-04-24T16:06:18.971 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2021-04-24T16:06:18.986 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: set os type and version on server 2021-04-24T16:06:18.986 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-24T16:06:19.266 INFO:teuthology.orchestra.run.smithi159.stdout:x86_64 2021-04-24T16:06:19.319 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="Red Hat Enterprise Linux" 2021-04-24T16:06:19.319 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="8.3 (Ootpa)" 2021-04-24T16:06:19.319 INFO:teuthology.orchestra.run.smithi159.stdout:ID="rhel" 2021-04-24T16:06:19.319 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="fedora" 2021-04-24T16:06:19.319 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="8.3" 2021-04-24T16:06:19.319 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el8" 2021-04-24T16:06:19.319 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2021-04-24T16:06:19.319 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31" 2021-04-24T16:06:19.319 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2021-04-24T16:06:19.319 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://www.redhat.com/" 2021-04-24T16:06:19.319 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-04-24T16:06:19.320 INFO:teuthology.orchestra.run.smithi159.stdout: 2021-04-24T16:06:19.320 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-04-24T16:06:19.320 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2021-04-24T16:06:19.320 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-04-24T16:06:19.320 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2021-04-24T16:06:19.320 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server 2021-04-24T16:06:19.387 INFO:teuthology.dispatcher.supervisor:Running job 6071207 2021-04-24T16:06:19.387 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/virtualenv/bin/teuthology -v --owner scheduled_sage@teuthology --archive /home/teuthworker/archive/sage-2021-04-24_15:27:17-rados:cephadm-wip-sage-testing-2021-04-23-1728-distro-basic-smithi/6071207 --name sage-2021-04-24_15:27:17-rados:cephadm-wip-sage-testing-2021-04-23-1728-distro-basic-smithi --description rados:cephadm/smoke-roleless/{0-distro/rhel_8.3_kubic_stable 1-start 2-services/client-keyring 3-final} -- /home/teuthworker/archive/sage-2021-04-24_15:27:17-rados:cephadm-wip-sage-testing-2021-04-23-1728-distro-basic-smithi/6071207/orig.config.yaml 2021-04-24T16:06:19.390 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/sage-2021-04-24_15:27:17-rados:cephadm-wip-sage-testing-2021-04-23-1728-distro-basic-smithi/6071207 2021-04-24T16:06:19.391 INFO:teuthology.dispatcher.supervisor:Job PID: 8341 2021-04-24T16:06:19.391 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-04-25T04:08:10.223 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-04-25T04:08:10.370 INFO:teuthology.kill:Killing Pids: {8341} 2021-04-25T04:08:12.376 INFO:teuthology.kill:Nuking machines: ['smithi050', 'smithi159'] 2021-04-25T04:08:13.388 INFO:teuthology.kill:2021-04-25 04:08:13,388.388 INFO:teuthology.nuke:targets: 2021-04-25T04:08:13.389 INFO:teuthology.kill: smithi050.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBFtVY3rerMXUMou9APLYFmmCx4EAulNu31LLUS6NGb007CUh9gHFdZVj6Ser0hJ5cD4xZ3lyzUoTSv/S+dIcHR5ivb0eP8G6qUoUZIJDhNGjX+MN4p7WUPZXEH/Z/p7LjPYpVZIU4qwL0CDUR9Yih5GfFgFBeXRzRzelOBeg+PlbPTGMtPHvFgz7ErjK3TjgUK+A0rtytrSkeu72hTWd2FwwcOBNSFTmHdaZO80mo4sqp/YnExKn5UybVs/DCxpcBcLRv38cGQsB5FIKgZZvZOal07/RnQtqk4Fw2d1vzz9PdMiFOhuPg/HG395A6/Y2kkpG8DPsYOkKqlPnX/5xmPnxLdrO5enCSG7g6Oy0ajeumXNrjFvpm0K+SBVZkC09o32ij7nRgoKeLUTzl3a+WkqOExr9zwzXjivUkc+Gjhp7PXej1vgdVl+0mIZufWjfnTOLpdBVq3k9hhihkw0oXf0unoZxd2IUGn1Pqg1qx+SQPjR7xwOqXLfPjM5ntyDk= 2021-04-25T04:08:13.389 INFO:teuthology.kill: smithi159.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCnhnZ8K5xlJZ+jmqVk0FemY0i5cBGcrcRFVO8X9wk0oIBq2D4Qqar89oW1lxGJb0siAKTD+dnVW8zCnb689tSWzXxWLfiwekBkb7U6EU3OLTDTvHuKeG+Foi9LWn7LSty0R+vc8geNYAm4hYrsyswOQkwHkdk/eD1rkmd7iNzY6c8iKDr+DPOsQvN+2ALe46HMFbu9V1Fa5eYU17AXr6o0R6e6b1ITOAvf7AnWcRUYvHmTOYHSVqbBSRIx9r5L2g6GdSKQja9lGJPB2d5h+P/SbX8CzvsRyMSHWlXsNo8G16fWdHs+wQsZnGiyRFylBgs1xu+ACZY0JD7HSTrE5/wbOUZ/sMPv1FXBnZ4RL7ORdwutPvsUixcyxPh+HVyUJtnGHgSaP914q/VcYnkIJLT8qzIb0/YR2Gq6XjloYykTilZ7elYXTOdfdHrEYpCl9wFHitSzq9jShncRJNGu7gmuWVuZ6PMdX4KmsLbCt/Rbt30Zc66E+HpLRnNhO6fYzC8= 2021-04-25T04:08:13.389 INFO:teuthology.kill:2021-04-25 04:08:13,389.389 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-04-25T04:08:13.391 INFO:teuthology.kill:2021-04-25 04:08:13,391.391 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-04-25T04:08:13.464 INFO:teuthology.kill:2021-04-25 04:08:13,463.463 INFO:teuthology.orchestra.console:Power off smithi050 2021-04-25T04:08:13.481 INFO:teuthology.kill:2021-04-25 04:08:13,480.480 INFO:teuthology.orchestra.console:Power off smithi159 2021-04-25T04:08:21.866 INFO:teuthology.kill:2021-04-25 04:08:21,865.865 INFO:teuthology.orchestra.console:Power off for smithi159 completed 2021-04-25T04:08:25.971 INFO:teuthology.kill:2021-04-25 04:08:25,971.971 INFO:teuthology.orchestra.console:Power off for smithi050 completed 2021-04-25T04:08:26.196 INFO:teuthology.task.internal:roles: ubuntu@smithi050.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2021-04-25T04:08:26.196 INFO:teuthology.task.internal:roles: ubuntu@smithi159.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2021-04-25T04:08:26.196 INFO:teuthology.misc:Compressing logs... 2021-04-25T04:08:26.197 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-25T04:09:26.260 ERROR:teuthology.dispatcher.supervisor:Could not save logs Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog teuth_config.archive_base, job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives compress_logs(ctx, log_path) File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/misc.py", line 1378, in compress_logs wait=False, File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/orchestra/cluster.py", line 64, in run return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/orchestra/cluster.py", line 64, in return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/orchestra/remote.py", line 215, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/orchestra/run.py", line 434, in run transport = client.get_transport() AttributeError: 'NoneType' object has no attribute 'get_transport' 2021-04-25T04:09:26.334 INFO:teuthology.kill:No teuthology processes running 2021-04-25T04:09:28.611 INFO:teuthology.kill:Nuking machines: ['smithi050', 'smithi159'] 2021-04-25T04:09:30.138 INFO:teuthology.kill:2021-04-25 04:09:30,138.138 INFO:teuthology.nuke:targets: 2021-04-25T04:09:30.139 INFO:teuthology.kill: smithi050.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBFtVY3rerMXUMou9APLYFmmCx4EAulNu31LLUS6NGb007CUh9gHFdZVj6Ser0hJ5cD4xZ3lyzUoTSv/S+dIcHR5ivb0eP8G6qUoUZIJDhNGjX+MN4p7WUPZXEH/Z/p7LjPYpVZIU4qwL0CDUR9Yih5GfFgFBeXRzRzelOBeg+PlbPTGMtPHvFgz7ErjK3TjgUK+A0rtytrSkeu72hTWd2FwwcOBNSFTmHdaZO80mo4sqp/YnExKn5UybVs/DCxpcBcLRv38cGQsB5FIKgZZvZOal07/RnQtqk4Fw2d1vzz9PdMiFOhuPg/HG395A6/Y2kkpG8DPsYOkKqlPnX/5xmPnxLdrO5enCSG7g6Oy0ajeumXNrjFvpm0K+SBVZkC09o32ij7nRgoKeLUTzl3a+WkqOExr9zwzXjivUkc+Gjhp7PXej1vgdVl+0mIZufWjfnTOLpdBVq3k9hhihkw0oXf0unoZxd2IUGn1Pqg1qx+SQPjR7xwOqXLfPjM5ntyDk= 2021-04-25T04:09:30.139 INFO:teuthology.kill: smithi159.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCnhnZ8K5xlJZ+jmqVk0FemY0i5cBGcrcRFVO8X9wk0oIBq2D4Qqar89oW1lxGJb0siAKTD+dnVW8zCnb689tSWzXxWLfiwekBkb7U6EU3OLTDTvHuKeG+Foi9LWn7LSty0R+vc8geNYAm4hYrsyswOQkwHkdk/eD1rkmd7iNzY6c8iKDr+DPOsQvN+2ALe46HMFbu9V1Fa5eYU17AXr6o0R6e6b1ITOAvf7AnWcRUYvHmTOYHSVqbBSRIx9r5L2g6GdSKQja9lGJPB2d5h+P/SbX8CzvsRyMSHWlXsNo8G16fWdHs+wQsZnGiyRFylBgs1xu+ACZY0JD7HSTrE5/wbOUZ/sMPv1FXBnZ4RL7ORdwutPvsUixcyxPh+HVyUJtnGHgSaP914q/VcYnkIJLT8qzIb0/YR2Gq6XjloYykTilZ7elYXTOdfdHrEYpCl9wFHitSzq9jShncRJNGu7gmuWVuZ6PMdX4KmsLbCt/Rbt30Zc66E+HpLRnNhO6fYzC8= 2021-04-25T04:09:30.162 INFO:teuthology.kill:2021-04-25 04:09:30,162.162 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-04-25T04:09:30.174 INFO:teuthology.kill:2021-04-25 04:09:30,174.174 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-04-25T04:09:30.244 INFO:teuthology.kill:2021-04-25 04:09:30,244.244 INFO:teuthology.orchestra.console:Power off smithi050 2021-04-25T04:09:30.259 INFO:teuthology.kill:2021-04-25 04:09:30,258.258 INFO:teuthology.orchestra.console:Power off smithi159 2021-04-25T04:09:30.398 INFO:teuthology.kill:2021-04-25 04:09:30,398.398 INFO:teuthology.orchestra.console:Power off for smithi050 completed 2021-04-25T04:09:30.408 INFO:teuthology.kill:2021-04-25 04:09:30,408.408 INFO:teuthology.orchestra.console:Power off for smithi159 completed 2021-04-25T04:09:30.552 INFO:teuthology.kill:2021-04-25 04:09:30,551.551 INFO:teuthology.lock.ops:unlocked smithi050.front.sepia.ceph.com 2021-04-25T04:09:30.569 INFO:teuthology.kill:2021-04-25 04:09:30,569.569 INFO:teuthology.lock.ops:unlocked smithi159.front.sepia.ceph.com 2021-04-25T04:11:30.888 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-04-25T04:11:30.975 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2021-04-25T04:11:30.975 INFO:teuthology.nuke:Checking targets against current locks 2021-04-25T04:11:31.064 INFO:teuthology.nuke:Not nuking smithi050.front.sepia.ceph.com because description doesn't match 2021-04-25T04:11:31.065 INFO:teuthology.nuke:Not nuking smithi159.front.sepia.ceph.com because description doesn't match