2021-04-25T21:23:14.875 INFO:root:teuthology version: 1.1.0-2713a3cd 2021-04-25T21:23:15.008 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi062.front.sepia.ceph.com' reimaging 2021-04-25T21:23:15.008 INFO:teuthology.lock.ops:Updating [ubuntu@smithi062.front.sepia.ceph.com]: reset os type and version on server 2021-04-25T21:23:15.009 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2021-04-25T21:23:15.025 INFO:teuthology.lock.ops:Node 'ubuntu@smithi062.front.sepia.ceph.com' reimaging is complete 2021-04-25T21:23:15.026 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi078.front.sepia.ceph.com' reimaging 2021-04-25T21:23:15.026 INFO:teuthology.lock.ops:Updating [ubuntu@smithi078.front.sepia.ceph.com]: reset os type and version on server 2021-04-25T21:23:15.026 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2021-04-25T21:23:15.048 INFO:teuthology.lock.ops:Node 'ubuntu@smithi078.front.sepia.ceph.com' reimaging is complete 2021-04-25T21:23:15.276 INFO:teuthology.provision.fog.smithi078:Scheduling deploy of rhel 8.3 2021-04-25T21:23:15.327 INFO:teuthology.provision.fog.smithi062:Scheduling deploy of rhel 8.3 2021-04-25T21:23:16.028 INFO:teuthology.orchestra.console:Power off smithi078 2021-04-25T21:23:16.112 INFO:teuthology.orchestra.console:Power off smithi062 2021-04-25T21:23:24.397 INFO:teuthology.orchestra.console:Power off for smithi078 completed 2021-04-25T21:23:24.474 INFO:teuthology.orchestra.console:Power off for smithi062 completed 2021-04-25T21:23:24.498 INFO:teuthology.orchestra.console:Power on smithi078 2021-04-25T21:23:24.576 INFO:teuthology.orchestra.console:Power on smithi062 2021-04-25T21:23:32.870 INFO:teuthology.orchestra.console:Power on for smithi078 completed 2021-04-25T21:23:32.971 INFO:teuthology.provision.fog.smithi078:Waiting for deploy to finish 2021-04-25T21:23:33.035 INFO:teuthology.orchestra.console:Power on for smithi062 completed 2021-04-25T21:23:33.136 INFO:teuthology.provision.fog.smithi062:Waiting for deploy to finish 2021-04-25T21:28:21.591 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-04-25T21:28:42.374 INFO:teuthology.provision.fog.smithi062:Node is ready 2021-04-25T21:28:42.393 INFO:teuthology.orchestra.run.smithi062.stdout:smithi062.front.sepia.ceph.com 2021-04-25T21:28:42.450 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62 smithi062.front.sepia.ceph.com smithi062 2021-04-25T21:28:42.816 INFO:teuthology.provision.fog.smithi062:Deploy complete! 2021-04-25T21:28:48.532 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-04-25T21:29:09.129 INFO:teuthology.provision.fog.smithi078:Node is ready 2021-04-25T21:29:09.148 INFO:teuthology.orchestra.run.smithi078.stdout:smithi078.front.sepia.ceph.com 2021-04-25T21:29:09.203 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78 smithi078.front.sepia.ceph.com smithi078 2021-04-25T21:29:09.559 INFO:teuthology.provision.fog.smithi078:Deploy complete! 2021-04-25T21:29:09.680 INFO:teuthology.lock.ops:Checking smithi062.front.sepia.ceph.com 2021-04-25T21:29:09.680 INFO:teuthology.lock.ops:New key found. Updating... 2021-04-25T21:29:09.696 INFO:teuthology.lock.ops:Checking smithi078.front.sepia.ceph.com 2021-04-25T21:29:09.696 INFO:teuthology.lock.ops:New key found. Updating... 2021-04-25T21:29:09.711 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: set os type and version on server 2021-04-25T21:29:09.711 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-25T21:29:10.001 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64 2021-04-25T21:29:10.055 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="Red Hat Enterprise Linux" 2021-04-25T21:29:10.056 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="8.3 (Ootpa)" 2021-04-25T21:29:10.056 INFO:teuthology.orchestra.run.smithi062.stdout:ID="rhel" 2021-04-25T21:29:10.056 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="fedora" 2021-04-25T21:29:10.056 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="8.3" 2021-04-25T21:29:10.056 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el8" 2021-04-25T21:29:10.056 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2021-04-25T21:29:10.056 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31" 2021-04-25T21:29:10.056 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2021-04-25T21:29:10.056 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://www.redhat.com/" 2021-04-25T21:29:10.056 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-04-25T21:29:10.057 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-04-25T21:29:10.057 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-04-25T21:29:10.057 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2021-04-25T21:29:10.057 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-04-25T21:29:10.057 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2021-04-25T21:29:10.058 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2021-04-25T21:29:10.073 INFO:teuthology.lock.ops:Updating [smithi078.front.sepia.ceph.com]: set os type and version on server 2021-04-25T21:29:10.073 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-25T21:29:10.290 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64 2021-04-25T21:29:10.345 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="Red Hat Enterprise Linux" 2021-04-25T21:29:10.345 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="8.3 (Ootpa)" 2021-04-25T21:29:10.345 INFO:teuthology.orchestra.run.smithi078.stdout:ID="rhel" 2021-04-25T21:29:10.345 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="fedora" 2021-04-25T21:29:10.345 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="8.3" 2021-04-25T21:29:10.345 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el8" 2021-04-25T21:29:10.346 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2021-04-25T21:29:10.346 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31" 2021-04-25T21:29:10.346 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2021-04-25T21:29:10.346 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://www.redhat.com/" 2021-04-25T21:29:10.346 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-04-25T21:29:10.346 INFO:teuthology.orchestra.run.smithi078.stdout: 2021-04-25T21:29:10.346 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-04-25T21:29:10.346 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2021-04-25T21:29:10.346 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-04-25T21:29:10.346 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2021-04-25T21:29:10.347 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2021-04-25T21:29:10.427 INFO:teuthology.dispatcher.supervisor:Running job 6072954 2021-04-25T21:29:10.427 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/virtualenv/bin/teuthology -v --owner scheduled_sage@teuthology --archive /home/teuthworker/archive/sage-2021-04-25_21:22:03-rados:cephadm-wip-sage-testing-2021-04-25-1236-distro-basic-smithi/6072954 --name sage-2021-04-25_21:22:03-rados:cephadm-wip-sage-testing-2021-04-25-1236-distro-basic-smithi --description rados:cephadm/smoke-roleless/{0-distro/rhel_8.3_kubic_stable 1-start 2-services/client-keyring 3-final} -- /home/teuthworker/archive/sage-2021-04-25_21:22:03-rados:cephadm-wip-sage-testing-2021-04-25-1236-distro-basic-smithi/6072954/orig.config.yaml 2021-04-25T21:29:10.430 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/sage-2021-04-25_21:22:03-rados:cephadm-wip-sage-testing-2021-04-25-1236-distro-basic-smithi/6072954 2021-04-25T21:29:10.431 INFO:teuthology.dispatcher.supervisor:Job PID: 11802 2021-04-25T21:29:10.431 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-04-26T09:30:04.603 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-04-26T09:30:04.791 INFO:teuthology.kill:Killing Pids: {11802} 2021-04-26T09:30:20.843 INFO:teuthology.kill:Nuking machines: ['smithi062', 'smithi078'] 2021-04-26T09:30:21.786 INFO:teuthology.kill:2021-04-26 09:30:21,785.785 INFO:teuthology.nuke:targets: 2021-04-26T09:30:21.786 INFO:teuthology.kill: smithi062.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDiyeZYp29gH0fte7fWcC1HziuPGYeNzabCThDvN1sx/iWmPLTGh+ehxzIx/+0aPZZzIz1Kt9rZ0OXVUStEP0lFJpaJbGNjpvOxkcCowCXvS5Wl4id91cMssXyzRKdAvrc+PvCd3Up5jv1bgT3lQaPtknmUXIUfjzjZ8lgC4oxtWLoc82t7nTeUKS/f+dXWXbrxcVS98duKWD29RHe07IcSdJmvZBoBjI7w2rQ5p3amhzJXfmaHyg4uS/Nj+HvQUj9gfv4wXWZ9SlRP3ydPgYOC9gXIrX1IPIiCNpH9E3fgHFoyYa/7GA32qFipQDk2xCHPMqyatnmiBIDAofL/ZeqsRqK0EDT7sUB4t1AETnStRGecf4XtJq2NsNAq2rnDrNufDKZq0aVg0D9CwwjNtK2PcRzv9ByrOyvK843wqoNNTSrBm99eDK3DB7JliVALytoNa/947gO76x2lZ4TGKFTEvYqy2lWfP06I2O9sa7FUrYvjuKuqd79Owybe2iKv/wk= 2021-04-26T09:30:21.786 INFO:teuthology.kill: smithi078.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCPLvpcK32D8HLmPY7g040Qv+d0e2kqzZ4mrs8y1uPFodqpPGYoJLalJezh+WeFSKhymV5vKbapbryPmKGQI4DN5G/3x6LcjUUECxtcjeM+m3r5LbSi5YR3GwwFmKqrurREscP2R9Go1/g3yu2Lvkry3/HObO1M/7rtkCdhTomnzG3gf851EZq/fb9KQVahiDofIeDdE2i3gu6wrbq39GIyjpaVOzWBeOMIq2pYgLuJb/Yh5oUdSVrDFk3Fc4E6dmpT6d/PndC32Jzkv90pFTQnvsNNT3Z1y378KWTYUbzh7URpeXodzD9pqXNc4X2Ri4EaSilnn90ZgUBva6Z2VafyP9mY47Ans0a/JtkPJaN63o5PTIQmXErn2lzJC5qqklV+Eg9sc1VfJsYC8n8QCFjz+D2g7vvsn1IMHeKs3qSIOMwaHOLyDwQZ/jS8RK/lJ2O9gZ2bJMxrXWZgJowKSrAR7ZmiWz03j9gl/09QZ/I3SnIZ/AQf/xVXjfVzxjFGEk= 2021-04-26T09:30:21.786 INFO:teuthology.kill:2021-04-26 09:30:21,786.786 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-04-26T09:30:21.788 INFO:teuthology.kill:2021-04-26 09:30:21,788.788 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-04-26T09:30:32.657 INFO:teuthology.kill:2021-04-26 09:30:32,657.657 INFO:teuthology.orchestra.console:Power off smithi062 2021-04-26T09:30:32.670 INFO:teuthology.kill:2021-04-26 09:30:32,669.669 INFO:teuthology.orchestra.console:Power off smithi078 2021-04-26T09:30:41.027 INFO:teuthology.kill:2021-04-26 09:30:41,026.026 INFO:teuthology.orchestra.console:Power off for smithi062 completed 2021-04-26T09:30:45.145 INFO:teuthology.kill:2021-04-26 09:30:45,145.145 INFO:teuthology.orchestra.console:Power off for smithi078 completed 2021-04-26T09:30:45.402 INFO:teuthology.task.internal:roles: ubuntu@smithi062.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2021-04-26T09:30:45.402 INFO:teuthology.task.internal:roles: ubuntu@smithi078.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2021-04-26T09:30:45.402 INFO:teuthology.misc:Compressing logs... 2021-04-26T09:30:45.403 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-26T09:31:03.899 ERROR:teuthology.dispatcher.supervisor:Could not save logs Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog teuth_config.archive_base, job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives compress_logs(ctx, log_path) File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/misc.py", line 1378, in compress_logs wait=False, File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/orchestra/cluster.py", line 64, in run return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/orchestra/cluster.py", line 64, in return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/orchestra/remote.py", line 215, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/orchestra/run.py", line 434, in run transport = client.get_transport() AttributeError: 'NoneType' object has no attribute 'get_transport' 2021-04-26T09:31:03.957 INFO:teuthology.kill:No teuthology processes running 2021-04-26T09:31:05.059 INFO:teuthology.kill:Nuking machines: ['smithi062', 'smithi078'] 2021-04-26T09:31:06.033 INFO:teuthology.kill:2021-04-26 09:31:06,033.033 INFO:teuthology.nuke:targets: 2021-04-26T09:31:06.034 INFO:teuthology.kill: smithi062.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDiyeZYp29gH0fte7fWcC1HziuPGYeNzabCThDvN1sx/iWmPLTGh+ehxzIx/+0aPZZzIz1Kt9rZ0OXVUStEP0lFJpaJbGNjpvOxkcCowCXvS5Wl4id91cMssXyzRKdAvrc+PvCd3Up5jv1bgT3lQaPtknmUXIUfjzjZ8lgC4oxtWLoc82t7nTeUKS/f+dXWXbrxcVS98duKWD29RHe07IcSdJmvZBoBjI7w2rQ5p3amhzJXfmaHyg4uS/Nj+HvQUj9gfv4wXWZ9SlRP3ydPgYOC9gXIrX1IPIiCNpH9E3fgHFoyYa/7GA32qFipQDk2xCHPMqyatnmiBIDAofL/ZeqsRqK0EDT7sUB4t1AETnStRGecf4XtJq2NsNAq2rnDrNufDKZq0aVg0D9CwwjNtK2PcRzv9ByrOyvK843wqoNNTSrBm99eDK3DB7JliVALytoNa/947gO76x2lZ4TGKFTEvYqy2lWfP06I2O9sa7FUrYvjuKuqd79Owybe2iKv/wk= 2021-04-26T09:31:06.034 INFO:teuthology.kill: smithi078.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCPLvpcK32D8HLmPY7g040Qv+d0e2kqzZ4mrs8y1uPFodqpPGYoJLalJezh+WeFSKhymV5vKbapbryPmKGQI4DN5G/3x6LcjUUECxtcjeM+m3r5LbSi5YR3GwwFmKqrurREscP2R9Go1/g3yu2Lvkry3/HObO1M/7rtkCdhTomnzG3gf851EZq/fb9KQVahiDofIeDdE2i3gu6wrbq39GIyjpaVOzWBeOMIq2pYgLuJb/Yh5oUdSVrDFk3Fc4E6dmpT6d/PndC32Jzkv90pFTQnvsNNT3Z1y378KWTYUbzh7URpeXodzD9pqXNc4X2Ri4EaSilnn90ZgUBva6Z2VafyP9mY47Ans0a/JtkPJaN63o5PTIQmXErn2lzJC5qqklV+Eg9sc1VfJsYC8n8QCFjz+D2g7vvsn1IMHeKs3qSIOMwaHOLyDwQZ/jS8RK/lJ2O9gZ2bJMxrXWZgJowKSrAR7ZmiWz03j9gl/09QZ/I3SnIZ/AQf/xVXjfVzxjFGEk= 2021-04-26T09:31:06.066 INFO:teuthology.kill:2021-04-26 09:31:06,065.065 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-04-26T09:31:06.077 INFO:teuthology.kill:2021-04-26 09:31:06,077.077 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-04-26T09:31:06.154 INFO:teuthology.kill:2021-04-26 09:31:06,154.154 INFO:teuthology.orchestra.console:Power off smithi062 2021-04-26T09:31:06.168 INFO:teuthology.kill:2021-04-26 09:31:06,168.168 INFO:teuthology.orchestra.console:Power off smithi078 2021-04-26T09:31:06.298 INFO:teuthology.kill:2021-04-26 09:31:06,298.298 INFO:teuthology.orchestra.console:Power off for smithi062 completed 2021-04-26T09:31:06.309 INFO:teuthology.kill:2021-04-26 09:31:06,308.308 INFO:teuthology.orchestra.console:Power off for smithi078 completed 2021-04-26T09:31:06.447 INFO:teuthology.kill:2021-04-26 09:31:06,446.446 INFO:teuthology.lock.ops:unlocked smithi062.front.sepia.ceph.com 2021-04-26T09:31:06.463 INFO:teuthology.kill:2021-04-26 09:31:06,463.463 INFO:teuthology.lock.ops:unlocked smithi078.front.sepia.ceph.com 2021-04-26T09:33:06.774 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-04-26T09:33:06.865 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2021-04-26T09:33:06.865 INFO:teuthology.nuke:Checking targets against current locks 2021-04-26T09:33:06.953 INFO:teuthology.nuke:Not nuking smithi062.front.sepia.ceph.com because description doesn't match 2021-04-26T09:33:06.954 INFO:teuthology.nuke:Not nuking smithi078.front.sepia.ceph.com because description doesn't match