2021-02-15T21:35:03.748 INFO:root:teuthology version: 1.1.0-64d5f180 2021-02-15T21:35:04.044 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi183.front.sepia.ceph.com' reimaging 2021-02-15T21:35:04.045 INFO:teuthology.lock.ops:Updating [ubuntu@smithi183.front.sepia.ceph.com]: reset os type and version on server 2021-02-15T21:35:04.045 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2021-02-15T21:35:04.064 INFO:teuthology.lock.ops:Node 'ubuntu@smithi183.front.sepia.ceph.com' reimaging is complete 2021-02-15T21:35:04.064 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi191.front.sepia.ceph.com' reimaging 2021-02-15T21:35:04.065 INFO:teuthology.lock.ops:Updating [ubuntu@smithi191.front.sepia.ceph.com]: reset os type and version on server 2021-02-15T21:35:04.065 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2021-02-15T21:35:04.096 INFO:teuthology.lock.ops:Node 'ubuntu@smithi191.front.sepia.ceph.com' reimaging is complete 2021-02-15T21:35:04.309 INFO:teuthology.provision.fog.smithi183:Scheduling deploy of rhel 8.3 2021-02-15T21:35:04.340 INFO:teuthology.provision.fog.smithi191:Scheduling deploy of rhel 8.3 2021-02-15T21:35:04.732 INFO:teuthology.orchestra.console:Power off smithi183 2021-02-15T21:35:04.866 INFO:teuthology.orchestra.console:Power off smithi191 2021-02-15T21:35:17.434 INFO:teuthology.orchestra.console:Power off for smithi183 completed 2021-02-15T21:35:17.475 INFO:teuthology.orchestra.console:Power off for smithi191 completed 2021-02-15T21:35:17.536 INFO:teuthology.orchestra.console:Power on smithi183 2021-02-15T21:35:17.613 INFO:teuthology.orchestra.console:Power on smithi191 2021-02-15T21:35:21.881 INFO:teuthology.orchestra.console:Power on for smithi183 completed 2021-02-15T21:35:22.049 INFO:teuthology.provision.fog.smithi183:Waiting for deploy to finish 2021-02-15T21:35:26.100 INFO:teuthology.orchestra.console:Power on for smithi191 completed 2021-02-15T21:35:26.202 INFO:teuthology.provision.fog.smithi191:Waiting for deploy to finish 2021-02-15T21:39:28.373 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-02-15T21:39:48.743 INFO:teuthology.provision.fog.smithi183:Node is ready 2021-02-15T21:39:48.763 INFO:teuthology.orchestra.run.smithi183.stdout:smithi183.front.sepia.ceph.com 2021-02-15T21:39:48.819 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.15.183 smithi183.front.sepia.ceph.com smithi183 2021-02-15T21:39:49.179 INFO:teuthology.provision.fog.smithi183:Deploy complete! 2021-02-15T21:39:58.071 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-02-15T21:39:58.377 INFO:teuthology.provision.fog.smithi191:Node is ready 2021-02-15T21:39:58.391 INFO:teuthology.orchestra.run.smithi191.stdout:smithi191.front.sepia.ceph.com 2021-02-15T21:39:58.445 INFO:teuthology.orchestra.run.smithi191.stdout:172.21.15.191 smithi191.front.sepia.ceph.com smithi191 2021-02-15T21:39:58.776 INFO:teuthology.provision.fog.smithi191:Deploy complete! 2021-02-15T21:39:58.911 INFO:teuthology.lock.ops:Checking smithi183.front.sepia.ceph.com 2021-02-15T21:39:58.911 INFO:teuthology.lock.ops:New key found. Updating... 2021-02-15T21:39:58.927 INFO:teuthology.lock.ops:Checking smithi191.front.sepia.ceph.com 2021-02-15T21:39:58.927 INFO:teuthology.lock.ops:New key found. Updating... 2021-02-15T21:39:58.941 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: set os type and version on server 2021-02-15T21:39:58.942 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-15T21:39:59.231 INFO:teuthology.orchestra.run.smithi183.stdout:x86_64 2021-02-15T21:39:59.286 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="Red Hat Enterprise Linux" 2021-02-15T21:39:59.286 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="8.3 (Ootpa)" 2021-02-15T21:39:59.286 INFO:teuthology.orchestra.run.smithi183.stdout:ID="rhel" 2021-02-15T21:39:59.286 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="fedora" 2021-02-15T21:39:59.286 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="8.3" 2021-02-15T21:39:59.287 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el8" 2021-02-15T21:39:59.287 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2021-02-15T21:39:59.287 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31" 2021-02-15T21:39:59.287 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2021-02-15T21:39:59.287 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://www.redhat.com/" 2021-02-15T21:39:59.287 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-02-15T21:39:59.287 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-02-15T21:39:59.287 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-02-15T21:39:59.287 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2021-02-15T21:39:59.287 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-02-15T21:39:59.287 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2021-02-15T21:39:59.289 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2021-02-15T21:39:59.304 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: set os type and version on server 2021-02-15T21:39:59.305 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-15T21:39:59.582 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64 2021-02-15T21:39:59.636 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="Red Hat Enterprise Linux" 2021-02-15T21:39:59.636 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="8.3 (Ootpa)" 2021-02-15T21:39:59.636 INFO:teuthology.orchestra.run.smithi191.stdout:ID="rhel" 2021-02-15T21:39:59.636 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="fedora" 2021-02-15T21:39:59.636 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="8.3" 2021-02-15T21:39:59.636 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el8" 2021-02-15T21:39:59.636 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2021-02-15T21:39:59.636 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2021-02-15T21:39:59.636 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2021-02-15T21:39:59.636 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://www.redhat.com/" 2021-02-15T21:39:59.636 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-02-15T21:39:59.637 INFO:teuthology.orchestra.run.smithi191.stdout: 2021-02-15T21:39:59.637 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-02-15T21:39:59.637 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2021-02-15T21:39:59.637 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-02-15T21:39:59.637 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2021-02-15T21:39:59.637 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2021-02-15T21:39:59.716 INFO:teuthology.dispatcher.supervisor:Running job 5885309 2021-02-15T21:39:59.717 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_64d5f18051c2fa3ad001b1c48f945134f60a8f76/virtualenv/bin/teuthology -v --owner scheduled_rzarzynski@teuthology --archive /home/teuthworker/archive/rzarzynski-2021-02-15_21:09:02-rados-master-distro-basic-smithi/5885309 --name rzarzynski-2021-02-15_21:09:02-rados-master-distro-basic-smithi --description rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} tasks/dashboard} -- /home/teuthworker/archive/rzarzynski-2021-02-15_21:09:02-rados-master-distro-basic-smithi/5885309/orig.config.yaml 2021-02-15T21:39:59.726 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rzarzynski-2021-02-15_21:09:02-rados-master-distro-basic-smithi/5885309 2021-02-15T21:39:59.727 INFO:teuthology.dispatcher.supervisor:Job PID: 12479 2021-02-15T21:39:59.727 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-02-16T09:40:15.476 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-02-16T09:40:15.953 INFO:teuthology.kill:Killing Pids: {12479} 2021-02-16T09:40:16.910 INFO:teuthology.kill:Nuking machines: ['smithi183', 'smithi191'] 2021-02-16T09:40:17.741 INFO:teuthology.kill:2021-02-16 09:40:17,741.741 INFO:teuthology.nuke:targets: 2021-02-16T09:40:17.742 INFO:teuthology.kill: smithi183.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLhJa/9ppDfyd/WVV+WcZDQ6Fz47bHND3DGLEOZ/pOf6GA/mbEPfq+mN3ftmsOe1kHqZwib4Rujcbo36VMT0PTddtAATBSxtOEIUAJiWeGuI5HYjf4LFO2l0d5WGIP6D81uTTCoCiecP2cctpFoFYJ6L+MY/0bmbmxPkB1YaMPMguLGuTWWhWeMyW3ATIkUzQyZF7qsj0x20+jeVMxBdVkHiF6iOxRuCfWmuffs/7T2aB1GPcsfAIlLX+Pcoyzf54Fu5e1v56FVpBQnzepgyODbjKPIB4S0JDSUfqTNppROtiAK/2y3IfVo0py/2wC4hd/0P+Af+EjkspsOuP4Alyb1mBXudrZ65eGgVdOD06HxeT521pfiJCsHtfnaz1C1xr/7OGcVZy+SyOV0B2o6hNxTFwmudl/VqlMf3YR4s/I/AISO1bCHyqhkRu3zABEOjlwAmi+XGhhMon3Sf1HbQz+YNit1KKyA1WuVByJXGS8BekicgYopYwrhKVN7xfbCbc= 2021-02-16T09:40:17.742 INFO:teuthology.kill: smithi191.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDVdGPcd11s1enFJD13xC7XYojKa7nSP1r3FXi8E6McSSSGukcQNWvOCOuHEjzMWbRGDNFzBwBnxPfYTB0Bkg/WhGzp9lr/wKZqR8SSCA6dkA56aYd1oZxYZsNFevd2lIRE2nDtsBkJAtOjKDpNaG/cOM91W1gBnpqkAhXpPkY8y/n1PxSljw681VXS9KZMiEZ9Fk99f6HVy0NXOEVJTg97ICVABqdOLWd9+V6Lo2ewWb6MXjMXT7UT7yDGEC5j6eJTMHRl1wKaBPZMo+85K5so9ockT63EQkENRNK2cokfP634SyXKKMmLsgDVP+p8yjxuJdKrNdkZya3lO48ZbQE3GrrXklqRR/VlcALCJ4K2h/am/FlSCWwbXqJz1coPG+otT5YgPfd23QtkivQIq4rHhkWyQ+7AJaZ2IhJY2oidNh41p4+BuxEKzTdy5dTBTpiSZcZcWHHJZgFVX6AkKTaH7QP+l2ilRUSncil0WM+XaqcR9Jq6AXIvCGEHLRduxjc= 2021-02-16T09:40:17.742 INFO:teuthology.kill:2021-02-16 09:40:17,741.741 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-02-16T09:40:17.747 INFO:teuthology.kill:2021-02-16 09:40:17,747.747 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-02-16T09:40:17.819 INFO:teuthology.kill:2021-02-16 09:40:17,818.818 INFO:teuthology.orchestra.console:Power off smithi191 2021-02-16T09:40:17.832 INFO:teuthology.kill:2021-02-16 09:40:17,832.832 INFO:teuthology.orchestra.console:Power off smithi183 2021-02-16T09:40:26.195 INFO:teuthology.kill:2021-02-16 09:40:26,194.194 INFO:teuthology.orchestra.console:Power off for smithi191 completed 2021-02-16T09:40:30.314 INFO:teuthology.kill:2021-02-16 09:40:30,314.314 INFO:teuthology.orchestra.console:Power off for smithi183 completed 2021-02-16T09:40:30.596 INFO:teuthology.task.internal:roles: ubuntu@smithi183.front.sepia.ceph.com - ['mgr.x', 'mon.a', 'mon.c', 'mds.a', 'mds.c', 'osd.0', 'client.0'] 2021-02-16T09:40:30.597 INFO:teuthology.task.internal:roles: ubuntu@smithi191.front.sepia.ceph.com - ['mgr.y', 'mgr.z', 'mon.b', 'mds.b', 'osd.1', 'osd.2', 'osd.3', 'client.1'] 2021-02-16T09:40:30.597 INFO:teuthology.misc:Compressing logs... 2021-02-16T09:40:30.597 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-16T09:41:05.094 ERROR:teuthology.dispatcher.supervisor:Could not save logs Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_64d5f18051c2fa3ad001b1c48f945134f60a8f76/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog teuth_config.archive_base, job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_64d5f18051c2fa3ad001b1c48f945134f60a8f76/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives compress_logs(ctx, log_path) File "/home/teuthworker/src/git.ceph.com_git_teuthology_64d5f18051c2fa3ad001b1c48f945134f60a8f76/teuthology/misc.py", line 1372, in compress_logs wait=False, File "/home/teuthworker/src/git.ceph.com_git_teuthology_64d5f18051c2fa3ad001b1c48f945134f60a8f76/teuthology/orchestra/cluster.py", line 64, in run return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_64d5f18051c2fa3ad001b1c48f945134f60a8f76/teuthology/orchestra/cluster.py", line 64, in return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_64d5f18051c2fa3ad001b1c48f945134f60a8f76/teuthology/orchestra/remote.py", line 215, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_64d5f18051c2fa3ad001b1c48f945134f60a8f76/teuthology/orchestra/run.py", line 434, in run transport = client.get_transport() AttributeError: 'NoneType' object has no attribute 'get_transport' 2021-02-16T09:41:05.150 INFO:teuthology.kill:No teuthology processes running 2021-02-16T09:41:06.041 INFO:teuthology.kill:Nuking machines: ['smithi183', 'smithi191'] 2021-02-16T09:41:06.850 INFO:teuthology.kill:2021-02-16 09:41:06,849.849 INFO:teuthology.nuke:targets: 2021-02-16T09:41:06.850 INFO:teuthology.kill: smithi183.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLhJa/9ppDfyd/WVV+WcZDQ6Fz47bHND3DGLEOZ/pOf6GA/mbEPfq+mN3ftmsOe1kHqZwib4Rujcbo36VMT0PTddtAATBSxtOEIUAJiWeGuI5HYjf4LFO2l0d5WGIP6D81uTTCoCiecP2cctpFoFYJ6L+MY/0bmbmxPkB1YaMPMguLGuTWWhWeMyW3ATIkUzQyZF7qsj0x20+jeVMxBdVkHiF6iOxRuCfWmuffs/7T2aB1GPcsfAIlLX+Pcoyzf54Fu5e1v56FVpBQnzepgyODbjKPIB4S0JDSUfqTNppROtiAK/2y3IfVo0py/2wC4hd/0P+Af+EjkspsOuP4Alyb1mBXudrZ65eGgVdOD06HxeT521pfiJCsHtfnaz1C1xr/7OGcVZy+SyOV0B2o6hNxTFwmudl/VqlMf3YR4s/I/AISO1bCHyqhkRu3zABEOjlwAmi+XGhhMon3Sf1HbQz+YNit1KKyA1WuVByJXGS8BekicgYopYwrhKVN7xfbCbc= 2021-02-16T09:41:06.850 INFO:teuthology.kill: smithi191.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDVdGPcd11s1enFJD13xC7XYojKa7nSP1r3FXi8E6McSSSGukcQNWvOCOuHEjzMWbRGDNFzBwBnxPfYTB0Bkg/WhGzp9lr/wKZqR8SSCA6dkA56aYd1oZxYZsNFevd2lIRE2nDtsBkJAtOjKDpNaG/cOM91W1gBnpqkAhXpPkY8y/n1PxSljw681VXS9KZMiEZ9Fk99f6HVy0NXOEVJTg97ICVABqdOLWd9+V6Lo2ewWb6MXjMXT7UT7yDGEC5j6eJTMHRl1wKaBPZMo+85K5so9ockT63EQkENRNK2cokfP634SyXKKMmLsgDVP+p8yjxuJdKrNdkZya3lO48ZbQE3GrrXklqRR/VlcALCJ4K2h/am/FlSCWwbXqJz1coPG+otT5YgPfd23QtkivQIq4rHhkWyQ+7AJaZ2IhJY2oidNh41p4+BuxEKzTdy5dTBTpiSZcZcWHHJZgFVX6AkKTaH7QP+l2ilRUSncil0WM+XaqcR9Jq6AXIvCGEHLRduxjc= 2021-02-16T09:41:06.872 INFO:teuthology.kill:2021-02-16 09:41:06,872.872 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-02-16T09:41:06.874 INFO:teuthology.kill:2021-02-16 09:41:06,874.874 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-02-16T09:41:06.930 INFO:teuthology.kill:2021-02-16 09:41:06,930.930 INFO:teuthology.orchestra.console:Power off smithi183 2021-02-16T09:41:06.946 INFO:teuthology.kill:2021-02-16 09:41:06,946.946 INFO:teuthology.orchestra.console:Power off smithi191 2021-02-16T09:41:07.075 INFO:teuthology.kill:2021-02-16 09:41:07,074.074 INFO:teuthology.orchestra.console:Power off for smithi183 completed 2021-02-16T09:41:07.087 INFO:teuthology.kill:2021-02-16 09:41:07,087.087 INFO:teuthology.orchestra.console:Power off for smithi191 completed 2021-02-16T09:41:07.242 INFO:teuthology.kill:2021-02-16 09:41:07,241.241 INFO:teuthology.lock.ops:unlocked smithi183.front.sepia.ceph.com 2021-02-16T09:41:07.246 INFO:teuthology.kill:2021-02-16 09:41:07,246.246 INFO:teuthology.lock.ops:unlocked smithi191.front.sepia.ceph.com 2021-02-16T09:43:07.437 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-02-16T09:43:07.524 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2021-02-16T09:43:07.525 INFO:teuthology.nuke:Checking targets against current locks 2021-02-16T09:43:07.599 INFO:teuthology.nuke:Not nuking smithi191.front.sepia.ceph.com because description doesn't match 2021-02-16T09:43:07.599 INFO:teuthology.nuke:Not nuking smithi183.front.sepia.ceph.com because description doesn't match