2023-06-28T17:07:24.872 INFO:root:teuthology version: 0.0.1.dev132+gaa9345a 2023-06-28T17:07:24.874 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-28T17:07:24.874 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-28T17:07:45.340 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3a0c3733a0>, signals=[15]) 2023-06-28T17:07:45.342 INFO:teuthology.lock.ops:Start node 'smithi032.front.sepia.ceph.com' reimaging 2023-06-28T17:07:45.342 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: reset os type and version on server 2023-06-28T17:07:45.342 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server 2023-06-28T17:07:50.373 INFO:teuthology.lock.ops:Start node 'smithi178.front.sepia.ceph.com' reimaging 2023-06-28T17:07:50.373 INFO:teuthology.lock.ops:Updating [smithi178.front.sepia.ceph.com]: reset os type and version on server 2023-06-28T17:07:50.374 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server 2023-06-28T17:07:50.375 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /host {"name": "smithi032"} 2023-06-28T17:07:56.022 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /host {"name": "smithi178"} 2023-06-28T17:08:06.085 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-06-28T17:08:11.093 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-06-28T17:08:15.385 DEBUG:teuthology.provision.fog.smithi178:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-06-28T17:08:15.385 DEBUG:teuthology.provision.fog.smithi178:FOG request: PUT /host/283 {"imageID": 2} 2023-06-28T17:08:15.440 INFO:teuthology.provision.fog.smithi178:Scheduling deploy of ubuntu 20.04 2023-06-28T17:08:15.440 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-06-28T17:08:20.443 DEBUG:teuthology.provision.fog.smithi032:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-06-28T17:08:20.443 DEBUG:teuthology.provision.fog.smithi032:FOG request: PUT /host/137 {"imageID": 2} 2023-06-28T17:08:25.500 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /tasktype {"name": "deploy"} 2023-06-28T17:08:30.506 INFO:teuthology.provision.fog.smithi032:Scheduling deploy of ubuntu 20.04 2023-06-28T17:08:30.506 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-06-28T17:08:35.536 DEBUG:teuthology.provision.fog.smithi178:FOG request: POST /host/283/task {"taskTypeID": 1} 2023-06-28T17:08:35.565 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /tasktype {"name": "deploy"} 2023-06-28T17:08:35.592 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-06-28T17:08:40.599 DEBUG:teuthology.provision.fog.smithi032:FOG request: POST /host/137/task {"taskTypeID": 1} 2023-06-28T17:08:50.677 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-06-28T17:08:55.713 INFO:teuthology.orchestra.console:Power off smithi178 2023-06-28T17:08:55.714 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-28T17:08:56.021 INFO:teuthology.orchestra.console:Power off smithi032 2023-06-28T17:08:56.022 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-28T17:08:56.048 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T17:09:00.072 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T17:09:00.739 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T17:09:05.183 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T17:09:05.750 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T17:09:10.294 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T17:09:10.862 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T17:09:11.071 INFO:teuthology.orchestra.console:Power off for smithi178 completed 2023-06-28T17:09:11.172 INFO:teuthology.orchestra.console:Power on smithi178 2023-06-28T17:09:11.172 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-28T17:09:15.404 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T17:09:15.614 INFO:teuthology.orchestra.console:Power off for smithi032 completed 2023-06-28T17:09:15.715 INFO:teuthology.orchestra.console:Power on smithi032 2023-06-28T17:09:15.715 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-28T17:09:16.195 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T17:09:20.738 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T17:09:21.206 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T17:09:21.416 INFO:teuthology.orchestra.console:Power on for smithi178 completed 2023-06-28T17:09:21.517 INFO:teuthology.provision.fog.smithi178:Waiting for deploy to finish 2023-06-28T17:09:21.518 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-06-28T17:09:26.193 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T17:09:30.130 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T17:09:30.877 INFO:teuthology.orchestra.console:Power on for smithi032 completed 2023-06-28T17:09:30.978 INFO:teuthology.provision.fog.smithi032:Waiting for deploy to finish 2023-06-28T17:09:30.978 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-06-28T17:09:31.421 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T17:09:44.688 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-06-28T17:09:49.812 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-06-28T17:09:50.691 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T17:09:53.748 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-06-28T17:09:55.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T17:10:00.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T17:10:05.825 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-06-28T17:10:08.880 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-06-28T17:10:11.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T17:10:16.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T17:10:24.916 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-06-28T17:10:30.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T17:10:35.925 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-06-28T17:10:38.992 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-06-28T17:10:41.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T17:10:44.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T17:10:45.012 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-06-28T17:10:51.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T17:10:56.136 ERROR:teuthology.orchestra.connection:Error authenticating with smithi032.front.sepia.ceph.com: Authentication failed. 2023-06-28T17:10:56.138 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-28T17:10:56.139 DEBUG:teuthology.orchestra.run.smithi032:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-28T17:10:56.140 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:10:57.144 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:10:58.149 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:10:59.155 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:11:00.161 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:11:01.166 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:11:02.171 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:11:03.177 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:11:04.183 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:11:05.188 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:11:06.195 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:11:07.200 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:11:08.206 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:11:09.212 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:11:10.218 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:11:11.224 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:11:12.229 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:11:13.236 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:11:14.242 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:11:15.249 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:11:16.255 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:11:17.260 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:11:18.266 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:11:19.272 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:11:20.277 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:11:21.283 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:11:22.288 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:11:23.294 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:11:24.299 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:11:25.304 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:11:26.310 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:11:27.315 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:11:28.320 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:11:29.326 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:11:30.331 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:11:31.336 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:11:32.342 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:11:33.350 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:11:34.357 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:11:35.362 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:11:36.367 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:11:37.373 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:11:38.378 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:11:39.384 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:11:40.389 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:11:41.394 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:11:42.400 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:11:43.406 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:11:44.411 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:11:45.000 WARNING:teuthology.provision.fog.smithi178:timed out 2023-06-28T17:11:45.416 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:11:46.422 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:11:47.427 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:11:48.433 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:11:49.439 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:11:50.444 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:11:51.002 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T17:11:51.452 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:11:51.512 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-28T17:11:51.512 DEBUG:teuthology.orchestra.run.smithi178:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-28T17:11:51.759 INFO:teuthology.provision.fog.smithi178:Node is ready 2023-06-28T17:11:51.759 DEBUG:teuthology.orchestra.run.smithi178:> hostname 2023-06-28T17:11:51.815 INFO:teuthology.orchestra.run.smithi178.stdout:smithi178.front.sepia.ceph.com 2023-06-28T17:11:51.815 DEBUG:teuthology.orchestra.run.smithi178:> grep smithi178.front.sepia.ceph.com /etc/hosts 2023-06-28T17:11:51.871 INFO:teuthology.orchestra.run.smithi178.stdout:172.21.15.178 smithi178.front.sepia.ceph.com smithi178 2023-06-28T17:11:51.872 DEBUG:teuthology.orchestra.run.smithi178:> sudo hostname smithi178 2023-06-28T17:11:51.993 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/smithi178.front.sepia.ceph.com/smithi178/g' /etc/hosts 2023-06-28T17:11:52.019 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/172.21.15.178/172.21.15.178/g' /etc/hosts 2023-06-28T17:11:52.083 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/smithi178.front.sepia.ceph.com/smithi178/g' /etc/hostname 2023-06-28T17:11:52.147 DEBUG:teuthology.orchestra.run.smithi178:> sudo hostname smithi178 2023-06-28T17:11:52.210 DEBUG:teuthology.orchestra.run.smithi178:> cat /etc/os-release 2023-06-28T17:11:52.264 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="Red Hat Enterprise Linux" 2023-06-28T17:11:52.264 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="8.4 (Ootpa)" 2023-06-28T17:11:52.264 INFO:teuthology.orchestra.run.smithi178.stdout:ID="rhel" 2023-06-28T17:11:52.265 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE="fedora" 2023-06-28T17:11:52.265 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="8.4" 2023-06-28T17:11:52.265 INFO:teuthology.orchestra.run.smithi178.stdout:PLATFORM_ID="platform:el8" 2023-06-28T17:11:52.265 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-06-28T17:11:52.265 INFO:teuthology.orchestra.run.smithi178.stdout:ANSI_COLOR="0;31" 2023-06-28T17:11:52.265 INFO:teuthology.orchestra.run.smithi178.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-06-28T17:11:52.265 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://www.redhat.com/" 2023-06-28T17:11:52.266 INFO:teuthology.orchestra.run.smithi178.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-28T17:11:52.266 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-28T17:11:52.266 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-06-28T17:11:52.266 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-28T17:11:52.266 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-06-28T17:11:52.266 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-28T17:11:52.266 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-06-28T17:11:52.269 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 338, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi178's OS to be ubuntu 20.04 but found rhel 8.4 2023-06-28T17:11:52.270 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-28T17:11:52.270 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-28T17:11:57.283 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:11:57.344 INFO:teuthology.nuke:Checking targets against current locks 2023-06-28T17:12:02.349 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:12:11.741 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:12:11.779 DEBUG:teuthology.nuke:shortname: smithi032 2023-06-28T17:12:11.779 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-28T17:12:11.825 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi032.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-28_14:13:04-rados-quincy_release-distro-default-smithi/7320479', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-28 17:07:24.078565', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-06-28T17:12:11.831 DEBUG:teuthology.nuke:shortname: smithi178 2023-06-28T17:12:11.831 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-28T17:12:11.873 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi178.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-28_14:13:04-rados-quincy_release-distro-default-smithi/7320479', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-28 17:07:24.080689', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-06-28T17:12:11.890 INFO:teuthology.orchestra.console:Power off smithi032 2023-06-28T17:12:11.891 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-28T17:12:11.913 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T17:12:11.929 INFO:teuthology.orchestra.console:Power off smithi178 2023-06-28T17:12:11.930 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-28T17:12:11.954 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T17:12:12.748 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:12:13.756 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:12:14.764 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:12:15.771 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:12:15.940 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T17:12:15.977 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T17:12:16.779 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:12:17.784 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:12:18.790 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T17:12:20.051 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T17:12:20.089 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T17:12:20.262 INFO:teuthology.orchestra.console:Power off for smithi032 completed 2023-06-28T17:12:20.301 INFO:teuthology.orchestra.console:Power off for smithi178 completed 2023-06-28T17:12:24.556 INFO:teuthology.lock.ops:unlocked: smithi032.front.sepia.ceph.com 2023-06-28T17:12:24.615 INFO:teuthology.lock.ops:unlocked: smithi178.front.sepia.ceph.com 2023-06-28T17:12:24.896 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/supervisor.py", line 57, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 338, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi178's OS to be ubuntu 20.04 but found rhel 8.4