2023-06-27T05:27:46.064 INFO:root:teuthology version: 0.0.1.dev130+g3fdf1f2 2023-06-27T05:27:46.066 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-27T05:27:46.066 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-27T05:28:06.229 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb71b0188b0>, signals=[15]) 2023-06-27T05:28:06.231 INFO:teuthology.lock.ops:Start node 'smithi061.front.sepia.ceph.com' reimaging 2023-06-27T05:28:06.231 INFO:teuthology.lock.ops:Updating [smithi061.front.sepia.ceph.com]: reset os type and version on server 2023-06-27T05:28:06.232 INFO:teuthology.lock.ops:Updating smithi061.front.sepia.ceph.com on lock server 2023-06-27T05:28:11.268 INFO:teuthology.lock.ops:Start node 'smithi181.front.sepia.ceph.com' reimaging 2023-06-27T05:28:11.270 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: reset os type and version on server 2023-06-27T05:28:11.271 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2023-06-27T05:28:11.272 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /host {"name": "smithi061"} 2023-06-27T05:28:26.306 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /host {"name": "smithi181"} 2023-06-27T05:28:36.051 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-06-27T05:28:46.088 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-06-27T05:28:51.099 DEBUG:teuthology.provision.fog.smithi061:Requesting image smithi_centos_8.stream (ID 3) 2023-06-27T05:28:51.099 DEBUG:teuthology.provision.fog.smithi061:FOG request: PUT /host/166 {"imageID": 3} 2023-06-27T05:28:56.154 INFO:teuthology.provision.fog.smithi061:Scheduling deploy of centos 8.stream 2023-06-27T05:28:56.155 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-06-27T05:29:01.163 DEBUG:teuthology.provision.fog.smithi181:Requesting image smithi_centos_8.stream (ID 3) 2023-06-27T05:29:01.164 DEBUG:teuthology.provision.fog.smithi181:FOG request: PUT /host/286 {"imageID": 3} 2023-06-27T05:29:06.232 INFO:teuthology.provision.fog.smithi181:Scheduling deploy of centos 8.stream 2023-06-27T05:29:06.233 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-06-27T05:29:10.944 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /tasktype {"name": "deploy"} 2023-06-27T05:29:10.985 DEBUG:teuthology.provision.fog.smithi061:FOG request: POST /host/166/task {"taskTypeID": 1} 2023-06-27T05:29:11.033 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /tasktype {"name": "deploy"} 2023-06-27T05:29:11.117 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-06-27T05:29:11.154 DEBUG:teuthology.provision.fog.smithi181:FOG request: POST /host/286/task {"taskTypeID": 1} 2023-06-27T05:29:16.191 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-06-27T05:29:21.220 INFO:teuthology.orchestra.console:Power off smithi061 2023-06-27T05:29:21.221 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-27T05:29:21.243 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T05:29:26.350 INFO:teuthology.orchestra.console:Power off smithi181 2023-06-27T05:29:26.351 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-27T05:29:30.323 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T05:29:31.378 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T05:29:35.433 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T05:29:36.390 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T05:29:40.544 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T05:29:41.501 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T05:29:45.656 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T05:29:46.613 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T05:29:50.767 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T05:29:51.724 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T05:29:55.878 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T05:29:56.836 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T05:29:57.048 INFO:teuthology.orchestra.console:Power off for smithi181 completed 2023-06-27T05:29:57.149 INFO:teuthology.orchestra.console:Power on smithi181 2023-06-27T05:29:57.150 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-27T05:29:57.171 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T05:30:00.992 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T05:30:01.201 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T05:30:06.104 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T05:30:06.313 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T05:30:11.220 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T05:30:11.425 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T05:30:16.333 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T05:30:16.539 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T05:30:16.549 INFO:teuthology.orchestra.console:Power off for smithi061 completed 2023-06-27T05:30:16.650 INFO:teuthology.orchestra.console:Power on smithi061 2023-06-27T05:30:16.650 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-27T05:30:16.674 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T05:30:20.698 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T05:30:21.652 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T05:30:25.810 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T05:30:26.765 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T05:30:30.923 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T05:30:31.877 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T05:30:36.035 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T05:30:36.246 INFO:teuthology.orchestra.console:Power on for smithi061 completed 2023-06-27T05:30:36.348 INFO:teuthology.provision.fog.smithi061:Waiting for deploy to finish 2023-06-27T05:30:36.348 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-06-27T05:30:39.747 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T05:30:44.864 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T05:30:49.976 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T05:30:54.860 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-06-27T05:30:59.396 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T05:31:00.108 INFO:teuthology.orchestra.console:Power on for smithi181 completed 2023-06-27T05:31:00.209 INFO:teuthology.provision.fog.smithi181:Waiting for deploy to finish 2023-06-27T05:31:00.210 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-06-27T05:31:04.637 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T05:31:07.696 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-06-27T05:31:13.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T05:31:14.487 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-06-27T05:31:30.152 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-06-27T05:31:34.457 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-06-27T05:31:40.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T05:31:45.575 ERROR:teuthology.orchestra.connection:Error authenticating with smithi181.front.sepia.ceph.com: Authentication failed. 2023-06-27T05:31:45.577 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-27T05:31:45.578 DEBUG:teuthology.orchestra.run.smithi181:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-27T05:31:45.579 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-27T05:31:46.583 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-27T05:31:47.587 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-27T05:31:48.592 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-27T05:31:49.560 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-06-27T05:31:49.598 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-27T05:31:49.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T05:31:50.602 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-27T05:31:51.607 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-27T05:31:52.611 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-27T05:31:52.692 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-06-27T05:31:53.616 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-27T05:31:54.621 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-27T05:31:55.626 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-27T05:31:56.631 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-27T05:31:57.636 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-27T05:31:58.641 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-27T05:31:58.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T05:32:03.697 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-27T05:32:04.701 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-27T05:32:05.705 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-27T05:32:06.709 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-27T05:32:06.768 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-06-27T05:32:07.717 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-27T05:32:08.722 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-27T05:32:09.726 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-27T05:32:10.731 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-27T05:32:11.736 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-27T05:32:12.741 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-27T05:32:12.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T05:32:17.777 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-27T05:32:18.781 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-27T05:32:18.800 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-06-27T05:32:19.786 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-27T05:32:20.791 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-27T05:32:21.796 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-27T05:32:22.801 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-27T05:32:23.805 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-27T05:32:24.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T05:32:24.810 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-27T05:32:25.297 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-27T05:32:25.297 DEBUG:teuthology.orchestra.run.smithi061:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-27T05:32:25.818 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-27T05:32:26.003 INFO:teuthology.provision.fog.smithi061:Node is ready 2023-06-27T05:32:26.004 DEBUG:teuthology.orchestra.run.smithi061:> hostname 2023-06-27T05:32:26.050 INFO:teuthology.orchestra.run.smithi061.stdout:smithi061.front.sepia.ceph.com 2023-06-27T05:32:26.051 DEBUG:teuthology.orchestra.run.smithi061:> grep smithi061.front.sepia.ceph.com /etc/hosts 2023-06-27T05:32:26.099 INFO:teuthology.orchestra.run.smithi061.stdout:172.21.15.61 smithi061.front.sepia.ceph.com smithi061 2023-06-27T05:32:26.099 DEBUG:teuthology.orchestra.run.smithi061:> sudo hostname smithi061 2023-06-27T05:32:26.319 DEBUG:teuthology.orchestra.run.smithi061:> sudo sed -i -e 's/smithi061.front.sepia.ceph.com/smithi061/g' /etc/hosts 2023-06-27T05:32:26.332 DEBUG:teuthology.orchestra.run.smithi061:> sudo sed -i -e 's/172.21.15.61/172.21.15.61/g' /etc/hosts 2023-06-27T05:32:26.385 DEBUG:teuthology.orchestra.run.smithi061:> sudo sed -i -e 's/smithi061.front.sepia.ceph.com/smithi061/g' /etc/hostname 2023-06-27T05:32:26.456 DEBUG:teuthology.orchestra.run.smithi061:> sudo hostname smithi061 2023-06-27T05:32:26.511 DEBUG:teuthology.orchestra.run.smithi061:> cat /etc/os-release 2023-06-27T05:32:26.558 INFO:teuthology.orchestra.run.smithi061.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-27T05:32:26.559 INFO:teuthology.orchestra.run.smithi061.stdout:NAME="Ubuntu" 2023-06-27T05:32:26.559 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION_ID="22.04" 2023-06-27T05:32:26.559 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-27T05:32:26.559 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION_CODENAME=jammy 2023-06-27T05:32:26.559 INFO:teuthology.orchestra.run.smithi061.stdout:ID=ubuntu 2023-06-27T05:32:26.560 INFO:teuthology.orchestra.run.smithi061.stdout:ID_LIKE=debian 2023-06-27T05:32:26.560 INFO:teuthology.orchestra.run.smithi061.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-27T05:32:26.560 INFO:teuthology.orchestra.run.smithi061.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-27T05:32:26.560 INFO:teuthology.orchestra.run.smithi061.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-27T05:32:26.560 INFO:teuthology.orchestra.run.smithi061.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-27T05:32:26.560 INFO:teuthology.orchestra.run.smithi061.stdout:UBUNTU_CODENAME=jammy 2023-06-27T05:32:26.562 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/teuthology/provision/fog.py", line 338, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi061's OS to be centos 8 but found ubuntu 22.04 2023-06-27T05:32:26.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-27T05:32:26.563 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-27T05:32:27.453 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-27T05:32:27.540 INFO:teuthology.nuke:Checking targets against current locks 2023-06-27T05:32:27.582 DEBUG:teuthology.nuke:shortname: smithi061 2023-06-27T05:32:27.583 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-27T05:32:27.603 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi061.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-06-27_00:54:25-orch:cephadm-wip-adk4-testing-2023-06-26-1649-distro-default-smithi/7317606', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-27 05:27:45.198450', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLcHFYvyqz8jxlANQvTyZH+Z6HunCVxt/Ne99FjYifXUsL6o4PAgod+iTcvzhs8MZ59pxnmwbf67Wo3QcvxwacU='} 2023-06-27T05:32:27.606 DEBUG:teuthology.nuke:shortname: smithi181 2023-06-27T05:32:27.607 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-27T05:32:27.628 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi181.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-06-27_00:54:25-orch:cephadm-wip-adk4-testing-2023-06-26-1649-distro-default-smithi/7317606', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-27 05:27:45.200456', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-06-27T05:32:27.649 INFO:teuthology.orchestra.console:Power off smithi061 2023-06-27T05:32:27.649 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-27T05:32:27.671 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T05:32:27.689 INFO:teuthology.orchestra.console:Power off smithi181 2023-06-27T05:32:27.690 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-27T05:32:27.710 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T05:32:28.464 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-27T05:32:29.471 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-27T05:32:30.476 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-27T05:32:31.482 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-27T05:32:31.699 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T05:32:31.732 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T05:32:32.487 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-27T05:32:33.493 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-27T05:32:34.497 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-27T05:32:35.503 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-27T05:32:36.809 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T05:32:36.843 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T05:32:41.920 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T05:32:41.952 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T05:32:47.032 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T05:32:47.062 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T05:32:52.142 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T05:32:52.171 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T05:32:52.353 INFO:teuthology.orchestra.console:Power off for smithi061 completed 2023-06-27T05:33:02.484 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T05:33:02.528 INFO:teuthology.lock.ops:unlocked: smithi061.front.sepia.ceph.com 2023-06-27T05:33:07.596 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T05:33:07.807 INFO:teuthology.orchestra.console:Power off for smithi181 completed 2023-06-27T05:33:15.297 INFO:teuthology.lock.ops:unlocked: smithi181.front.sepia.ceph.com 2023-06-27T05:33:20.518 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/teuthology/dispatcher/supervisor.py", line 57, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/teuthology/provision/fog.py", line 338, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi061's OS to be centos 8 but found ubuntu 22.04