2023-07-14T04:31:40.655 INFO:root:teuthology version: 0.0.1.dev143+g073e6eb 2023-07-14T04:31:40.657 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T04:31:40.657 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T04:32:05.328 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa9ec590f70>, signals=[15]) 2023-07-14T04:32:05.331 INFO:teuthology.lock.ops:Start node 'smithi137.front.sepia.ceph.com' reimaging 2023-07-14T04:32:05.332 INFO:teuthology.lock.ops:Updating [smithi137.front.sepia.ceph.com]: reset os type and version on server 2023-07-14T04:32:05.332 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server 2023-07-14T04:32:09.912 INFO:teuthology.lock.ops:Start node 'smithi160.front.sepia.ceph.com' reimaging 2023-07-14T04:32:09.913 INFO:teuthology.lock.ops:Updating [smithi160.front.sepia.ceph.com]: reset os type and version on server 2023-07-14T04:32:09.914 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server 2023-07-14T04:32:09.915 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /host {"name": "smithi137"} 2023-07-14T04:32:15.118 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /host {"name": "smithi160"} 2023-07-14T04:32:25.200 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-07-14T04:32:25.289 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-07-14T04:32:25.340 DEBUG:teuthology.provision.fog.smithi137:Requesting image smithi_centos_9.stream (ID 10) 2023-07-14T04:32:25.340 DEBUG:teuthology.provision.fog.smithi137:FOG request: PUT /host/242 {"imageID": 10} 2023-07-14T04:32:30.346 DEBUG:teuthology.provision.fog.smithi160:Requesting image smithi_centos_9.stream (ID 10) 2023-07-14T04:32:30.347 DEBUG:teuthology.provision.fog.smithi160:FOG request: PUT /host/265 {"imageID": 10} 2023-07-14T04:32:35.397 INFO:teuthology.provision.fog.smithi160:Scheduling deploy of centos 9.stream 2023-07-14T04:32:35.397 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-07-14T04:32:40.400 INFO:teuthology.provision.fog.smithi137:Scheduling deploy of centos 9.stream 2023-07-14T04:32:40.401 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-07-14T04:32:45.459 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /tasktype {"name": "deploy"} 2023-07-14T04:32:45.461 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /tasktype {"name": "deploy"} 2023-07-14T04:32:45.498 DEBUG:teuthology.provision.fog.smithi137:FOG request: POST /host/242/task {"taskTypeID": 1} 2023-07-14T04:32:45.500 DEBUG:teuthology.provision.fog.smithi160:FOG request: POST /host/265/task {"taskTypeID": 1} 2023-07-14T04:32:45.560 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-07-14T04:32:50.557 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-07-14T04:33:00.663 INFO:teuthology.orchestra.console:Power off smithi137 2023-07-14T04:33:00.664 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T04:33:00.677 INFO:teuthology.orchestra.console:Power off smithi160 2023-07-14T04:33:00.678 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T04:33:05.688 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:33:05.703 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:33:10.703 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:33:10.712 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:33:15.813 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:33:15.821 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:33:20.924 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:33:20.932 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:33:26.035 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:33:26.043 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:33:26.254 INFO:teuthology.orchestra.console:Power off for smithi160 completed 2023-07-14T04:33:26.355 INFO:teuthology.orchestra.console:Power on smithi160 2023-07-14T04:33:26.355 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-14T04:33:26.382 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:33:30.404 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:33:31.146 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:33:35.517 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:33:36.258 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:33:40.626 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:33:40.837 INFO:teuthology.orchestra.console:Power on for smithi160 completed 2023-07-14T04:33:40.938 INFO:teuthology.provision.fog.smithi160:Waiting for deploy to finish 2023-07-14T04:33:40.939 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-07-14T04:33:41.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:33:41.369 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:33:44.080 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-07-14T04:33:46.480 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:33:50.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:33:51.590 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:33:51.800 INFO:teuthology.orchestra.console:Power off for smithi137 completed 2023-07-14T04:33:51.901 INFO:teuthology.orchestra.console:Power on smithi137 2023-07-14T04:33:51.901 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-14T04:33:51.924 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:33:53.169 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-07-14T04:33:55.947 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:33:59.173 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:34:04.180 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:34:07.248 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-07-14T04:34:09.294 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:34:13.253 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:34:18.257 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:34:21.332 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-07-14T04:34:23.369 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:34:27.337 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:34:28.480 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:34:30.416 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-07-14T04:34:33.591 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:34:33.800 INFO:teuthology.orchestra.console:Power on for smithi137 completed 2023-07-14T04:34:33.901 INFO:teuthology.provision.fog.smithi137:Waiting for deploy to finish 2023-07-14T04:34:33.901 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-07-14T04:34:38.909 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:34:38.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:34:41.968 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-07-14T04:34:42.032 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2023-07-14T04:34:47.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:34:48.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:34:51.088 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2023-07-14T04:34:57.095 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:35:06.480 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-07-14T04:35:12.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:35:12.950 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-07-14T04:35:18.957 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:35:19.077 ERROR:teuthology.orchestra.connection:Error authenticating with smithi160.front.sepia.ceph.com: Authentication failed. 2023-07-14T04:35:19.079 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-14T04:35:19.080 DEBUG:teuthology.orchestra.run.smithi160:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-14T04:35:19.081 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:35:20.086 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:35:21.091 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:35:22.096 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:35:23.100 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:35:24.105 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:35:25.110 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:35:26.114 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:35:27.119 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:35:28.123 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:35:29.127 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:35:30.132 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:35:31.137 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:35:32.141 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:35:33.145 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:35:34.149 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:35:35.156 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:35:36.160 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:35:37.164 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:35:38.168 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:35:39.172 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:35:40.176 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:35:41.181 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:35:42.186 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:35:43.190 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:35:44.194 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:35:45.198 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:35:46.203 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:35:47.208 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:35:48.213 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:35:49.218 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:35:50.223 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:35:51.228 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:35:52.234 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:35:53.239 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:35:54.243 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:35:55.247 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:35:56.252 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:35:57.256 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:35:58.260 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:35:59.265 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:36:00.269 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:36:01.273 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:36:02.097 WARNING:teuthology.provision.fog.smithi137:timed out 2023-07-14T04:36:02.278 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:36:03.284 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:36:04.289 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:36:05.294 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:36:06.299 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:36:07.303 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:36:08.099 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:36:13.106 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:36:13.454 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-14T04:36:13.454 DEBUG:teuthology.orchestra.run.smithi137:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-14T04:36:13.741 INFO:teuthology.provision.fog.smithi137:Node is ready 2023-07-14T04:36:13.741 DEBUG:teuthology.orchestra.run.smithi137:> hostname 2023-07-14T04:36:13.758 INFO:teuthology.orchestra.run.smithi137.stdout:smithi137 2023-07-14T04:36:13.759 DEBUG:teuthology.orchestra.run.smithi137:> grep smithi137 /etc/hosts 2023-07-14T04:36:13.816 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.137 smithi137.front.sepia.ceph.com smithi137 2023-07-14T04:36:13.817 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.137 smithi137 smithi137 2023-07-14T04:36:13.817 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.137 smithi137 smithi137 2023-07-14T04:36:13.817 DEBUG:teuthology.orchestra.run.smithi137:> sudo hostname smithi137 2023-07-14T04:36:13.947 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i -e 's/smithi137/smithi137/g' /etc/hosts 2023-07-14T04:36:13.975 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i -e 's/172.21.15.137/172.21.15.137/g' /etc/hosts 2023-07-14T04:36:14.043 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i -e 's/smithi137/smithi137/g' /etc/hostname 2023-07-14T04:36:14.109 DEBUG:teuthology.orchestra.run.smithi137:> sudo hostname smithi137 2023-07-14T04:36:14.113 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:36:14.176 DEBUG:teuthology.orchestra.run.smithi137:> cat /etc/os-release 2023-07-14T04:36:14.232 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="Red Hat Enterprise Linux" 2023-07-14T04:36:14.233 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="8.6 (Ootpa)" 2023-07-14T04:36:14.233 INFO:teuthology.orchestra.run.smithi137.stdout:ID="rhel" 2023-07-14T04:36:14.233 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE="fedora" 2023-07-14T04:36:14.233 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="8.6" 2023-07-14T04:36:14.233 INFO:teuthology.orchestra.run.smithi137.stdout:PLATFORM_ID="platform:el8" 2023-07-14T04:36:14.233 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-14T04:36:14.234 INFO:teuthology.orchestra.run.smithi137.stdout:ANSI_COLOR="0;31" 2023-07-14T04:36:14.234 INFO:teuthology.orchestra.run.smithi137.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-14T04:36:14.234 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://www.redhat.com/" 2023-07-14T04:36:14.234 INFO:teuthology.orchestra.run.smithi137.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-14T04:36:14.234 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-14T04:36:14.234 INFO:teuthology.orchestra.run.smithi137.stdout: 2023-07-14T04:36:14.234 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-14T04:36:14.234 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-14T04:36:14.235 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-14T04:36:14.235 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-14T04:36:14.237 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/provision/fog.py", line 348, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi137's OS to be centos 9 but found rhel 8.6 2023-07-14T04:36:14.237 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T04:36:14.238 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T04:36:19.253 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:36:19.322 INFO:teuthology.nuke:Checking targets against current locks 2023-07-14T04:36:24.331 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:36:34.370 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:36:39.398 DEBUG:teuthology.nuke:shortname: smithi137 2023-07-14T04:36:39.399 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-14T04:36:44.402 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:36:44.428 DEBUG:teuthology.nuke:shortname: smithi160 2023-07-14T04:36:44.428 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-14T04:36:49.431 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi137.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-13_23:26:42-fs-wip-yuri2-testing-2023-07-13-1236-distro-default-smithi/7337015', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 04:31:26.882666', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-14T04:36:53.095 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:36:53.120 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi160.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-13_23:26:42-fs-wip-yuri2-testing-2023-07-13-1236-distro-default-smithi/7337015', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 04:31:26.884550', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKzujrAtOaFYkRVBtF28/KiF/Ps8VMOq3cV7r9SrBGSgXk2hXtZW6s+piypiRUHdier9kDzdJR5GQ75816S2kmY='} 2023-07-14T04:36:55.833 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:36:55.870 INFO:teuthology.orchestra.console:Power off smithi137 2023-07-14T04:36:55.871 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T04:36:55.891 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:36:55.907 INFO:teuthology.orchestra.console:Power off smithi160 2023-07-14T04:36:55.908 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T04:36:55.928 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:36:56.842 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:36:57.848 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:36:58.852 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:36:59.857 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:36:59.917 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:36:59.953 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:37:00.866 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:37:01.871 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:37:02.876 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:37:05.029 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:37:05.065 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:37:10.139 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:37:10.177 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:37:15.251 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:37:15.287 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:37:20.361 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:37:20.398 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:37:25.471 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:37:25.506 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:37:25.717 INFO:teuthology.orchestra.console:Power off for smithi160 completed 2023-07-14T04:37:35.856 INFO:teuthology.orchestra.console:Power off for smithi137 completed 2023-07-14T04:37:35.881 INFO:teuthology.lock.ops:unlocked: smithi160.front.sepia.ceph.com 2023-07-14T04:37:36.674 INFO:teuthology.lock.ops:unlocked: smithi137.front.sepia.ceph.com 2023-07-14T04:37:36.900 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/dispatcher/supervisor.py", line 57, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/provision/fog.py", line 348, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi137's OS to be centos 9 but found rhel 8.6