2023-07-14T04:33:51.856 INFO:root:teuthology version: 0.0.1.dev143+g073e6eb 2023-07-14T04:33:51.858 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T04:33:51.859 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T04:34:01.350 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe65d11a9d0>, signals=[15]) 2023-07-14T04:34:01.351 INFO:teuthology.lock.ops:Start node 'smithi153.front.sepia.ceph.com' reimaging 2023-07-14T04:34:01.352 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: reset os type and version on server 2023-07-14T04:34:01.352 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2023-07-14T04:34:01.369 INFO:teuthology.lock.ops:Start node 'smithi173.front.sepia.ceph.com' reimaging 2023-07-14T04:34:01.370 INFO:teuthology.lock.ops:Updating [smithi173.front.sepia.ceph.com]: reset os type and version on server 2023-07-14T04:34:01.370 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2023-07-14T04:34:01.371 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /host {"name": "smithi153"} 2023-07-14T04:34:11.403 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /host {"name": "smithi173"} 2023-07-14T04:34:21.436 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-14T04:34:31.366 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-14T04:34:36.374 DEBUG:teuthology.provision.fog.smithi153:Requesting image smithi_centos_8.stream (ID 3) 2023-07-14T04:34:36.375 DEBUG:teuthology.provision.fog.smithi153:FOG request: PUT /host/258 {"imageID": 3} 2023-07-14T04:34:41.426 DEBUG:teuthology.provision.fog.smithi173:Requesting image smithi_centos_8.stream (ID 3) 2023-07-14T04:34:41.427 DEBUG:teuthology.provision.fog.smithi173:FOG request: PUT /host/278 {"imageID": 3} 2023-07-14T04:34:46.435 INFO:teuthology.provision.fog.smithi153:Scheduling deploy of centos 8.stream 2023-07-14T04:34:46.435 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-07-14T04:34:51.488 INFO:teuthology.provision.fog.smithi173:Scheduling deploy of centos 8.stream 2023-07-14T04:34:51.489 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-07-14T04:34:56.496 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /tasktype {"name": "deploy"} 2023-07-14T04:34:56.563 DEBUG:teuthology.provision.fog.smithi153:FOG request: POST /host/258/task {"taskTypeID": 1} 2023-07-14T04:35:01.570 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /tasktype {"name": "deploy"} 2023-07-14T04:35:06.632 DEBUG:teuthology.provision.fog.smithi173:FOG request: POST /host/278/task {"taskTypeID": 1} 2023-07-14T04:35:06.659 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-07-14T04:35:06.752 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-07-14T04:35:16.902 INFO:teuthology.orchestra.console:Power off smithi173 2023-07-14T04:35:16.903 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T04:35:16.919 INFO:teuthology.orchestra.console:Power off smithi153 2023-07-14T04:35:16.920 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T04:35:16.941 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:35:17.062 INFO:teuthology.orchestra.console:Power off for smithi153 completed 2023-07-14T04:35:17.163 INFO:teuthology.orchestra.console:Power on smithi153 2023-07-14T04:35:17.163 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-14T04:35:17.183 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:35:21.206 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:35:26.316 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:35:26.933 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:35:31.430 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:35:31.945 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:35:36.542 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:35:37.055 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:35:41.652 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:35:42.166 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:35:42.376 INFO:teuthology.orchestra.console:Power off for smithi173 completed 2023-07-14T04:35:42.477 INFO:teuthology.orchestra.console:Power on smithi173 2023-07-14T04:35:42.478 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-14T04:35:42.497 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:35:46.521 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:35:46.763 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:35:50.634 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:35:50.845 INFO:teuthology.orchestra.console:Power on for smithi173 completed 2023-07-14T04:35:50.946 INFO:teuthology.provision.fog.smithi173:Waiting for deploy to finish 2023-07-14T04:35:50.947 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-07-14T04:35:55.955 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:35:56.050 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:36:00.272 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-07-14T04:36:02.250 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:36:06.277 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:36:11.284 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:36:11.495 INFO:teuthology.orchestra.console:Power on for smithi153 completed 2023-07-14T04:36:11.596 INFO:teuthology.provision.fog.smithi153:Waiting for deploy to finish 2023-07-14T04:36:11.596 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-07-14T04:36:14.352 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-07-14T04:36:20.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:36:26.979 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-07-14T04:36:31.984 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-07-14T04:36:37.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:36:46.064 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-07-14T04:36:47.111 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-07-14T04:36:52.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:36:57.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:37:05.264 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-07-14T04:37:11.271 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:37:16.386 ERROR:teuthology.orchestra.connection:Error authenticating with smithi153.front.sepia.ceph.com: Authentication failed. 2023-07-14T04:37:16.387 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-14T04:37:16.388 DEBUG:teuthology.orchestra.run.smithi153:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-14T04:37:16.389 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:37:17.394 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:37:18.400 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:37:19.404 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:37:20.409 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:37:21.413 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:37:22.419 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:37:23.423 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:37:24.428 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:37:25.433 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:37:26.438 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:37:27.443 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:37:28.448 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:37:29.453 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:37:30.458 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:37:31.462 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:37:32.466 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:37:33.471 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:37:34.475 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:37:35.479 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:37:36.484 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:37:37.489 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:37:38.493 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:37:39.498 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:37:40.502 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:37:41.507 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:37:42.511 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:37:43.516 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:37:44.520 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:37:45.524 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:37:46.528 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:37:47.533 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:37:48.537 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:37:49.541 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:37:50.545 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:37:51.550 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:37:52.554 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:37:53.558 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:37:54.563 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:37:55.567 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:37:56.571 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:37:57.121 WARNING:teuthology.provision.fog.smithi173:timed out 2023-07-14T04:37:57.577 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:37:58.582 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:37:59.586 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:38:00.591 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:38:01.595 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:38:02.600 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:38:03.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:38:08.130 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:38:09.135 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:38:10.140 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:38:11.144 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:38:12.148 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:38:13.154 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:38:14.159 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:38:14.224 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-07-14T04:38:15.165 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:38:16.171 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:38:17.176 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:38:18.181 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:38:19.186 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:38:20.192 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:38:20.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:38:21.196 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:38:22.201 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:38:23.205 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:38:23.284 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-07-14T04:38:24.210 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:38:25.214 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:38:26.219 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:38:27.223 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:38:28.227 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:38:29.236 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:38:29.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:38:30.241 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:38:31.246 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:38:31.316 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-07-14T04:38:32.250 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:38:33.254 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:38:34.258 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:38:35.262 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:38:36.266 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:38:37.271 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:38:37.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:38:42.325 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:38:43.328 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:38:44.332 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:38:45.335 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:38:45.392 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-07-14T04:38:46.340 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:38:47.344 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:38:48.348 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:38:49.353 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:38:50.357 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:38:51.361 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:38:51.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:38:52.701 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:38:53.705 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:38:54.709 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:38:55.714 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:38:55.760 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-07-14T04:38:56.718 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:38:57.722 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:38:58.727 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:38:59.731 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:39:00.735 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:39:01.740 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:39:01.762 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:39:06.769 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:39:07.772 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:39:08.776 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:39:09.781 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:39:09.840 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-07-14T04:39:10.785 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:39:11.790 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:39:12.794 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:39:13.798 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:39:14.803 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:39:15.807 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:39:15.841 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:39:20.848 ERROR:teuthology.provision.fog: on smithi153 2023-07-14T04:39:23.920 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-07-14T04:39:29.856 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-07-14T04:39:29.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:39:29.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:39:29.928 ERROR:teuthology.orchestra.connection:Error authenticating with smithi153.front.sepia.ceph.com: Authentication failed. 2023-07-14T04:39:29.928 DEBUG:teuthology.orchestra.run.smithi153:> true 2023-07-14T04:39:29.929 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:39:32.976 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-07-14T04:39:38.978 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:39:47.056 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-07-14T04:39:53.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:40:01.136 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-07-14T04:40:07.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:40:15.216 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-07-14T04:40:21.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:40:29.296 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-07-14T04:40:35.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:40:38.352 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-07-14T04:40:44.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:40:47.408 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-07-14T04:40:53.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:41:01.488 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-07-14T04:41:07.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:41:15.568 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-07-14T04:41:21.570 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:41:24.624 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-07-14T04:41:30.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:41:33.680 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-07-14T04:41:38.868 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-07-14T04:41:38.869 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:41:43.873 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:41:48.945 ERROR:teuthology.orchestra.connection:Error authenticating with smithi153.front.sepia.ceph.com: Authentication failed. 2023-07-14T04:41:48.946 DEBUG:teuthology.orchestra.run.smithi153:> true 2023-07-14T04:41:48.946 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:42:07.344 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-07-14T04:42:13.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:42:18.424 ERROR:teuthology.orchestra.connection:Error authenticating with smithi173.front.sepia.ceph.com: Authentication failed. 2023-07-14T04:42:18.425 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-14T04:42:18.425 DEBUG:teuthology.orchestra.run.smithi173:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-14T04:42:18.426 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:42:19.431 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:42:20.436 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:42:21.443 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:42:22.448 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:42:23.455 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:42:24.461 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:42:25.466 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:42:26.471 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:42:27.476 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:42:28.481 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:42:29.487 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:42:30.493 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:42:31.501 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:42:32.508 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:42:33.514 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:42:34.521 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:42:35.527 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:42:36.535 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:42:37.542 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:42:38.549 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:42:39.555 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:42:40.561 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:42:41.567 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:42:42.573 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:42:43.579 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:42:44.586 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:42:45.594 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:42:46.600 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:42:47.605 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:42:48.611 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:42:49.617 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:42:50.623 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:42:51.630 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:42:52.637 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:42:53.643 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:42:54.648 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:42:55.654 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:42:56.660 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:42:57.664 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:42:58.670 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:42:59.675 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:55.878 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-07-14T04:43:55.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:44:00.955 ERROR:teuthology.orchestra.connection:Error authenticating with smithi153.front.sepia.ceph.com: Authentication failed. 2023-07-14T04:44:00.955 DEBUG:teuthology.orchestra.run.smithi153:> true 2023-07-14T04:44:00.956 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:48.628 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-07-14T04:44:48.629 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi173 2023-07-14T04:44:57.631 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2023-07-14T04:44:57.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:44:57.717 DEBUG:teuthology.orchestra.run.smithi173:> true 2023-07-14T04:44:57.788 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi173.front.sepia.ceph.com' 2023-07-14T04:44:57.789 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-14T04:44:57.789 DEBUG:teuthology.orchestra.run.smithi173:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-14T04:45:02.846 INFO:teuthology.provision.fog.smithi173:Node is ready 2023-07-14T04:45:02.846 DEBUG:teuthology.orchestra.run.smithi173:> hostname 2023-07-14T04:45:02.864 INFO:teuthology.orchestra.run.smithi173.stdout:smithi173.front.sepia.ceph.com 2023-07-14T04:45:02.864 DEBUG:teuthology.orchestra.run.smithi173:> grep smithi173.front.sepia.ceph.com /etc/hosts 2023-07-14T04:45:02.921 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.15.173 smithi173.front.sepia.ceph.com smithi173 2023-07-14T04:45:02.921 DEBUG:teuthology.orchestra.run.smithi173:> sudo hostname smithi173 2023-07-14T04:45:03.034 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i -e 's/smithi173.front.sepia.ceph.com/smithi173/g' /etc/hosts 2023-07-14T04:45:03.065 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i -e 's/172.21.15.173/172.21.15.173/g' /etc/hosts 2023-07-14T04:45:03.134 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i -e 's/smithi173.front.sepia.ceph.com/smithi173/g' /etc/hostname 2023-07-14T04:45:03.202 DEBUG:teuthology.orchestra.run.smithi173:> sudo hostname smithi173 2023-07-14T04:45:03.270 DEBUG:teuthology.orchestra.run.smithi173:> cat /etc/os-release 2023-07-14T04:45:03.324 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="CentOS Stream" 2023-07-14T04:45:03.324 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="9" 2023-07-14T04:45:03.325 INFO:teuthology.orchestra.run.smithi173.stdout:ID="centos" 2023-07-14T04:45:03.325 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE="rhel fedora" 2023-07-14T04:45:03.325 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="9" 2023-07-14T04:45:03.325 INFO:teuthology.orchestra.run.smithi173.stdout:PLATFORM_ID="platform:el9" 2023-07-14T04:45:03.325 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-14T04:45:03.325 INFO:teuthology.orchestra.run.smithi173.stdout:ANSI_COLOR="0;31" 2023-07-14T04:45:03.325 INFO:teuthology.orchestra.run.smithi173.stdout:LOGO="fedora-logo-icon" 2023-07-14T04:45:03.326 INFO:teuthology.orchestra.run.smithi173.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-14T04:45:03.326 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://centos.org/" 2023-07-14T04:45:03.326 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-14T04:45:03.326 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-14T04:45:03.326 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-14T04:45:03.329 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/provision/fog.py", line 348, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi173's OS to be centos 8 but found centos 9 2023-07-14T04:45:03.330 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T04:45:03.330 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T04:45:08.407 INFO:teuthology.nuke:Checking targets against current locks 2023-07-14T04:45:23.475 DEBUG:teuthology.nuke:shortname: smithi153 2023-07-14T04:45:23.476 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-14T04:45:33.239 DEBUG:teuthology.nuke:shortname: smithi173 2023-07-14T04:45:33.239 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-14T04:45:38.246 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-13_23:26:42-fs-wip-yuri2-testing-2023-07-13-1236-distro-default-smithi/7337021', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 04:33:36.010626', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-07-14T04:45:39.049 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi173.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-13_23:26:42-fs-wip-yuri2-testing-2023-07-13-1236-distro-default-smithi/7337045', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 04:38:53.641423', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEzmIELa66Pnp/x8mkFfZrDdviKPWFLqv+4SRC7UANv0WWhMiHRnzoySmljEOO2T0s9yAlDpPF9saDd+yLqqK8A='} 2023-07-14T04:45:39.103 INFO:teuthology.orchestra.console:Power off smithi153 2023-07-14T04:45:39.104 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T04:45:39.126 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:45:39.173 INFO:teuthology.orchestra.console:Power off smithi173 2023-07-14T04:45:39.174 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T04:45:39.199 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:45:43.148 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:45:43.223 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:45:47.260 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:45:47.334 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:45:51.371 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:45:52.445 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:45:56.483 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:45:57.555 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:46:01.594 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:46:02.665 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:46:06.705 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:46:07.777 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:46:11.816 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:46:12.888 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:46:16.926 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:46:17.137 INFO:teuthology.orchestra.console:Power off for smithi153 completed 2023-07-14T04:46:22.246 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:46:27.313 INFO:teuthology.lock.ops:unlocked: smithi153.front.sepia.ceph.com 2023-07-14T04:46:27.386 INFO:teuthology.orchestra.console:Power off for smithi173 completed 2023-07-14T04:46:37.553 INFO:teuthology.lock.ops:unlocked: smithi173.front.sepia.ceph.com 2023-07-14T04:46:46.802 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/dispatcher/supervisor.py", line 57, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/provision/fog.py", line 348, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi173's OS to be centos 8 but found centos 9