2023-07-15T07:17:47.015 INFO:root:teuthology version: 0.0.1.dev147+gff9991b 2023-07-15T07:17:47.016 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T07:17:47.017 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T07:17:47.192 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2da9a5bee0>, signals=[15]) 2023-07-15T07:17:47.194 INFO:teuthology.lock.ops:Start node 'smithi115.front.sepia.ceph.com' reimaging 2023-07-15T07:17:47.194 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: reset os type and version on server 2023-07-15T07:17:47.194 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2023-07-15T07:17:47.223 INFO:teuthology.lock.ops:Start node 'smithi148.front.sepia.ceph.com' reimaging 2023-07-15T07:17:47.224 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: reset os type and version on server 2023-07-15T07:17:47.224 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2023-07-15T07:17:47.225 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /host {"name": "smithi115"} 2023-07-15T07:17:48.348 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /host {"name": "smithi148"} 2023-07-15T07:18:03.397 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-15T07:18:13.486 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-15T07:18:18.488 DEBUG:teuthology.provision.fog.smithi115:Requesting image smithi_centos_8.stream (ID 3) 2023-07-15T07:18:18.488 DEBUG:teuthology.provision.fog.smithi115:FOG request: PUT /host/220 {"imageID": 3} 2023-07-15T07:18:23.551 DEBUG:teuthology.provision.fog.smithi148:Requesting image smithi_centos_8.stream (ID 3) 2023-07-15T07:18:23.551 DEBUG:teuthology.provision.fog.smithi148:FOG request: PUT /host/253 {"imageID": 3} 2023-07-15T07:18:28.529 INFO:teuthology.provision.fog.smithi115:Scheduling deploy of centos 8.stream 2023-07-15T07:18:28.529 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None 2023-07-15T07:18:28.623 INFO:teuthology.provision.fog.smithi148:Scheduling deploy of centos 8.stream 2023-07-15T07:18:28.624 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-07-15T07:18:33.583 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /tasktype {"name": "deploy"} 2023-07-15T07:18:33.697 DEBUG:teuthology.provision.fog.smithi115:FOG request: POST /host/220/task {"taskTypeID": 1} 2023-07-15T07:18:38.706 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /tasktype {"name": "deploy"} 2023-07-15T07:18:43.749 DEBUG:teuthology.provision.fog.smithi148:FOG request: POST /host/253/task {"taskTypeID": 1} 2023-07-15T07:18:48.753 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None 2023-07-15T07:18:53.815 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-07-15T07:19:03.863 INFO:teuthology.orchestra.console:Power off smithi115 2023-07-15T07:19:03.865 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-15T07:19:08.899 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:19:08.935 INFO:teuthology.orchestra.console:Power off smithi148 2023-07-15T07:19:08.936 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-15T07:19:13.912 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:19:13.964 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:19:18.977 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:19:19.024 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:19:19.241 INFO:teuthology.orchestra.console:Power off for smithi115 completed 2023-07-15T07:19:19.343 INFO:teuthology.orchestra.console:Power on smithi115 2023-07-15T07:19:19.343 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-15T07:19:19.369 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:19:23.396 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:19:24.096 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:19:28.507 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:19:29.209 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:19:33.620 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:19:34.324 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:19:38.734 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:19:39.441 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:19:43.848 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:19:44.555 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:19:48.962 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:19:49.178 INFO:teuthology.orchestra.console:Power on for smithi115 completed 2023-07-15T07:19:49.279 INFO:teuthology.provision.fog.smithi115:Waiting for deploy to finish 2023-07-15T07:19:49.280 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None 2023-07-15T07:19:54.290 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:19:54.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:19:59.493 INFO:teuthology.orchestra.console:Power off for smithi148 completed 2023-07-15T07:19:59.594 INFO:teuthology.orchestra.console:Power on smithi148 2023-07-15T07:19:59.595 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-15T07:20:02.449 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-07-15T07:20:04.625 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:20:08.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:20:09.648 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:20:11.504 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-07-15T07:20:14.765 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:20:17.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:20:22.513 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:20:22.724 INFO:teuthology.orchestra.console:Power on for smithi148 completed 2023-07-15T07:20:22.825 INFO:teuthology.provision.fog.smithi148:Waiting for deploy to finish 2023-07-15T07:20:22.826 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-07-15T07:20:22.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:20:25.588 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-07-15T07:20:25.968 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-07-15T07:20:31.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:20:31.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:20:36.972 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-07-15T07:20:40.052 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-07-15T07:20:42.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:20:47.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:20:52.985 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-07-15T07:20:56.051 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-07-15T07:20:58.989 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:21:03.993 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:21:04.108 ERROR:teuthology.orchestra.connection:Error authenticating with smithi115.front.sepia.ceph.com: Authentication failed. 2023-07-15T07:21:04.110 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-15T07:21:04.111 DEBUG:teuthology.orchestra.run.smithi115:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-15T07:21:04.112 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:05.117 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:06.123 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:07.056 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-07-15T07:21:07.129 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:08.135 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:09.143 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:10.149 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:11.155 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:12.161 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:13.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:21:13.168 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:14.175 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:15.182 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:16.112 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-07-15T07:21:16.188 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:17.196 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:18.205 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:19.211 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:20.218 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:21.227 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:22.114 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:21:27.122 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:28.126 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:29.132 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:30.138 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:31.144 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:32.149 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:33.158 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:34.165 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:35.172 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:36.182 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:37.189 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:38.199 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:39.206 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:40.216 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:41.226 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:42.233 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:43.240 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:44.246 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:45.254 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:46.263 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:47.271 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:48.277 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:49.293 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:50.309 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:51.317 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:52.323 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:53.330 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:54.337 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:55.345 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:56.350 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:57.356 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:58.363 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:59.371 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:00.377 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:01.384 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:02.390 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:03.396 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:04.403 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:05.411 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:06.418 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:07.424 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:08.430 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:09.447 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:10.455 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:11.463 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:12.470 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:13.476 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:14.483 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:15.490 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:16.496 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:17.502 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:18.512 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:19.518 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:20.524 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:21.530 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:22.537 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:23.548 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:24.555 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:25.561 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:26.573 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:27.122 WARNING:teuthology.provision.fog.smithi148:timed out 2023-07-15T07:22:27.595 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:28.606 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:29.613 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:30.620 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:31.631 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:32.642 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:33.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:22:38.132 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:38.544 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-15T07:22:38.545 DEBUG:teuthology.orchestra.run.smithi148:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-15T07:22:38.811 INFO:teuthology.provision.fog.smithi148:Node is ready 2023-07-15T07:22:38.812 DEBUG:teuthology.orchestra.run.smithi148:> hostname 2023-07-15T07:22:38.830 INFO:teuthology.orchestra.run.smithi148.stdout:smithi148 2023-07-15T07:22:38.831 DEBUG:teuthology.orchestra.run.smithi148:> grep smithi148 /etc/hosts 2023-07-15T07:22:38.895 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148 smithi148.front.sepia.ceph.com smithi148 2023-07-15T07:22:38.896 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148 smithi148 smithi148 2023-07-15T07:22:38.896 DEBUG:teuthology.orchestra.run.smithi148:> sudo hostname smithi148 2023-07-15T07:22:39.024 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/smithi148/smithi148/g' /etc/hosts 2023-07-15T07:22:39.053 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/172.21.15.148/172.21.15.148/g' /etc/hosts 2023-07-15T07:22:39.124 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/smithi148/smithi148/g' /etc/hostname 2023-07-15T07:22:39.144 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:39.195 DEBUG:teuthology.orchestra.run.smithi148:> sudo hostname smithi148 2023-07-15T07:22:39.267 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2023-07-15T07:22:39.327 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="Red Hat Enterprise Linux" 2023-07-15T07:22:39.327 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="8.6 (Ootpa)" 2023-07-15T07:22:39.328 INFO:teuthology.orchestra.run.smithi148.stdout:ID="rhel" 2023-07-15T07:22:39.328 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="fedora" 2023-07-15T07:22:39.328 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="8.6" 2023-07-15T07:22:39.328 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el8" 2023-07-15T07:22:39.328 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-15T07:22:39.329 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31" 2023-07-15T07:22:39.329 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-15T07:22:39.330 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://www.redhat.com/" 2023-07-15T07:22:39.330 INFO:teuthology.orchestra.run.smithi148.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-15T07:22:39.330 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-15T07:22:39.330 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-07-15T07:22:39.330 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-15T07:22:39.330 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-15T07:22:39.330 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-15T07:22:39.331 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-15T07:22:39.335 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/fog.py", line 348, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi148's OS to be centos 8 but found rhel 8.6 2023-07-15T07:22:39.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T07:22:39.336 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T07:22:44.347 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:44.457 INFO:teuthology.nuke:Checking targets against current locks 2023-07-15T07:22:49.468 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:55.499 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:55.530 DEBUG:teuthology.nuke:shortname: smithi115 2023-07-15T07:22:55.530 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-15T07:22:55.552 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi115.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-14_23:39:06-rados-wip-yuri5-testing-2023-07-14-0757-distro-default-smithi/7338716', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-15 07:17:46.125020', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLnhP5P15HBrAUuZPFCnFCeqHTVmKFf+JaIOjm2BxosAiZzCgeIv90BrQrOIoukzBFnIKmO0PEBy5MNAbUl91lHz+nySA1w/UTo+VBFL5PoTFoQWvJat65ppCuUFWOysCLCmeskhjw2PNQZF+6tywkWQJsq+BdTse5vPkSMP7ciE6FZQNNvbkEM1eVMJXvbsKGKIToraFJXZFg00GWo5P/4G96ZTFz7SLw7QoOH0SQfYmcTuOfEVpkRkvvyziYJ6WMHwNM2uJKoIuTg7bPlykW71BYZzHYYGfUluklKcjW3TZZA7aa+TtuX6hk8/EbDUUgQ0uC8D7j1nTcQBDWpeCpApG0UviuRdbSZDCVs2PNkQk50xJPDhFYHs7oC6JF4j3CRV69UFGiX7IIqgduInRwedHcn++e2RVZ+t0gwzeaRKfmvFQ9nFkQaybdS/HxFEOU8Nynoro1bJfko+GCGP5/D4qMESadnA9nljPbXf82vd15efx+U9J3NqJxQM1ioec='} 2023-07-15T07:22:55.558 DEBUG:teuthology.nuke:shortname: smithi148 2023-07-15T07:22:55.558 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-15T07:22:55.580 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi148.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-14_23:39:06-rados-wip-yuri5-testing-2023-07-14-0757-distro-default-smithi/7338716', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-15 07:17:46.123532', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-15T07:22:55.640 INFO:teuthology.orchestra.console:Power off smithi115 2023-07-15T07:22:55.641 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-15T07:22:55.671 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:22:55.701 INFO:teuthology.orchestra.console:Power off smithi148 2023-07-15T07:22:55.702 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-15T07:22:55.730 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:22:56.530 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:57.540 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:58.549 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:59.561 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:59.717 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:22:59.761 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:23:03.835 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:23:03.879 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:23:08.950 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:23:08.991 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:23:09.162 INFO:teuthology.orchestra.console:Power off for smithi115 completed 2023-07-15T07:23:19.307 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:23:19.349 INFO:teuthology.lock.ops:unlocked: smithi115.front.sepia.ceph.com 2023-07-15T07:23:24.421 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:23:29.536 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:23:34.650 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:23:39.762 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:23:44.874 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:23:49.985 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:23:50.197 INFO:teuthology.orchestra.console:Power off for smithi148 completed 2023-07-15T07:24:00.360 INFO:teuthology.lock.ops:unlocked: smithi148.front.sepia.ceph.com 2023-07-15T07:24:10.628 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/dispatcher/supervisor.py", line 57, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/fog.py", line 348, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi148's OS to be centos 8 but found rhel 8.6