2023-08-27T16:25:23.005 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-27T16:25:23.005 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T16:25:23.162 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe90d3181f0>, signals=[15]) 2023-08-27T16:25:23.163 INFO:teuthology.lock.ops:Start node 'smithi093.front.sepia.ceph.com' reimaging 2023-08-27T16:25:23.163 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: reset os type and version on server 2023-08-27T16:25:23.163 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server 2023-08-27T16:25:23.181 INFO:teuthology.lock.ops:Start node 'smithi102.front.sepia.ceph.com' reimaging 2023-08-27T16:25:23.181 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: reset os type and version on server 2023-08-27T16:25:23.181 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2023-08-27T16:25:23.182 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /host {"name": "smithi093"} 2023-08-27T16:25:23.206 INFO:teuthology.lock.ops:Start node 'smithi103.front.sepia.ceph.com' reimaging 2023-08-27T16:25:23.206 INFO:teuthology.lock.ops:Updating [smithi103.front.sepia.ceph.com]: reset os type and version on server 2023-08-27T16:25:23.206 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2023-08-27T16:25:23.207 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /host {"name": "smithi102"} 2023-08-27T16:25:23.231 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /host {"name": "smithi103"} 2023-08-27T16:25:23.269 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-27T16:25:23.276 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-27T16:25:23.294 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-27T16:25:23.308 DEBUG:teuthology.provision.fog.smithi093:Requesting image smithi_centos_8.stream (ID 3) 2023-08-27T16:25:23.309 DEBUG:teuthology.provision.fog.smithi093:FOG request: PUT /host/198 {"imageID": 3} 2023-08-27T16:25:23.312 DEBUG:teuthology.provision.fog.smithi102:Requesting image smithi_centos_8.stream (ID 3) 2023-08-27T16:25:23.312 DEBUG:teuthology.provision.fog.smithi102:FOG request: PUT /host/207 {"imageID": 3} 2023-08-27T16:25:23.333 DEBUG:teuthology.provision.fog.smithi103:Requesting image smithi_centos_8.stream (ID 3) 2023-08-27T16:25:23.334 DEBUG:teuthology.provision.fog.smithi103:FOG request: PUT /host/208 {"imageID": 3} 2023-08-27T16:25:23.361 INFO:teuthology.provision.fog.smithi102:Scheduling deploy of centos 8.stream 2023-08-27T16:25:23.361 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-08-27T16:25:23.364 INFO:teuthology.provision.fog.smithi093:Scheduling deploy of centos 8.stream 2023-08-27T16:25:23.364 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-08-27T16:25:23.384 INFO:teuthology.provision.fog.smithi103:Scheduling deploy of centos 8.stream 2023-08-27T16:25:23.384 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-08-27T16:25:23.415 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /tasktype {"name": "deploy"} 2023-08-27T16:25:23.427 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /tasktype {"name": "deploy"} 2023-08-27T16:25:23.445 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /tasktype {"name": "deploy"} 2023-08-27T16:25:23.456 DEBUG:teuthology.provision.fog.smithi102:FOG request: POST /host/207/task {"taskTypeID": 1} 2023-08-27T16:25:23.467 DEBUG:teuthology.provision.fog.smithi093:FOG request: POST /host/198/task {"taskTypeID": 1} 2023-08-27T16:25:23.476 DEBUG:teuthology.provision.fog.smithi103:FOG request: POST /host/208/task {"taskTypeID": 1} 2023-08-27T16:25:23.506 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-08-27T16:25:23.511 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-08-27T16:25:23.528 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-08-27T16:25:23.601 INFO:teuthology.orchestra.console.smithi102:Power off 2023-08-27T16:25:23.601 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-27T16:25:23.612 INFO:teuthology.orchestra.console.smithi093:Power off 2023-08-27T16:25:23.612 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-27T16:25:23.624 INFO:teuthology.orchestra.console.smithi103:Power off 2023-08-27T16:25:23.624 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-27T16:25:23.630 DEBUG:teuthology.orchestra.console.smithi102:power off output: Chassis Power Control: Down/Off 2023-08-27T16:25:23.630 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T16:25:23.637 DEBUG:teuthology.orchestra.console.smithi093:power off output: Chassis Power Control: Down/Off 2023-08-27T16:25:23.637 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T16:25:23.645 DEBUG:teuthology.orchestra.console.smithi103:power off output: Chassis Power Control: Down/Off 2023-08-27T16:25:23.645 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T16:25:23.652 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2023-08-27T16:25:23.659 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off 2023-08-27T16:25:23.663 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2023-08-27T16:25:23.759 INFO:teuthology.orchestra.console.smithi093:Power off completed 2023-08-27T16:25:23.860 INFO:teuthology.orchestra.console.smithi093:Power on 2023-08-27T16:25:23.860 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-27T16:25:23.882 DEBUG:teuthology.orchestra.console.smithi093:power on output: Chassis Power Control: Up/On 2023-08-27T16:25:23.882 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T16:25:23.901 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off 2023-08-27T16:25:27.655 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T16:25:27.664 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T16:25:27.763 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2023-08-27T16:25:27.771 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2023-08-27T16:25:27.902 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T16:25:28.010 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on 2023-08-27T16:25:28.142 INFO:teuthology.orchestra.console.smithi093:Power on completed 2023-08-27T16:25:28.242 INFO:teuthology.provision.fog.smithi093:Waiting for deploy to finish 2023-08-27T16:25:28.243 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-08-27T16:25:31.767 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T16:25:31.773 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T16:25:31.875 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2023-08-27T16:25:31.880 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2023-08-27T16:25:31.976 INFO:teuthology.orchestra.console.smithi102:Power off completed 2023-08-27T16:25:31.981 INFO:teuthology.orchestra.console.smithi103:Power off completed 2023-08-27T16:25:32.077 INFO:teuthology.orchestra.console.smithi102:Power on 2023-08-27T16:25:32.077 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-27T16:25:32.083 INFO:teuthology.orchestra.console.smithi103:Power on 2023-08-27T16:25:32.084 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-27T16:25:32.100 DEBUG:teuthology.orchestra.console.smithi102:power on output: Chassis Power Control: Up/On 2023-08-27T16:25:32.100 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T16:25:32.107 DEBUG:teuthology.orchestra.console.smithi103:power on output: Chassis Power Control: Up/On 2023-08-27T16:25:32.108 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T16:25:32.119 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2023-08-27T16:25:32.126 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2023-08-27T16:25:36.123 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T16:25:36.131 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T16:25:36.234 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2023-08-27T16:25:36.238 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2023-08-27T16:25:36.339 INFO:teuthology.orchestra.console.smithi103:Power on completed 2023-08-27T16:25:36.439 INFO:teuthology.provision.fog.smithi103:Waiting for deploy to finish 2023-08-27T16:25:36.440 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-08-27T16:25:40.239 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T16:25:40.347 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2023-08-27T16:25:40.448 INFO:teuthology.orchestra.console.smithi102:Power on completed 2023-08-27T16:25:40.549 INFO:teuthology.provision.fog.smithi102:Waiting for deploy to finish 2023-08-27T16:25:40.549 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-08-27T16:25:43.311 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-08-27T16:25:51.511 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-08-27T16:25:55.609 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-08-27T16:25:58.370 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-08-27T16:26:06.571 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-08-27T16:26:10.667 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-08-27T16:26:13.444 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-08-27T16:26:21.643 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-08-27T16:26:25.728 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-08-27T16:26:28.502 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-08-27T16:26:36.715 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-08-27T16:26:40.787 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-08-27T16:26:43.562 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-08-27T16:26:51.787 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-08-27T16:26:55.844 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-08-27T16:26:58.633 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-08-27T16:27:06.851 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-08-27T16:27:10.907 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-08-27T16:27:13.695 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-08-27T16:27:21.931 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-08-27T16:27:25.988 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-08-27T16:27:28.773 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-08-27T16:27:28.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T16:27:37.031 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-08-27T16:27:41.071 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-08-27T16:27:47.183 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-08-27T16:27:52.111 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-08-27T16:27:53.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T16:27:56.166 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-08-27T16:27:56.271 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-08-27T16:28:02.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T16:28:05.355 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-08-27T16:28:07.189 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-08-27T16:28:11.239 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-08-27T16:28:11.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T16:28:11.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T16:28:14.411 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-08-27T16:28:20.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T16:28:22.263 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-08-27T16:28:23.467 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-08-27T16:28:29.469 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T16:28:29.679 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-08-27T16:28:35.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T16:28:37.337 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-08-27T16:28:37.405 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T16:28:38.763 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-08-27T16:28:44.767 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T16:28:47.819 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-08-27T16:28:47.851 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-08-27T16:28:53.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T16:28:53.852 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T16:28:55.791 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-08-27T16:28:56.395 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-08-27T16:28:56.911 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-08-27T16:29:01.795 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T16:29:02.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T16:29:02.512 ERROR:teuthology.orchestra.connection:Error authenticating with smithi093.front.sepia.ceph.com: Authentication failed. 2023-08-27T16:29:02.512 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-27T16:29:02.513 DEBUG:teuthology.orchestra.run.smithi093:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-27T16:29:02.513 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-27T16:29:02.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T16:29:03.517 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-27T16:29:04.522 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-27T16:29:04.875 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-08-27T16:29:05.526 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-27T16:29:05.963 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-08-27T16:29:06.531 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-27T16:29:07.537 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-27T16:29:08.542 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-27T16:29:09.548 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-27T16:29:10.615 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-27T16:29:10.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T16:29:11.646 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-27T16:29:11.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T16:29:12.707 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-27T16:29:13.757 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-27T16:29:13.995 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-08-27T16:29:14.761 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-27T16:29:15.765 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-27T16:29:16.769 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-27T16:29:17.773 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-27T16:29:18.778 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-27T16:29:19.782 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-27T16:29:19.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T16:29:20.786 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-27T16:29:21.792 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-27T16:29:22.797 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-27T16:29:23.051 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-08-27T16:29:23.802 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-27T16:29:24.807 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-27T16:29:25.812 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-27T16:29:26.827 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-27T16:29:27.832 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-27T16:29:28.838 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-27T16:29:29.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T16:29:29.843 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-27T16:29:30.848 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-27T16:29:31.867 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-27T16:29:32.107 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-08-27T16:29:32.873 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-27T16:29:33.879 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-27T16:29:34.885 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-27T16:29:35.891 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-27T16:29:36.896 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-27T16:29:37.902 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-27T16:29:38.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T16:29:38.908 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-27T16:29:39.914 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-27T16:29:40.920 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-27T16:29:41.163 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-08-27T16:29:41.926 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-27T16:29:42.933 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-27T16:29:43.938 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-27T16:29:44.944 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-27T16:29:45.950 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-27T16:29:46.955 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-27T16:29:47.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T16:29:47.960 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-27T16:29:48.965 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-27T16:29:49.971 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-27T16:29:50.976 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-27T16:29:51.981 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-27T16:29:52.987 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-27T16:29:53.992 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-27T16:30:11.966 WARNING:teuthology.provision.fog.smithi102:timed out 2023-08-27T16:30:17.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T16:30:18.166 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-27T16:30:18.166 DEBUG:teuthology.orchestra.run.smithi102:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-27T16:30:18.445 INFO:teuthology.provision.fog.smithi102:Node is ready 2023-08-27T16:30:18.445 DEBUG:teuthology.orchestra.run.smithi102:> hostname 2023-08-27T16:30:18.466 INFO:teuthology.orchestra.run.smithi102.stdout:smithi102.front.sepia.ceph.com 2023-08-27T16:30:18.466 DEBUG:teuthology.orchestra.run.smithi102:> grep smithi102.front.sepia.ceph.com /etc/hosts 2023-08-27T16:30:18.528 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.15.102 smithi102.front.sepia.ceph.com smithi102 2023-08-27T16:30:18.529 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102 2023-08-27T16:30:18.629 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102.front.sepia.ceph.com/smithi102/g' /etc/hosts 2023-08-27T16:30:18.663 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/172.21.15.102/172.21.15.102/g' /etc/hosts 2023-08-27T16:30:18.737 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102.front.sepia.ceph.com/smithi102/g' /etc/hostname 2023-08-27T16:30:18.810 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102 2023-08-27T16:30:18.884 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2023-08-27T16:30:18.945 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="CentOS Stream" 2023-08-27T16:30:18.946 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="8" 2023-08-27T16:30:18.946 INFO:teuthology.orchestra.run.smithi102.stdout:ID="centos" 2023-08-27T16:30:18.946 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="rhel fedora" 2023-08-27T16:30:18.946 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="8" 2023-08-27T16:30:18.946 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el8" 2023-08-27T16:30:18.946 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-27T16:30:18.946 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31" 2023-08-27T16:30:18.946 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-27T16:30:18.947 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://centos.org/" 2023-08-27T16:30:18.947 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-27T16:30:18.947 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-27T16:30:18.947 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-27T16:30:18.947 INFO:teuthology.provision.fog.smithi102:Deploy complete! 2023-08-27T16:30:18.949 DEBUG:teuthology.parallel:result is None 2023-08-27T16:30:47.166 WARNING:teuthology.provision.fog.smithi103:timed out 2023-08-27T16:30:53.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T16:30:53.395 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-27T16:30:53.396 DEBUG:teuthology.orchestra.run.smithi103:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-27T16:30:53.647 INFO:teuthology.provision.fog.smithi103:Node is ready 2023-08-27T16:30:53.647 DEBUG:teuthology.orchestra.run.smithi103:> hostname 2023-08-27T16:30:53.666 INFO:teuthology.orchestra.run.smithi103.stdout:smithi103.front.sepia.ceph.com 2023-08-27T16:30:53.667 DEBUG:teuthology.orchestra.run.smithi103:> grep smithi103.front.sepia.ceph.com /etc/hosts 2023-08-27T16:30:53.726 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103 smithi103.front.sepia.ceph.com smithi103 2023-08-27T16:30:53.727 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname smithi103 2023-08-27T16:30:53.828 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/smithi103.front.sepia.ceph.com/smithi103/g' /etc/hosts 2023-08-27T16:30:53.858 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/172.21.15.103/172.21.15.103/g' /etc/hosts 2023-08-27T16:30:53.926 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/smithi103.front.sepia.ceph.com/smithi103/g' /etc/hostname 2023-08-27T16:30:53.994 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname smithi103 2023-08-27T16:30:54.062 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2023-08-27T16:30:54.120 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="CentOS Stream" 2023-08-27T16:30:54.120 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="8" 2023-08-27T16:30:54.120 INFO:teuthology.orchestra.run.smithi103.stdout:ID="centos" 2023-08-27T16:30:54.120 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="rhel fedora" 2023-08-27T16:30:54.120 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="8" 2023-08-27T16:30:54.121 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el8" 2023-08-27T16:30:54.121 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-27T16:30:54.121 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31" 2023-08-27T16:30:54.121 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-27T16:30:54.121 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://centos.org/" 2023-08-27T16:30:54.121 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-27T16:30:54.121 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-27T16:30:54.121 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-27T16:30:54.121 INFO:teuthology.provision.fog.smithi103:Deploy complete! 2023-08-27T16:30:54.122 DEBUG:teuthology.parallel:result is None 2023-08-27T16:31:42.191 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-08-27T16:31:42.191 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi093 2023-08-27T16:31:51.192 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-08-27T16:31:51.193 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T16:31:51.262 DEBUG:teuthology.orchestra.run.smithi093:> true 2023-08-27T16:31:51.392 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-08-27T16:31:51.392 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-27T16:31:51.392 DEBUG:teuthology.orchestra.run.smithi093:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-27T16:31:51.449 INFO:teuthology.provision.fog.smithi093:Node is ready 2023-08-27T16:31:51.450 DEBUG:teuthology.orchestra.run.smithi093:> hostname 2023-08-27T16:31:51.506 INFO:teuthology.orchestra.run.smithi093.stdout:smithi093 2023-08-27T16:31:51.506 DEBUG:teuthology.orchestra.run.smithi093:> grep smithi093 /etc/hosts 2023-08-27T16:31:51.563 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93 smithi093.front.sepia.ceph.com smithi093 2023-08-27T16:31:51.563 DEBUG:teuthology.orchestra.run.smithi093:> sudo hostname smithi093 2023-08-27T16:31:51.632 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/smithi093/smithi093/g' /etc/hosts 2023-08-27T16:31:51.700 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/172.21.15.93/172.21.15.93/g' /etc/hosts 2023-08-27T16:31:51.765 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/smithi093/smithi093/g' /etc/hostname 2023-08-27T16:31:51.832 DEBUG:teuthology.orchestra.run.smithi093:> sudo hostname smithi093 2023-08-27T16:31:51.898 DEBUG:teuthology.orchestra.run.smithi093:> cat /etc/os-release 2023-08-27T16:31:51.954 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="Red Hat Enterprise Linux" 2023-08-27T16:31:51.955 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="8.6 (Ootpa)" 2023-08-27T16:31:51.955 INFO:teuthology.orchestra.run.smithi093.stdout:ID="rhel" 2023-08-27T16:31:51.955 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE="fedora" 2023-08-27T16:31:51.955 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="8.6" 2023-08-27T16:31:51.955 INFO:teuthology.orchestra.run.smithi093.stdout:PLATFORM_ID="platform:el8" 2023-08-27T16:31:51.955 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-27T16:31:51.955 INFO:teuthology.orchestra.run.smithi093.stdout:ANSI_COLOR="0;31" 2023-08-27T16:31:51.955 INFO:teuthology.orchestra.run.smithi093.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-27T16:31:51.955 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://www.redhat.com/" 2023-08-27T16:31:51.955 INFO:teuthology.orchestra.run.smithi093.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-27T16:31:51.955 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-27T16:31:51.956 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-08-27T16:31:51.956 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-27T16:31:51.956 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-27T16:31:51.956 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-27T16:31:51.956 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-27T16:31:51.957 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/provision/fog.py", line 348, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi093's OS to be centos 8 but found rhel 8.6 2023-08-27T16:31:51.958 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T16:31:52.099 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=a28a0854caac4949932ca87651525bd8 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/provision/fog.py", line 348, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi093's OS to be centos 8 but found rhel 8.6 2023-08-27T16:31:52.101 INFO:teuthology.nuke:Checking targets against current locks 2023-08-27T16:31:52.171 DEBUG:teuthology.nuke:shortname: smithi093 2023-08-27T16:31:52.172 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-27T16:31:52.196 DEBUG:teuthology.nuke:shortname: smithi102 2023-08-27T16:31:52.196 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-27T16:31:52.200 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi093.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-26_02:16:12-fs-wip-rishabh-xiubo-wip-57154-testing-default-smithi/7381682', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-27 16:27:13.636385', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKoUyJ1nH+Fp2ujBmLEDl9VR+Gyb5g6Y7iISL3hwHXj2I+hYx6UxdIfmV/Yt6juozrWzuhCQxucBnIMrF6TbaWA='} 2023-08-27T16:31:52.218 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-26_02:16:12-fs-wip-rishabh-xiubo-wip-57154-testing-default-smithi/7381679', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-27 16:25:22.166877', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDP38ROCauDfw+ORR7pOWG41TQ6cx8QFm9m2PG3AYmj1X4XlRhCq0RSVqXh522Q1vycFZyaUQUgrFDID9wMOJk+YxnMQueFP2/S1euoUEEgGN8Ga1zcH7tY9To16fH7iW0aWOlO/fsCp4VasraPAS7HLJsHfUgnztA/gx63O7FvvTmCiO6dDq6IFdP5nVdxxdxGl0K09x7+H5a70VJVIVLhTc3jorBmVkE7KVYubEGBGBrSCt9F5cJJGuy1KIg27BDXu/u/N0iObKBi6Chj4IN/NXWmFkJx4OTWm+zIjZ3QmCyxT8L+5zQTlVLjcL3frdQU6Lp5uS5E/J2hE4RwEJJHXPv7ALNU5oouUEhvNZrh35abz4iMuDdgcAIYbOqHbCeqg0TUPSRnItBINMHap0c3D3gNN9tsGX7NB3v4WRs7dt1A6Vv1JMEUUvl57CtiZB8JEEUk9yNB7EPpuBEEOqGZleJylIr6U2DfMByRHT1WREDhI48BzX3mZAT/yOVNxn8='} 2023-08-27T16:31:52.224 DEBUG:teuthology.nuke:shortname: smithi103 2023-08-27T16:31:52.224 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-27T16:31:52.243 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi103.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-26_02:16:12-fs-wip-rishabh-xiubo-wip-57154-testing-default-smithi/7381679', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-27 16:25:22.165669', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDA12casfW58jTXhBgVVibRANpDhgh1xmdJ0WLBjiefEitYzSSrON0WwW6naODJLr/kBcuvRrfnBND1zZo0XZm3tVyC6htb8Nzgiy+wXE87iUZDBsYFMLbHvGyCmIQmi9FfF/BbU59mvcO7oOcwLOomOqza6zYuQNGcXxHOVR8JuvypKstFblGCcIxo/fp0KWdGVll1ZTcMxn46xZxFOhiT9iez/qxjlj9gelufwlROQKeB2/2TGn1clEsExXsup9XhivV1yaZ1+4lbrdU4hH6XfiqxWMayjo+ez3DRH9WNKokfREI3JS5WSM0aewoXqvUzB8E5MFujaS0cxZH5MEYAF3+52yS5AoJvlQM5WUebBW5YbGhJcU9jFhg30Ddwq/9hPRUqQsre04W7xYhC1HVsNcrMywIVuMIL+g0h6whgvnuUOCu3HE3dUDP391vAlutbk7IG7KQR60PGwBDrxlYx2R92nugKt6VDEIKqtZSbf8D2D72C/s7yKzecxM7lHXU='} 2023-08-27T16:31:52.249 INFO:teuthology.orchestra.console.smithi093:Power off 2023-08-27T16:31:52.250 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-27T16:31:52.273 DEBUG:teuthology.orchestra.console.smithi093:power off output: Chassis Power Control: Down/Off 2023-08-27T16:31:52.274 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T16:31:52.286 INFO:teuthology.orchestra.console.smithi102:Power off 2023-08-27T16:31:52.287 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-27T16:31:52.298 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on 2023-08-27T16:31:52.308 DEBUG:teuthology.orchestra.console.smithi102:power off output: Chassis Power Control: Down/Off 2023-08-27T16:31:52.308 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T16:31:52.324 INFO:teuthology.orchestra.console.smithi103:Power off 2023-08-27T16:31:52.324 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-27T16:31:52.332 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2023-08-27T16:31:52.345 DEBUG:teuthology.orchestra.console.smithi103:power off output: Chassis Power Control: Down/Off 2023-08-27T16:31:52.345 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T16:31:52.365 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2023-08-27T16:31:56.298 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T16:31:56.333 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T16:31:56.365 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T16:31:56.426 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on 2023-08-27T16:31:56.441 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2023-08-27T16:31:56.474 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2023-08-27T16:32:00.431 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T16:32:00.442 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T16:32:00.475 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T16:32:00.542 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on 2023-08-27T16:32:00.569 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2023-08-27T16:32:00.596 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2023-08-27T16:32:00.671 INFO:teuthology.orchestra.console.smithi102:Power off completed 2023-08-27T16:32:00.697 INFO:teuthology.orchestra.console.smithi103:Power off completed 2023-08-27T16:32:00.826 INFO:teuthology.lock.ops:unlocked: smithi102.front.sepia.ceph.com 2023-08-27T16:32:00.850 INFO:teuthology.lock.ops:unlocked: smithi103.front.sepia.ceph.com 2023-08-27T16:32:04.573 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T16:32:04.682 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off 2023-08-27T16:32:04.790 INFO:teuthology.orchestra.console.smithi093:Power off completed 2023-08-27T16:32:04.941 INFO:teuthology.lock.ops:unlocked: smithi093.front.sepia.ceph.com 2023-08-27T16:32:05.335 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/dispatcher/supervisor.py", line 58, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/provision/fog.py", line 348, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi093's OS to be centos 8 but found rhel 8.6