2024-03-26T03:36:13.266 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-26T03:36:13.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T03:36:13.443 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe832b20c10>, signals=[15]) 2024-03-26T03:36:13.443 INFO:teuthology.lock.ops:Start node 'smithi119.front.sepia.ceph.com' reimaging 2024-03-26T03:36:13.443 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: reset os type and version on server 2024-03-26T03:36:13.443 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2024-03-26T03:36:13.463 INFO:teuthology.lock.ops:Start node 'smithi189.front.sepia.ceph.com' reimaging 2024-03-26T03:36:13.463 INFO:teuthology.lock.ops:Updating [smithi189.front.sepia.ceph.com]: reset os type and version on server 2024-03-26T03:36:13.463 INFO:teuthology.lock.ops:Updating smithi189.front.sepia.ceph.com on lock server 2024-03-26T03:36:13.479 INFO:teuthology.lock.ops:Start node 'smithi203.front.sepia.ceph.com' reimaging 2024-03-26T03:36:13.480 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: reset os type and version on server 2024-03-26T03:36:13.480 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server 2024-03-26T03:36:13.585 DEBUG:teuthology.provision.fog.smithi119:Requesting image smithi_centos_9.stream (ID 10) 2024-03-26T03:36:13.590 DEBUG:teuthology.provision.fog.smithi189:Requesting image smithi_centos_9.stream (ID 10) 2024-03-26T03:36:13.608 DEBUG:teuthology.provision.fog.smithi203:Requesting image smithi_centos_9.stream (ID 10) 2024-03-26T03:36:13.629 INFO:teuthology.provision.fog.smithi189:Scheduling deploy of centos 9.stream 2024-03-26T03:36:13.637 INFO:teuthology.provision.fog.smithi119:Scheduling deploy of centos 9.stream 2024-03-26T03:36:13.642 INFO:teuthology.provision.fog.smithi203:Scheduling deploy of centos 9.stream 2024-03-26T03:36:13.857 INFO:teuthology.orchestra.console.smithi189:Power off 2024-03-26T03:36:13.858 DEBUG:teuthology.orchestra.console.smithi189:pexpect command: ipmitool -H smithi189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-26T03:36:13.871 INFO:teuthology.orchestra.console.smithi203:Power off 2024-03-26T03:36:13.872 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-26T03:36:13.880 DEBUG:teuthology.orchestra.console.smithi189:power off output: Chassis Power Control: Down/Off 2024-03-26T03:36:13.880 DEBUG:teuthology.orchestra.console.smithi189:pexpect command: ipmitool -H smithi189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T03:36:13.893 INFO:teuthology.orchestra.console.smithi119:Power off 2024-03-26T03:36:13.893 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-26T03:36:13.900 DEBUG:teuthology.orchestra.console.smithi189:check power output: Chassis Power is off 2024-03-26T03:36:13.901 DEBUG:teuthology.orchestra.console.smithi203:power off output: Chassis Power Control: Down/Off 2024-03-26T03:36:13.901 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T03:36:13.914 DEBUG:teuthology.orchestra.console.smithi119:power off output: Chassis Power Control: Down/Off 2024-03-26T03:36:13.915 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T03:36:13.922 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off 2024-03-26T03:36:13.934 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off 2024-03-26T03:36:14.002 INFO:teuthology.orchestra.console.smithi189:Power off completed 2024-03-26T03:36:14.023 INFO:teuthology.orchestra.console.smithi203:Power off completed 2024-03-26T03:36:14.035 INFO:teuthology.orchestra.console.smithi119:Power off completed 2024-03-26T03:36:14.103 INFO:teuthology.orchestra.console.smithi189:Power on 2024-03-26T03:36:14.103 DEBUG:teuthology.orchestra.console.smithi189:pexpect command: ipmitool -H smithi189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-26T03:36:14.124 INFO:teuthology.orchestra.console.smithi203:Power on 2024-03-26T03:36:14.124 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-26T03:36:14.131 DEBUG:teuthology.orchestra.console.smithi189:power on output: Chassis Power Control: Up/On 2024-03-26T03:36:14.131 DEBUG:teuthology.orchestra.console.smithi189:pexpect command: ipmitool -H smithi189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T03:36:14.140 INFO:teuthology.orchestra.console.smithi119:Power on 2024-03-26T03:36:14.140 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-26T03:36:14.149 DEBUG:teuthology.orchestra.console.smithi203:power on output: Chassis Power Control: Up/On 2024-03-26T03:36:14.150 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T03:36:14.158 DEBUG:teuthology.orchestra.console.smithi189:check power output: Chassis Power is off 2024-03-26T03:36:14.161 DEBUG:teuthology.orchestra.console.smithi119:power on output: Chassis Power Control: Up/On 2024-03-26T03:36:14.161 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T03:36:14.174 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off 2024-03-26T03:36:14.181 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off 2024-03-26T03:36:18.162 DEBUG:teuthology.orchestra.console.smithi189:pexpect command: ipmitool -H smithi189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T03:36:18.175 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T03:36:18.182 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T03:36:18.270 DEBUG:teuthology.orchestra.console.smithi189:check power output: Chassis Power is off 2024-03-26T03:36:18.284 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off 2024-03-26T03:36:18.289 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off 2024-03-26T03:36:22.276 DEBUG:teuthology.orchestra.console.smithi189:pexpect command: ipmitool -H smithi189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T03:36:22.285 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T03:36:22.291 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T03:36:22.393 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on 2024-03-26T03:36:22.482 DEBUG:teuthology.orchestra.console.smithi189:check power output: Chassis Power is on 2024-03-26T03:36:22.494 INFO:teuthology.orchestra.console.smithi203:Power on completed 2024-03-26T03:36:22.519 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on 2024-03-26T03:36:22.583 INFO:teuthology.orchestra.console.smithi189:Power on completed 2024-03-26T03:36:22.596 INFO:teuthology.provision.fog.smithi203:Waiting for deploy to finish 2024-03-26T03:36:22.620 INFO:teuthology.orchestra.console.smithi119:Power on completed 2024-03-26T03:36:22.684 INFO:teuthology.provision.fog.smithi189:Waiting for deploy to finish 2024-03-26T03:36:22.720 INFO:teuthology.provision.fog.smithi119:Waiting for deploy to finish 2024-03-26T03:38:54.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:38:57.214 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-03-26T03:39:03.221 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:39:06.302 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-03-26T03:39:12.306 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:39:15.358 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-03-26T03:39:21.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:39:24.446 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-03-26T03:39:30.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:39:33.534 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-03-26T03:39:39.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:39:39.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:39:42.558 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2024-03-26T03:39:42.594 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-03-26T03:39:48.565 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:39:48.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:39:51.646 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2024-03-26T03:39:51.647 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-03-26T03:39:57.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:39:57.653 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:40:00.707 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2024-03-26T03:40:06.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:40:09.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:40:09.794 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2024-03-26T03:40:12.702 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:40:15.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:40:16.030 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-03-26T03:40:18.707 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:40:18.878 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2024-03-26T03:40:21.758 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:40:22.031 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:40:24.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:40:25.086 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-03-26T03:40:27.762 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:40:27.934 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2024-03-26T03:40:30.814 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:40:31.087 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:40:33.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:40:34.142 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-03-26T03:40:36.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:40:36.990 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2024-03-26T03:40:39.870 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:40:40.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:40:42.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:40:43.198 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-03-26T03:40:45.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:40:46.046 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2024-03-26T03:40:48.926 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:40:49.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:40:52.049 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:40:52.254 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-03-26T03:40:54.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:40:55.102 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2024-03-26T03:40:57.982 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:40:58.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:41:01.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:41:01.310 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-03-26T03:41:03.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:41:04.158 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2024-03-26T03:41:07.038 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:41:07.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:41:10.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:41:10.366 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-03-26T03:41:13.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:41:13.214 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2024-03-26T03:41:16.094 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:41:16.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:41:19.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:41:19.422 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-03-26T03:41:22.099 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:41:22.270 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2024-03-26T03:41:25.182 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:41:25.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:41:28.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:41:31.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:41:31.326 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2024-03-26T03:41:34.242 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:41:37.330 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:41:40.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:41:43.326 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:41:43.838 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-03-26T03:41:47.678 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2024-03-26T03:41:49.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:41:49.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:41:52.382 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:41:52.894 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-03-26T03:41:53.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:41:56.734 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2024-03-26T03:41:58.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:41:58.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:41:59.018 ERROR:teuthology.orchestra.connection:Error authenticating with smithi119.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-03-26T03:42:01.438 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:42:02.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:42:02.860 ERROR:teuthology.orchestra.connection:Error authenticating with smithi203.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-03-26T03:42:03.103 ERROR:teuthology.orchestra.connection:Error authenticating with smithi119.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-03-26T03:42:06.989 ERROR:teuthology.orchestra.connection:Error authenticating with smithi203.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-03-26T03:42:07.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:42:10.185 ERROR:teuthology.orchestra.connection:Error authenticating with smithi119.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-03-26T03:42:10.494 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:42:14.078 ERROR:teuthology.orchestra.connection:Error authenticating with smithi203.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-03-26T03:42:16.495 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:42:19.550 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:42:20.309 ERROR:teuthology.orchestra.connection:Error authenticating with smithi119.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-03-26T03:42:24.167 ERROR:teuthology.orchestra.connection:Error authenticating with smithi203.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-03-26T03:42:25.551 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:42:28.609 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:42:33.394 ERROR:teuthology.orchestra.connection:Error authenticating with smithi119.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-03-26T03:42:34.611 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:42:37.293 ERROR:teuthology.orchestra.connection:Error authenticating with smithi203.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-03-26T03:42:37.662 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:42:43.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:42:46.718 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:42:49.518 ERROR:teuthology.orchestra.connection:Error authenticating with smithi119.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-03-26T03:42:52.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:42:53.425 ERROR:teuthology.orchestra.connection:Error authenticating with smithi203.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-03-26T03:42:55.774 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:43:01.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:43:04.830 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:43:10.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:43:13.886 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:43:19.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:43:22.942 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:43:28.943 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:43:32.002 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:43:38.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:43:41.054 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:43:43.134 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-03-26T03:43:46.974 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2024-03-26T03:43:47.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:43:49.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:43:50.114 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:43:52.190 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-03-26T03:43:52.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:43:56.030 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2024-03-26T03:43:56.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:43:58.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:43:59.198 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:44:02.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:44:05.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:44:08.254 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:44:14.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:44:17.310 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:44:23.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:44:26.366 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:44:32.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:44:35.422 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:44:41.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:44:44.482 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:44:50.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:44:53.534 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:44:58.193 WARNING:teuthology.provision.fog.smithi119:timed out 2024-03-26T03:44:59.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:45:02.034 WARNING:teuthology.provision.fog.smithi203:timed out 2024-03-26T03:45:02.590 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:45:04.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:45:04.500 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-26T03:45:04.501 DEBUG:teuthology.orchestra.run.smithi119:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-26T03:45:04.816 INFO:teuthology.provision.fog.smithi119:Node is ready 2024-03-26T03:45:04.816 DEBUG:teuthology.orchestra.run.smithi119:> hostname 2024-03-26T03:45:04.830 INFO:teuthology.orchestra.run.smithi119.stdout:smithi119.front.sepia.ceph.com 2024-03-26T03:45:04.831 DEBUG:teuthology.orchestra.run.smithi119:> grep smithi119.front.sepia.ceph.com /etc/hosts 2024-03-26T03:45:04.885 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119 smithi119.front.sepia.ceph.com smithi119 2024-03-26T03:45:04.885 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119 2024-03-26T03:45:05.001 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi119.front.sepia.ceph.com/smithi119/g' /etc/hosts 2024-03-26T03:45:05.027 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/172.21.15.119/172.21.15.119/g' /etc/hosts 2024-03-26T03:45:05.094 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi119.front.sepia.ceph.com/smithi119/g' /etc/hostname 2024-03-26T03:45:05.160 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119 2024-03-26T03:45:05.227 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release 2024-03-26T03:45:05.283 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="CentOS Stream" 2024-03-26T03:45:05.283 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="9" 2024-03-26T03:45:05.283 INFO:teuthology.orchestra.run.smithi119.stdout:ID="centos" 2024-03-26T03:45:05.283 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="rhel fedora" 2024-03-26T03:45:05.283 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="9" 2024-03-26T03:45:05.283 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el9" 2024-03-26T03:45:05.283 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-26T03:45:05.283 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31" 2024-03-26T03:45:05.283 INFO:teuthology.orchestra.run.smithi119.stdout:LOGO="fedora-logo-icon" 2024-03-26T03:45:05.283 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-26T03:45:05.283 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://centos.org/" 2024-03-26T03:45:05.283 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-26T03:45:05.284 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-26T03:45:05.284 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-26T03:45:05.284 INFO:teuthology.provision.fog.smithi119:Deploy complete! 2024-03-26T03:45:05.286 DEBUG:teuthology.parallel:result is None 2024-03-26T03:45:08.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:45:08.299 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-26T03:45:08.299 DEBUG:teuthology.orchestra.run.smithi203:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-26T03:45:08.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:45:08.687 INFO:teuthology.provision.fog.smithi203:Node is ready 2024-03-26T03:45:08.687 DEBUG:teuthology.orchestra.run.smithi203:> hostname 2024-03-26T03:45:08.702 INFO:teuthology.orchestra.run.smithi203.stdout:smithi203.front.sepia.ceph.com 2024-03-26T03:45:08.702 DEBUG:teuthology.orchestra.run.smithi203:> grep smithi203.front.sepia.ceph.com /etc/hosts 2024-03-26T03:45:08.758 INFO:teuthology.orchestra.run.smithi203.stdout:172.21.15.203 smithi203.front.sepia.ceph.com smithi203 2024-03-26T03:45:08.758 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203 2024-03-26T03:45:08.862 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi203.front.sepia.ceph.com/smithi203/g' /etc/hosts 2024-03-26T03:45:08.892 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/172.21.15.203/172.21.15.203/g' /etc/hosts 2024-03-26T03:45:08.962 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi203.front.sepia.ceph.com/smithi203/g' /etc/hostname 2024-03-26T03:45:09.030 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203 2024-03-26T03:45:09.097 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release 2024-03-26T03:45:09.153 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="CentOS Stream" 2024-03-26T03:45:09.153 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="9" 2024-03-26T03:45:09.153 INFO:teuthology.orchestra.run.smithi203.stdout:ID="centos" 2024-03-26T03:45:09.153 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="rhel fedora" 2024-03-26T03:45:09.153 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="9" 2024-03-26T03:45:09.153 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el9" 2024-03-26T03:45:09.153 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-26T03:45:09.154 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31" 2024-03-26T03:45:09.154 INFO:teuthology.orchestra.run.smithi203.stdout:LOGO="fedora-logo-icon" 2024-03-26T03:45:09.154 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-26T03:45:09.154 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://centos.org/" 2024-03-26T03:45:09.154 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-26T03:45:09.154 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-26T03:45:09.154 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-26T03:45:09.154 INFO:teuthology.provision.fog.smithi203:Deploy complete! 2024-03-26T03:45:09.155 DEBUG:teuthology.parallel:result is None 2024-03-26T03:45:11.650 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:45:17.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:45:20.703 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:45:26.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:45:29.758 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:45:35.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:45:38.818 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:45:44.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:45:47.870 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:45:53.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:45:56.930 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:46:02.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:46:06.014 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:46:12.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:46:15.074 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:46:21.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:46:24.126 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:46:30.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:46:33.182 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:46:39.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:46:42.239 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:46:48.241 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:46:51.298 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:46:57.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:47:00.382 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:47:06.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:47:09.438 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:47:15.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:47:33.790 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:47:39.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:47:41.842 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:47:47.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:47:47.975 ERROR:teuthology.orchestra.connection:Error authenticating with smithi189.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-03-26T03:47:52.103 ERROR:teuthology.orchestra.connection:Error authenticating with smithi189.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-03-26T03:47:59.192 ERROR:teuthology.orchestra.connection:Error authenticating with smithi189.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-03-26T03:48:09.281 ERROR:teuthology.orchestra.connection:Error authenticating with smithi189.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-03-26T03:48:22.414 ERROR:teuthology.orchestra.connection:Error authenticating with smithi189.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-03-26T03:48:38.505 ERROR:teuthology.orchestra.connection:Error authenticating with smithi189.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-03-26T03:48:57.640 ERROR:teuthology.orchestra.connection:Error authenticating with smithi189.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-03-26T03:49:54.342 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:50:00.345 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:50:03.426 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:50:09.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:50:12.514 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:50:18.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:50:21.566 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:50:27.569 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:50:46.047 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:50:52.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:50:55.102 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:51:01.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:51:02.069 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:51:08.071 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:51:08.073 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:51:14.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:51:14.077 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:51:20.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:51:20.080 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:51:26.081 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:51:26.084 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T03:51:32.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T03:51:32.348 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-26T03:51:32.349 DEBUG:teuthology.orchestra.run.smithi189:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-26T03:51:32.834 INFO:teuthology.provision.fog.smithi189:Node is ready 2024-03-26T03:51:32.834 DEBUG:teuthology.orchestra.run.smithi189:> hostname 2024-03-26T03:51:32.887 INFO:teuthology.orchestra.run.smithi189.stdout:smithi189.front.sepia.ceph.com 2024-03-26T03:51:32.887 DEBUG:teuthology.orchestra.run.smithi189:> grep smithi189.front.sepia.ceph.com /etc/hosts 2024-03-26T03:51:32.935 INFO:teuthology.orchestra.run.smithi189.stdout:172.21.15.189 smithi189.front.sepia.ceph.com smithi189 2024-03-26T03:51:32.935 DEBUG:teuthology.orchestra.run.smithi189:> sudo hostname smithi189 2024-03-26T03:51:33.087 DEBUG:teuthology.orchestra.run.smithi189:> sudo sed -i -e 's/smithi189.front.sepia.ceph.com/smithi189/g' /etc/hosts 2024-03-26T03:51:33.100 DEBUG:teuthology.orchestra.run.smithi189:> sudo sed -i -e 's/172.21.15.189/172.21.15.189/g' /etc/hosts 2024-03-26T03:51:33.154 DEBUG:teuthology.orchestra.run.smithi189:> sudo sed -i -e 's/smithi189.front.sepia.ceph.com/smithi189/g' /etc/hostname 2024-03-26T03:51:33.214 DEBUG:teuthology.orchestra.run.smithi189:> sudo hostname smithi189 2024-03-26T03:51:33.273 DEBUG:teuthology.orchestra.run.smithi189:> cat /etc/os-release 2024-03-26T03:51:33.322 INFO:teuthology.orchestra.run.smithi189.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-03-26T03:51:33.322 INFO:teuthology.orchestra.run.smithi189.stdout:NAME="Ubuntu" 2024-03-26T03:51:33.322 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION_ID="22.04" 2024-03-26T03:51:33.322 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-03-26T03:51:33.322 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION_CODENAME=jammy 2024-03-26T03:51:33.322 INFO:teuthology.orchestra.run.smithi189.stdout:ID=ubuntu 2024-03-26T03:51:33.322 INFO:teuthology.orchestra.run.smithi189.stdout:ID_LIKE=debian 2024-03-26T03:51:33.322 INFO:teuthology.orchestra.run.smithi189.stdout:HOME_URL="https://www.ubuntu.com/" 2024-03-26T03:51:33.323 INFO:teuthology.orchestra.run.smithi189.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-03-26T03:51:33.323 INFO:teuthology.orchestra.run.smithi189.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-03-26T03:51:33.323 INFO:teuthology.orchestra.run.smithi189.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-03-26T03:51:33.323 INFO:teuthology.orchestra.run.smithi189.stdout:UBUNTU_CODENAME=jammy 2024-03-26T03:51:33.325 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/dispatcher/supervisor.py", line 232, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/provision/fog.py", line 347, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi189's OS to be centos 9 but found ubuntu 22.04 2024-03-26T03:51:33.326 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T03:51:33.612 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=bb92c1e61bc543bf98a0a88389e72797 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/dispatcher/supervisor.py", line 232, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/provision/fog.py", line 347, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi189's OS to be centos 9 but found ubuntu 22.04 2024-03-26T03:51:33.614 INFO:teuthology.nuke:Checking targets against current locks 2024-03-26T03:51:33.644 INFO:teuthology.nuke:Not nuking smithi119.front.sepia.ceph.com because description doesn't match: xiubli-2024-03-26_03:27:40-fs:fscrypt:-wip-lxb-fscrypt-20240321-1047-distro-default-smithi != /home/teuthworker/archive/teuthology-2024-03-25_21:08:11-orch-squid-distro-default-smithi/7621974 2024-03-26T03:51:33.661 INFO:teuthology.nuke:Not nuking smithi189.front.sepia.ceph.com because description doesn't match: xiubli-2024-03-26_03:27:40-fs:fscrypt:-wip-lxb-fscrypt-20240321-1047-distro-default-smithi != /home/teuthworker/archive/xiubli-2024-03-26_03:37:59-fs:fscrypt:-wip-lxb-fscrypt-20240321-1047-distro-default-smithi/7622501 2024-03-26T03:51:33.680 INFO:teuthology.nuke:Not nuking smithi203.front.sepia.ceph.com because description doesn't match: xiubli-2024-03-26_03:27:40-fs:fscrypt:-wip-lxb-fscrypt-20240321-1047-distro-default-smithi != /home/teuthworker/archive/teuthology-2024-03-25_21:08:11-orch-squid-distro-default-smithi/7621974 2024-03-26T03:51:33.681 ERROR:teuthology.nuke:Could not nuke the following targets: targets: smithi119.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNGunsF/Dj7N57Lhsi4A4hn8pHqzHS04bSuvm+GbQYHXE7/K6GwxO7o3zTrolOFm5DTCP28TGilQ8QfqbSNnEdY= smithi189.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOAuw48xZeKJS3pNQbveFhhmdQamTUNVf4V8h/YPoWc//k/1hjrXpSMrEhHbFzMLb/rFIRRQeuiyOB53doVWv44= smithi203.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPgnFsj1KOJIoHzP7L92aP16VMDd4BAtZbLcFYfaV7eM8hQFVfeEDq81hQpz3lPCoCujfslni/gGGyl+UkZblnI= 2024-03-26T03:51:34.012 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/dispatcher/supervisor.py", line 58, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/dispatcher/supervisor.py", line 232, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/provision/fog.py", line 347, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi189's OS to be centos 9 but found ubuntu 22.04