2024-04-09T23:40:17.013 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-09T23:40:17.013 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T23:40:17.216 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fea425c0c10>, signals=[15]) 2024-04-09T23:40:17.217 INFO:teuthology.lock.ops:Start node 'smithi031.front.sepia.ceph.com' reimaging 2024-04-09T23:40:17.217 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: reset os type and version on server 2024-04-09T23:40:17.217 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2024-04-09T23:40:17.235 INFO:teuthology.lock.ops:Start node 'smithi043.front.sepia.ceph.com' reimaging 2024-04-09T23:40:17.235 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: reset os type and version on server 2024-04-09T23:40:17.235 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server 2024-04-09T23:40:17.260 INFO:teuthology.lock.ops:Start node 'smithi072.front.sepia.ceph.com' reimaging 2024-04-09T23:40:17.260 INFO:teuthology.lock.ops:Updating [smithi072.front.sepia.ceph.com]: reset os type and version on server 2024-04-09T23:40:17.260 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2024-04-09T23:40:17.285 INFO:teuthology.lock.ops:Start node 'smithi176.front.sepia.ceph.com' reimaging 2024-04-09T23:40:17.285 INFO:teuthology.lock.ops:Updating [smithi176.front.sepia.ceph.com]: reset os type and version on server 2024-04-09T23:40:17.285 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server 2024-04-09T23:40:17.373 DEBUG:teuthology.provision.fog.smithi031:Requesting image smithi_centos_9.stream (ID 10) 2024-04-09T23:40:17.388 DEBUG:teuthology.provision.fog.smithi043:Requesting image smithi_centos_9.stream (ID 10) 2024-04-09T23:40:17.400 DEBUG:teuthology.provision.fog.smithi072:Requesting image smithi_centos_9.stream (ID 10) 2024-04-09T23:40:17.420 INFO:teuthology.provision.fog.smithi031:Scheduling deploy of centos 9.stream 2024-04-09T23:40:17.433 DEBUG:teuthology.provision.fog.smithi176:Requesting image smithi_centos_9.stream (ID 10) 2024-04-09T23:40:17.440 INFO:teuthology.provision.fog.smithi043:Scheduling deploy of centos 9.stream 2024-04-09T23:40:17.442 INFO:teuthology.provision.fog.smithi072:Scheduling deploy of centos 9.stream 2024-04-09T23:40:17.486 INFO:teuthology.provision.fog.smithi176:Scheduling deploy of centos 9.stream 2024-04-09T23:40:17.661 INFO:teuthology.orchestra.console.smithi031:Power off 2024-04-09T23:40:17.661 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-09T23:40:17.676 INFO:teuthology.orchestra.console.smithi043:Power off 2024-04-09T23:40:17.676 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-09T23:40:17.688 INFO:teuthology.orchestra.console.smithi072:Power off 2024-04-09T23:40:17.688 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-09T23:40:17.701 DEBUG:teuthology.orchestra.console.smithi031:power off output: Chassis Power Control: Down/Off 2024-04-09T23:40:17.701 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T23:40:17.708 DEBUG:teuthology.orchestra.console.smithi043:power off output: Chassis Power Control: Down/Off 2024-04-09T23:40:17.708 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T23:40:17.716 DEBUG:teuthology.orchestra.console.smithi072:power off output: Chassis Power Control: Down/Off 2024-04-09T23:40:17.716 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T23:40:17.723 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2024-04-09T23:40:17.730 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is on 2024-04-09T23:40:17.741 INFO:teuthology.orchestra.console.smithi176:Power off 2024-04-09T23:40:17.741 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-09T23:40:17.748 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2024-04-09T23:40:17.761 DEBUG:teuthology.orchestra.console.smithi176:power off output: Chassis Power Control: Down/Off 2024-04-09T23:40:17.762 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T23:40:17.783 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is on 2024-04-09T23:40:21.728 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T23:40:21.734 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T23:40:21.749 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T23:40:21.785 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T23:40:21.836 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2024-04-09T23:40:21.842 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is on 2024-04-09T23:40:21.858 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2024-04-09T23:40:21.893 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is on 2024-04-09T23:40:25.838 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T23:40:25.847 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T23:40:25.858 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T23:40:25.894 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T23:40:25.950 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2024-04-09T23:40:25.956 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off 2024-04-09T23:40:25.966 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2024-04-09T23:40:26.003 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is on 2024-04-09T23:40:26.050 INFO:teuthology.orchestra.console.smithi031:Power off completed 2024-04-09T23:40:26.057 INFO:teuthology.orchestra.console.smithi043:Power off completed 2024-04-09T23:40:26.151 INFO:teuthology.orchestra.console.smithi031:Power on 2024-04-09T23:40:26.152 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-09T23:40:26.159 INFO:teuthology.orchestra.console.smithi043:Power on 2024-04-09T23:40:26.161 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-09T23:40:26.173 DEBUG:teuthology.orchestra.console.smithi031:power on output: Chassis Power Control: Up/On 2024-04-09T23:40:26.173 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T23:40:26.191 DEBUG:teuthology.orchestra.console.smithi043:power on output: Chassis Power Control: Up/On 2024-04-09T23:40:26.191 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T23:40:26.200 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2024-04-09T23:40:26.212 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off 2024-04-09T23:40:29.970 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T23:40:30.004 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T23:40:30.079 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2024-04-09T23:40:30.113 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is off 2024-04-09T23:40:30.181 INFO:teuthology.orchestra.console.smithi072:Power off completed 2024-04-09T23:40:30.201 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T23:40:30.213 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T23:40:30.220 INFO:teuthology.orchestra.console.smithi176:Power off completed 2024-04-09T23:40:30.282 INFO:teuthology.orchestra.console.smithi072:Power on 2024-04-09T23:40:30.283 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-09T23:40:30.304 DEBUG:teuthology.orchestra.console.smithi072:power on output: Chassis Power Control: Up/On 2024-04-09T23:40:30.304 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T23:40:30.313 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2024-04-09T23:40:30.320 INFO:teuthology.orchestra.console.smithi176:Power on 2024-04-09T23:40:30.321 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-09T23:40:30.328 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off 2024-04-09T23:40:30.328 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2024-04-09T23:40:30.341 DEBUG:teuthology.orchestra.console.smithi176:power on output: Chassis Power Control: Up/On 2024-04-09T23:40:30.342 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T23:40:30.361 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is off 2024-04-09T23:40:34.318 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T23:40:34.329 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T23:40:34.336 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T23:40:34.363 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T23:40:34.428 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2024-04-09T23:40:34.438 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is on 2024-04-09T23:40:34.444 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2024-04-09T23:40:34.471 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is on 2024-04-09T23:40:34.530 INFO:teuthology.orchestra.console.smithi031:Power on completed 2024-04-09T23:40:34.539 INFO:teuthology.orchestra.console.smithi043:Power on completed 2024-04-09T23:40:34.572 INFO:teuthology.orchestra.console.smithi176:Power on completed 2024-04-09T23:40:34.631 INFO:teuthology.provision.fog.smithi031:Waiting for deploy to finish 2024-04-09T23:40:34.640 INFO:teuthology.provision.fog.smithi043:Waiting for deploy to finish 2024-04-09T23:40:34.673 INFO:teuthology.provision.fog.smithi176:Waiting for deploy to finish 2024-04-09T23:40:38.446 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T23:40:38.555 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2024-04-09T23:40:38.656 INFO:teuthology.orchestra.console.smithi072:Power on completed 2024-04-09T23:40:38.757 INFO:teuthology.provision.fog.smithi072:Waiting for deploy to finish 2024-04-09T23:42:50.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:42:53.474 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31 2024-04-09T23:42:59.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:43:02.565 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31 2024-04-09T23:43:05.501 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:43:05.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:43:08.570 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:43:08.574 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2024-04-09T23:43:08.574 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-04-09T23:43:11.646 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31 2024-04-09T23:43:14.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:43:14.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:43:17.634 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2024-04-09T23:43:17.635 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-04-09T23:43:17.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:43:20.706 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31 2024-04-09T23:43:23.637 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:43:23.639 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:43:26.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:43:26.718 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-04-09T23:43:26.718 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2024-04-09T23:43:29.794 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31 2024-04-09T23:43:32.722 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:43:32.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:43:35.778 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-04-09T23:43:35.779 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2024-04-09T23:43:35.795 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:43:39.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:43:41.781 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:43:41.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:43:42.786 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:43:44.862 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-04-09T23:43:44.863 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2024-04-09T23:43:48.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:43:50.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:43:50.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:43:51.870 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:43:53.918 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-04-09T23:43:53.919 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2024-04-09T23:43:57.875 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:43:59.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:43:59.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:44:00.929 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:44:02.978 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-04-09T23:44:06.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:44:08.981 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:44:10.014 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:44:16.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:44:19.106 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:44:25.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:44:28.190 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:44:34.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:44:35.799 WARNING:teuthology.provision.fog.smithi031:timed out 2024-04-09T23:44:37.278 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:44:41.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:44:42.097 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-09T23:44:42.097 DEBUG:teuthology.orchestra.run.smithi031:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-09T23:44:42.427 INFO:teuthology.provision.fog.smithi031:Node is ready 2024-04-09T23:44:42.427 DEBUG:teuthology.orchestra.run.smithi031:> hostname 2024-04-09T23:44:42.442 INFO:teuthology.orchestra.run.smithi031.stdout:smithi031.front.sepia.ceph.com 2024-04-09T23:44:42.442 DEBUG:teuthology.orchestra.run.smithi031:> grep smithi031.front.sepia.ceph.com /etc/hosts 2024-04-09T23:44:42.498 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31 smithi031.front.sepia.ceph.com smithi031 2024-04-09T23:44:42.498 DEBUG:teuthology.orchestra.run.smithi031:> sudo hostname smithi031 2024-04-09T23:44:42.602 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi031.front.sepia.ceph.com/smithi031/g' /etc/hosts 2024-04-09T23:44:42.634 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/172.21.15.31/172.21.15.31/g' /etc/hosts 2024-04-09T23:44:42.705 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi031.front.sepia.ceph.com/smithi031/g' /etc/hostname 2024-04-09T23:44:42.776 DEBUG:teuthology.orchestra.run.smithi031:> sudo hostname smithi031 2024-04-09T23:44:42.846 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release 2024-04-09T23:44:42.901 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="CentOS Stream" 2024-04-09T23:44:42.901 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="9" 2024-04-09T23:44:42.902 INFO:teuthology.orchestra.run.smithi031.stdout:ID="centos" 2024-04-09T23:44:42.902 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="rhel fedora" 2024-04-09T23:44:42.902 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="9" 2024-04-09T23:44:42.902 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el9" 2024-04-09T23:44:42.902 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-09T23:44:42.902 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31" 2024-04-09T23:44:42.902 INFO:teuthology.orchestra.run.smithi031.stdout:LOGO="fedora-logo-icon" 2024-04-09T23:44:42.902 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-09T23:44:42.902 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://centos.org/" 2024-04-09T23:44:42.902 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-09T23:44:42.902 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-09T23:44:42.902 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-09T23:44:42.903 INFO:teuthology.provision.fog.smithi031:Deploy complete! 2024-04-09T23:44:42.904 DEBUG:teuthology.parallel:result is None 2024-04-09T23:44:43.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:44:59.930 WARNING:teuthology.provision.fog.smithi043:timed out 2024-04-09T23:45:05.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:45:06.184 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-09T23:45:06.184 DEBUG:teuthology.orchestra.run.smithi043:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-09T23:45:06.521 INFO:teuthology.provision.fog.smithi043:Node is ready 2024-04-09T23:45:06.521 DEBUG:teuthology.orchestra.run.smithi043:> hostname 2024-04-09T23:45:06.536 INFO:teuthology.orchestra.run.smithi043.stdout:smithi043.front.sepia.ceph.com 2024-04-09T23:45:06.536 DEBUG:teuthology.orchestra.run.smithi043:> grep smithi043.front.sepia.ceph.com /etc/hosts 2024-04-09T23:45:06.592 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43 smithi043.front.sepia.ceph.com smithi043 2024-04-09T23:45:06.593 DEBUG:teuthology.orchestra.run.smithi043:> sudo hostname smithi043 2024-04-09T23:45:06.705 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/smithi043.front.sepia.ceph.com/smithi043/g' /etc/hosts 2024-04-09T23:45:06.737 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/172.21.15.43/172.21.15.43/g' /etc/hosts 2024-04-09T23:45:06.808 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/smithi043.front.sepia.ceph.com/smithi043/g' /etc/hostname 2024-04-09T23:45:06.879 DEBUG:teuthology.orchestra.run.smithi043:> sudo hostname smithi043 2024-04-09T23:45:06.949 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release 2024-04-09T23:45:07.004 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="CentOS Stream" 2024-04-09T23:45:07.004 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="9" 2024-04-09T23:45:07.004 INFO:teuthology.orchestra.run.smithi043.stdout:ID="centos" 2024-04-09T23:45:07.004 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="rhel fedora" 2024-04-09T23:45:07.004 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="9" 2024-04-09T23:45:07.005 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el9" 2024-04-09T23:45:07.005 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-09T23:45:07.005 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31" 2024-04-09T23:45:07.005 INFO:teuthology.orchestra.run.smithi043.stdout:LOGO="fedora-logo-icon" 2024-04-09T23:45:07.005 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-09T23:45:07.005 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://centos.org/" 2024-04-09T23:45:07.005 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-09T23:45:07.005 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-09T23:45:07.005 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-09T23:45:07.005 INFO:teuthology.provision.fog.smithi043:Deploy complete! 2024-04-09T23:45:07.006 DEBUG:teuthology.parallel:result is None 2024-04-09T23:45:08.983 WARNING:teuthology.provision.fog.smithi176:timed out 2024-04-09T23:45:14.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:45:15.223 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-09T23:45:15.223 DEBUG:teuthology.orchestra.run.smithi176:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-09T23:45:15.565 INFO:teuthology.provision.fog.smithi176:Node is ready 2024-04-09T23:45:15.565 DEBUG:teuthology.orchestra.run.smithi176:> hostname 2024-04-09T23:45:15.580 INFO:teuthology.orchestra.run.smithi176.stdout:smithi176.front.sepia.ceph.com 2024-04-09T23:45:15.580 DEBUG:teuthology.orchestra.run.smithi176:> grep smithi176.front.sepia.ceph.com /etc/hosts 2024-04-09T23:45:15.639 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.15.176 smithi176.front.sepia.ceph.com smithi176 2024-04-09T23:45:15.639 DEBUG:teuthology.orchestra.run.smithi176:> sudo hostname smithi176 2024-04-09T23:45:15.744 DEBUG:teuthology.orchestra.run.smithi176:> sudo sed -i -e 's/smithi176.front.sepia.ceph.com/smithi176/g' /etc/hosts 2024-04-09T23:45:15.772 DEBUG:teuthology.orchestra.run.smithi176:> sudo sed -i -e 's/172.21.15.176/172.21.15.176/g' /etc/hosts 2024-04-09T23:45:15.843 DEBUG:teuthology.orchestra.run.smithi176:> sudo sed -i -e 's/smithi176.front.sepia.ceph.com/smithi176/g' /etc/hostname 2024-04-09T23:45:15.913 DEBUG:teuthology.orchestra.run.smithi176:> sudo hostname smithi176 2024-04-09T23:45:15.982 DEBUG:teuthology.orchestra.run.smithi176:> cat /etc/os-release 2024-04-09T23:45:16.040 INFO:teuthology.orchestra.run.smithi176.stdout:NAME="CentOS Stream" 2024-04-09T23:45:16.041 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION="9" 2024-04-09T23:45:16.041 INFO:teuthology.orchestra.run.smithi176.stdout:ID="centos" 2024-04-09T23:45:16.041 INFO:teuthology.orchestra.run.smithi176.stdout:ID_LIKE="rhel fedora" 2024-04-09T23:45:16.041 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_ID="9" 2024-04-09T23:45:16.041 INFO:teuthology.orchestra.run.smithi176.stdout:PLATFORM_ID="platform:el9" 2024-04-09T23:45:16.041 INFO:teuthology.orchestra.run.smithi176.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-09T23:45:16.041 INFO:teuthology.orchestra.run.smithi176.stdout:ANSI_COLOR="0;31" 2024-04-09T23:45:16.041 INFO:teuthology.orchestra.run.smithi176.stdout:LOGO="fedora-logo-icon" 2024-04-09T23:45:16.041 INFO:teuthology.orchestra.run.smithi176.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-09T23:45:16.041 INFO:teuthology.orchestra.run.smithi176.stdout:HOME_URL="https://centos.org/" 2024-04-09T23:45:16.041 INFO:teuthology.orchestra.run.smithi176.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-09T23:45:16.041 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-09T23:45:16.041 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-09T23:45:16.042 INFO:teuthology.provision.fog.smithi176:Deploy complete! 2024-04-09T23:45:16.043 DEBUG:teuthology.parallel:result is None 2024-04-09T23:45:43.307 WARNING:teuthology.provision.fog.smithi072:timed out 2024-04-09T23:45:49.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:45:52.386 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:45:58.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:46:01.470 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:46:07.475 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:46:10.530 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:46:16.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:46:19.614 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:46:25.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:46:28.670 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:46:34.675 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:46:37.730 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:46:43.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:46:46.814 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:46:52.821 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:46:55.902 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:47:01.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:47:04.958 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:47:10.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:47:14.014 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:47:20.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:47:23.074 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:47:29.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:47:32.162 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:47:38.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:47:41.250 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:47:47.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:47:50.334 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:47:56.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:47:59.394 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:48:05.401 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:48:08.478 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:48:14.482 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:48:17.537 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:48:23.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:48:26.626 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:48:32.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:48:35.710 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:48:41.717 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:48:44.798 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:48:50.801 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:48:53.858 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:48:59.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:49:02.942 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:49:08.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:49:11.998 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:49:18.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:49:21.054 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:49:27.059 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:49:30.110 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:49:36.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:49:39.201 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:49:45.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:49:48.286 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:49:54.293 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:49:57.374 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:50:03.381 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:50:06.462 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:50:12.469 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:50:15.550 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:50:21.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:50:24.606 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:50:30.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:50:33.694 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:50:39.701 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:50:42.782 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:50:48.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:50:51.838 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:50:57.841 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:51:00.894 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:51:06.901 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:51:09.982 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:51:15.985 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:51:19.038 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:51:25.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:51:28.094 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:51:34.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:51:37.150 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:51:43.157 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:51:46.238 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:51:52.245 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:51:55.326 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:52:01.333 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:52:04.418 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:52:10.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:52:13.502 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:52:19.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:52:22.590 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:52:28.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:52:31.678 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:52:37.685 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:52:40.770 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:52:46.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:52:49.859 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:52:55.865 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:52:58.947 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:53:04.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:53:08.030 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:53:14.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:53:17.090 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:53:23.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:53:26.174 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:53:32.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:53:35.234 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:53:41.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:53:44.318 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:53:50.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:53:53.378 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:53:59.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:54:02.462 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:54:08.469 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:54:11.550 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:54:17.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:54:20.610 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:54:26.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:54:29.694 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:54:35.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:54:38.782 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:54:44.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:54:47.838 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:54:53.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:54:56.898 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:55:02.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:55:05.986 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:55:11.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:55:15.070 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:55:21.077 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:55:24.158 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:55:30.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:55:33.218 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:55:39.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:55:42.303 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:55:48.306 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:55:51.358 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:55:57.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:56:00.450 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:56:06.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:56:09.538 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:56:15.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:56:18.622 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:56:24.629 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:56:27.714 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:56:33.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:56:36.798 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:56:42.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:56:45.854 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:56:51.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:56:54.911 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:57:00.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:57:03.966 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:57:09.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:57:13.022 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:57:19.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:57:22.079 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:57:28.083 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:57:31.138 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:57:37.145 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:57:40.222 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:57:46.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:57:49.282 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:57:55.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:57:58.367 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:58:04.373 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:58:07.454 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:58:13.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:58:16.546 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:58:22.551 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:58:25.634 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:58:31.641 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:58:34.718 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:58:40.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:58:43.778 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:58:49.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:58:52.862 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:58:58.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:59:01.921 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:59:07.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:59:11.006 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:59:17.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:59:20.066 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:59:26.071 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:59:29.150 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:59:35.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T23:59:38.206 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-09T23:59:38.209 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/dispatcher/supervisor.py", line 232, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/fog.py", line 275, in _wait_for_ready while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds 2024-04-09T23:59:38.210 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T23:59:38.526 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=9a745360131547adbfb96632b7705ffc Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/dispatcher/supervisor.py", line 232, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/fog.py", line 275, in _wait_for_ready while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds 2024-04-09T23:59:38.528 INFO:teuthology.nuke:Checking targets against current locks 2024-04-09T23:59:38.596 DEBUG:teuthology.nuke:shortname: smithi031 2024-04-09T23:59:38.597 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-09T23:59:38.624 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi031.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-04-09_14:35:50-rados-wip-yuri5-testing-2024-03-21-0833-distro-default-smithi/7648673', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-09 23:40:15.839840', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKbGYUdCSE2pcmx+597LDpy5hN4dINGGJJpXyzVRZNMgo5/vHm+M8yB7NDvEopnIyA2XDbEmvrQSl4YPAJHcNvQ='} 2024-04-09T23:59:38.626 DEBUG:teuthology.nuke:shortname: smithi043 2024-04-09T23:59:38.627 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-09T23:59:38.649 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi043.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-04-09_14:35:50-rados-wip-yuri5-testing-2024-03-21-0833-distro-default-smithi/7648673', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-09 23:40:15.838027', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN5UB1CVl4fv9gM/j0WqqdHy0XoV4yz18i+6uSvF+vHyEfKXikzeQk9RQHxfiGQhgDKqQnpp9GQVKXX4EI3TkZY='} 2024-04-09T23:59:38.655 DEBUG:teuthology.nuke:shortname: smithi072 2024-04-09T23:59:38.655 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-09T23:59:38.662 DEBUG:teuthology.nuke:shortname: smithi176 2024-04-09T23:59:38.662 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-09T23:59:38.680 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi072.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-04-09_14:35:50-rados-wip-yuri5-testing-2024-03-21-0833-distro-default-smithi/7648673', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-09 23:40:15.840929', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIqdIyzqPZjHvdbwnBRCIXKk4BoWr6WjSyvhrOnb4XXb6xete+HzV0WnE3qUqNDNW2k6ID8xvGtQ0ZQIDa+sIBE='} 2024-04-09T23:59:38.685 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi176.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-04-09_14:35:50-rados-wip-yuri5-testing-2024-03-21-0833-distro-default-smithi/7648673', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-09 23:40:15.842031', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA6NkMMbUC2AshxyVUVkfczkKwrwHWwqWXBzE+Dw4mMrwpMYrVqe0kZT3EmvhRYSH/OS4GELH/iD+/cmKSqOlWI='} 2024-04-09T23:59:38.693 INFO:teuthology.orchestra.console.smithi031:Power off 2024-04-09T23:59:38.693 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-09T23:59:38.720 DEBUG:teuthology.orchestra.console.smithi031:power off output: Chassis Power Control: Down/Off 2024-04-09T23:59:38.720 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T23:59:38.738 INFO:teuthology.orchestra.console.smithi043:Power off 2024-04-09T23:59:38.739 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-09T23:59:38.755 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2024-04-09T23:59:38.764 DEBUG:teuthology.orchestra.console.smithi043:power off output: Chassis Power Control: Down/Off 2024-04-09T23:59:38.764 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T23:59:38.782 INFO:teuthology.orchestra.console.smithi176:Power off 2024-04-09T23:59:38.783 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-09T23:59:38.802 INFO:teuthology.orchestra.console.smithi072:Power off 2024-04-09T23:59:38.802 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-09T23:59:38.811 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is on 2024-04-09T23:59:38.812 DEBUG:teuthology.orchestra.console.smithi176:power off output: Chassis Power Control: Down/Off 2024-04-09T23:59:38.812 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T23:59:38.826 DEBUG:teuthology.orchestra.console.smithi072:power off output: Chassis Power Control: Down/Off 2024-04-09T23:59:38.827 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T23:59:38.838 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is on 2024-04-09T23:59:38.850 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2024-04-09T23:59:42.758 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T23:59:42.813 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T23:59:42.840 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T23:59:42.850 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T23:59:42.870 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2024-04-09T23:59:42.923 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is on 2024-04-09T23:59:42.950 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is on 2024-04-09T23:59:42.960 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2024-04-09T23:59:46.874 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T23:59:46.923 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T23:59:46.951 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T23:59:46.961 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T23:59:46.983 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2024-04-09T23:59:47.033 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is on 2024-04-09T23:59:47.061 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is off 2024-04-09T23:59:47.070 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2024-04-09T23:59:47.084 INFO:teuthology.orchestra.console.smithi031:Power off completed 2024-04-09T23:59:47.162 INFO:teuthology.orchestra.console.smithi176:Power off completed 2024-04-09T23:59:47.240 INFO:teuthology.lock.ops:unlocked: smithi031.front.sepia.ceph.com 2024-04-09T23:59:47.307 INFO:teuthology.lock.ops:unlocked: smithi176.front.sepia.ceph.com 2024-04-09T23:59:51.037 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T23:59:51.071 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T23:59:51.149 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off 2024-04-09T23:59:51.181 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2024-04-09T23:59:51.251 INFO:teuthology.orchestra.console.smithi043:Power off completed 2024-04-09T23:59:51.283 INFO:teuthology.orchestra.console.smithi072:Power off completed 2024-04-09T23:59:51.409 INFO:teuthology.lock.ops:unlocked: smithi043.front.sepia.ceph.com 2024-04-09T23:59:51.562 INFO:teuthology.lock.ops:unlocked: smithi072.front.sepia.ceph.com 2024-04-09T23:59:52.091 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/dispatcher/supervisor.py", line 58, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/dispatcher/supervisor.py", line 232, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/fog.py", line 275, in _wait_for_ready while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds