2023-11-25T07:03:45.962 INFO:root:teuthology version: 0.0.1.dev205+g2442239 2023-11-25T07:03:45.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-25T07:03:46.192 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6b145f5670>, signals=[15]) 2023-11-25T07:03:46.193 INFO:teuthology.lock.ops:Start node 'smithi070.front.sepia.ceph.com' reimaging 2023-11-25T07:03:46.193 INFO:teuthology.lock.ops:Updating [smithi070.front.sepia.ceph.com]: reset os type and version on server 2023-11-25T07:03:46.193 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server 2023-11-25T07:03:46.213 INFO:teuthology.lock.ops:Start node 'smithi084.front.sepia.ceph.com' reimaging 2023-11-25T07:03:46.214 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: reset os type and version on server 2023-11-25T07:03:46.214 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2023-11-25T07:03:46.238 INFO:teuthology.lock.ops:Start node 'smithi138.front.sepia.ceph.com' reimaging 2023-11-25T07:03:46.238 INFO:teuthology.lock.ops:Updating [smithi138.front.sepia.ceph.com]: reset os type and version on server 2023-11-25T07:03:46.239 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2023-11-25T07:03:46.263 INFO:teuthology.lock.ops:Start node 'smithi157.front.sepia.ceph.com' reimaging 2023-11-25T07:03:46.263 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: reset os type and version on server 2023-11-25T07:03:46.263 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2023-11-25T07:03:46.288 INFO:teuthology.lock.ops:Start node 'smithi177.front.sepia.ceph.com' reimaging 2023-11-25T07:03:46.288 INFO:teuthology.lock.ops:Updating [smithi177.front.sepia.ceph.com]: reset os type and version on server 2023-11-25T07:03:46.288 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server 2023-11-25T07:03:46.332 DEBUG:teuthology.provision.fog.smithi070:Requesting image smithi_rhel_8.6 (ID 5) 2023-11-25T07:03:46.355 DEBUG:teuthology.provision.fog.smithi084:Requesting image smithi_rhel_8.6 (ID 5) 2023-11-25T07:03:46.373 DEBUG:teuthology.provision.fog.smithi138:Requesting image smithi_rhel_8.6 (ID 5) 2023-11-25T07:03:46.376 INFO:teuthology.provision.fog.smithi070:Scheduling deploy of rhel 8.6 2023-11-25T07:03:46.397 INFO:teuthology.provision.fog.smithi084:Scheduling deploy of rhel 8.6 2023-11-25T07:03:46.416 INFO:teuthology.provision.fog.smithi138:Scheduling deploy of rhel 8.6 2023-11-25T07:03:46.427 DEBUG:teuthology.provision.fog.smithi157:Requesting image smithi_rhel_8.6 (ID 5) 2023-11-25T07:03:46.433 DEBUG:teuthology.provision.fog.smithi177:Requesting image smithi_rhel_8.6 (ID 5) 2023-11-25T07:03:46.483 INFO:teuthology.provision.fog.smithi157:Scheduling deploy of rhel 8.6 2023-11-25T07:03:46.486 INFO:teuthology.provision.fog.smithi177:Scheduling deploy of rhel 8.6 2023-11-25T07:03:46.615 INFO:teuthology.orchestra.console.smithi070:Power off 2023-11-25T07:03:46.616 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-25T07:03:46.628 INFO:teuthology.orchestra.console.smithi084:Power off 2023-11-25T07:03:46.628 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-25T07:03:46.642 DEBUG:teuthology.orchestra.console.smithi070:power off output: Chassis Power Control: Down/Off 2023-11-25T07:03:46.642 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-25T07:03:46.650 DEBUG:teuthology.orchestra.console.smithi084:power off output: Chassis Power Control: Down/Off 2023-11-25T07:03:46.651 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-25T07:03:46.667 INFO:teuthology.orchestra.console.smithi138:Power off 2023-11-25T07:03:46.667 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-25T07:03:46.675 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2023-11-25T07:03:46.675 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is on 2023-11-25T07:03:46.688 DEBUG:teuthology.orchestra.console.smithi138:power off output: Chassis Power Control: Down/Off 2023-11-25T07:03:46.688 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-25T07:03:46.710 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on 2023-11-25T07:03:46.725 INFO:teuthology.orchestra.console.smithi157:Power off 2023-11-25T07:03:46.725 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-25T07:03:46.737 INFO:teuthology.orchestra.console.smithi177:Power off 2023-11-25T07:03:46.738 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-25T07:03:46.746 DEBUG:teuthology.orchestra.console.smithi157:power off output: Chassis Power Control: Down/Off 2023-11-25T07:03:46.746 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-25T07:03:46.758 DEBUG:teuthology.orchestra.console.smithi177:power off output: Chassis Power Control: Down/Off 2023-11-25T07:03:46.758 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-25T07:03:46.768 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2023-11-25T07:03:46.780 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on 2023-11-25T07:03:50.678 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-25T07:03:50.684 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-25T07:03:50.711 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-25T07:03:50.769 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-25T07:03:50.781 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-25T07:03:50.789 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2023-11-25T07:03:50.792 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is on 2023-11-25T07:03:50.821 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on 2023-11-25T07:03:50.877 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2023-11-25T07:03:50.889 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on 2023-11-25T07:03:54.793 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-25T07:03:54.800 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-25T07:03:54.822 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-25T07:03:54.878 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-25T07:03:54.890 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-25T07:03:54.903 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2023-11-25T07:03:54.909 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is on 2023-11-25T07:03:54.930 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on 2023-11-25T07:03:54.987 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2023-11-25T07:03:54.998 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off 2023-11-25T07:03:55.004 INFO:teuthology.orchestra.console.smithi084:Power off completed 2023-11-25T07:03:55.088 INFO:teuthology.orchestra.console.smithi157:Power off completed 2023-11-25T07:03:55.099 INFO:teuthology.orchestra.console.smithi177:Power off completed 2023-11-25T07:03:55.105 INFO:teuthology.orchestra.console.smithi084:Power on 2023-11-25T07:03:55.106 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-25T07:03:55.127 DEBUG:teuthology.orchestra.console.smithi084:power on output: Chassis Power Control: Up/On 2023-11-25T07:03:55.128 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-25T07:03:55.149 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2023-11-25T07:03:55.189 INFO:teuthology.orchestra.console.smithi157:Power on 2023-11-25T07:03:55.190 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-25T07:03:55.200 INFO:teuthology.orchestra.console.smithi177:Power on 2023-11-25T07:03:55.200 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-25T07:03:55.211 DEBUG:teuthology.orchestra.console.smithi157:power on output: Chassis Power Control: Up/On 2023-11-25T07:03:55.212 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-25T07:03:55.221 DEBUG:teuthology.orchestra.console.smithi177:power on output: Chassis Power Control: Up/On 2023-11-25T07:03:55.221 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-25T07:03:55.232 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2023-11-25T07:03:55.243 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off 2023-11-25T07:03:58.910 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-25T07:03:58.931 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-25T07:03:59.019 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is off 2023-11-25T07:03:59.040 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off 2023-11-25T07:03:59.121 INFO:teuthology.orchestra.console.smithi070:Power off completed 2023-11-25T07:03:59.141 INFO:teuthology.orchestra.console.smithi138:Power off completed 2023-11-25T07:03:59.150 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-25T07:03:59.222 INFO:teuthology.orchestra.console.smithi070:Power on 2023-11-25T07:03:59.222 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-25T07:03:59.233 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-25T07:03:59.242 INFO:teuthology.orchestra.console.smithi138:Power on 2023-11-25T07:03:59.243 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-25T07:03:59.250 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-25T07:03:59.256 DEBUG:teuthology.orchestra.console.smithi070:power on output: Chassis Power Control: Up/On 2023-11-25T07:03:59.256 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-25T07:03:59.263 DEBUG:teuthology.orchestra.console.smithi138:power on output: Chassis Power Control: Up/On 2023-11-25T07:03:59.263 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-25T07:03:59.269 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2023-11-25T07:03:59.277 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is off 2023-11-25T07:03:59.283 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off 2023-11-25T07:03:59.341 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2023-11-25T07:03:59.358 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off 2023-11-25T07:04:03.274 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-25T07:04:03.281 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-25T07:04:03.288 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-25T07:04:03.342 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-25T07:04:03.359 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-25T07:04:03.383 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2023-11-25T07:04:03.389 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is on 2023-11-25T07:04:03.397 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on 2023-11-25T07:04:03.451 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2023-11-25T07:04:03.467 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on 2023-11-25T07:04:03.485 INFO:teuthology.orchestra.console.smithi084:Power on completed 2023-11-25T07:04:03.490 INFO:teuthology.orchestra.console.smithi070:Power on completed 2023-11-25T07:04:03.497 INFO:teuthology.orchestra.console.smithi138:Power on completed 2023-11-25T07:04:03.552 INFO:teuthology.orchestra.console.smithi157:Power on completed 2023-11-25T07:04:03.568 INFO:teuthology.orchestra.console.smithi177:Power on completed 2023-11-25T07:04:03.586 INFO:teuthology.provision.fog.smithi084:Waiting for deploy to finish 2023-11-25T07:04:03.591 INFO:teuthology.provision.fog.smithi070:Waiting for deploy to finish 2023-11-25T07:04:03.598 INFO:teuthology.provision.fog.smithi138:Waiting for deploy to finish 2023-11-25T07:04:03.653 INFO:teuthology.provision.fog.smithi157:Waiting for deploy to finish 2023-11-25T07:04:03.669 INFO:teuthology.provision.fog.smithi177:Waiting for deploy to finish 2023-11-25T07:06:34.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T07:06:34.529 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T07:06:34.754 ERROR:teuthology.orchestra.connection:Error authenticating with smithi177.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-11-25T07:06:49.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T07:06:49.577 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T07:07:04.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T07:07:08.002 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-11-25T07:07:08.002 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2023-11-25T07:07:14.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T07:07:14.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T07:07:17.058 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-11-25T07:07:17.058 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2023-11-25T07:07:23.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T07:07:23.061 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T07:07:23.106 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-11-25T07:07:26.114 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2023-11-25T07:07:26.114 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-11-25T07:07:29.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T07:07:32.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T07:07:32.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T07:07:32.162 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-11-25T07:07:35.170 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-11-25T07:07:35.174 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2023-11-25T07:07:38.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T07:07:38.758 WARNING:teuthology.provision.fog.smithi177:timed out 2023-11-25T07:07:41.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T07:07:41.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T07:07:41.222 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-11-25T07:07:44.226 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-11-25T07:07:44.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T07:07:47.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T07:07:50.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T07:07:50.278 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-11-25T07:07:56.279 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T07:07:59.330 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-11-25T07:08:03.302 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2023-11-25T07:08:04.813 ERROR:teuthology.orchestra.connection:Error authenticating with smithi084.front.sepia.ceph.com: AuthenticationException('Authentication timeout.') 2023-11-25T07:08:05.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T07:08:08.390 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-11-25T07:08:09.304 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T07:08:12.354 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2023-11-25T07:08:14.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T07:08:18.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T07:08:18.698 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-25T07:08:18.698 DEBUG:teuthology.orchestra.run.smithi177:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-25T07:08:18.945 INFO:teuthology.provision.fog.smithi177:Node is ready 2023-11-25T07:08:18.945 DEBUG:teuthology.orchestra.run.smithi177:> hostname 2023-11-25T07:08:18.961 INFO:teuthology.orchestra.run.smithi177.stdout:smithi177.front.sepia.ceph.com 2023-11-25T07:08:18.962 DEBUG:teuthology.orchestra.run.smithi177:> grep smithi177.front.sepia.ceph.com /etc/hosts 2023-11-25T07:08:19.019 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.15.177 smithi177.front.sepia.ceph.com smithi177 2023-11-25T07:08:19.019 DEBUG:teuthology.orchestra.run.smithi177:> sudo hostname smithi177 2023-11-25T07:08:19.161 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/smithi177.front.sepia.ceph.com/smithi177/g' /etc/hosts 2023-11-25T07:08:19.188 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/172.21.15.177/172.21.15.177/g' /etc/hosts 2023-11-25T07:08:19.256 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/smithi177.front.sepia.ceph.com/smithi177/g' /etc/hostname 2023-11-25T07:08:19.321 DEBUG:teuthology.orchestra.run.smithi177:> sudo hostname smithi177 2023-11-25T07:08:19.386 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release 2023-11-25T07:08:19.442 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="Red Hat Enterprise Linux" 2023-11-25T07:08:19.442 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="8.6 (Ootpa)" 2023-11-25T07:08:19.443 INFO:teuthology.orchestra.run.smithi177.stdout:ID="rhel" 2023-11-25T07:08:19.443 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE="fedora" 2023-11-25T07:08:19.443 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="8.6" 2023-11-25T07:08:19.443 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM_ID="platform:el8" 2023-11-25T07:08:19.443 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-25T07:08:19.443 INFO:teuthology.orchestra.run.smithi177.stdout:ANSI_COLOR="0;31" 2023-11-25T07:08:19.443 INFO:teuthology.orchestra.run.smithi177.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-25T07:08:19.443 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://www.redhat.com/" 2023-11-25T07:08:19.443 INFO:teuthology.orchestra.run.smithi177.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-25T07:08:19.443 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-25T07:08:19.443 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-25T07:08:19.443 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-25T07:08:19.443 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-25T07:08:19.444 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-25T07:08:19.444 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-25T07:08:19.444 INFO:teuthology.provision.fog.smithi177:Deploy complete! 2023-11-25T07:08:19.446 DEBUG:teuthology.parallel:result is None 2023-11-25T07:08:24.350 ERROR:teuthology.orchestra.connection:Error authenticating with smithi084.front.sepia.ceph.com: BadHostKeyException('smithi084.front.sepia.ceph.com', , ) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 438, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi084.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIJk1bro4yMqAvIU5gecKE7s81r70ElMBMGhNW04z3b8a' 2023-11-25T07:08:31.367 ERROR:teuthology.orchestra.connection:Error authenticating with smithi084.front.sepia.ceph.com: BadHostKeyException('smithi084.front.sepia.ceph.com', , ) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 438, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi084.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIJk1bro4yMqAvIU5gecKE7s81r70ElMBMGhNW04z3b8a' 2023-11-25T07:08:41.178 WARNING:teuthology.provision.fog.smithi070:timed out 2023-11-25T07:08:41.382 ERROR:teuthology.orchestra.connection:Error authenticating with smithi084.front.sepia.ceph.com: BadHostKeyException('smithi084.front.sepia.ceph.com', , ) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 438, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi084.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIJk1bro4yMqAvIU5gecKE7s81r70ElMBMGhNW04z3b8a' 2023-11-25T07:08:47.179 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T07:08:47.512 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-25T07:08:47.512 DEBUG:teuthology.orchestra.run.smithi070:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-25T07:08:47.812 INFO:teuthology.provision.fog.smithi070:Node is ready 2023-11-25T07:08:47.813 DEBUG:teuthology.orchestra.run.smithi070:> hostname 2023-11-25T07:08:47.831 INFO:teuthology.orchestra.run.smithi070.stdout:smithi070.front.sepia.ceph.com 2023-11-25T07:08:47.831 DEBUG:teuthology.orchestra.run.smithi070:> grep smithi070.front.sepia.ceph.com /etc/hosts 2023-11-25T07:08:47.887 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70 smithi070.front.sepia.ceph.com smithi070 2023-11-25T07:08:47.888 DEBUG:teuthology.orchestra.run.smithi070:> sudo hostname smithi070 2023-11-25T07:08:48.007 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i -e 's/smithi070.front.sepia.ceph.com/smithi070/g' /etc/hosts 2023-11-25T07:08:48.037 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i -e 's/172.21.15.70/172.21.15.70/g' /etc/hosts 2023-11-25T07:08:48.105 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i -e 's/smithi070.front.sepia.ceph.com/smithi070/g' /etc/hostname 2023-11-25T07:08:48.174 DEBUG:teuthology.orchestra.run.smithi070:> sudo hostname smithi070 2023-11-25T07:08:48.241 DEBUG:teuthology.orchestra.run.smithi070:> cat /etc/os-release 2023-11-25T07:08:48.298 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="Red Hat Enterprise Linux" 2023-11-25T07:08:48.298 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="8.6 (Ootpa)" 2023-11-25T07:08:48.298 INFO:teuthology.orchestra.run.smithi070.stdout:ID="rhel" 2023-11-25T07:08:48.299 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE="fedora" 2023-11-25T07:08:48.299 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="8.6" 2023-11-25T07:08:48.299 INFO:teuthology.orchestra.run.smithi070.stdout:PLATFORM_ID="platform:el8" 2023-11-25T07:08:48.299 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-25T07:08:48.299 INFO:teuthology.orchestra.run.smithi070.stdout:ANSI_COLOR="0;31" 2023-11-25T07:08:48.299 INFO:teuthology.orchestra.run.smithi070.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-25T07:08:48.299 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://www.redhat.com/" 2023-11-25T07:08:48.299 INFO:teuthology.orchestra.run.smithi070.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-25T07:08:48.299 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-25T07:08:48.299 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-25T07:08:48.299 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-25T07:08:48.300 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-25T07:08:48.300 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-25T07:08:48.300 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-25T07:08:48.300 INFO:teuthology.provision.fog.smithi070:Deploy complete! 2023-11-25T07:08:48.301 DEBUG:teuthology.parallel:result is None 2023-11-25T07:08:50.229 WARNING:teuthology.provision.fog.smithi138:timed out 2023-11-25T07:08:54.399 ERROR:teuthology.orchestra.connection:Error authenticating with smithi084.front.sepia.ceph.com: BadHostKeyException('smithi084.front.sepia.ceph.com', , ) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 438, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi084.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIJk1bro4yMqAvIU5gecKE7s81r70ElMBMGhNW04z3b8a' 2023-11-25T07:08:56.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T07:08:56.466 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-25T07:08:56.467 DEBUG:teuthology.orchestra.run.smithi138:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-25T07:08:56.728 INFO:teuthology.provision.fog.smithi138:Node is ready 2023-11-25T07:08:56.728 DEBUG:teuthology.orchestra.run.smithi138:> hostname 2023-11-25T07:08:56.744 INFO:teuthology.orchestra.run.smithi138.stdout:smithi138 2023-11-25T07:08:56.745 DEBUG:teuthology.orchestra.run.smithi138:> grep smithi138 /etc/hosts 2023-11-25T07:08:56.805 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138 smithi138.front.sepia.ceph.com smithi138 2023-11-25T07:08:56.806 DEBUG:teuthology.orchestra.run.smithi138:> sudo hostname smithi138 2023-11-25T07:08:56.941 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/smithi138/smithi138/g' /etc/hosts 2023-11-25T07:08:56.969 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/172.21.15.138/172.21.15.138/g' /etc/hosts 2023-11-25T07:08:57.039 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/smithi138/smithi138/g' /etc/hostname 2023-11-25T07:08:57.109 DEBUG:teuthology.orchestra.run.smithi138:> sudo hostname smithi138 2023-11-25T07:08:57.177 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release 2023-11-25T07:08:57.238 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="Red Hat Enterprise Linux" 2023-11-25T07:08:57.238 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="8.6 (Ootpa)" 2023-11-25T07:08:57.238 INFO:teuthology.orchestra.run.smithi138.stdout:ID="rhel" 2023-11-25T07:08:57.238 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE="fedora" 2023-11-25T07:08:57.238 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="8.6" 2023-11-25T07:08:57.238 INFO:teuthology.orchestra.run.smithi138.stdout:PLATFORM_ID="platform:el8" 2023-11-25T07:08:57.238 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-25T07:08:57.238 INFO:teuthology.orchestra.run.smithi138.stdout:ANSI_COLOR="0;31" 2023-11-25T07:08:57.238 INFO:teuthology.orchestra.run.smithi138.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-25T07:08:57.238 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://www.redhat.com/" 2023-11-25T07:08:57.239 INFO:teuthology.orchestra.run.smithi138.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-25T07:08:57.239 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-25T07:08:57.239 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-11-25T07:08:57.239 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-25T07:08:57.239 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-25T07:08:57.239 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-25T07:08:57.239 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-25T07:08:57.239 INFO:teuthology.provision.fog.smithi138:Deploy complete! 2023-11-25T07:08:57.240 DEBUG:teuthology.parallel:result is None 2023-11-25T07:09:07.555 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-11-25T07:09:10.416 ERROR:teuthology.orchestra.connection:Error authenticating with smithi084.front.sepia.ceph.com: BadHostKeyException('smithi084.front.sepia.ceph.com', , ) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 438, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi084.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIJk1bro4yMqAvIU5gecKE7s81r70ElMBMGhNW04z3b8a' 2023-11-25T07:09:14.394 WARNING:teuthology.provision.fog.smithi157:timed out 2023-11-25T07:09:20.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T07:09:20.744 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-25T07:09:20.745 DEBUG:teuthology.orchestra.run.smithi157:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-25T07:09:21.085 INFO:teuthology.provision.fog.smithi157:Node is ready 2023-11-25T07:09:21.085 DEBUG:teuthology.orchestra.run.smithi157:> hostname 2023-11-25T07:09:21.103 INFO:teuthology.orchestra.run.smithi157.stdout:smithi157.front.sepia.ceph.com 2023-11-25T07:09:21.103 DEBUG:teuthology.orchestra.run.smithi157:> grep smithi157.front.sepia.ceph.com /etc/hosts 2023-11-25T07:09:21.162 INFO:teuthology.orchestra.run.smithi157.stdout:172.21.15.157 smithi157.front.sepia.ceph.com smithi157 2023-11-25T07:09:21.162 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname smithi157 2023-11-25T07:09:21.287 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/smithi157.front.sepia.ceph.com/smithi157/g' /etc/hosts 2023-11-25T07:09:21.316 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/172.21.15.157/172.21.15.157/g' /etc/hosts 2023-11-25T07:09:21.384 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/smithi157.front.sepia.ceph.com/smithi157/g' /etc/hostname 2023-11-25T07:09:21.451 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname smithi157 2023-11-25T07:09:21.517 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2023-11-25T07:09:21.574 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="Red Hat Enterprise Linux" 2023-11-25T07:09:21.574 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="8.6 (Ootpa)" 2023-11-25T07:09:21.574 INFO:teuthology.orchestra.run.smithi157.stdout:ID="rhel" 2023-11-25T07:09:21.574 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="fedora" 2023-11-25T07:09:21.574 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="8.6" 2023-11-25T07:09:21.575 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el8" 2023-11-25T07:09:21.575 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-25T07:09:21.575 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31" 2023-11-25T07:09:21.575 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-25T07:09:21.575 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://www.redhat.com/" 2023-11-25T07:09:21.575 INFO:teuthology.orchestra.run.smithi157.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-25T07:09:21.575 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-25T07:09:21.575 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-11-25T07:09:21.576 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-25T07:09:21.576 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-25T07:09:21.576 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-25T07:09:21.576 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-25T07:09:21.576 INFO:teuthology.provision.fog.smithi157:Deploy complete! 2023-11-25T07:09:21.577 DEBUG:teuthology.parallel:result is None 2023-11-25T07:09:29.433 ERROR:teuthology.orchestra.connection:Error authenticating with smithi084.front.sepia.ceph.com: BadHostKeyException('smithi084.front.sepia.ceph.com', , ) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 438, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi084.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIJk1bro4yMqAvIU5gecKE7s81r70ElMBMGhNW04z3b8a' 2023-11-25T07:09:51.496 ERROR:teuthology.orchestra.connection:Error authenticating with smithi084.front.sepia.ceph.com: BadHostKeyException('smithi084.front.sepia.ceph.com', , ) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 438, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi084.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIJk1bro4yMqAvIU5gecKE7s81r70ElMBMGhNW04z3b8a' 2023-11-25T07:10:16.512 ERROR:teuthology.orchestra.connection:Error authenticating with smithi084.front.sepia.ceph.com: BadHostKeyException('smithi084.front.sepia.ceph.com', , ) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 438, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi084.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIJk1bro4yMqAvIU5gecKE7s81r70ElMBMGhNW04z3b8a' 2023-11-25T07:10:44.528 ERROR:teuthology.orchestra.connection:Error authenticating with smithi084.front.sepia.ceph.com: BadHostKeyException('smithi084.front.sepia.ceph.com', , ) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 438, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi084.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIJk1bro4yMqAvIU5gecKE7s81r70ElMBMGhNW04z3b8a' 2023-11-25T07:10:44.528 WARNING:teuthology.provision.fog.smithi084:'connect to smithi084.front.sepia.ceph.com' reached maximum tries (11) after waiting for 145 seconds 2023-11-25T07:10:50.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T07:10:50.832 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-25T07:10:50.832 DEBUG:teuthology.orchestra.run.smithi084:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-25T07:10:51.109 INFO:teuthology.provision.fog.smithi084:Node is ready 2023-11-25T07:10:51.109 DEBUG:teuthology.orchestra.run.smithi084:> hostname 2023-11-25T07:10:51.168 INFO:teuthology.orchestra.run.smithi084.stdout:smithi084 2023-11-25T07:10:51.168 DEBUG:teuthology.orchestra.run.smithi084:> grep smithi084 /etc/hosts 2023-11-25T07:10:51.227 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84 smithi084.front.sepia.ceph.com smithi084 2023-11-25T07:10:51.227 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname smithi084 2023-11-25T07:10:51.331 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/smithi084/smithi084/g' /etc/hosts 2023-11-25T07:10:51.360 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/172.21.15.84/172.21.15.84/g' /etc/hosts 2023-11-25T07:10:51.429 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/smithi084/smithi084/g' /etc/hostname 2023-11-25T07:10:51.495 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname smithi084 2023-11-25T07:10:51.561 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2023-11-25T07:10:51.620 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="Red Hat Enterprise Linux" 2023-11-25T07:10:51.620 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="8.6 (Ootpa)" 2023-11-25T07:10:51.620 INFO:teuthology.orchestra.run.smithi084.stdout:ID="rhel" 2023-11-25T07:10:51.620 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="fedora" 2023-11-25T07:10:51.620 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="8.6" 2023-11-25T07:10:51.620 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el8" 2023-11-25T07:10:51.620 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-25T07:10:51.620 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2023-11-25T07:10:51.620 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-25T07:10:51.620 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://www.redhat.com/" 2023-11-25T07:10:51.621 INFO:teuthology.orchestra.run.smithi084.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-25T07:10:51.621 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-25T07:10:51.621 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-11-25T07:10:51.621 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-25T07:10:51.621 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-25T07:10:51.621 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-25T07:10:51.621 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-25T07:10:51.621 INFO:teuthology.provision.fog.smithi084:Deploy complete! 2023-11-25T07:10:51.622 DEBUG:teuthology.parallel:result is None 2023-11-25T07:10:51.888 INFO:teuthology.lock.ops:Checking smithi070.front.sepia.ceph.com 2023-11-25T07:10:51.888 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-25T07:10:51.915 INFO:teuthology.lock.ops:Checking smithi084.front.sepia.ceph.com 2023-11-25T07:10:51.916 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-25T07:10:51.931 INFO:teuthology.lock.ops:Checking smithi138.front.sepia.ceph.com 2023-11-25T07:10:51.931 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-25T07:10:51.948 INFO:teuthology.lock.ops:Checking smithi157.front.sepia.ceph.com 2023-11-25T07:10:51.949 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-25T07:10:51.965 INFO:teuthology.lock.ops:Checking smithi177.front.sepia.ceph.com 2023-11-25T07:10:51.965 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-25T07:10:51.983 INFO:teuthology.lock.ops:Updating [smithi070.front.sepia.ceph.com]: set os type and version on server 2023-11-25T07:10:51.983 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2023-11-25T07:10:51.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T07:10:52.051 DEBUG:teuthology.orchestra.run.smithi070:> true 2023-11-25T07:10:52.143 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com' 2023-11-25T07:10:52.143 DEBUG:teuthology.orchestra.run.smithi070:> uname -m 2023-11-25T07:10:52.201 INFO:teuthology.orchestra.run.smithi070.stdout:x86_64 2023-11-25T07:10:52.201 DEBUG:teuthology.orchestra.run.smithi070:> cat /etc/os-release 2023-11-25T07:10:52.260 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="Red Hat Enterprise Linux" 2023-11-25T07:10:52.260 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="8.6 (Ootpa)" 2023-11-25T07:10:52.260 INFO:teuthology.orchestra.run.smithi070.stdout:ID="rhel" 2023-11-25T07:10:52.260 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE="fedora" 2023-11-25T07:10:52.260 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="8.6" 2023-11-25T07:10:52.260 INFO:teuthology.orchestra.run.smithi070.stdout:PLATFORM_ID="platform:el8" 2023-11-25T07:10:52.260 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-25T07:10:52.260 INFO:teuthology.orchestra.run.smithi070.stdout:ANSI_COLOR="0;31" 2023-11-25T07:10:52.260 INFO:teuthology.orchestra.run.smithi070.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-25T07:10:52.260 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://www.redhat.com/" 2023-11-25T07:10:52.261 INFO:teuthology.orchestra.run.smithi070.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-25T07:10:52.261 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-25T07:10:52.261 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-25T07:10:52.261 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-25T07:10:52.261 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-25T07:10:52.261 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-25T07:10:52.261 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-25T07:10:52.262 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server 2023-11-25T07:10:52.291 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: set os type and version on server 2023-11-25T07:10:52.291 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-11-25T07:10:52.292 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T07:10:52.357 DEBUG:teuthology.orchestra.run.smithi084:> true 2023-11-25T07:10:52.424 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-11-25T07:10:52.424 DEBUG:teuthology.orchestra.run.smithi084:> uname -m 2023-11-25T07:10:52.482 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64 2023-11-25T07:10:52.482 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2023-11-25T07:10:52.541 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="Red Hat Enterprise Linux" 2023-11-25T07:10:52.541 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="8.6 (Ootpa)" 2023-11-25T07:10:52.541 INFO:teuthology.orchestra.run.smithi084.stdout:ID="rhel" 2023-11-25T07:10:52.542 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="fedora" 2023-11-25T07:10:52.542 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="8.6" 2023-11-25T07:10:52.542 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el8" 2023-11-25T07:10:52.542 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-25T07:10:52.542 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2023-11-25T07:10:52.542 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-25T07:10:52.543 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://www.redhat.com/" 2023-11-25T07:10:52.543 INFO:teuthology.orchestra.run.smithi084.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-25T07:10:52.543 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-25T07:10:52.543 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-11-25T07:10:52.543 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-25T07:10:52.543 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-25T07:10:52.544 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-25T07:10:52.544 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-25T07:10:52.546 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2023-11-25T07:10:52.574 INFO:teuthology.lock.ops:Updating [smithi138.front.sepia.ceph.com]: set os type and version on server 2023-11-25T07:10:52.574 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2023-11-25T07:10:52.577 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T07:10:52.644 DEBUG:teuthology.orchestra.run.smithi138:> true 2023-11-25T07:10:52.785 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com' 2023-11-25T07:10:52.786 DEBUG:teuthology.orchestra.run.smithi138:> uname -m 2023-11-25T07:10:52.843 INFO:teuthology.orchestra.run.smithi138.stdout:x86_64 2023-11-25T07:10:52.844 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release 2023-11-25T07:10:52.901 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="Red Hat Enterprise Linux" 2023-11-25T07:10:52.901 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="8.6 (Ootpa)" 2023-11-25T07:10:52.901 INFO:teuthology.orchestra.run.smithi138.stdout:ID="rhel" 2023-11-25T07:10:52.901 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE="fedora" 2023-11-25T07:10:52.901 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="8.6" 2023-11-25T07:10:52.901 INFO:teuthology.orchestra.run.smithi138.stdout:PLATFORM_ID="platform:el8" 2023-11-25T07:10:52.901 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-25T07:10:52.901 INFO:teuthology.orchestra.run.smithi138.stdout:ANSI_COLOR="0;31" 2023-11-25T07:10:52.901 INFO:teuthology.orchestra.run.smithi138.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-25T07:10:52.902 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://www.redhat.com/" 2023-11-25T07:10:52.902 INFO:teuthology.orchestra.run.smithi138.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-25T07:10:52.902 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-25T07:10:52.902 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-11-25T07:10:52.902 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-25T07:10:52.902 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-25T07:10:52.902 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-25T07:10:52.902 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-25T07:10:52.903 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2023-11-25T07:10:52.924 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: set os type and version on server 2023-11-25T07:10:52.924 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2023-11-25T07:10:52.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T07:10:52.992 DEBUG:teuthology.orchestra.run.smithi157:> true 2023-11-25T07:10:53.124 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2023-11-25T07:10:53.124 DEBUG:teuthology.orchestra.run.smithi157:> uname -m 2023-11-25T07:10:53.182 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64 2023-11-25T07:10:53.183 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2023-11-25T07:10:53.240 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="Red Hat Enterprise Linux" 2023-11-25T07:10:53.240 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="8.6 (Ootpa)" 2023-11-25T07:10:53.240 INFO:teuthology.orchestra.run.smithi157.stdout:ID="rhel" 2023-11-25T07:10:53.240 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="fedora" 2023-11-25T07:10:53.240 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="8.6" 2023-11-25T07:10:53.240 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el8" 2023-11-25T07:10:53.240 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-25T07:10:53.240 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31" 2023-11-25T07:10:53.240 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-25T07:10:53.240 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://www.redhat.com/" 2023-11-25T07:10:53.241 INFO:teuthology.orchestra.run.smithi157.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-25T07:10:53.241 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-25T07:10:53.241 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-11-25T07:10:53.241 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-25T07:10:53.241 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-25T07:10:53.241 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-25T07:10:53.241 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-25T07:10:53.241 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2023-11-25T07:10:53.265 INFO:teuthology.lock.ops:Updating [smithi177.front.sepia.ceph.com]: set os type and version on server 2023-11-25T07:10:53.266 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2023-11-25T07:10:53.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T07:10:53.333 DEBUG:teuthology.orchestra.run.smithi177:> true 2023-11-25T07:10:53.468 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi177.front.sepia.ceph.com' 2023-11-25T07:10:53.468 DEBUG:teuthology.orchestra.run.smithi177:> uname -m 2023-11-25T07:10:53.525 INFO:teuthology.orchestra.run.smithi177.stdout:x86_64 2023-11-25T07:10:53.526 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release 2023-11-25T07:10:53.582 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="Red Hat Enterprise Linux" 2023-11-25T07:10:53.583 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="8.6 (Ootpa)" 2023-11-25T07:10:53.583 INFO:teuthology.orchestra.run.smithi177.stdout:ID="rhel" 2023-11-25T07:10:53.583 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE="fedora" 2023-11-25T07:10:53.583 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="8.6" 2023-11-25T07:10:53.583 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM_ID="platform:el8" 2023-11-25T07:10:53.583 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-25T07:10:53.583 INFO:teuthology.orchestra.run.smithi177.stdout:ANSI_COLOR="0;31" 2023-11-25T07:10:53.583 INFO:teuthology.orchestra.run.smithi177.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-25T07:10:53.583 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://www.redhat.com/" 2023-11-25T07:10:53.583 INFO:teuthology.orchestra.run.smithi177.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-25T07:10:53.583 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-25T07:10:53.583 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-25T07:10:53.584 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-25T07:10:53.584 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-25T07:10:53.584 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-25T07:10:53.584 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-25T07:10:53.584 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server 2023-11-25T07:10:53.615 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-25T07:10:53.702 INFO:teuthology.dispatcher.supervisor:Running job 7466425 2023-11-25T07:10:53.703 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-11-24_21:18:30-rados-main-distro-default-smithi/7466425 --name yuriw-2023-11-24_21:18:30-rados-main-distro-default-smithi --description rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/classic task/test_orch_cli_mon} -- /home/teuthworker/archive/yuriw-2023-11-24_21:18:30-rados-main-distro-default-smithi/7466425/orig.config.yaml 2023-11-25T07:10:53.706 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-11-24_21:18:30-rados-main-distro-default-smithi/7466425 2023-11-25T07:10:53.706 INFO:teuthology.dispatcher.supervisor:Job PID: 839932 2023-11-25T07:10:53.706 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-25T07:12:53.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-25T07:14:53.786 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-25T07:16:53.853 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-25T07:18:53.924 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-25T07:20:54.000 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-25T07:22:54.074 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-25T07:22:54.150 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-11-25T07:22:54.300 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-25T07:22:54.300 INFO:teuthology.nuke:Checking targets against current locks 2023-11-25T07:22:54.349 DEBUG:teuthology.nuke:shortname: smithi070 2023-11-25T07:22:54.349 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-25T07:22:54.379 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi070.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-24_21:18:30-rados-main-distro-default-smithi/7466425', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-25 07:03:45.078570', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-25T07:22:54.380 DEBUG:teuthology.nuke:shortname: smithi084 2023-11-25T07:22:54.380 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-25T07:22:54.405 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi084.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-24_21:18:30-rados-main-distro-default-smithi/7466425', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-25 07:03:45.082415', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-25T07:22:54.406 DEBUG:teuthology.nuke:shortname: smithi138 2023-11-25T07:22:54.406 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-25T07:22:54.427 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi138.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-24_21:18:30-rados-main-distro-default-smithi/7466425', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-25 07:03:45.081318', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-25T07:22:54.431 DEBUG:teuthology.nuke:shortname: smithi157 2023-11-25T07:22:54.431 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-25T07:22:54.437 INFO:teuthology.orchestra.console.smithi070:Power off 2023-11-25T07:22:54.437 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-25T07:22:54.448 DEBUG:teuthology.nuke:shortname: smithi177 2023-11-25T07:22:54.448 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-25T07:22:54.457 DEBUG:teuthology.orchestra.console.smithi070:power off output: Chassis Power Control: Down/Off 2023-11-25T07:22:54.457 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-25T07:22:54.472 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi157.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-24_21:18:30-rados-main-distro-default-smithi/7466425', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-25 07:03:45.083521', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-25T07:22:54.475 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi177.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-24_21:18:30-rados-main-distro-default-smithi/7466425', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-25 07:03:45.080261', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-25T07:22:54.481 INFO:teuthology.orchestra.console.smithi084:Power off 2023-11-25T07:22:54.481 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-25T07:22:54.495 INFO:teuthology.orchestra.console.smithi138:Power off 2023-11-25T07:22:54.496 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-25T07:22:54.502 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is off 2023-11-25T07:22:54.505 DEBUG:teuthology.orchestra.console.smithi084:power off output: Chassis Power Control: Down/Off 2023-11-25T07:22:54.505 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-25T07:22:54.517 DEBUG:teuthology.orchestra.console.smithi138:power off output: Chassis Power Control: Down/Off 2023-11-25T07:22:54.517 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-25T07:22:54.528 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2023-11-25T07:22:54.540 INFO:teuthology.orchestra.console.smithi157:Power off 2023-11-25T07:22:54.541 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-25T07:22:54.557 INFO:teuthology.orchestra.console.smithi177:Power off 2023-11-25T07:22:54.557 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-25T07:22:54.564 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off 2023-11-25T07:22:54.567 DEBUG:teuthology.orchestra.console.smithi157:power off output: Chassis Power Control: Down/Off 2023-11-25T07:22:54.567 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-25T07:22:54.576 DEBUG:teuthology.orchestra.console.smithi177:power off output: Chassis Power Control: Down/Off 2023-11-25T07:22:54.577 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-25T07:22:54.589 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2023-11-25T07:22:54.597 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off 2023-11-25T07:22:54.603 INFO:teuthology.orchestra.console.smithi070:Power off completed 2023-11-25T07:22:54.629 INFO:teuthology.orchestra.console.smithi084:Power off completed 2023-11-25T07:22:54.665 INFO:teuthology.orchestra.console.smithi138:Power off completed 2023-11-25T07:22:54.689 INFO:teuthology.orchestra.console.smithi157:Power off completed 2023-11-25T07:22:54.698 INFO:teuthology.orchestra.console.smithi177:Power off completed 2023-11-25T07:22:54.758 INFO:teuthology.lock.ops:unlocked: smithi070.front.sepia.ceph.com 2023-11-25T07:22:54.782 INFO:teuthology.lock.ops:unlocked: smithi084.front.sepia.ceph.com 2023-11-25T07:22:54.815 INFO:teuthology.lock.ops:unlocked: smithi138.front.sepia.ceph.com 2023-11-25T07:22:54.840 INFO:teuthology.lock.ops:unlocked: smithi157.front.sepia.ceph.com 2023-11-25T07:22:54.848 INFO:teuthology.lock.ops:unlocked: smithi177.front.sepia.ceph.com