2023-11-16T23:32:09.676 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-16T23:32:09.677 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T23:32:09.905 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fce5272dd30>, signals=[15]) 2023-11-16T23:32:09.905 INFO:teuthology.lock.ops:Start node 'smithi006.front.sepia.ceph.com' reimaging 2023-11-16T23:32:09.906 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: reset os type and version on server 2023-11-16T23:32:09.906 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2023-11-16T23:32:09.930 INFO:teuthology.lock.ops:Start node 'smithi087.front.sepia.ceph.com' reimaging 2023-11-16T23:32:09.930 INFO:teuthology.lock.ops:Updating [smithi087.front.sepia.ceph.com]: reset os type and version on server 2023-11-16T23:32:09.930 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server 2023-11-16T23:32:09.932 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /host {"name": "smithi006"} 2023-11-16T23:32:09.954 INFO:teuthology.lock.ops:Start node 'smithi186.front.sepia.ceph.com' reimaging 2023-11-16T23:32:09.954 INFO:teuthology.lock.ops:Updating [smithi186.front.sepia.ceph.com]: reset os type and version on server 2023-11-16T23:32:09.954 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server 2023-11-16T23:32:09.955 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /host {"name": "smithi087"} 2023-11-16T23:32:09.978 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /host {"name": "smithi186"} 2023-11-16T23:32:10.009 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-11-16T23:32:10.032 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-11-16T23:32:10.043 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-11-16T23:32:10.047 DEBUG:teuthology.provision.fog.smithi006:Requesting image smithi_rhel_8.6 (ID 5) 2023-11-16T23:32:10.047 DEBUG:teuthology.provision.fog.smithi006:FOG request: PUT /host/112 {"imageID": 5} 2023-11-16T23:32:10.083 DEBUG:teuthology.provision.fog.smithi087:Requesting image smithi_rhel_8.6 (ID 5) 2023-11-16T23:32:10.083 DEBUG:teuthology.provision.fog.smithi087:FOG request: PUT /host/192 {"imageID": 5} 2023-11-16T23:32:10.089 DEBUG:teuthology.provision.fog.smithi186:Requesting image smithi_rhel_8.6 (ID 5) 2023-11-16T23:32:10.089 DEBUG:teuthology.provision.fog.smithi186:FOG request: PUT /host/291 {"imageID": 5} 2023-11-16T23:32:10.096 INFO:teuthology.provision.fog.smithi006:Scheduling deploy of rhel 8.6 2023-11-16T23:32:10.096 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-11-16T23:32:10.134 INFO:teuthology.provision.fog.smithi186:Scheduling deploy of rhel 8.6 2023-11-16T23:32:10.134 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-11-16T23:32:10.135 INFO:teuthology.provision.fog.smithi087:Scheduling deploy of rhel 8.6 2023-11-16T23:32:10.135 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-11-16T23:32:10.140 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /tasktype {"name": "deploy"} 2023-11-16T23:32:10.174 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /tasktype {"name": "deploy"} 2023-11-16T23:32:10.181 DEBUG:teuthology.provision.fog.smithi006:FOG request: POST /host/112/task {"taskTypeID": 1} 2023-11-16T23:32:10.182 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /tasktype {"name": "deploy"} 2023-11-16T23:32:10.218 DEBUG:teuthology.provision.fog.smithi087:FOG request: POST /host/192/task {"taskTypeID": 1} 2023-11-16T23:32:10.223 DEBUG:teuthology.provision.fog.smithi186:FOG request: POST /host/291/task {"taskTypeID": 1} 2023-11-16T23:32:10.232 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-11-16T23:32:10.264 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-11-16T23:32:10.272 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-11-16T23:32:10.320 INFO:teuthology.orchestra.console.smithi006:Power off 2023-11-16T23:32:10.320 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-16T23:32:10.385 INFO:teuthology.orchestra.console.smithi186:Power off 2023-11-16T23:32:10.385 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-16T23:32:10.403 INFO:teuthology.orchestra.console.smithi087:Power off 2023-11-16T23:32:10.404 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-16T23:32:10.427 DEBUG:teuthology.orchestra.console.smithi186:power off output: Chassis Power Control: Down/Off 2023-11-16T23:32:10.429 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T23:32:10.440 DEBUG:teuthology.orchestra.console.smithi087:power off output: Chassis Power Control: Down/Off 2023-11-16T23:32:10.441 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T23:32:10.451 DEBUG:teuthology.orchestra.console.smithi006:power off output: Chassis Power Control: Down/Off 2023-11-16T23:32:10.451 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T23:32:10.468 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2023-11-16T23:32:10.474 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is on 2023-11-16T23:32:10.477 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is on 2023-11-16T23:32:14.470 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T23:32:14.487 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T23:32:14.493 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T23:32:14.589 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2023-11-16T23:32:14.595 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is on 2023-11-16T23:32:14.602 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is on 2023-11-16T23:32:18.591 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T23:32:18.600 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T23:32:18.606 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T23:32:18.704 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2023-11-16T23:32:18.708 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is on 2023-11-16T23:32:18.714 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is on 2023-11-16T23:32:22.706 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T23:32:22.713 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T23:32:22.720 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T23:32:22.816 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2023-11-16T23:32:22.822 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is off 2023-11-16T23:32:22.840 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off 2023-11-16T23:32:22.918 INFO:teuthology.orchestra.console.smithi186:Power off completed 2023-11-16T23:32:22.923 INFO:teuthology.orchestra.console.smithi087:Power off completed 2023-11-16T23:32:22.940 INFO:teuthology.orchestra.console.smithi006:Power off completed 2023-11-16T23:32:23.019 INFO:teuthology.orchestra.console.smithi186:Power on 2023-11-16T23:32:23.019 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-16T23:32:23.026 INFO:teuthology.orchestra.console.smithi087:Power on 2023-11-16T23:32:23.026 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-16T23:32:23.041 DEBUG:teuthology.orchestra.console.smithi186:power on output: Chassis Power Control: Up/On 2023-11-16T23:32:23.041 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T23:32:23.056 INFO:teuthology.orchestra.console.smithi006:Power on 2023-11-16T23:32:23.057 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-16T23:32:23.064 DEBUG:teuthology.orchestra.console.smithi087:power on output: Chassis Power Control: Up/On 2023-11-16T23:32:23.064 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T23:32:23.074 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2023-11-16T23:32:23.087 DEBUG:teuthology.orchestra.console.smithi006:power on output: Chassis Power Control: Up/On 2023-11-16T23:32:23.087 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T23:32:23.106 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is off 2023-11-16T23:32:23.133 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off 2023-11-16T23:32:27.078 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T23:32:27.107 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T23:32:27.134 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T23:32:27.187 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2023-11-16T23:32:27.216 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is on 2023-11-16T23:32:27.243 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is on 2023-11-16T23:32:27.317 INFO:teuthology.orchestra.console.smithi087:Power on completed 2023-11-16T23:32:27.344 INFO:teuthology.orchestra.console.smithi006:Power on completed 2023-11-16T23:32:27.418 INFO:teuthology.provision.fog.smithi087:Waiting for deploy to finish 2023-11-16T23:32:27.418 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-11-16T23:32:27.444 INFO:teuthology.provision.fog.smithi006:Waiting for deploy to finish 2023-11-16T23:32:27.444 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-11-16T23:32:31.191 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T23:32:31.301 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2023-11-16T23:32:31.402 INFO:teuthology.orchestra.console.smithi186:Power on completed 2023-11-16T23:32:31.506 INFO:teuthology.provision.fog.smithi186:Waiting for deploy to finish 2023-11-16T23:32:31.517 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-11-16T23:32:42.486 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-11-16T23:32:42.499 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-11-16T23:32:46.578 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-11-16T23:32:57.550 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-11-16T23:32:57.551 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-11-16T23:33:01.639 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-11-16T23:33:12.614 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-11-16T23:33:12.616 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-11-16T23:33:16.699 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-11-16T23:33:27.678 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-11-16T23:33:37.569 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-11-16T23:33:37.574 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-11-16T23:33:52.682 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-11-16T23:33:52.683 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-11-16T23:33:52.684 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-11-16T23:34:07.750 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-11-16T23:34:07.751 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-11-16T23:34:07.752 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-11-16T23:34:22.818 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-11-16T23:34:22.820 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-11-16T23:34:22.820 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-11-16T23:34:37.885 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-11-16T23:34:37.886 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-11-16T23:34:37.887 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-11-16T23:34:52.962 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-11-16T23:34:52.964 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-11-16T23:34:52.965 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-11-16T23:35:08.034 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-11-16T23:35:08.035 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-11-16T23:35:08.036 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-11-16T23:35:08.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T23:35:08.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T23:35:11.162 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2023-11-16T23:35:11.162 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2023-11-16T23:35:17.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T23:35:17.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T23:35:20.218 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2023-11-16T23:35:20.250 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2023-11-16T23:35:23.090 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-11-16T23:35:23.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T23:35:26.204 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-16T23:35:26.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T23:35:26.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T23:35:29.274 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2023-11-16T23:35:29.306 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2023-11-16T23:35:32.206 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T23:35:35.258 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-16T23:35:35.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T23:35:35.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T23:35:38.330 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2023-11-16T23:35:38.362 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2023-11-16T23:35:41.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T23:35:44.314 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-16T23:35:44.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T23:35:44.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T23:35:47.386 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2023-11-16T23:35:47.418 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2023-11-16T23:35:50.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T23:35:53.370 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-16T23:35:53.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T23:35:53.420 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T23:35:56.442 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2023-11-16T23:36:12.965 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T23:36:16.026 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-16T23:36:18.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T23:36:22.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T23:36:37.498 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2023-11-16T23:36:40.570 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-16T23:36:43.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T23:36:43.818 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-16T23:36:43.818 DEBUG:teuthology.orchestra.run.smithi087:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-16T23:36:44.102 INFO:teuthology.provision.fog.smithi087:Node is ready 2023-11-16T23:36:44.103 DEBUG:teuthology.orchestra.run.smithi087:> hostname 2023-11-16T23:36:44.121 INFO:teuthology.orchestra.run.smithi087.stdout:smithi087.front.sepia.ceph.com 2023-11-16T23:36:44.122 DEBUG:teuthology.orchestra.run.smithi087:> grep smithi087.front.sepia.ceph.com /etc/hosts 2023-11-16T23:36:44.177 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87 smithi087.front.sepia.ceph.com smithi087 2023-11-16T23:36:44.178 DEBUG:teuthology.orchestra.run.smithi087:> sudo hostname smithi087 2023-11-16T23:36:44.302 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i -e 's/smithi087.front.sepia.ceph.com/smithi087/g' /etc/hosts 2023-11-16T23:36:44.330 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i -e 's/172.21.15.87/172.21.15.87/g' /etc/hosts 2023-11-16T23:36:44.397 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i -e 's/smithi087.front.sepia.ceph.com/smithi087/g' /etc/hostname 2023-11-16T23:36:44.464 DEBUG:teuthology.orchestra.run.smithi087:> sudo hostname smithi087 2023-11-16T23:36:44.530 DEBUG:teuthology.orchestra.run.smithi087:> cat /etc/os-release 2023-11-16T23:36:44.587 INFO:teuthology.orchestra.run.smithi087.stdout:NAME="Red Hat Enterprise Linux" 2023-11-16T23:36:44.587 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION="8.6 (Ootpa)" 2023-11-16T23:36:44.587 INFO:teuthology.orchestra.run.smithi087.stdout:ID="rhel" 2023-11-16T23:36:44.587 INFO:teuthology.orchestra.run.smithi087.stdout:ID_LIKE="fedora" 2023-11-16T23:36:44.587 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_ID="8.6" 2023-11-16T23:36:44.587 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM_ID="platform:el8" 2023-11-16T23:36:44.587 INFO:teuthology.orchestra.run.smithi087.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-16T23:36:44.587 INFO:teuthology.orchestra.run.smithi087.stdout:ANSI_COLOR="0;31" 2023-11-16T23:36:44.587 INFO:teuthology.orchestra.run.smithi087.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-16T23:36:44.587 INFO:teuthology.orchestra.run.smithi087.stdout:HOME_URL="https://www.redhat.com/" 2023-11-16T23:36:44.588 INFO:teuthology.orchestra.run.smithi087.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-16T23:36:44.588 INFO:teuthology.orchestra.run.smithi087.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-16T23:36:44.588 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-11-16T23:36:44.588 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-16T23:36:44.588 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-16T23:36:44.588 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-16T23:36:44.588 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-16T23:36:44.589 INFO:teuthology.provision.fog.smithi087:Deploy complete! 2023-11-16T23:36:44.590 DEBUG:teuthology.parallel:result is None 2023-11-16T23:36:46.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T23:36:49.626 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-16T23:36:53.426 WARNING:teuthology.provision.fog.smithi006:timed out 2023-11-16T23:36:55.629 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T23:36:58.997 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-16T23:36:58.997 DEBUG:teuthology.orchestra.run.smithi186:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-16T23:36:59.310 INFO:teuthology.provision.fog.smithi186:Node is ready 2023-11-16T23:36:59.310 DEBUG:teuthology.orchestra.run.smithi186:> hostname 2023-11-16T23:36:59.325 INFO:teuthology.orchestra.run.smithi186.stdout:smithi022 2023-11-16T23:36:59.325 DEBUG:teuthology.orchestra.run.smithi186:> grep smithi022 /etc/hosts 2023-11-16T23:36:59.381 INFO:teuthology.orchestra.run.smithi186.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-11-16T23:36:59.381 DEBUG:teuthology.orchestra.run.smithi186:> sudo hostname smithi186 2023-11-16T23:36:59.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T23:36:59.494 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/smithi022/smithi186/g' /etc/hosts 2023-11-16T23:36:59.520 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/172.21.15.22/172.21.15.186/g' /etc/hosts 2023-11-16T23:36:59.591 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/smithi022/smithi186/g' /etc/hostname 2023-11-16T23:36:59.862 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-16T23:36:59.862 DEBUG:teuthology.orchestra.run.smithi006:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-16T23:36:59.939 DEBUG:teuthology.orchestra.run.smithi186:> sudo hostname smithi186 2023-11-16T23:37:00.006 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release 2023-11-16T23:37:00.063 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="Red Hat Enterprise Linux" 2023-11-16T23:37:00.063 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="8.6 (Ootpa)" 2023-11-16T23:37:00.063 INFO:teuthology.orchestra.run.smithi186.stdout:ID="rhel" 2023-11-16T23:37:00.063 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE="fedora" 2023-11-16T23:37:00.063 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="8.6" 2023-11-16T23:37:00.063 INFO:teuthology.orchestra.run.smithi186.stdout:PLATFORM_ID="platform:el8" 2023-11-16T23:37:00.063 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-16T23:37:00.063 INFO:teuthology.orchestra.run.smithi186.stdout:ANSI_COLOR="0;31" 2023-11-16T23:37:00.063 INFO:teuthology.orchestra.run.smithi186.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-16T23:37:00.064 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://www.redhat.com/" 2023-11-16T23:37:00.064 INFO:teuthology.orchestra.run.smithi186.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-16T23:37:00.064 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-16T23:37:00.064 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-16T23:37:00.064 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-16T23:37:00.064 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-16T23:37:00.064 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-16T23:37:00.064 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-16T23:37:00.064 INFO:teuthology.provision.fog.smithi186:Deploy complete! 2023-11-16T23:37:00.065 DEBUG:teuthology.parallel:result is None 2023-11-16T23:37:00.108 INFO:teuthology.provision.fog.smithi006:Node is ready 2023-11-16T23:37:00.109 DEBUG:teuthology.orchestra.run.smithi006:> hostname 2023-11-16T23:37:00.127 INFO:teuthology.orchestra.run.smithi006.stdout:smithi006.front.sepia.ceph.com 2023-11-16T23:37:00.127 DEBUG:teuthology.orchestra.run.smithi006:> grep smithi006.front.sepia.ceph.com /etc/hosts 2023-11-16T23:37:00.186 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6 smithi006.front.sepia.ceph.com smithi006 2023-11-16T23:37:00.939 DEBUG:teuthology.orchestra.run.smithi006:> sudo hostname smithi006 2023-11-16T23:37:01.109 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/smithi006.front.sepia.ceph.com/smithi006/g' /etc/hosts 2023-11-16T23:37:01.169 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/172.21.15.6/172.21.15.6/g' /etc/hosts 2023-11-16T23:37:01.240 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/smithi006.front.sepia.ceph.com/smithi006/g' /etc/hostname 2023-11-16T23:37:01.310 DEBUG:teuthology.orchestra.run.smithi006:> sudo hostname smithi006 2023-11-16T23:37:01.380 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2023-11-16T23:37:01.438 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="Red Hat Enterprise Linux" 2023-11-16T23:37:01.438 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="8.6 (Ootpa)" 2023-11-16T23:37:01.439 INFO:teuthology.orchestra.run.smithi006.stdout:ID="rhel" 2023-11-16T23:37:01.439 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="fedora" 2023-11-16T23:37:01.439 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="8.6" 2023-11-16T23:37:01.439 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el8" 2023-11-16T23:37:01.439 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-16T23:37:01.439 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31" 2023-11-16T23:37:01.439 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-16T23:37:01.439 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://www.redhat.com/" 2023-11-16T23:37:01.439 INFO:teuthology.orchestra.run.smithi006.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-16T23:37:01.439 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-16T23:37:01.439 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-16T23:37:01.439 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-16T23:37:01.439 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-16T23:37:01.440 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-16T23:37:01.440 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-16T23:37:01.440 INFO:teuthology.provision.fog.smithi006:Deploy complete! 2023-11-16T23:37:01.440 DEBUG:teuthology.parallel:result is None 2023-11-16T23:37:01.688 INFO:teuthology.lock.ops:Checking smithi006.front.sepia.ceph.com 2023-11-16T23:37:01.689 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-16T23:37:01.716 INFO:teuthology.lock.ops:Checking smithi087.front.sepia.ceph.com 2023-11-16T23:37:01.716 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-16T23:37:01.732 INFO:teuthology.lock.ops:Checking smithi186.front.sepia.ceph.com 2023-11-16T23:37:01.732 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-16T23:37:01.750 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: set os type and version on server 2023-11-16T23:37:01.751 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-11-16T23:37:01.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T23:37:01.817 DEBUG:teuthology.orchestra.run.smithi006:> true 2023-11-16T23:37:01.889 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-11-16T23:37:01.889 DEBUG:teuthology.orchestra.run.smithi006:> uname -m 2023-11-16T23:37:01.947 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64 2023-11-16T23:37:01.947 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2023-11-16T23:37:02.005 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="Red Hat Enterprise Linux" 2023-11-16T23:37:02.005 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="8.6 (Ootpa)" 2023-11-16T23:37:02.005 INFO:teuthology.orchestra.run.smithi006.stdout:ID="rhel" 2023-11-16T23:37:02.006 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="fedora" 2023-11-16T23:37:02.006 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="8.6" 2023-11-16T23:37:02.006 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el8" 2023-11-16T23:37:02.006 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-16T23:37:02.006 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31" 2023-11-16T23:37:02.006 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-16T23:37:02.006 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://www.redhat.com/" 2023-11-16T23:37:02.006 INFO:teuthology.orchestra.run.smithi006.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-16T23:37:02.006 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-16T23:37:02.007 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-16T23:37:02.007 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-16T23:37:02.007 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-16T23:37:02.007 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-16T23:37:02.007 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-16T23:37:02.007 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2023-11-16T23:37:02.042 INFO:teuthology.lock.ops:Updating [smithi087.front.sepia.ceph.com]: set os type and version on server 2023-11-16T23:37:02.042 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2023-11-16T23:37:02.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T23:37:02.109 DEBUG:teuthology.orchestra.run.smithi087:> true 2023-11-16T23:37:02.243 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi087.front.sepia.ceph.com' 2023-11-16T23:37:02.243 DEBUG:teuthology.orchestra.run.smithi087:> uname -m 2023-11-16T23:37:02.300 INFO:teuthology.orchestra.run.smithi087.stdout:x86_64 2023-11-16T23:37:02.300 DEBUG:teuthology.orchestra.run.smithi087:> cat /etc/os-release 2023-11-16T23:37:02.357 INFO:teuthology.orchestra.run.smithi087.stdout:NAME="Red Hat Enterprise Linux" 2023-11-16T23:37:02.357 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION="8.6 (Ootpa)" 2023-11-16T23:37:02.357 INFO:teuthology.orchestra.run.smithi087.stdout:ID="rhel" 2023-11-16T23:37:02.357 INFO:teuthology.orchestra.run.smithi087.stdout:ID_LIKE="fedora" 2023-11-16T23:37:02.357 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_ID="8.6" 2023-11-16T23:37:02.357 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM_ID="platform:el8" 2023-11-16T23:37:02.357 INFO:teuthology.orchestra.run.smithi087.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-16T23:37:02.358 INFO:teuthology.orchestra.run.smithi087.stdout:ANSI_COLOR="0;31" 2023-11-16T23:37:02.358 INFO:teuthology.orchestra.run.smithi087.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-16T23:37:02.358 INFO:teuthology.orchestra.run.smithi087.stdout:HOME_URL="https://www.redhat.com/" 2023-11-16T23:37:02.358 INFO:teuthology.orchestra.run.smithi087.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-16T23:37:02.358 INFO:teuthology.orchestra.run.smithi087.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-16T23:37:02.358 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-11-16T23:37:02.358 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-16T23:37:02.358 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-16T23:37:02.358 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-16T23:37:02.358 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-16T23:37:02.359 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server 2023-11-16T23:37:02.384 INFO:teuthology.lock.ops:Updating [smithi186.front.sepia.ceph.com]: set os type and version on server 2023-11-16T23:37:02.384 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2023-11-16T23:37:02.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T23:37:02.449 DEBUG:teuthology.orchestra.run.smithi186:> true 2023-11-16T23:37:02.515 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi186.front.sepia.ceph.com' 2023-11-16T23:37:02.515 DEBUG:teuthology.orchestra.run.smithi186:> uname -m 2023-11-16T23:37:02.572 INFO:teuthology.orchestra.run.smithi186.stdout:x86_64 2023-11-16T23:37:02.572 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release 2023-11-16T23:37:02.629 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="Red Hat Enterprise Linux" 2023-11-16T23:37:02.629 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="8.6 (Ootpa)" 2023-11-16T23:37:02.629 INFO:teuthology.orchestra.run.smithi186.stdout:ID="rhel" 2023-11-16T23:37:02.629 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE="fedora" 2023-11-16T23:37:02.629 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="8.6" 2023-11-16T23:37:02.629 INFO:teuthology.orchestra.run.smithi186.stdout:PLATFORM_ID="platform:el8" 2023-11-16T23:37:02.629 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-16T23:37:02.629 INFO:teuthology.orchestra.run.smithi186.stdout:ANSI_COLOR="0;31" 2023-11-16T23:37:02.630 INFO:teuthology.orchestra.run.smithi186.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-16T23:37:02.630 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://www.redhat.com/" 2023-11-16T23:37:02.630 INFO:teuthology.orchestra.run.smithi186.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-16T23:37:02.630 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-16T23:37:02.630 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-16T23:37:02.630 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-16T23:37:02.630 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-16T23:37:02.630 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-16T23:37:02.630 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-16T23:37:02.631 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server 2023-11-16T23:37:02.650 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T23:37:02.746 INFO:teuthology.dispatcher.supervisor:Running job 7461180 2023-11-16T23:37:02.746 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_choffman@teuthology --archive /home/teuthworker/archive/choffman-2023-11-16_21:22:00-fs-wip-choffman-62793-distro-default-smithi/7461180 --name choffman-2023-11-16_21:22:00-fs-wip-choffman-62793-distro-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/fs/misc}} -- /home/teuthworker/archive/choffman-2023-11-16_21:22:00-fs-wip-choffman-62793-distro-default-smithi/7461180/orig.config.yaml 2023-11-16T23:37:02.750 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/choffman-2023-11-16_21:22:00-fs-wip-choffman-62793-distro-default-smithi/7461180 2023-11-16T23:37:02.750 INFO:teuthology.dispatcher.supervisor:Job PID: 2963737 2023-11-16T23:37:02.750 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-16T23:39:02.850 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T23:41:03.102 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T23:43:04.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T23:45:04.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T23:47:04.614 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T23:49:04.783 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T23:51:04.958 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T23:53:05.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T23:55:05.380 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T23:57:05.552 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T23:59:08.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-17T00:01:10.323 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-17T00:03:10.524 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-17T00:05:10.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-17T00:07:10.881 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-17T00:09:11.048 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-17T00:11:11.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-17T00:13:11.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-17T00:15:11.565 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-17T00:17:11.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-17T00:19:11.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-17T00:21:12.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-17T00:23:12.243 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-17T00:25:12.416 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-17T00:27:12.558 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-17T00:29:12.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-17T00:31:12.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-17T00:31:12.984 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-11-17T00:31:13.200 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-17T00:31:13.201 INFO:teuthology.nuke:Checking targets against current locks 2023-11-17T00:31:13.259 DEBUG:teuthology.nuke:shortname: smithi006 2023-11-17T00:31:13.259 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-17T00:31:13.288 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi006.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-11-16_21:22:00-fs-wip-choffman-62793-distro-default-smithi/7461180', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-16 23:32:08.707568', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-17T00:31:13.289 DEBUG:teuthology.nuke:shortname: smithi087 2023-11-17T00:31:13.289 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-17T00:31:13.312 DEBUG:teuthology.nuke:shortname: smithi186 2023-11-17T00:31:13.312 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-17T00:31:13.315 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi087.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-11-16_21:22:00-fs-wip-choffman-62793-distro-default-smithi/7461180', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-16 23:32:08.711857', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-17T00:31:13.337 INFO:teuthology.orchestra.console.smithi006:Power off 2023-11-17T00:31:13.338 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-17T00:31:13.350 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi186.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-11-16_21:22:00-fs-wip-choffman-62793-distro-default-smithi/7461180', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-16 23:32:08.710219', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-17T00:31:13.382 INFO:teuthology.orchestra.console.smithi087:Power off 2023-11-17T00:31:13.383 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-17T00:31:13.404 DEBUG:teuthology.orchestra.console.smithi087:power off output: Chassis Power Control: Down/Off 2023-11-17T00:31:13.404 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-17T00:31:13.421 INFO:teuthology.orchestra.console.smithi186:Power off 2023-11-17T00:31:13.421 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-17T00:31:13.434 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is off 2023-11-17T00:31:13.443 DEBUG:teuthology.orchestra.console.smithi186:power off output: Chassis Power Control: Down/Off 2023-11-17T00:31:13.444 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-17T00:31:13.467 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2023-11-17T00:31:13.536 INFO:teuthology.orchestra.console.smithi087:Power off completed 2023-11-17T00:31:13.568 INFO:teuthology.orchestra.console.smithi186:Power off completed 2023-11-17T00:31:13.691 INFO:teuthology.lock.ops:unlocked: smithi087.front.sepia.ceph.com 2023-11-17T00:31:13.716 INFO:teuthology.lock.ops:unlocked: smithi186.front.sepia.ceph.com 2023-11-17T00:31:33.416 DEBUG:teuthology.orchestra.console.smithi006:power off output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-11-17T00:31:34.814 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-17T00:31:44.880 DEBUG:teuthology.orchestra.console.smithi006:power off output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-11-17T00:31:44.880 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-17T00:31:44.990 DEBUG:teuthology.orchestra.console.smithi006:power off output: Chassis Power Control: Down/Off 2023-11-17T00:31:44.991 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-17T00:31:45.037 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off 2023-11-17T00:31:45.138 INFO:teuthology.orchestra.console.smithi006:Power off completed 2023-11-17T00:31:45.295 INFO:teuthology.lock.ops:unlocked: smithi006.front.sepia.ceph.com