2023-10-16T07:07:11.024 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-16T07:07:11.025 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T07:07:11.231 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f35989eeca0>, signals=[15]) 2023-10-16T07:07:11.232 INFO:teuthology.lock.ops:Start node 'smithi099.front.sepia.ceph.com' reimaging 2023-10-16T07:07:11.233 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: reset os type and version on server 2023-10-16T07:07:11.233 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2023-10-16T07:07:11.260 INFO:teuthology.lock.ops:Start node 'smithi129.front.sepia.ceph.com' reimaging 2023-10-16T07:07:11.261 INFO:teuthology.lock.ops:Updating [smithi129.front.sepia.ceph.com]: reset os type and version on server 2023-10-16T07:07:11.261 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server 2023-10-16T07:07:11.262 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /host {"name": "smithi099"} 2023-10-16T07:07:11.302 INFO:teuthology.lock.ops:Start node 'smithi186.front.sepia.ceph.com' reimaging 2023-10-16T07:07:11.302 INFO:teuthology.lock.ops:Updating [smithi186.front.sepia.ceph.com]: reset os type and version on server 2023-10-16T07:07:11.302 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server 2023-10-16T07:07:11.304 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /host {"name": "smithi129"} 2023-10-16T07:07:11.348 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /host {"name": "smithi186"} 2023-10-16T07:07:11.387 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-10-16T07:07:11.399 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-10-16T07:07:11.443 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-10-16T07:07:11.454 DEBUG:teuthology.provision.fog.smithi099:Requesting image smithi_rhel_8.6 (ID 5) 2023-10-16T07:07:11.454 DEBUG:teuthology.provision.fog.smithi099:FOG request: PUT /host/204 {"imageID": 5} 2023-10-16T07:07:11.465 DEBUG:teuthology.provision.fog.smithi129:Requesting image smithi_rhel_8.6 (ID 5) 2023-10-16T07:07:11.465 DEBUG:teuthology.provision.fog.smithi129:FOG request: PUT /host/234 {"imageID": 5} 2023-10-16T07:07:11.497 DEBUG:teuthology.provision.fog.smithi186:Requesting image smithi_rhel_8.6 (ID 5) 2023-10-16T07:07:11.497 DEBUG:teuthology.provision.fog.smithi186:FOG request: PUT /host/291 {"imageID": 5} 2023-10-16T07:07:11.524 INFO:teuthology.provision.fog.smithi129:Scheduling deploy of rhel 8.6 2023-10-16T07:07:11.524 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-10-16T07:07:11.537 INFO:teuthology.provision.fog.smithi099:Scheduling deploy of rhel 8.6 2023-10-16T07:07:11.537 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-16T07:07:11.551 INFO:teuthology.provision.fog.smithi186:Scheduling deploy of rhel 8.6 2023-10-16T07:07:11.551 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-16T07:07:11.591 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /tasktype {"name": "deploy"} 2023-10-16T07:07:11.604 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /tasktype {"name": "deploy"} 2023-10-16T07:07:11.616 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /tasktype {"name": "deploy"} 2023-10-16T07:07:11.646 DEBUG:teuthology.provision.fog.smithi129:FOG request: POST /host/234/task {"taskTypeID": 1} 2023-10-16T07:07:11.657 DEBUG:teuthology.provision.fog.smithi099:FOG request: POST /host/204/task {"taskTypeID": 1} 2023-10-16T07:07:11.670 DEBUG:teuthology.provision.fog.smithi186:FOG request: POST /host/291/task {"taskTypeID": 1} 2023-10-16T07:07:11.721 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-16T07:07:11.732 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-10-16T07:07:11.754 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-16T07:07:11.844 INFO:teuthology.orchestra.console.smithi129:Power off 2023-10-16T07:07:11.845 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T07:07:11.859 INFO:teuthology.orchestra.console.smithi186:Power off 2023-10-16T07:07:11.859 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T07:07:11.870 INFO:teuthology.orchestra.console.smithi099:Power off 2023-10-16T07:07:11.870 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T07:07:11.895 DEBUG:teuthology.orchestra.console.smithi129:power off output: Chassis Power Control: Down/Off 2023-10-16T07:07:11.895 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T07:07:11.903 DEBUG:teuthology.orchestra.console.smithi186:power off output: Chassis Power Control: Down/Off 2023-10-16T07:07:11.903 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T07:07:11.919 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off 2023-10-16T07:07:11.920 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T07:07:11.944 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on 2023-10-16T07:07:11.949 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2023-10-16T07:07:11.969 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2023-10-16T07:07:15.949 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T07:07:15.956 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T07:07:15.970 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T07:07:16.058 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on 2023-10-16T07:07:16.065 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2023-10-16T07:07:16.079 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2023-10-16T07:07:20.064 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T07:07:20.071 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T07:07:20.080 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T07:07:20.173 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2023-10-16T07:07:20.179 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2023-10-16T07:07:20.189 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2023-10-16T07:07:20.274 INFO:teuthology.orchestra.console.smithi129:Power off completed 2023-10-16T07:07:20.375 INFO:teuthology.orchestra.console.smithi129:Power on 2023-10-16T07:07:20.376 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-16T07:07:20.406 DEBUG:teuthology.orchestra.console.smithi129:power on output: Chassis Power Control: Up/On 2023-10-16T07:07:20.407 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T07:07:20.436 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2023-10-16T07:07:24.182 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T07:07:24.190 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T07:07:24.291 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2023-10-16T07:07:24.298 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2023-10-16T07:07:24.393 INFO:teuthology.orchestra.console.smithi186:Power off completed 2023-10-16T07:07:24.399 INFO:teuthology.orchestra.console.smithi099:Power off completed 2023-10-16T07:07:24.438 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T07:07:24.493 INFO:teuthology.orchestra.console.smithi186:Power on 2023-10-16T07:07:24.494 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-16T07:07:24.503 INFO:teuthology.orchestra.console.smithi099:Power on 2023-10-16T07:07:24.503 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-16T07:07:24.542 DEBUG:teuthology.orchestra.console.smithi186:power on output: Chassis Power Control: Up/On 2023-10-16T07:07:24.542 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T07:07:24.550 DEBUG:teuthology.orchestra.console.smithi099:power on output: Chassis Power Control: Up/On 2023-10-16T07:07:24.550 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T07:07:24.557 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2023-10-16T07:07:24.571 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2023-10-16T07:07:24.578 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2023-10-16T07:07:28.558 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T07:07:28.572 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T07:07:28.579 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T07:07:28.681 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2023-10-16T07:07:28.689 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2023-10-16T07:07:28.755 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on 2023-10-16T07:07:28.791 INFO:teuthology.orchestra.console.smithi099:Power on completed 2023-10-16T07:07:28.856 INFO:teuthology.orchestra.console.smithi129:Power on completed 2023-10-16T07:07:28.892 INFO:teuthology.provision.fog.smithi099:Waiting for deploy to finish 2023-10-16T07:07:28.892 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-16T07:07:28.958 INFO:teuthology.provision.fog.smithi129:Waiting for deploy to finish 2023-10-16T07:07:28.959 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-10-16T07:07:32.687 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T07:07:32.880 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2023-10-16T07:07:32.981 INFO:teuthology.orchestra.console.smithi186:Power on completed 2023-10-16T07:07:33.082 INFO:teuthology.provision.fog.smithi186:Waiting for deploy to finish 2023-10-16T07:07:33.082 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-16T07:07:43.961 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-16T07:07:44.018 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-10-16T07:07:48.152 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-16T07:07:59.047 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-16T07:07:59.093 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-10-16T07:08:03.226 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-16T07:08:14.122 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-16T07:08:14.153 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-10-16T07:08:18.308 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-16T07:08:29.192 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-16T07:08:29.212 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-10-16T07:08:33.376 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-16T07:08:44.276 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-16T07:08:44.278 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-10-16T07:08:48.482 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-16T07:08:59.366 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-10-16T07:08:59.377 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-16T07:09:03.562 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-16T07:09:14.453 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-10-16T07:09:14.455 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-16T07:09:18.630 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-16T07:09:29.538 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-10-16T07:09:29.539 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-16T07:09:33.710 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-16T07:09:44.630 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-16T07:09:44.632 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-10-16T07:09:48.787 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-16T07:09:59.725 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-10-16T07:09:59.726 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-16T07:10:03.858 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-16T07:10:14.814 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-16T07:10:14.816 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-10-16T07:10:14.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:10:14.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:10:18.930 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-16T07:10:18.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:10:33.338 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-10-16T07:10:33.339 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-10-16T07:10:37.434 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-10-16T07:10:39.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:10:39.353 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:10:42.429 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-10-16T07:10:42.462 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-10-16T07:10:43.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:10:46.526 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-10-16T07:10:48.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:10:48.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:10:51.518 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-10-16T07:10:51.550 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-10-16T07:10:52.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:10:55.610 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-10-16T07:10:57.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:10:57.551 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:11:00.602 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-10-16T07:11:00.638 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-10-16T07:11:01.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:11:04.698 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-10-16T07:11:06.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:11:06.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:11:10.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:11:13.790 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-10-16T07:11:19.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:11:25.050 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-10-16T07:11:31.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:11:34.138 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-10-16T07:11:38.362 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-10-16T07:11:40.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:11:41.906 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-16T07:11:41.907 DEBUG:teuthology.orchestra.run.smithi129:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-16T07:11:42.208 INFO:teuthology.provision.fog.smithi129:Node is ready 2023-10-16T07:11:42.209 DEBUG:teuthology.orchestra.run.smithi129:> hostname 2023-10-16T07:11:42.224 INFO:teuthology.orchestra.run.smithi129.stdout:smithi022 2023-10-16T07:11:42.225 DEBUG:teuthology.orchestra.run.smithi129:> grep smithi022 /etc/hosts 2023-10-16T07:11:42.281 INFO:teuthology.orchestra.run.smithi129.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-10-16T07:11:42.281 DEBUG:teuthology.orchestra.run.smithi129:> sudo hostname smithi129 2023-10-16T07:11:42.399 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/smithi022/smithi129/g' /etc/hosts 2023-10-16T07:11:42.427 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/172.21.15.22/172.21.15.129/g' /etc/hosts 2023-10-16T07:11:42.493 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/smithi022/smithi129/g' /etc/hostname 2023-10-16T07:11:42.560 DEBUG:teuthology.orchestra.run.smithi129:> sudo hostname smithi129 2023-10-16T07:11:42.625 DEBUG:teuthology.orchestra.run.smithi129:> cat /etc/os-release 2023-10-16T07:11:42.682 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="Red Hat Enterprise Linux" 2023-10-16T07:11:42.682 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="8.6 (Ootpa)" 2023-10-16T07:11:42.683 INFO:teuthology.orchestra.run.smithi129.stdout:ID="rhel" 2023-10-16T07:11:42.683 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE="fedora" 2023-10-16T07:11:42.683 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="8.6" 2023-10-16T07:11:42.683 INFO:teuthology.orchestra.run.smithi129.stdout:PLATFORM_ID="platform:el8" 2023-10-16T07:11:42.684 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-16T07:11:42.684 INFO:teuthology.orchestra.run.smithi129.stdout:ANSI_COLOR="0;31" 2023-10-16T07:11:42.684 INFO:teuthology.orchestra.run.smithi129.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-16T07:11:42.684 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://www.redhat.com/" 2023-10-16T07:11:42.685 INFO:teuthology.orchestra.run.smithi129.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-16T07:11:42.685 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T07:11:42.685 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-16T07:11:42.685 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-16T07:11:42.685 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-16T07:11:42.686 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-16T07:11:42.686 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-16T07:11:42.687 INFO:teuthology.provision.fog.smithi129:Deploy complete! 2023-10-16T07:11:42.688 DEBUG:teuthology.parallel:result is None 2023-10-16T07:11:44.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:11:47.450 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-10-16T07:11:53.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:11:56.712 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-16T07:11:56.713 DEBUG:teuthology.orchestra.run.smithi186:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-16T07:11:57.115 INFO:teuthology.provision.fog.smithi186:Node is ready 2023-10-16T07:11:57.115 DEBUG:teuthology.orchestra.run.smithi186:> hostname 2023-10-16T07:11:57.131 INFO:teuthology.orchestra.run.smithi186.stdout:smithi022 2023-10-16T07:11:57.132 DEBUG:teuthology.orchestra.run.smithi186:> grep smithi022 /etc/hosts 2023-10-16T07:11:57.189 INFO:teuthology.orchestra.run.smithi186.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-10-16T07:11:57.189 DEBUG:teuthology.orchestra.run.smithi186:> sudo hostname smithi186 2023-10-16T07:11:57.292 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/smithi022/smithi186/g' /etc/hosts 2023-10-16T07:11:57.320 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/172.21.15.22/172.21.15.186/g' /etc/hosts 2023-10-16T07:11:57.386 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/smithi022/smithi186/g' /etc/hostname 2023-10-16T07:11:57.460 DEBUG:teuthology.orchestra.run.smithi186:> sudo hostname smithi186 2023-10-16T07:11:57.560 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release 2023-10-16T07:11:57.581 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="Red Hat Enterprise Linux" 2023-10-16T07:11:57.581 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="8.6 (Ootpa)" 2023-10-16T07:11:57.581 INFO:teuthology.orchestra.run.smithi186.stdout:ID="rhel" 2023-10-16T07:11:57.581 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE="fedora" 2023-10-16T07:11:57.582 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="8.6" 2023-10-16T07:11:57.582 INFO:teuthology.orchestra.run.smithi186.stdout:PLATFORM_ID="platform:el8" 2023-10-16T07:11:57.582 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-16T07:11:57.582 INFO:teuthology.orchestra.run.smithi186.stdout:ANSI_COLOR="0;31" 2023-10-16T07:11:57.582 INFO:teuthology.orchestra.run.smithi186.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-16T07:11:57.583 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://www.redhat.com/" 2023-10-16T07:11:57.583 INFO:teuthology.orchestra.run.smithi186.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-16T07:11:57.583 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T07:11:57.583 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-10-16T07:11:57.583 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-16T07:11:57.584 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-16T07:11:57.584 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-16T07:11:57.584 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-16T07:11:57.584 INFO:teuthology.provision.fog.smithi186:Deploy complete! 2023-10-16T07:11:57.585 DEBUG:teuthology.parallel:result is None 2023-10-16T07:12:06.650 WARNING:teuthology.provision.fog.smithi099:timed out 2023-10-16T07:12:12.653 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:12:13.007 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-16T07:12:13.007 DEBUG:teuthology.orchestra.run.smithi099:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-16T07:12:13.269 INFO:teuthology.provision.fog.smithi099:Node is ready 2023-10-16T07:12:13.269 DEBUG:teuthology.orchestra.run.smithi099:> hostname 2023-10-16T07:12:13.287 INFO:teuthology.orchestra.run.smithi099.stdout:smithi099.front.sepia.ceph.com 2023-10-16T07:12:13.287 DEBUG:teuthology.orchestra.run.smithi099:> grep smithi099.front.sepia.ceph.com /etc/hosts 2023-10-16T07:12:13.345 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99 smithi099.front.sepia.ceph.com smithi099 2023-10-16T07:12:13.346 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099 2023-10-16T07:12:13.468 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hosts 2023-10-16T07:12:13.496 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/172.21.15.99/172.21.15.99/g' /etc/hosts 2023-10-16T07:12:13.563 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hostname 2023-10-16T07:12:13.631 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099 2023-10-16T07:12:13.697 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2023-10-16T07:12:13.754 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="Red Hat Enterprise Linux" 2023-10-16T07:12:13.754 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="8.6 (Ootpa)" 2023-10-16T07:12:13.754 INFO:teuthology.orchestra.run.smithi099.stdout:ID="rhel" 2023-10-16T07:12:13.754 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="fedora" 2023-10-16T07:12:13.755 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="8.6" 2023-10-16T07:12:13.755 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el8" 2023-10-16T07:12:13.755 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-16T07:12:13.755 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2023-10-16T07:12:13.755 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-16T07:12:13.756 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://www.redhat.com/" 2023-10-16T07:12:13.756 INFO:teuthology.orchestra.run.smithi099.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-16T07:12:13.756 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T07:12:13.756 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-10-16T07:12:13.756 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-16T07:12:13.757 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-16T07:12:13.757 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-16T07:12:13.757 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-16T07:12:13.757 INFO:teuthology.provision.fog.smithi099:Deploy complete! 2023-10-16T07:12:13.758 DEBUG:teuthology.parallel:result is None 2023-10-16T07:12:14.187 INFO:teuthology.lock.ops:Checking smithi099.front.sepia.ceph.com 2023-10-16T07:12:14.188 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-16T07:12:14.223 INFO:teuthology.lock.ops:Checking smithi129.front.sepia.ceph.com 2023-10-16T07:12:14.224 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-16T07:12:14.256 INFO:teuthology.lock.ops:Checking smithi186.front.sepia.ceph.com 2023-10-16T07:12:14.257 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-16T07:12:14.291 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: set os type and version on server 2023-10-16T07:12:14.292 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2023-10-16T07:12:14.293 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:12:14.366 DEBUG:teuthology.orchestra.run.smithi099:> true 2023-10-16T07:12:14.390 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2023-10-16T07:12:14.390 DEBUG:teuthology.orchestra.run.smithi099:> uname -m 2023-10-16T07:12:14.447 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64 2023-10-16T07:12:14.447 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2023-10-16T07:12:14.503 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="Red Hat Enterprise Linux" 2023-10-16T07:12:14.504 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="8.6 (Ootpa)" 2023-10-16T07:12:14.504 INFO:teuthology.orchestra.run.smithi099.stdout:ID="rhel" 2023-10-16T07:12:14.504 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="fedora" 2023-10-16T07:12:14.504 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="8.6" 2023-10-16T07:12:14.505 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el8" 2023-10-16T07:12:14.505 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-16T07:12:14.505 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2023-10-16T07:12:14.505 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-16T07:12:14.505 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://www.redhat.com/" 2023-10-16T07:12:14.505 INFO:teuthology.orchestra.run.smithi099.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-16T07:12:14.506 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T07:12:14.506 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-10-16T07:12:14.506 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-16T07:12:14.506 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-16T07:12:14.506 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-16T07:12:14.507 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-16T07:12:14.507 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2023-10-16T07:12:14.540 INFO:teuthology.lock.ops:Updating [smithi129.front.sepia.ceph.com]: set os type and version on server 2023-10-16T07:12:14.540 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2023-10-16T07:12:14.541 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:12:14.615 DEBUG:teuthology.orchestra.run.smithi129:> true 2023-10-16T07:12:14.691 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi129.front.sepia.ceph.com' 2023-10-16T07:12:14.692 DEBUG:teuthology.orchestra.run.smithi129:> uname -m 2023-10-16T07:12:14.752 INFO:teuthology.orchestra.run.smithi129.stdout:x86_64 2023-10-16T07:12:14.752 DEBUG:teuthology.orchestra.run.smithi129:> cat /etc/os-release 2023-10-16T07:12:14.812 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="Red Hat Enterprise Linux" 2023-10-16T07:12:14.812 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="8.6 (Ootpa)" 2023-10-16T07:12:14.812 INFO:teuthology.orchestra.run.smithi129.stdout:ID="rhel" 2023-10-16T07:12:14.813 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE="fedora" 2023-10-16T07:12:14.813 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="8.6" 2023-10-16T07:12:14.813 INFO:teuthology.orchestra.run.smithi129.stdout:PLATFORM_ID="platform:el8" 2023-10-16T07:12:14.813 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-16T07:12:14.814 INFO:teuthology.orchestra.run.smithi129.stdout:ANSI_COLOR="0;31" 2023-10-16T07:12:14.814 INFO:teuthology.orchestra.run.smithi129.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-16T07:12:14.814 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://www.redhat.com/" 2023-10-16T07:12:14.814 INFO:teuthology.orchestra.run.smithi129.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-16T07:12:14.814 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T07:12:14.815 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-16T07:12:14.815 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-16T07:12:14.815 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-16T07:12:14.815 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-16T07:12:14.816 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-16T07:12:14.816 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server 2023-10-16T07:12:14.848 INFO:teuthology.lock.ops:Updating [smithi186.front.sepia.ceph.com]: set os type and version on server 2023-10-16T07:12:14.848 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2023-10-16T07:12:14.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:12:14.924 DEBUG:teuthology.orchestra.run.smithi186:> true 2023-10-16T07:12:15.055 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi186.front.sepia.ceph.com' 2023-10-16T07:12:15.056 DEBUG:teuthology.orchestra.run.smithi186:> uname -m 2023-10-16T07:12:15.112 INFO:teuthology.orchestra.run.smithi186.stdout:x86_64 2023-10-16T07:12:15.112 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release 2023-10-16T07:12:15.169 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="Red Hat Enterprise Linux" 2023-10-16T07:12:15.170 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="8.6 (Ootpa)" 2023-10-16T07:12:15.170 INFO:teuthology.orchestra.run.smithi186.stdout:ID="rhel" 2023-10-16T07:12:15.170 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE="fedora" 2023-10-16T07:12:15.170 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="8.6" 2023-10-16T07:12:15.171 INFO:teuthology.orchestra.run.smithi186.stdout:PLATFORM_ID="platform:el8" 2023-10-16T07:12:15.171 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-16T07:12:15.171 INFO:teuthology.orchestra.run.smithi186.stdout:ANSI_COLOR="0;31" 2023-10-16T07:12:15.171 INFO:teuthology.orchestra.run.smithi186.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-16T07:12:15.171 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://www.redhat.com/" 2023-10-16T07:12:15.172 INFO:teuthology.orchestra.run.smithi186.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-16T07:12:15.172 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T07:12:15.172 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-10-16T07:12:15.172 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-16T07:12:15.172 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-16T07:12:15.172 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-16T07:12:15.173 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-16T07:12:15.173 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server 2023-10-16T07:12:15.206 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T07:12:15.310 INFO:teuthology.dispatcher.supervisor:Running job 7428879 2023-10-16T07:12:15.310 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-10-16_06:54:33-fs-rishabh-2023oct13-testing-default-smithi/7428879 --name rishabh-2023-10-16_06:54:33-fs-rishabh-2023oct13-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/postgres}} -- /home/teuthworker/archive/rishabh-2023-10-16_06:54:33-fs-rishabh-2023oct13-testing-default-smithi/7428879/orig.config.yaml 2023-10-16T07:12:15.313 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-10-16_06:54:33-fs-rishabh-2023oct13-testing-default-smithi/7428879 2023-10-16T07:12:15.314 INFO:teuthology.dispatcher.supervisor:Job PID: 4053590 2023-10-16T07:12:15.314 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-16T07:14:15.316 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T07:16:15.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T07:18:15.484 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T07:20:15.556 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T07:22:15.631 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T07:24:15.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T07:26:15.783 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T07:28:15.860 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T07:30:15.937 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T07:32:16.005 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T07:34:16.078 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T07:36:16.146 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T07:38:16.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T07:38:16.364 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-16T07:38:16.534 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-16T07:38:16.535 INFO:teuthology.nuke:Checking targets against current locks 2023-10-16T07:38:16.623 DEBUG:teuthology.nuke:shortname: smithi099 2023-10-16T07:38:16.623 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-16T07:38:16.653 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-16_06:54:33-fs-rishabh-2023oct13-testing-default-smithi/7428879', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 07:07:10.149443', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-16T07:38:16.655 DEBUG:teuthology.nuke:shortname: smithi129 2023-10-16T07:38:16.655 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-16T07:38:16.694 DEBUG:teuthology.nuke:shortname: smithi186 2023-10-16T07:38:16.694 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-16T07:38:16.706 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi129.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-16_06:54:33-fs-rishabh-2023oct13-testing-default-smithi/7428879', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 07:07:10.150326', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-16T07:38:16.751 INFO:teuthology.orchestra.console.smithi099:Power off 2023-10-16T07:38:16.752 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T07:38:16.762 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi186.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-16_06:54:33-fs-rishabh-2023oct13-testing-default-smithi/7428879', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 07:07:10.147929', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-16T07:38:16.799 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off 2023-10-16T07:38:16.799 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T07:38:16.813 INFO:teuthology.orchestra.console.smithi129:Power off 2023-10-16T07:38:16.813 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T07:38:16.832 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2023-10-16T07:38:16.856 INFO:teuthology.orchestra.console.smithi186:Power off 2023-10-16T07:38:16.857 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T07:38:16.865 DEBUG:teuthology.orchestra.console.smithi129:power off output: Chassis Power Control: Down/Off 2023-10-16T07:38:16.866 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T07:38:16.902 DEBUG:teuthology.orchestra.console.smithi186:power off output: Chassis Power Control: Down/Off 2023-10-16T07:38:16.903 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T07:38:16.912 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2023-10-16T07:38:16.932 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2023-10-16T07:38:16.933 INFO:teuthology.orchestra.console.smithi099:Power off completed 2023-10-16T07:38:17.013 INFO:teuthology.orchestra.console.smithi129:Power off completed 2023-10-16T07:38:17.033 INFO:teuthology.orchestra.console.smithi186:Power off completed 2023-10-16T07:38:17.097 INFO:teuthology.lock.ops:unlocked: smithi099.front.sepia.ceph.com 2023-10-16T07:38:17.198 INFO:teuthology.lock.ops:unlocked: smithi129.front.sepia.ceph.com 2023-10-16T07:38:17.214 INFO:teuthology.lock.ops:unlocked: smithi186.front.sepia.ceph.com