2023-09-06T05:25:56.009 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-06T05:25:56.010 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-06T05:25:56.225 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe575e4a670>, signals=[15]) 2023-09-06T05:25:56.227 INFO:teuthology.lock.ops:Start node 'smithi105.front.sepia.ceph.com' reimaging 2023-09-06T05:25:56.228 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: reset os type and version on server 2023-09-06T05:25:56.228 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2023-09-06T05:25:56.257 INFO:teuthology.lock.ops:Start node 'smithi111.front.sepia.ceph.com' reimaging 2023-09-06T05:25:56.258 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: reset os type and version on server 2023-09-06T05:25:56.258 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server 2023-09-06T05:25:56.260 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /host {"name": "smithi105"} 2023-09-06T05:25:56.282 INFO:teuthology.lock.ops:Start node 'smithi141.front.sepia.ceph.com' reimaging 2023-09-06T05:25:56.283 INFO:teuthology.lock.ops:Updating [smithi141.front.sepia.ceph.com]: reset os type and version on server 2023-09-06T05:25:56.283 INFO:teuthology.lock.ops:Updating smithi141.front.sepia.ceph.com on lock server 2023-09-06T05:25:56.284 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /host {"name": "smithi111"} 2023-09-06T05:25:56.307 INFO:teuthology.lock.ops:Start node 'smithi144.front.sepia.ceph.com' reimaging 2023-09-06T05:25:56.307 INFO:teuthology.lock.ops:Updating [smithi144.front.sepia.ceph.com]: reset os type and version on server 2023-09-06T05:25:56.308 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server 2023-09-06T05:25:56.309 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /host {"name": "smithi141"} 2023-09-06T05:25:56.332 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /host {"name": "smithi144"} 2023-09-06T05:25:56.338 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-09-06T05:25:56.363 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-09-06T05:25:56.373 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-09-06T05:25:56.392 DEBUG:teuthology.provision.fog.smithi105:Requesting image smithi_centos_9.stream (ID 10) 2023-09-06T05:25:56.393 DEBUG:teuthology.provision.fog.smithi105:FOG request: PUT /host/210 {"imageID": 10} 2023-09-06T05:25:56.403 DEBUG:teuthology.provision.fog.smithi111:Requesting image smithi_centos_9.stream (ID 10) 2023-09-06T05:25:56.404 DEBUG:teuthology.provision.fog.smithi111:FOG request: PUT /host/216 {"imageID": 10} 2023-09-06T05:25:56.406 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-09-06T05:25:56.421 DEBUG:teuthology.provision.fog.smithi141:Requesting image smithi_centos_9.stream (ID 10) 2023-09-06T05:25:56.421 DEBUG:teuthology.provision.fog.smithi141:FOG request: PUT /host/246 {"imageID": 10} 2023-09-06T05:25:56.440 DEBUG:teuthology.provision.fog.smithi144:Requesting image smithi_centos_9.stream (ID 10) 2023-09-06T05:25:56.440 DEBUG:teuthology.provision.fog.smithi144:FOG request: PUT /host/249 {"imageID": 10} 2023-09-06T05:25:56.448 INFO:teuthology.provision.fog.smithi105:Scheduling deploy of centos 9.stream 2023-09-06T05:25:56.448 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-09-06T05:25:56.453 INFO:teuthology.provision.fog.smithi111:Scheduling deploy of centos 9.stream 2023-09-06T05:25:56.453 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-09-06T05:25:56.468 INFO:teuthology.provision.fog.smithi141:Scheduling deploy of centos 9.stream 2023-09-06T05:25:56.469 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-09-06T05:25:56.480 INFO:teuthology.provision.fog.smithi144:Scheduling deploy of centos 9.stream 2023-09-06T05:25:56.481 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-09-06T05:25:56.497 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /tasktype {"name": "deploy"} 2023-09-06T05:25:56.499 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /tasktype {"name": "deploy"} 2023-09-06T05:25:56.523 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /tasktype {"name": "deploy"} 2023-09-06T05:25:56.526 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /tasktype {"name": "deploy"} 2023-09-06T05:25:56.538 DEBUG:teuthology.provision.fog.smithi105:FOG request: POST /host/210/task {"taskTypeID": 1} 2023-09-06T05:25:56.545 DEBUG:teuthology.provision.fog.smithi111:FOG request: POST /host/216/task {"taskTypeID": 1} 2023-09-06T05:25:56.568 DEBUG:teuthology.provision.fog.smithi144:FOG request: POST /host/249/task {"taskTypeID": 1} 2023-09-06T05:25:56.571 DEBUG:teuthology.provision.fog.smithi141:FOG request: POST /host/246/task {"taskTypeID": 1} 2023-09-06T05:25:56.589 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-09-06T05:25:56.594 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-09-06T05:25:56.618 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-09-06T05:25:56.624 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-09-06T05:25:56.677 INFO:teuthology.orchestra.console.smithi105:Power off 2023-09-06T05:25:56.678 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-06T05:25:56.692 INFO:teuthology.orchestra.console.smithi144:Power off 2023-09-06T05:25:56.693 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-06T05:25:56.704 INFO:teuthology.orchestra.console.smithi111:Power off 2023-09-06T05:25:56.705 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-06T05:25:56.718 INFO:teuthology.orchestra.console.smithi141:Power off 2023-09-06T05:25:56.719 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-06T05:25:56.726 DEBUG:teuthology.orchestra.console.smithi144:power off output: Chassis Power Control: Down/Off 2023-09-06T05:25:56.728 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-06T05:25:56.735 DEBUG:teuthology.orchestra.console.smithi105:power off output: Chassis Power Control: Down/Off 2023-09-06T05:25:56.735 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-06T05:25:56.742 DEBUG:teuthology.orchestra.console.smithi111:power off output: Chassis Power Control: Down/Off 2023-09-06T05:25:56.742 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-06T05:25:56.749 DEBUG:teuthology.orchestra.console.smithi141:power off output: Chassis Power Control: Down/Off 2023-09-06T05:25:56.750 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-06T05:25:56.756 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is on 2023-09-06T05:25:56.757 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2023-09-06T05:25:56.763 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2023-09-06T05:25:56.770 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on 2023-09-06T05:26:00.758 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-06T05:26:00.765 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-06T05:26:00.772 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-06T05:26:00.778 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-06T05:26:00.867 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is on 2023-09-06T05:26:00.874 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2023-09-06T05:26:00.880 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2023-09-06T05:26:00.886 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on 2023-09-06T05:26:04.870 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-06T05:26:04.877 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-06T05:26:04.884 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-06T05:26:04.892 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-06T05:26:04.979 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is off 2023-09-06T05:26:04.986 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2023-09-06T05:26:04.994 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2023-09-06T05:26:05.001 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on 2023-09-06T05:26:05.081 INFO:teuthology.orchestra.console.smithi144:Power off completed 2023-09-06T05:26:05.087 INFO:teuthology.orchestra.console.smithi105:Power off completed 2023-09-06T05:26:05.183 INFO:teuthology.orchestra.console.smithi144:Power on 2023-09-06T05:26:05.183 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-06T05:26:05.191 INFO:teuthology.orchestra.console.smithi105:Power on 2023-09-06T05:26:05.191 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-06T05:26:05.202 DEBUG:teuthology.orchestra.console.smithi144:power on output: Chassis Power Control: Up/On 2023-09-06T05:26:05.203 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-06T05:26:05.211 DEBUG:teuthology.orchestra.console.smithi105:power on output: Chassis Power Control: Up/On 2023-09-06T05:26:05.211 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-06T05:26:05.225 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is off 2023-09-06T05:26:05.232 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2023-09-06T05:26:08.998 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-06T05:26:09.004 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-06T05:26:09.107 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off 2023-09-06T05:26:09.113 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off 2023-09-06T05:26:09.208 INFO:teuthology.orchestra.console.smithi111:Power off completed 2023-09-06T05:26:09.214 INFO:teuthology.orchestra.console.smithi141:Power off completed 2023-09-06T05:26:09.226 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-06T05:26:09.234 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-06T05:26:09.310 INFO:teuthology.orchestra.console.smithi111:Power on 2023-09-06T05:26:09.310 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-06T05:26:09.318 INFO:teuthology.orchestra.console.smithi141:Power on 2023-09-06T05:26:09.318 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-06T05:26:09.331 DEBUG:teuthology.orchestra.console.smithi111:power on output: Chassis Power Control: Up/On 2023-09-06T05:26:09.332 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-06T05:26:09.339 DEBUG:teuthology.orchestra.console.smithi141:power on output: Chassis Power Control: Up/On 2023-09-06T05:26:09.339 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-06T05:26:09.346 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is off 2023-09-06T05:26:09.349 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2023-09-06T05:26:09.353 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off 2023-09-06T05:26:09.362 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off 2023-09-06T05:26:09.449 INFO:teuthology.orchestra.console.smithi105:Power on completed 2023-09-06T05:26:09.550 INFO:teuthology.provision.fog.smithi105:Waiting for deploy to finish 2023-09-06T05:26:09.551 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-09-06T05:26:13.350 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-06T05:26:13.356 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-06T05:26:13.363 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-06T05:26:13.464 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off 2023-09-06T05:26:13.471 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off 2023-09-06T05:26:13.574 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is on 2023-09-06T05:26:13.675 INFO:teuthology.orchestra.console.smithi144:Power on completed 2023-09-06T05:26:13.776 INFO:teuthology.provision.fog.smithi144:Waiting for deploy to finish 2023-09-06T05:26:13.776 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-09-06T05:26:17.470 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-06T05:26:17.477 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-06T05:26:17.579 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2023-09-06T05:26:17.587 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on 2023-09-06T05:26:17.681 INFO:teuthology.orchestra.console.smithi111:Power on completed 2023-09-06T05:26:17.688 INFO:teuthology.orchestra.console.smithi141:Power on completed 2023-09-06T05:26:17.782 INFO:teuthology.provision.fog.smithi111:Waiting for deploy to finish 2023-09-06T05:26:17.783 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-09-06T05:26:17.789 INFO:teuthology.provision.fog.smithi141:Waiting for deploy to finish 2023-09-06T05:26:17.790 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-09-06T05:26:24.626 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-09-06T05:26:28.834 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-09-06T05:26:32.838 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-09-06T05:26:32.841 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-09-06T05:26:39.682 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-09-06T05:26:43.890 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-09-06T05:26:47.910 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-09-06T05:26:47.918 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-09-06T05:26:54.746 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-09-06T05:26:58.950 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-09-06T05:27:02.966 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-09-06T05:27:02.970 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-09-06T05:27:09.802 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-09-06T05:27:14.006 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-09-06T05:27:18.030 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-09-06T05:27:18.031 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-09-06T05:27:24.858 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-09-06T05:27:29.066 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-09-06T05:27:33.086 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-09-06T05:27:33.089 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-09-06T05:27:39.924 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-09-06T05:27:44.138 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-09-06T05:27:48.150 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-09-06T05:27:48.151 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-09-06T05:27:54.986 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-09-06T05:27:59.202 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-09-06T05:28:03.210 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-09-06T05:28:03.211 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-09-06T05:28:10.051 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-09-06T05:28:14.266 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-09-06T05:28:18.274 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-09-06T05:28:18.285 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-09-06T05:28:25.126 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-09-06T05:28:29.334 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-09-06T05:28:33.334 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-09-06T05:28:33.350 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-09-06T05:28:40.194 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-09-06T05:28:44.398 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-09-06T05:28:44.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T05:28:47.518 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-09-06T05:28:48.396 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-09-06T05:28:48.412 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-09-06T05:28:53.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T05:28:55.254 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-09-06T05:28:55.313 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T05:28:56.602 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-09-06T05:28:58.394 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-09-06T05:29:02.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T05:29:03.451 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-09-06T05:29:03.465 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-09-06T05:29:03.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T05:29:03.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T05:29:04.397 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T05:29:05.694 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-09-06T05:29:06.586 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-09-06T05:29:06.587 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-09-06T05:29:07.450 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-09-06T05:29:11.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T05:29:12.589 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T05:29:12.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T05:29:13.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T05:29:14.782 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-09-06T05:29:15.646 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-09-06T05:29:15.647 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-09-06T05:29:16.506 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-09-06T05:29:20.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T05:29:21.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T05:29:21.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T05:29:22.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T05:29:23.870 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-09-06T05:29:24.734 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-09-06T05:29:24.734 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-09-06T05:29:25.566 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-09-06T05:29:29.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T05:29:30.737 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T05:29:30.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T05:29:31.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T05:29:32.955 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-09-06T05:29:33.818 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-09-06T05:29:33.818 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-09-06T05:29:34.654 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-09-06T05:29:38.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T05:29:39.820 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T05:29:39.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T05:29:40.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T05:29:42.014 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-09-06T05:29:42.878 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-09-06T05:29:42.878 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-09-06T05:29:43.742 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-09-06T05:29:48.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T05:29:48.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T05:29:48.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T05:29:49.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T05:29:51.966 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-09-06T05:29:51.967 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-09-06T05:29:57.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T05:29:57.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T05:30:01.054 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-09-06T05:30:07.059 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T05:30:08.154 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-09-06T05:30:10.138 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-09-06T05:30:14.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T05:30:16.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T05:30:17.210 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-09-06T05:30:23.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T05:30:26.303 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-09-06T05:30:32.306 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T05:30:35.229 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-06T05:30:35.230 DEBUG:teuthology.orchestra.run.smithi141:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-06T05:30:48.021 WARNING:teuthology.provision.fog.smithi144:timed out 2023-09-06T05:30:49.747 WARNING:teuthology.provision.fog.smithi105:timed out 2023-09-06T05:30:54.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T05:30:54.326 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-06T05:30:54.327 DEBUG:teuthology.orchestra.run.smithi144:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-06T05:30:54.642 INFO:teuthology.provision.fog.smithi144:Node is ready 2023-09-06T05:30:54.642 DEBUG:teuthology.orchestra.run.smithi144:> hostname 2023-09-06T05:30:54.658 INFO:teuthology.orchestra.run.smithi144.stdout:smithi144.front.sepia.ceph.com 2023-09-06T05:30:54.658 DEBUG:teuthology.orchestra.run.smithi144:> grep smithi144.front.sepia.ceph.com /etc/hosts 2023-09-06T05:30:54.713 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.15.144 smithi144.front.sepia.ceph.com smithi144 2023-09-06T05:30:54.714 DEBUG:teuthology.orchestra.run.smithi144:> sudo hostname smithi144 2023-09-06T05:30:54.819 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i -e 's/smithi144.front.sepia.ceph.com/smithi144/g' /etc/hosts 2023-09-06T05:30:54.848 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i -e 's/172.21.15.144/172.21.15.144/g' /etc/hosts 2023-09-06T05:30:54.917 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i -e 's/smithi144.front.sepia.ceph.com/smithi144/g' /etc/hostname 2023-09-06T05:30:54.987 DEBUG:teuthology.orchestra.run.smithi144:> sudo hostname smithi144 2023-09-06T05:30:55.053 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release 2023-09-06T05:30:55.107 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="CentOS Stream" 2023-09-06T05:30:55.108 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="9" 2023-09-06T05:30:55.108 INFO:teuthology.orchestra.run.smithi144.stdout:ID="centos" 2023-09-06T05:30:55.108 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE="rhel fedora" 2023-09-06T05:30:55.108 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="9" 2023-09-06T05:30:55.109 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM_ID="platform:el9" 2023-09-06T05:30:55.109 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="CentOS Stream 9" 2023-09-06T05:30:55.109 INFO:teuthology.orchestra.run.smithi144.stdout:ANSI_COLOR="0;31" 2023-09-06T05:30:55.109 INFO:teuthology.orchestra.run.smithi144.stdout:LOGO="fedora-logo-icon" 2023-09-06T05:30:55.109 INFO:teuthology.orchestra.run.smithi144.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-09-06T05:30:55.110 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://centos.org/" 2023-09-06T05:30:55.110 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-06T05:30:55.110 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-09-06T05:30:55.110 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-06T05:30:55.111 INFO:teuthology.provision.fog.smithi144:Deploy complete! 2023-09-06T05:30:55.112 DEBUG:teuthology.parallel:result is None 2023-09-06T05:30:55.588 INFO:teuthology.provision.fog.smithi141:Node is ready 2023-09-06T05:30:55.588 DEBUG:teuthology.orchestra.run.smithi141:> hostname 2023-09-06T05:30:55.608 INFO:teuthology.orchestra.run.smithi141.stdout:smithi046 2023-09-06T05:30:55.608 DEBUG:teuthology.orchestra.run.smithi141:> grep smithi046 /etc/hosts 2023-09-06T05:30:55.665 INFO:teuthology.orchestra.run.smithi141.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2023-09-06T05:30:55.665 DEBUG:teuthology.orchestra.run.smithi141:> sudo hostname smithi141 2023-09-06T05:30:55.748 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T05:30:55.815 DEBUG:teuthology.orchestra.run.smithi141:> sudo sed -i -e 's/smithi046/smithi141/g' /etc/hosts 2023-09-06T05:30:55.848 DEBUG:teuthology.orchestra.run.smithi141:> sudo sed -i -e 's/172.21.15.46/172.21.15.141/g' /etc/hosts 2023-09-06T05:30:55.918 DEBUG:teuthology.orchestra.run.smithi141:> sudo sed -i -e 's/smithi046/smithi141/g' /etc/hostname 2023-09-06T05:30:55.949 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-06T05:30:55.949 DEBUG:teuthology.orchestra.run.smithi105:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-06T05:30:56.010 DEBUG:teuthology.orchestra.run.smithi141:> sudo hostname smithi141 2023-09-06T05:30:56.077 DEBUG:teuthology.orchestra.run.smithi141:> cat /etc/os-release 2023-09-06T05:30:56.132 INFO:teuthology.orchestra.run.smithi141.stdout:NAME="CentOS Stream" 2023-09-06T05:30:56.133 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION="9" 2023-09-06T05:30:56.133 INFO:teuthology.orchestra.run.smithi141.stdout:ID="centos" 2023-09-06T05:30:56.133 INFO:teuthology.orchestra.run.smithi141.stdout:ID_LIKE="rhel fedora" 2023-09-06T05:30:56.133 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_ID="9" 2023-09-06T05:30:56.134 INFO:teuthology.orchestra.run.smithi141.stdout:PLATFORM_ID="platform:el9" 2023-09-06T05:30:56.134 INFO:teuthology.orchestra.run.smithi141.stdout:PRETTY_NAME="CentOS Stream 9" 2023-09-06T05:30:56.134 INFO:teuthology.orchestra.run.smithi141.stdout:ANSI_COLOR="0;31" 2023-09-06T05:30:56.134 INFO:teuthology.orchestra.run.smithi141.stdout:LOGO="fedora-logo-icon" 2023-09-06T05:30:56.134 INFO:teuthology.orchestra.run.smithi141.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-09-06T05:30:56.135 INFO:teuthology.orchestra.run.smithi141.stdout:HOME_URL="https://centos.org/" 2023-09-06T05:30:56.135 INFO:teuthology.orchestra.run.smithi141.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-06T05:30:56.135 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-09-06T05:30:56.135 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-06T05:30:56.135 INFO:teuthology.provision.fog.smithi141:Deploy complete! 2023-09-06T05:30:56.136 DEBUG:teuthology.parallel:result is None 2023-09-06T05:30:56.292 INFO:teuthology.provision.fog.smithi105:Node is ready 2023-09-06T05:30:56.293 DEBUG:teuthology.orchestra.run.smithi105:> hostname 2023-09-06T05:30:56.307 INFO:teuthology.orchestra.run.smithi105.stdout:smithi105.front.sepia.ceph.com 2023-09-06T05:30:56.308 DEBUG:teuthology.orchestra.run.smithi105:> grep smithi105.front.sepia.ceph.com /etc/hosts 2023-09-06T05:30:56.363 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.15.105 smithi105.front.sepia.ceph.com smithi105 2023-09-06T05:30:56.363 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105 2023-09-06T05:30:56.491 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105.front.sepia.ceph.com/smithi105/g' /etc/hosts 2023-09-06T05:30:56.520 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/172.21.15.105/172.21.15.105/g' /etc/hosts 2023-09-06T05:30:56.587 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105.front.sepia.ceph.com/smithi105/g' /etc/hostname 2023-09-06T05:30:56.653 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105 2023-09-06T05:30:56.721 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release 2023-09-06T05:30:56.775 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Stream" 2023-09-06T05:30:56.775 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="9" 2023-09-06T05:30:56.775 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos" 2023-09-06T05:30:56.776 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora" 2023-09-06T05:30:56.776 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="9" 2023-09-06T05:30:56.776 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el9" 2023-09-06T05:30:56.776 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Stream 9" 2023-09-06T05:30:56.776 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31" 2023-09-06T05:30:56.777 INFO:teuthology.orchestra.run.smithi105.stdout:LOGO="fedora-logo-icon" 2023-09-06T05:30:56.777 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-09-06T05:30:56.777 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://centos.org/" 2023-09-06T05:30:56.777 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-06T05:30:56.777 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-09-06T05:30:56.778 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-06T05:30:56.778 INFO:teuthology.provision.fog.smithi105:Deploy complete! 2023-09-06T05:30:56.778 DEBUG:teuthology.parallel:result is None 2023-09-06T05:31:16.162 WARNING:teuthology.provision.fog.smithi111:timed out 2023-09-06T05:31:22.166 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T05:31:22.523 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-06T05:31:22.524 DEBUG:teuthology.orchestra.run.smithi111:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-06T05:31:22.867 INFO:teuthology.provision.fog.smithi111:Node is ready 2023-09-06T05:31:22.868 DEBUG:teuthology.orchestra.run.smithi111:> hostname 2023-09-06T05:31:22.884 INFO:teuthology.orchestra.run.smithi111.stdout:smithi111.front.sepia.ceph.com 2023-09-06T05:31:22.885 DEBUG:teuthology.orchestra.run.smithi111:> grep smithi111.front.sepia.ceph.com /etc/hosts 2023-09-06T05:31:22.940 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111 smithi111.front.sepia.ceph.com smithi111 2023-09-06T05:31:22.940 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111 2023-09-06T05:31:23.040 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hosts 2023-09-06T05:31:23.068 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/172.21.15.111/172.21.15.111/g' /etc/hosts 2023-09-06T05:31:23.136 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hostname 2023-09-06T05:31:23.202 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111 2023-09-06T05:31:23.269 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release 2023-09-06T05:31:23.323 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="CentOS Stream" 2023-09-06T05:31:23.324 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="9" 2023-09-06T05:31:23.324 INFO:teuthology.orchestra.run.smithi111.stdout:ID="centos" 2023-09-06T05:31:23.324 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="rhel fedora" 2023-09-06T05:31:23.324 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="9" 2023-09-06T05:31:23.325 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el9" 2023-09-06T05:31:23.325 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="CentOS Stream 9" 2023-09-06T05:31:23.325 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31" 2023-09-06T05:31:23.325 INFO:teuthology.orchestra.run.smithi111.stdout:LOGO="fedora-logo-icon" 2023-09-06T05:31:23.325 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-09-06T05:31:23.326 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://centos.org/" 2023-09-06T05:31:23.326 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-06T05:31:23.326 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-09-06T05:31:23.326 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-06T05:31:23.326 INFO:teuthology.provision.fog.smithi111:Deploy complete! 2023-09-06T05:31:23.327 DEBUG:teuthology.parallel:result is None 2023-09-06T05:31:23.619 INFO:teuthology.lock.ops:Checking smithi105.front.sepia.ceph.com 2023-09-06T05:31:23.620 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-06T05:31:23.675 INFO:teuthology.lock.ops:Checking smithi111.front.sepia.ceph.com 2023-09-06T05:31:23.675 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-06T05:31:23.699 INFO:teuthology.lock.ops:Checking smithi141.front.sepia.ceph.com 2023-09-06T05:31:23.699 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-06T05:31:23.716 INFO:teuthology.lock.ops:Checking smithi144.front.sepia.ceph.com 2023-09-06T05:31:23.716 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-06T05:31:23.745 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: set os type and version on server 2023-09-06T05:31:23.745 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2023-09-06T05:31:23.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T05:31:23.828 DEBUG:teuthology.orchestra.run.smithi105:> true 2023-09-06T05:31:23.992 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi105.front.sepia.ceph.com' 2023-09-06T05:31:23.992 DEBUG:teuthology.orchestra.run.smithi105:> uname -m 2023-09-06T05:31:24.046 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64 2023-09-06T05:31:24.046 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release 2023-09-06T05:31:24.102 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Stream" 2023-09-06T05:31:24.102 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="9" 2023-09-06T05:31:24.102 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos" 2023-09-06T05:31:24.102 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora" 2023-09-06T05:31:24.103 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="9" 2023-09-06T05:31:24.103 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el9" 2023-09-06T05:31:24.103 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Stream 9" 2023-09-06T05:31:24.103 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31" 2023-09-06T05:31:24.103 INFO:teuthology.orchestra.run.smithi105.stdout:LOGO="fedora-logo-icon" 2023-09-06T05:31:24.104 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-09-06T05:31:24.104 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://centos.org/" 2023-09-06T05:31:24.104 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-06T05:31:24.104 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-09-06T05:31:24.105 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-06T05:31:24.105 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2023-09-06T05:31:24.133 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: set os type and version on server 2023-09-06T05:31:24.134 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2023-09-06T05:31:24.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T05:31:24.220 DEBUG:teuthology.orchestra.run.smithi111:> true 2023-09-06T05:31:24.249 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com' 2023-09-06T05:31:24.249 DEBUG:teuthology.orchestra.run.smithi111:> uname -m 2023-09-06T05:31:24.303 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64 2023-09-06T05:31:24.304 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release 2023-09-06T05:31:24.358 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="CentOS Stream" 2023-09-06T05:31:24.359 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="9" 2023-09-06T05:31:24.359 INFO:teuthology.orchestra.run.smithi111.stdout:ID="centos" 2023-09-06T05:31:24.359 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="rhel fedora" 2023-09-06T05:31:24.359 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="9" 2023-09-06T05:31:24.360 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el9" 2023-09-06T05:31:24.360 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="CentOS Stream 9" 2023-09-06T05:31:24.360 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31" 2023-09-06T05:31:24.360 INFO:teuthology.orchestra.run.smithi111.stdout:LOGO="fedora-logo-icon" 2023-09-06T05:31:24.360 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-09-06T05:31:24.361 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://centos.org/" 2023-09-06T05:31:24.362 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-06T05:31:24.362 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-09-06T05:31:24.362 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-06T05:31:24.363 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server 2023-09-06T05:31:24.383 INFO:teuthology.lock.ops:Updating [smithi141.front.sepia.ceph.com]: set os type and version on server 2023-09-06T05:31:24.383 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-09-06T05:31:24.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T05:31:24.470 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-09-06T05:31:24.640 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-09-06T05:31:24.641 DEBUG:teuthology.orchestra.run.smithi141:> uname -m 2023-09-06T05:31:24.696 INFO:teuthology.orchestra.run.smithi141.stdout:x86_64 2023-09-06T05:31:24.697 DEBUG:teuthology.orchestra.run.smithi141:> cat /etc/os-release 2023-09-06T05:31:24.755 INFO:teuthology.orchestra.run.smithi141.stdout:NAME="CentOS Stream" 2023-09-06T05:31:24.755 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION="9" 2023-09-06T05:31:24.755 INFO:teuthology.orchestra.run.smithi141.stdout:ID="centos" 2023-09-06T05:31:24.755 INFO:teuthology.orchestra.run.smithi141.stdout:ID_LIKE="rhel fedora" 2023-09-06T05:31:24.756 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_ID="9" 2023-09-06T05:31:24.756 INFO:teuthology.orchestra.run.smithi141.stdout:PLATFORM_ID="platform:el9" 2023-09-06T05:31:24.756 INFO:teuthology.orchestra.run.smithi141.stdout:PRETTY_NAME="CentOS Stream 9" 2023-09-06T05:31:24.756 INFO:teuthology.orchestra.run.smithi141.stdout:ANSI_COLOR="0;31" 2023-09-06T05:31:24.756 INFO:teuthology.orchestra.run.smithi141.stdout:LOGO="fedora-logo-icon" 2023-09-06T05:31:24.757 INFO:teuthology.orchestra.run.smithi141.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-09-06T05:31:24.757 INFO:teuthology.orchestra.run.smithi141.stdout:HOME_URL="https://centos.org/" 2023-09-06T05:31:24.757 INFO:teuthology.orchestra.run.smithi141.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-06T05:31:24.757 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-09-06T05:31:24.757 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-06T05:31:24.759 INFO:teuthology.lock.ops:Updating smithi141.front.sepia.ceph.com on lock server 2023-09-06T05:31:24.784 INFO:teuthology.lock.ops:Updating [smithi144.front.sepia.ceph.com]: set os type and version on server 2023-09-06T05:31:24.784 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-09-06T05:31:24.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T05:31:24.867 DEBUG:teuthology.orchestra.run.smithi144:> true 2023-09-06T05:31:25.032 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-09-06T05:31:25.033 DEBUG:teuthology.orchestra.run.smithi144:> uname -m 2023-09-06T05:31:25.088 INFO:teuthology.orchestra.run.smithi144.stdout:x86_64 2023-09-06T05:31:25.088 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release 2023-09-06T05:31:25.146 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="CentOS Stream" 2023-09-06T05:31:25.147 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="9" 2023-09-06T05:31:25.147 INFO:teuthology.orchestra.run.smithi144.stdout:ID="centos" 2023-09-06T05:31:25.147 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE="rhel fedora" 2023-09-06T05:31:25.147 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="9" 2023-09-06T05:31:25.147 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM_ID="platform:el9" 2023-09-06T05:31:25.148 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="CentOS Stream 9" 2023-09-06T05:31:25.148 INFO:teuthology.orchestra.run.smithi144.stdout:ANSI_COLOR="0;31" 2023-09-06T05:31:25.148 INFO:teuthology.orchestra.run.smithi144.stdout:LOGO="fedora-logo-icon" 2023-09-06T05:31:25.151 INFO:teuthology.orchestra.run.smithi144.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-09-06T05:31:25.151 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://centos.org/" 2023-09-06T05:31:25.151 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-06T05:31:25.152 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-09-06T05:31:25.152 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-06T05:31:25.152 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server 2023-09-06T05:31:25.174 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-06T05:31:25.261 INFO:teuthology.dispatcher.supervisor:Running job 7389726 2023-09-06T05:31:25.262 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_nmordech@teuthology --archive /home/teuthworker/archive/nmordech-2023-09-06_04:30:02-rados:thrash-erasure-code-crush-4-nodes-main-distro-default-smithi/7389726 --name nmordech-2023-09-06_04:30:02-rados:thrash-erasure-code-crush-4-nodes-main-distro-default-smithi --description rados:thrash-erasure-code-crush-4-nodes/{arch/x86_64 ceph mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=8-m=6-crush} -- /home/teuthworker/archive/nmordech-2023-09-06_04:30:02-rados:thrash-erasure-code-crush-4-nodes-main-distro-default-smithi/7389726/orig.config.yaml 2023-09-06T05:31:25.267 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/nmordech-2023-09-06_04:30:02-rados:thrash-erasure-code-crush-4-nodes-main-distro-default-smithi/7389726 2023-09-06T05:31:25.267 INFO:teuthology.dispatcher.supervisor:Job PID: 1153219 2023-09-06T05:31:25.268 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-06T05:33:25.369 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-06T05:35:25.543 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-06T05:37:25.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-06T05:39:25.836 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-06T05:41:26.001 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-06T05:43:26.126 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-06T05:45:26.294 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-06T05:47:26.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-06T05:49:26.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-06T05:51:26.819 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-06T05:53:26.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-06T05:55:27.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-06T05:57:27.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-06T05:59:27.442 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-06T05:59:27.509 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-09-06T05:59:27.733 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-06T05:59:27.733 INFO:teuthology.nuke:Checking targets against current locks 2023-09-06T05:59:27.787 DEBUG:teuthology.nuke:shortname: smithi105 2023-09-06T05:59:27.788 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-06T05:59:27.814 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi105.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/nmordech-2023-09-06_04:30:02-rados:thrash-erasure-code-crush-4-nodes-main-distro-default-smithi/7389726', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-06 05:25:55.112060', 'locked_by': 'scheduled_nmordech@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEoBCfTPts7EeI8++4qRtDH9sjvUTYfsc3gLDu1wUXKOBBZ5V64hzteaXpq7XFNJ3ptJ2WAVlnOyUmxwGa4qX0I='} 2023-09-06T05:59:27.815 DEBUG:teuthology.nuke:shortname: smithi111 2023-09-06T05:59:27.815 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-06T05:59:27.836 DEBUG:teuthology.nuke:shortname: smithi141 2023-09-06T05:59:27.837 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-06T05:59:27.843 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi111.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/nmordech-2023-09-06_04:30:02-rados:thrash-erasure-code-crush-4-nodes-main-distro-default-smithi/7389726', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-06 05:25:55.110508', 'locked_by': 'scheduled_nmordech@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM5ZYmLPB7yBmamjyIerpsHZGJVxOE8EObE5IAQ1jrPuypJJjrVABzu7eoFqavjaBM/ojHQcX9FqvuJflCG4O7I='} 2023-09-06T05:59:27.846 DEBUG:teuthology.nuke:shortname: smithi144 2023-09-06T05:59:27.846 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-06T05:59:27.860 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi141.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/nmordech-2023-09-06_04:30:02-rados:thrash-erasure-code-crush-4-nodes-main-distro-default-smithi/7389726', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-06 05:25:55.108314', 'locked_by': 'scheduled_nmordech@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE9pZxnohEMV+r+O/6aS+y2HIGPnYQ+HaNK8e+d2FHc1XVaokLr7Yom6cB1mGlrrhirNfQbdgsjzwe3G6i6Q0HQ='} 2023-09-06T05:59:27.869 INFO:teuthology.orchestra.console.smithi105:Power off 2023-09-06T05:59:27.869 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-06T05:59:27.880 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi144.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/nmordech-2023-09-06_04:30:02-rados:thrash-erasure-code-crush-4-nodes-main-distro-default-smithi/7389726', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-06 05:25:55.113212', 'locked_by': 'scheduled_nmordech@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCFjdv75DTJUQyAGPokbVhcLT4JXyo//cVe9sEttVfsFlFvAk5tbm4NnbvtjES4N9eXwsU0tsgtcIkBp2Zdo88g='} 2023-09-06T05:59:27.892 DEBUG:teuthology.orchestra.console.smithi105:power off output: Chassis Power Control: Down/Off 2023-09-06T05:59:27.893 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-06T05:59:27.911 INFO:teuthology.orchestra.console.smithi111:Power off 2023-09-06T05:59:27.912 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-06T05:59:27.920 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2023-09-06T05:59:27.928 INFO:teuthology.orchestra.console.smithi141:Power off 2023-09-06T05:59:27.929 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-06T05:59:27.936 DEBUG:teuthology.orchestra.console.smithi111:power off output: Chassis Power Control: Down/Off 2023-09-06T05:59:27.937 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-06T05:59:27.951 INFO:teuthology.orchestra.console.smithi144:Power off 2023-09-06T05:59:27.952 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-06T05:59:27.960 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off 2023-09-06T05:59:27.960 DEBUG:teuthology.orchestra.console.smithi141:power off output: Chassis Power Control: Down/Off 2023-09-06T05:59:27.961 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-06T05:59:27.971 DEBUG:teuthology.orchestra.console.smithi144:power off output: Chassis Power Control: Down/Off 2023-09-06T05:59:27.975 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-06T05:59:27.987 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off 2023-09-06T05:59:28.001 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is off 2023-09-06T05:59:28.021 INFO:teuthology.orchestra.console.smithi105:Power off completed 2023-09-06T05:59:28.061 INFO:teuthology.orchestra.console.smithi111:Power off completed 2023-09-06T05:59:28.088 INFO:teuthology.orchestra.console.smithi141:Power off completed 2023-09-06T05:59:28.101 INFO:teuthology.orchestra.console.smithi144:Power off completed 2023-09-06T05:59:28.176 INFO:teuthology.lock.ops:unlocked: smithi105.front.sepia.ceph.com 2023-09-06T05:59:28.209 INFO:teuthology.lock.ops:unlocked: smithi111.front.sepia.ceph.com 2023-09-06T05:59:28.232 INFO:teuthology.lock.ops:unlocked: smithi141.front.sepia.ceph.com 2023-09-06T05:59:28.250 INFO:teuthology.lock.ops:unlocked: smithi144.front.sepia.ceph.com