2023-08-01T19:18:37.471 INFO:root:teuthology version: 0.0.1.dev174+g10753fd 2023-08-01T19:18:37.473 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-01T19:18:37.653 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7faaf28baee0>, signals=[15]) 2023-08-01T19:18:37.655 INFO:teuthology.lock.ops:Start node 'smithi103.front.sepia.ceph.com' reimaging 2023-08-01T19:18:37.655 INFO:teuthology.lock.ops:Updating [smithi103.front.sepia.ceph.com]: reset os type and version on server 2023-08-01T19:18:37.655 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2023-08-01T19:18:37.674 INFO:teuthology.lock.ops:Start node 'smithi117.front.sepia.ceph.com' reimaging 2023-08-01T19:18:37.674 INFO:teuthology.lock.ops:Updating [smithi117.front.sepia.ceph.com]: reset os type and version on server 2023-08-01T19:18:37.675 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server 2023-08-01T19:18:37.676 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /host {"name": "smithi103"} 2023-08-01T19:18:37.698 INFO:teuthology.lock.ops:Start node 'smithi146.front.sepia.ceph.com' reimaging 2023-08-01T19:18:37.699 INFO:teuthology.lock.ops:Updating [smithi146.front.sepia.ceph.com]: reset os type and version on server 2023-08-01T19:18:37.699 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2023-08-01T19:18:37.700 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /host {"name": "smithi117"} 2023-08-01T19:18:37.715 INFO:teuthology.lock.ops:Start node 'smithi164.front.sepia.ceph.com' reimaging 2023-08-01T19:18:37.715 INFO:teuthology.lock.ops:Updating [smithi164.front.sepia.ceph.com]: reset os type and version on server 2023-08-01T19:18:37.716 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2023-08-01T19:18:37.717 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /host {"name": "smithi146"} 2023-08-01T19:18:37.732 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /host {"name": "smithi164"} 2023-08-01T19:18:37.741 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-01T19:18:37.770 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-01T19:18:37.781 DEBUG:teuthology.provision.fog.smithi103:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-01T19:18:37.781 DEBUG:teuthology.provision.fog.smithi103:FOG request: PUT /host/208 {"imageID": 5} 2023-08-01T19:18:37.784 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-01T19:18:37.796 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-01T19:18:37.821 INFO:teuthology.provision.fog.smithi103:Scheduling deploy of rhel 8.6 2023-08-01T19:18:37.822 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-08-01T19:18:37.824 DEBUG:teuthology.provision.fog.smithi117:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-01T19:18:37.824 DEBUG:teuthology.provision.fog.smithi117:FOG request: PUT /host/222 {"imageID": 5} 2023-08-01T19:18:37.829 DEBUG:teuthology.provision.fog.smithi146:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-01T19:18:37.829 DEBUG:teuthology.provision.fog.smithi146:FOG request: PUT /host/251 {"imageID": 5} 2023-08-01T19:18:37.834 DEBUG:teuthology.provision.fog.smithi164:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-01T19:18:37.834 DEBUG:teuthology.provision.fog.smithi164:FOG request: PUT /host/269 {"imageID": 5} 2023-08-01T19:18:37.862 INFO:teuthology.provision.fog.smithi117:Scheduling deploy of rhel 8.6 2023-08-01T19:18:37.863 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-08-01T19:18:37.883 INFO:teuthology.provision.fog.smithi146:Scheduling deploy of rhel 8.6 2023-08-01T19:18:37.883 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-08-01T19:18:37.888 INFO:teuthology.provision.fog.smithi164:Scheduling deploy of rhel 8.6 2023-08-01T19:18:37.888 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-08-01T19:18:37.896 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /tasktype {"name": "deploy"} 2023-08-01T19:18:37.936 DEBUG:teuthology.provision.fog.smithi103:FOG request: POST /host/208/task {"taskTypeID": 1} 2023-08-01T19:18:37.944 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /tasktype {"name": "deploy"} 2023-08-01T19:18:37.948 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /tasktype {"name": "deploy"} 2023-08-01T19:18:37.951 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /tasktype {"name": "deploy"} 2023-08-01T19:18:37.981 DEBUG:teuthology.provision.fog.smithi117:FOG request: POST /host/222/task {"taskTypeID": 1} 2023-08-01T19:18:37.984 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-08-01T19:18:37.987 DEBUG:teuthology.provision.fog.smithi164:FOG request: POST /host/269/task {"taskTypeID": 1} 2023-08-01T19:18:37.990 DEBUG:teuthology.provision.fog.smithi146:FOG request: POST /host/251/task {"taskTypeID": 1} 2023-08-01T19:18:38.029 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-08-01T19:18:38.032 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-08-01T19:18:38.046 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-08-01T19:18:38.087 INFO:teuthology.orchestra.console.smithi103:Power off 2023-08-01T19:18:38.088 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-01T19:18:38.110 DEBUG:teuthology.orchestra.console.smithi103:power off output: Chassis Power Control: Down/Off 2023-08-01T19:18:38.111 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-01T19:18:38.135 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2023-08-01T19:18:38.154 INFO:teuthology.orchestra.console.smithi164:Power off 2023-08-01T19:18:38.155 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-01T19:18:38.170 INFO:teuthology.orchestra.console.smithi117:Power off 2023-08-01T19:18:38.170 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-01T19:18:38.183 INFO:teuthology.orchestra.console.smithi146:Power off 2023-08-01T19:18:38.184 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-01T19:18:38.192 DEBUG:teuthology.orchestra.console.smithi117:power off output: Chassis Power Control: Down/Off 2023-08-01T19:18:38.192 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-01T19:18:38.200 DEBUG:teuthology.orchestra.console.smithi164:power off output: Chassis Power Control: Down/Off 2023-08-01T19:18:38.201 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-01T19:18:38.210 DEBUG:teuthology.orchestra.console.smithi146:power off output: Chassis Power Control: Down/Off 2023-08-01T19:18:38.211 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-01T19:18:38.221 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is on 2023-08-01T19:18:38.223 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on 2023-08-01T19:18:38.232 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on 2023-08-01T19:18:42.139 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-01T19:18:42.222 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-01T19:18:42.229 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-01T19:18:42.238 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-01T19:18:42.248 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2023-08-01T19:18:42.331 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is on 2023-08-01T19:18:42.339 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on 2023-08-01T19:18:42.348 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on 2023-08-01T19:18:46.252 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-01T19:18:46.332 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-01T19:18:46.340 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-01T19:18:46.349 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-01T19:18:46.361 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2023-08-01T19:18:46.442 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is on 2023-08-01T19:18:46.449 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on 2023-08-01T19:18:46.457 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on 2023-08-01T19:18:50.364 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-01T19:18:50.443 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-01T19:18:50.455 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-01T19:18:50.462 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-01T19:18:50.474 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2023-08-01T19:18:50.556 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is off 2023-08-01T19:18:50.563 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off 2023-08-01T19:18:50.571 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is off 2023-08-01T19:18:50.575 INFO:teuthology.orchestra.console.smithi103:Power off completed 2023-08-01T19:18:50.658 INFO:teuthology.orchestra.console.smithi117:Power off completed 2023-08-01T19:18:50.664 INFO:teuthology.orchestra.console.smithi164:Power off completed 2023-08-01T19:18:50.672 INFO:teuthology.orchestra.console.smithi146:Power off completed 2023-08-01T19:18:50.676 INFO:teuthology.orchestra.console.smithi103:Power on 2023-08-01T19:18:50.676 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-01T19:18:50.695 DEBUG:teuthology.orchestra.console.smithi103:power on output: Chassis Power Control: Up/On 2023-08-01T19:18:50.696 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-01T19:18:50.716 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2023-08-01T19:18:50.759 INFO:teuthology.orchestra.console.smithi117:Power on 2023-08-01T19:18:50.759 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-01T19:18:50.766 INFO:teuthology.orchestra.console.smithi164:Power on 2023-08-01T19:18:50.766 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-01T19:18:50.773 INFO:teuthology.orchestra.console.smithi146:Power on 2023-08-01T19:18:50.774 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-01T19:18:50.781 DEBUG:teuthology.orchestra.console.smithi117:power on output: Chassis Power Control: Up/On 2023-08-01T19:18:50.782 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-01T19:18:50.789 DEBUG:teuthology.orchestra.console.smithi164:power on output: Chassis Power Control: Up/On 2023-08-01T19:18:50.790 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-01T19:18:50.798 DEBUG:teuthology.orchestra.console.smithi146:power on output: Chassis Power Control: Up/On 2023-08-01T19:18:50.798 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-01T19:18:50.806 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is off 2023-08-01T19:18:50.808 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off 2023-08-01T19:18:50.817 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is off 2023-08-01T19:18:54.720 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-01T19:18:54.808 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-01T19:18:54.816 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-01T19:18:54.824 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-01T19:18:54.834 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2023-08-01T19:18:54.918 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is off 2023-08-01T19:18:54.926 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off 2023-08-01T19:18:54.935 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on 2023-08-01T19:18:55.035 INFO:teuthology.orchestra.console.smithi146:Power on completed 2023-08-01T19:18:55.136 INFO:teuthology.provision.fog.smithi146:Waiting for deploy to finish 2023-08-01T19:18:55.136 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-08-01T19:18:58.839 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-01T19:18:58.920 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-01T19:18:58.927 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-01T19:18:58.949 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2023-08-01T19:18:59.029 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is on 2023-08-01T19:18:59.036 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on 2023-08-01T19:18:59.050 INFO:teuthology.orchestra.console.smithi103:Power on completed 2023-08-01T19:18:59.130 INFO:teuthology.orchestra.console.smithi117:Power on completed 2023-08-01T19:18:59.136 INFO:teuthology.orchestra.console.smithi164:Power on completed 2023-08-01T19:18:59.152 INFO:teuthology.provision.fog.smithi103:Waiting for deploy to finish 2023-08-01T19:18:59.152 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-08-01T19:18:59.231 INFO:teuthology.provision.fog.smithi117:Waiting for deploy to finish 2023-08-01T19:18:59.231 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-08-01T19:18:59.237 INFO:teuthology.provision.fog.smithi164:Waiting for deploy to finish 2023-08-01T19:18:59.237 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-08-01T19:19:10.287 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-08-01T19:19:14.340 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-08-01T19:19:14.402 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-08-01T19:19:14.405 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-08-01T19:19:25.444 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-08-01T19:19:29.508 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-08-01T19:19:29.573 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-08-01T19:19:29.576 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-08-01T19:19:40.590 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-08-01T19:19:44.880 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-08-01T19:19:44.966 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-08-01T19:19:44.993 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-08-01T19:19:55.831 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-08-01T19:20:00.191 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-08-01T19:20:00.264 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-08-01T19:20:00.301 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-08-01T19:20:11.138 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-08-01T19:20:15.520 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-08-01T19:20:15.592 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-08-01T19:20:15.632 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-08-01T19:20:26.368 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-08-01T19:20:30.829 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-08-01T19:20:30.900 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-08-01T19:20:30.966 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-08-01T19:20:41.674 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-08-01T19:20:46.219 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-08-01T19:20:46.299 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-08-01T19:20:46.429 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-08-01T19:20:57.062 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-08-01T19:21:01.752 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-08-01T19:21:01.798 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-08-01T19:21:01.880 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-08-01T19:21:12.412 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-08-01T19:21:17.140 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-08-01T19:21:17.333 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-08-01T19:21:17.342 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-08-01T19:21:27.788 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-08-01T19:21:32.696 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-08-01T19:21:32.852 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-08-01T19:21:33.180 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-08-01T19:21:43.201 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-08-01T19:21:48.364 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-08-01T19:21:48.496 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-08-01T19:21:49.084 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-08-01T19:21:58.638 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-08-01T19:22:03.995 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-08-01T19:22:04.130 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-08-01T19:22:04.649 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-08-01T19:22:14.088 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-08-01T19:22:14.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-01T19:22:14.555 ERROR:teuthology.orchestra.connection:Error authenticating with smithi146.front.sepia.ceph.com: Authentication failed. 2023-08-01T19:22:14.557 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-01T19:22:14.557 DEBUG:teuthology.orchestra.run.smithi146:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-01T19:22:14.558 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-01T19:22:19.808 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-08-01T19:22:19.827 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-08-01T19:22:20.139 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-08-01T19:22:20.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-01T19:22:20.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-01T19:22:35.714 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-08-01T19:22:39.088 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-08-01T19:22:39.344 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-08-01T19:22:45.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-01T19:22:45.345 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-01T19:22:48.144 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-08-01T19:22:48.400 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-08-01T19:22:51.452 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-08-01T19:22:54.145 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-01T19:22:54.401 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-01T19:22:57.200 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-08-01T19:22:57.456 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-08-01T19:23:03.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-01T19:23:03.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-01T19:23:06.256 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-08-01T19:23:06.512 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-08-01T19:23:07.052 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-08-01T19:23:12.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-01T19:23:12.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-01T19:23:15.312 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-08-01T19:23:15.568 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-08-01T19:23:21.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-01T19:23:21.570 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-01T19:23:22.862 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-08-01T19:23:24.368 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-08-01T19:23:30.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-01T19:23:38.554 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-08-01T19:23:54.182 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-08-01T19:24:05.104 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-08-01T19:24:05.106 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi146 2023-08-01T19:24:09.669 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-08-01T19:24:14.111 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-08-01T19:24:14.111 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-01T19:24:14.436 DEBUG:teuthology.orchestra.run.smithi146:> true 2023-08-01T19:24:14.722 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-08-01T19:24:14.722 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-01T19:24:14.722 DEBUG:teuthology.orchestra.run.smithi146:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-01T19:24:14.739 INFO:teuthology.provision.fog.smithi146:Node is ready 2023-08-01T19:24:14.739 DEBUG:teuthology.orchestra.run.smithi146:> hostname 2023-08-01T19:24:14.796 INFO:teuthology.orchestra.run.smithi146.stdout:smithi146.front.sepia.ceph.com 2023-08-01T19:24:14.796 DEBUG:teuthology.orchestra.run.smithi146:> grep smithi146.front.sepia.ceph.com /etc/hosts 2023-08-01T19:24:14.853 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146 smithi146.front.sepia.ceph.com smithi146 2023-08-01T19:24:14.853 DEBUG:teuthology.orchestra.run.smithi146:> sudo hostname smithi146 2023-08-01T19:24:14.962 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i -e 's/smithi146.front.sepia.ceph.com/smithi146/g' /etc/hosts 2023-08-01T19:24:14.989 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i -e 's/172.21.15.146/172.21.15.146/g' /etc/hosts 2023-08-01T19:24:15.055 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i -e 's/smithi146.front.sepia.ceph.com/smithi146/g' /etc/hostname 2023-08-01T19:24:15.121 DEBUG:teuthology.orchestra.run.smithi146:> sudo hostname smithi146 2023-08-01T19:24:15.187 DEBUG:teuthology.orchestra.run.smithi146:> cat /etc/os-release 2023-08-01T19:24:15.242 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="Red Hat Enterprise Linux" 2023-08-01T19:24:15.243 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="8.6 (Ootpa)" 2023-08-01T19:24:15.243 INFO:teuthology.orchestra.run.smithi146.stdout:ID="rhel" 2023-08-01T19:24:15.243 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE="fedora" 2023-08-01T19:24:15.243 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="8.6" 2023-08-01T19:24:15.243 INFO:teuthology.orchestra.run.smithi146.stdout:PLATFORM_ID="platform:el8" 2023-08-01T19:24:15.243 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-01T19:24:15.243 INFO:teuthology.orchestra.run.smithi146.stdout:ANSI_COLOR="0;31" 2023-08-01T19:24:15.244 INFO:teuthology.orchestra.run.smithi146.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-01T19:24:15.244 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://www.redhat.com/" 2023-08-01T19:24:15.244 INFO:teuthology.orchestra.run.smithi146.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-01T19:24:15.244 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-01T19:24:15.244 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-08-01T19:24:15.244 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-01T19:24:15.244 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-01T19:24:15.244 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-01T19:24:15.245 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-01T19:24:15.245 INFO:teuthology.provision.fog.smithi146:Deploy complete! 2023-08-01T19:24:15.246 DEBUG:teuthology.parallel:result is None 2023-08-01T19:24:21.578 WARNING:teuthology.provision.fog.smithi164:timed out 2023-08-01T19:24:25.136 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-08-01T19:24:27.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-01T19:24:27.913 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-01T19:24:27.913 DEBUG:teuthology.orchestra.run.smithi164:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-01T19:24:28.200 INFO:teuthology.provision.fog.smithi164:Node is ready 2023-08-01T19:24:28.201 DEBUG:teuthology.orchestra.run.smithi164:> hostname 2023-08-01T19:24:28.217 INFO:teuthology.orchestra.run.smithi164.stdout:smithi164.front.sepia.ceph.com 2023-08-01T19:24:28.218 DEBUG:teuthology.orchestra.run.smithi164:> grep smithi164.front.sepia.ceph.com /etc/hosts 2023-08-01T19:24:28.275 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.164 smithi164.front.sepia.ceph.com smithi164 2023-08-01T19:24:28.275 DEBUG:teuthology.orchestra.run.smithi164:> sudo hostname smithi164 2023-08-01T19:24:28.373 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/smithi164.front.sepia.ceph.com/smithi164/g' /etc/hosts 2023-08-01T19:24:28.400 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/172.21.15.164/172.21.15.164/g' /etc/hosts 2023-08-01T19:24:28.468 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/smithi164.front.sepia.ceph.com/smithi164/g' /etc/hostname 2023-08-01T19:24:28.534 DEBUG:teuthology.orchestra.run.smithi164:> sudo hostname smithi164 2023-08-01T19:24:28.599 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release 2023-08-01T19:24:28.654 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="Red Hat Enterprise Linux" 2023-08-01T19:24:28.654 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="8.6 (Ootpa)" 2023-08-01T19:24:28.655 INFO:teuthology.orchestra.run.smithi164.stdout:ID="rhel" 2023-08-01T19:24:28.655 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE="fedora" 2023-08-01T19:24:28.655 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="8.6" 2023-08-01T19:24:28.655 INFO:teuthology.orchestra.run.smithi164.stdout:PLATFORM_ID="platform:el8" 2023-08-01T19:24:28.655 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-01T19:24:28.655 INFO:teuthology.orchestra.run.smithi164.stdout:ANSI_COLOR="0;31" 2023-08-01T19:24:28.655 INFO:teuthology.orchestra.run.smithi164.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-01T19:24:28.655 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://www.redhat.com/" 2023-08-01T19:24:28.656 INFO:teuthology.orchestra.run.smithi164.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-01T19:24:28.656 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-01T19:24:28.656 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-08-01T19:24:28.656 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-01T19:24:28.656 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-01T19:24:28.656 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-01T19:24:28.656 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-01T19:24:28.657 INFO:teuthology.provision.fog.smithi164:Deploy complete! 2023-08-01T19:24:28.657 DEBUG:teuthology.parallel:result is None 2023-08-01T19:24:30.372 WARNING:teuthology.provision.fog.smithi103:timed out 2023-08-01T19:24:36.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-01T19:24:36.726 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-01T19:24:36.727 DEBUG:teuthology.orchestra.run.smithi103:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-01T19:24:37.023 INFO:teuthology.provision.fog.smithi103:Node is ready 2023-08-01T19:24:37.023 DEBUG:teuthology.orchestra.run.smithi103:> hostname 2023-08-01T19:24:37.039 INFO:teuthology.orchestra.run.smithi103.stdout:smithi103.front.sepia.ceph.com 2023-08-01T19:24:37.040 DEBUG:teuthology.orchestra.run.smithi103:> grep smithi103.front.sepia.ceph.com /etc/hosts 2023-08-01T19:24:37.099 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103 smithi103.front.sepia.ceph.com smithi103 2023-08-01T19:24:37.100 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname smithi103 2023-08-01T19:24:37.231 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/smithi103.front.sepia.ceph.com/smithi103/g' /etc/hosts 2023-08-01T19:24:37.259 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/172.21.15.103/172.21.15.103/g' /etc/hosts 2023-08-01T19:24:37.329 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/smithi103.front.sepia.ceph.com/smithi103/g' /etc/hostname 2023-08-01T19:24:37.399 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname smithi103 2023-08-01T19:24:37.467 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2023-08-01T19:24:37.526 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="Red Hat Enterprise Linux" 2023-08-01T19:24:37.527 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="8.6 (Ootpa)" 2023-08-01T19:24:37.527 INFO:teuthology.orchestra.run.smithi103.stdout:ID="rhel" 2023-08-01T19:24:37.527 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="fedora" 2023-08-01T19:24:37.527 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="8.6" 2023-08-01T19:24:37.527 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el8" 2023-08-01T19:24:37.528 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-01T19:24:37.528 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31" 2023-08-01T19:24:37.528 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-01T19:24:37.528 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://www.redhat.com/" 2023-08-01T19:24:37.528 INFO:teuthology.orchestra.run.smithi103.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-01T19:24:37.528 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-01T19:24:37.528 INFO:teuthology.orchestra.run.smithi103.stdout: 2023-08-01T19:24:37.529 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-01T19:24:37.529 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-01T19:24:37.529 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-01T19:24:37.529 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-01T19:24:37.529 INFO:teuthology.provision.fog.smithi103:Deploy complete! 2023-08-01T19:24:37.530 DEBUG:teuthology.parallel:result is None 2023-08-01T19:24:40.843 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-08-01T19:24:56.288 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-08-01T19:25:11.664 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-08-01T19:25:12.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-01T19:25:30.352 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117 2023-08-01T19:25:36.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-01T19:25:39.408 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117 2023-08-01T19:25:45.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-01T19:25:48.464 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117 2023-08-01T19:25:54.468 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-01T19:25:57.520 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117 2023-08-01T19:26:03.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-01T19:27:03.584 WARNING:teuthology.provision.fog.smithi117:timed out 2023-08-01T19:27:09.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-01T19:27:09.908 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-01T19:27:09.909 DEBUG:teuthology.orchestra.run.smithi117:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-01T19:27:10.365 INFO:teuthology.provision.fog.smithi117:Node is ready 2023-08-01T19:27:10.366 DEBUG:teuthology.orchestra.run.smithi117:> hostname 2023-08-01T19:27:10.384 INFO:teuthology.orchestra.run.smithi117.stdout:smithi117 2023-08-01T19:27:10.384 DEBUG:teuthology.orchestra.run.smithi117:> grep smithi117 /etc/hosts 2023-08-01T19:27:10.442 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117 smithi117.front.sepia.ceph.com smithi117 2023-08-01T19:27:10.443 DEBUG:teuthology.orchestra.run.smithi117:> sudo hostname smithi117 2023-08-01T19:27:10.566 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i -e 's/smithi117/smithi117/g' /etc/hosts 2023-08-01T19:27:10.594 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i -e 's/172.21.15.117/172.21.15.117/g' /etc/hosts 2023-08-01T19:27:10.662 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i -e 's/smithi117/smithi117/g' /etc/hostname 2023-08-01T19:27:10.729 DEBUG:teuthology.orchestra.run.smithi117:> sudo hostname smithi117 2023-08-01T19:27:10.794 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release 2023-08-01T19:27:10.850 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="Red Hat Enterprise Linux" 2023-08-01T19:27:10.851 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="8.6 (Ootpa)" 2023-08-01T19:27:10.851 INFO:teuthology.orchestra.run.smithi117.stdout:ID="rhel" 2023-08-01T19:27:10.851 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE="fedora" 2023-08-01T19:27:10.851 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="8.6" 2023-08-01T19:27:10.851 INFO:teuthology.orchestra.run.smithi117.stdout:PLATFORM_ID="platform:el8" 2023-08-01T19:27:10.851 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-01T19:27:10.851 INFO:teuthology.orchestra.run.smithi117.stdout:ANSI_COLOR="0;31" 2023-08-01T19:27:10.852 INFO:teuthology.orchestra.run.smithi117.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-01T19:27:10.852 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://www.redhat.com/" 2023-08-01T19:27:10.852 INFO:teuthology.orchestra.run.smithi117.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-01T19:27:10.852 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-01T19:27:10.852 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-01T19:27:10.852 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-01T19:27:10.853 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-01T19:27:10.853 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-01T19:27:10.853 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-01T19:27:10.853 INFO:teuthology.provision.fog.smithi117:Deploy complete! 2023-08-01T19:27:10.853 DEBUG:teuthology.parallel:result is None 2023-08-01T19:27:11.050 INFO:teuthology.lock.ops:Checking smithi103.front.sepia.ceph.com 2023-08-01T19:27:11.051 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-01T19:27:11.079 INFO:teuthology.lock.ops:Checking smithi117.front.sepia.ceph.com 2023-08-01T19:27:11.079 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-01T19:27:11.095 INFO:teuthology.lock.ops:Checking smithi146.front.sepia.ceph.com 2023-08-01T19:27:11.095 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-01T19:27:11.112 INFO:teuthology.lock.ops:Checking smithi164.front.sepia.ceph.com 2023-08-01T19:27:11.112 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-01T19:27:11.130 INFO:teuthology.lock.ops:Updating [smithi103.front.sepia.ceph.com]: set os type and version on server 2023-08-01T19:27:11.130 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2023-08-01T19:27:11.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-01T19:27:11.196 DEBUG:teuthology.orchestra.run.smithi103:> true 2023-08-01T19:27:11.325 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com' 2023-08-01T19:27:11.325 DEBUG:teuthology.orchestra.run.smithi103:> uname -m 2023-08-01T19:27:11.381 INFO:teuthology.orchestra.run.smithi103.stdout:x86_64 2023-08-01T19:27:11.382 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2023-08-01T19:27:11.438 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="Red Hat Enterprise Linux" 2023-08-01T19:27:11.439 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="8.6 (Ootpa)" 2023-08-01T19:27:11.439 INFO:teuthology.orchestra.run.smithi103.stdout:ID="rhel" 2023-08-01T19:27:11.439 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="fedora" 2023-08-01T19:27:11.439 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="8.6" 2023-08-01T19:27:11.439 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el8" 2023-08-01T19:27:11.439 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-01T19:27:11.439 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31" 2023-08-01T19:27:11.440 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-01T19:27:11.440 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://www.redhat.com/" 2023-08-01T19:27:11.440 INFO:teuthology.orchestra.run.smithi103.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-01T19:27:11.440 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-01T19:27:11.440 INFO:teuthology.orchestra.run.smithi103.stdout: 2023-08-01T19:27:11.440 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-01T19:27:11.440 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-01T19:27:11.440 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-01T19:27:11.441 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-01T19:27:11.441 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2023-08-01T19:27:11.462 INFO:teuthology.lock.ops:Updating [smithi117.front.sepia.ceph.com]: set os type and version on server 2023-08-01T19:27:11.463 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2023-08-01T19:27:11.463 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-01T19:27:11.528 DEBUG:teuthology.orchestra.run.smithi117:> true 2023-08-01T19:27:11.598 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com' 2023-08-01T19:27:11.598 DEBUG:teuthology.orchestra.run.smithi117:> uname -m 2023-08-01T19:27:11.656 INFO:teuthology.orchestra.run.smithi117.stdout:x86_64 2023-08-01T19:27:11.656 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release 2023-08-01T19:27:11.714 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="Red Hat Enterprise Linux" 2023-08-01T19:27:11.714 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="8.6 (Ootpa)" 2023-08-01T19:27:11.714 INFO:teuthology.orchestra.run.smithi117.stdout:ID="rhel" 2023-08-01T19:27:11.714 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE="fedora" 2023-08-01T19:27:11.715 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="8.6" 2023-08-01T19:27:11.715 INFO:teuthology.orchestra.run.smithi117.stdout:PLATFORM_ID="platform:el8" 2023-08-01T19:27:11.715 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-01T19:27:11.715 INFO:teuthology.orchestra.run.smithi117.stdout:ANSI_COLOR="0;31" 2023-08-01T19:27:11.715 INFO:teuthology.orchestra.run.smithi117.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-01T19:27:11.715 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://www.redhat.com/" 2023-08-01T19:27:11.715 INFO:teuthology.orchestra.run.smithi117.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-01T19:27:11.716 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-01T19:27:11.716 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-08-01T19:27:11.716 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-01T19:27:11.716 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-01T19:27:11.716 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-01T19:27:11.716 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-01T19:27:11.717 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server 2023-08-01T19:27:11.737 INFO:teuthology.lock.ops:Updating [smithi146.front.sepia.ceph.com]: set os type and version on server 2023-08-01T19:27:11.738 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-08-01T19:27:11.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-01T19:27:11.804 DEBUG:teuthology.orchestra.run.smithi146:> true 2023-08-01T19:27:11.938 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-08-01T19:27:11.938 DEBUG:teuthology.orchestra.run.smithi146:> uname -m 2023-08-01T19:27:11.994 INFO:teuthology.orchestra.run.smithi146.stdout:x86_64 2023-08-01T19:27:11.995 DEBUG:teuthology.orchestra.run.smithi146:> cat /etc/os-release 2023-08-01T19:27:12.052 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="Red Hat Enterprise Linux" 2023-08-01T19:27:12.052 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="8.6 (Ootpa)" 2023-08-01T19:27:12.052 INFO:teuthology.orchestra.run.smithi146.stdout:ID="rhel" 2023-08-01T19:27:12.052 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE="fedora" 2023-08-01T19:27:12.053 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="8.6" 2023-08-01T19:27:12.053 INFO:teuthology.orchestra.run.smithi146.stdout:PLATFORM_ID="platform:el8" 2023-08-01T19:27:12.053 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-01T19:27:12.053 INFO:teuthology.orchestra.run.smithi146.stdout:ANSI_COLOR="0;31" 2023-08-01T19:27:12.053 INFO:teuthology.orchestra.run.smithi146.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-01T19:27:12.053 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://www.redhat.com/" 2023-08-01T19:27:12.053 INFO:teuthology.orchestra.run.smithi146.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-01T19:27:12.054 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-01T19:27:12.054 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-08-01T19:27:12.054 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-01T19:27:12.054 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-01T19:27:12.054 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-01T19:27:12.054 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-01T19:27:12.055 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2023-08-01T19:27:12.088 INFO:teuthology.lock.ops:Updating [smithi164.front.sepia.ceph.com]: set os type and version on server 2023-08-01T19:27:12.088 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2023-08-01T19:27:12.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-01T19:27:12.154 DEBUG:teuthology.orchestra.run.smithi164:> true 2023-08-01T19:27:12.285 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com' 2023-08-01T19:27:12.285 DEBUG:teuthology.orchestra.run.smithi164:> uname -m 2023-08-01T19:27:12.342 INFO:teuthology.orchestra.run.smithi164.stdout:x86_64 2023-08-01T19:27:12.342 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release 2023-08-01T19:27:12.398 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="Red Hat Enterprise Linux" 2023-08-01T19:27:12.399 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="8.6 (Ootpa)" 2023-08-01T19:27:12.399 INFO:teuthology.orchestra.run.smithi164.stdout:ID="rhel" 2023-08-01T19:27:12.399 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE="fedora" 2023-08-01T19:27:12.399 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="8.6" 2023-08-01T19:27:12.399 INFO:teuthology.orchestra.run.smithi164.stdout:PLATFORM_ID="platform:el8" 2023-08-01T19:27:12.399 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-01T19:27:12.399 INFO:teuthology.orchestra.run.smithi164.stdout:ANSI_COLOR="0;31" 2023-08-01T19:27:12.399 INFO:teuthology.orchestra.run.smithi164.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-01T19:27:12.400 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://www.redhat.com/" 2023-08-01T19:27:12.400 INFO:teuthology.orchestra.run.smithi164.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-01T19:27:12.400 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-01T19:27:12.400 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-08-01T19:27:12.400 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-01T19:27:12.400 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-01T19:27:12.400 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-01T19:27:12.401 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-01T19:27:12.401 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2023-08-01T19:27:12.420 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-01T19:27:12.509 INFO:teuthology.dispatcher.supervisor:Running job 7358022 2023-08-01T19:27:12.509 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-08-01_19:17:42-powercycle-reef-distro-default-smithi/7358022 --name yuriw-2023-08-01_19:17:42-powercycle-reef-distro-default-smithi --description powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-zstd powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_suites_ffsb thrashosds-health} -- /home/teuthworker/archive/yuriw-2023-08-01_19:17:42-powercycle-reef-distro-default-smithi/7358022/orig.config.yaml 2023-08-01T19:27:12.513 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-08-01_19:17:42-powercycle-reef-distro-default-smithi/7358022 2023-08-01T19:27:12.514 INFO:teuthology.dispatcher.supervisor:Job PID: 740 2023-08-01T19:27:12.514 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-01T19:29:12.540 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-01T19:31:12.700 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-01T19:33:12.857 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-01T19:35:13.025 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-01T19:37:13.189 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-01T19:39:13.357 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-01T19:41:13.517 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-01T19:43:13.673 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-01T19:45:13.845 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-01T19:47:14.017 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-01T19:49:14.188 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-01T19:51:14.353 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-01T19:53:14.516 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-01T19:53:14.582 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-01T19:53:14.710 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-01T19:53:14.710 INFO:teuthology.nuke:Checking targets against current locks 2023-08-01T19:53:14.754 DEBUG:teuthology.nuke:shortname: smithi103 2023-08-01T19:53:14.755 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-01T19:53:14.778 DEBUG:teuthology.nuke:shortname: smithi117 2023-08-01T19:53:14.779 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-01T19:53:14.783 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi103.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-01_19:17:42-powercycle-reef-distro-default-smithi/7358022', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-01 19:18:36.656174', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-08-01T19:53:14.801 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi117.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-01_19:17:42-powercycle-reef-distro-default-smithi/7358022', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-01 19:18:36.659095', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-08-01T19:53:14.804 DEBUG:teuthology.nuke:shortname: smithi146 2023-08-01T19:53:14.804 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-01T19:53:14.825 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi146.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-01_19:17:42-powercycle-reef-distro-default-smithi/7358022', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-01 19:18:36.654854', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-08-01T19:53:14.832 INFO:teuthology.orchestra.console.smithi103:Power off 2023-08-01T19:53:14.833 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-01T19:53:14.844 DEBUG:teuthology.nuke:shortname: smithi164 2023-08-01T19:53:14.845 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-01T19:53:14.851 INFO:teuthology.orchestra.console.smithi117:Power off 2023-08-01T19:53:14.852 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-01T19:53:14.860 DEBUG:teuthology.orchestra.console.smithi103:power off output: Chassis Power Control: Down/Off 2023-08-01T19:53:14.861 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-01T19:53:14.875 INFO:teuthology.orchestra.console.smithi146:Power off 2023-08-01T19:53:14.876 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-01T19:53:14.885 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi164.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-01_19:17:42-powercycle-reef-distro-default-smithi/7358022', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-01 19:18:36.657652', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-08-01T19:53:14.887 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2023-08-01T19:53:14.888 DEBUG:teuthology.orchestra.console.smithi117:power off output: Chassis Power Control: Down/Off 2023-08-01T19:53:14.888 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-01T19:53:14.899 DEBUG:teuthology.orchestra.console.smithi146:power off output: Chassis Power Control: Down/Off 2023-08-01T19:53:14.900 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-01T19:53:14.909 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is off 2023-08-01T19:53:14.922 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is off 2023-08-01T19:53:14.948 INFO:teuthology.orchestra.console.smithi164:Power off 2023-08-01T19:53:14.949 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-01T19:53:14.969 DEBUG:teuthology.orchestra.console.smithi164:power off output: Chassis Power Control: Down/Off 2023-08-01T19:53:14.970 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-01T19:53:14.989 INFO:teuthology.orchestra.console.smithi103:Power off completed 2023-08-01T19:53:14.991 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off 2023-08-01T19:53:15.011 INFO:teuthology.orchestra.console.smithi117:Power off completed 2023-08-01T19:53:15.023 INFO:teuthology.orchestra.console.smithi146:Power off completed 2023-08-01T19:53:15.093 INFO:teuthology.orchestra.console.smithi164:Power off completed 2023-08-01T19:53:15.140 INFO:teuthology.lock.ops:unlocked: smithi103.front.sepia.ceph.com 2023-08-01T19:53:15.155 INFO:teuthology.lock.ops:unlocked: smithi117.front.sepia.ceph.com 2023-08-01T19:53:15.164 INFO:teuthology.lock.ops:unlocked: smithi146.front.sepia.ceph.com 2023-08-01T19:53:15.239 INFO:teuthology.lock.ops:unlocked: smithi164.front.sepia.ceph.com