2023-07-24T05:04:06.950 INFO:root:teuthology version: 0.0.1.dev158+g1426592 2023-07-24T05:04:06.951 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-24T05:04:06.952 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-24T05:04:07.123 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f777ba153a0>, signals=[15]) 2023-07-24T05:04:07.125 INFO:teuthology.lock.ops:Start node 'smithi006.front.sepia.ceph.com' reimaging 2023-07-24T05:04:07.126 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: reset os type and version on server 2023-07-24T05:04:07.126 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2023-07-24T05:04:07.151 INFO:teuthology.lock.ops:Start node 'smithi008.front.sepia.ceph.com' reimaging 2023-07-24T05:04:07.151 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: reset os type and version on server 2023-07-24T05:04:07.151 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2023-07-24T05:04:07.153 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /host {"name": "smithi006"} 2023-07-24T05:04:07.175 INFO:teuthology.lock.ops:Start node 'smithi098.front.sepia.ceph.com' reimaging 2023-07-24T05:04:07.176 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: reset os type and version on server 2023-07-24T05:04:07.176 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2023-07-24T05:04:07.178 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /host {"name": "smithi008"} 2023-07-24T05:04:07.200 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /host {"name": "smithi098"} 2023-07-24T05:04:07.215 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-07-24T05:04:07.248 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-07-24T05:04:07.264 DEBUG:teuthology.provision.fog.smithi006:Requesting image smithi_centos_9.stream (ID 10) 2023-07-24T05:04:07.264 DEBUG:teuthology.provision.fog.smithi006:FOG request: PUT /host/112 {"imageID": 10} 2023-07-24T05:04:07.271 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-07-24T05:04:07.294 DEBUG:teuthology.provision.fog.smithi008:Requesting image smithi_centos_9.stream (ID 10) 2023-07-24T05:04:07.295 DEBUG:teuthology.provision.fog.smithi008:FOG request: PUT /host/114 {"imageID": 10} 2023-07-24T05:04:07.304 DEBUG:teuthology.provision.fog.smithi098:Requesting image smithi_centos_9.stream (ID 10) 2023-07-24T05:04:07.304 DEBUG:teuthology.provision.fog.smithi098:FOG request: PUT /host/203 {"imageID": 10} 2023-07-24T05:04:07.316 INFO:teuthology.provision.fog.smithi006:Scheduling deploy of centos 9.stream 2023-07-24T05:04:07.316 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:04:07.352 INFO:teuthology.provision.fog.smithi008:Scheduling deploy of centos 9.stream 2023-07-24T05:04:07.353 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:04:07.355 INFO:teuthology.provision.fog.smithi098:Scheduling deploy of centos 9.stream 2023-07-24T05:04:07.356 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:04:07.511 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /tasktype {"name": "deploy"} 2023-07-24T05:04:07.518 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /tasktype {"name": "deploy"} 2023-07-24T05:04:07.525 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /tasktype {"name": "deploy"} 2023-07-24T05:04:07.547 DEBUG:teuthology.provision.fog.smithi008:FOG request: POST /host/114/task {"taskTypeID": 1} 2023-07-24T05:04:07.553 DEBUG:teuthology.provision.fog.smithi006:FOG request: POST /host/112/task {"taskTypeID": 1} 2023-07-24T05:04:07.561 DEBUG:teuthology.provision.fog.smithi098:FOG request: POST /host/203/task {"taskTypeID": 1} 2023-07-24T05:04:07.612 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:04:07.614 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:04:07.615 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:04:07.843 INFO:teuthology.orchestra.console:Power off smithi008 2023-07-24T05:04:07.844 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-24T05:04:07.858 INFO:teuthology.orchestra.console:Power off smithi098 2023-07-24T05:04:07.859 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-24T05:04:07.874 INFO:teuthology.orchestra.console:Power off smithi006 2023-07-24T05:04:07.874 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-24T05:04:07.882 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-24T05:04:07.882 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:04:07.891 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-24T05:04:07.892 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:04:07.901 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-24T05:04:07.902 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:04:07.912 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-24T05:04:07.913 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-24T05:04:07.924 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-24T05:04:11.916 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:04:11.923 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:04:11.932 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:04:12.025 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-24T05:04:12.033 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-24T05:04:12.042 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-24T05:04:16.030 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:04:16.039 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:04:16.047 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:04:16.140 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-24T05:04:16.149 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-24T05:04:16.157 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-24T05:04:16.242 INFO:teuthology.orchestra.console:Power off for smithi008 completed 2023-07-24T05:04:16.343 INFO:teuthology.orchestra.console:Power on smithi008 2023-07-24T05:04:16.343 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-24T05:04:16.363 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On 2023-07-24T05:04:16.364 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:04:16.390 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-24T05:04:20.154 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:04:20.161 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:04:20.263 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-24T05:04:20.270 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-24T05:04:20.365 INFO:teuthology.orchestra.console:Power off for smithi098 completed 2023-07-24T05:04:20.371 INFO:teuthology.orchestra.console:Power off for smithi006 completed 2023-07-24T05:04:20.392 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:04:20.466 INFO:teuthology.orchestra.console:Power on smithi098 2023-07-24T05:04:20.466 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-24T05:04:20.474 INFO:teuthology.orchestra.console:Power on smithi006 2023-07-24T05:04:20.474 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-24T05:04:20.485 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On 2023-07-24T05:04:20.486 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:04:20.493 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On 2023-07-24T05:04:20.493 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:04:20.501 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-24T05:04:20.504 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-24T05:04:20.512 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-24T05:04:24.504 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:04:24.511 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:04:24.518 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:04:24.613 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-24T05:04:24.619 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-24T05:04:24.626 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-24T05:04:24.714 INFO:teuthology.orchestra.console:Power on for smithi008 completed 2023-07-24T05:04:24.727 INFO:teuthology.orchestra.console:Power on for smithi006 completed 2023-07-24T05:04:24.815 INFO:teuthology.provision.fog.smithi008:Waiting for deploy to finish 2023-07-24T05:04:24.816 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:04:24.828 INFO:teuthology.provision.fog.smithi006:Waiting for deploy to finish 2023-07-24T05:04:24.828 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:04:28.624 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:04:28.735 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-24T05:04:28.836 INFO:teuthology.orchestra.console:Power on for smithi098 completed 2023-07-24T05:04:28.937 INFO:teuthology.provision.fog.smithi098:Waiting for deploy to finish 2023-07-24T05:04:28.937 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:04:40.055 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:04:40.066 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:04:44.178 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:04:55.379 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:04:55.380 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:04:59.441 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:05:10.624 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:05:10.625 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:05:14.684 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:05:25.915 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:05:25.916 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:05:29.940 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:05:41.261 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:05:41.262 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:05:45.297 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:05:56.594 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:05:56.596 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:06:00.649 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:06:19.894 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:06:20.092 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:06:23.499 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:06:37.825 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:06:37.827 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:06:40.734 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:06:54.995 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:06:55.343 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:06:59.357 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:07:10.533 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:07:10.876 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:07:16.532 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:07:27.718 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:07:27.779 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:07:33.456 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:07:46.021 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:07:47.073 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:07:48.975 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:08:01.440 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:08:03.538 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:08:04.795 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:08:17.090 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:08:18.939 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:08:21.408 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:08:34.119 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:08:34.415 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:08:38.916 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:08:50.970 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:08:51.781 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:08:55.344 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:09:07.673 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:09:08.162 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:09:11.804 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:09:23.736 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:09:24.564 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:09:28.183 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:09:39.666 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:09:41.283 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:09:44.400 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:09:55.000 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:09:57.604 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:09:59.738 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:10:10.320 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:10:13.260 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:10:15.119 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:10:25.676 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:10:28.883 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:10:30.519 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:10:41.036 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:10:44.226 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:10:45.890 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:10:56.364 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:10:59.544 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:11:01.258 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:11:11.723 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:11:14.880 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:11:16.632 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:11:27.069 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:11:30.192 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:11:31.998 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:11:42.380 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:11:45.504 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:11:47.292 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:11:57.680 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:12:00.804 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:12:02.607 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:12:12.992 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:12:16.100 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:12:17.899 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:12:28.268 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:12:31.392 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:12:33.180 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:12:43.540 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:12:46.676 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:12:48.498 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:12:58.863 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:13:02.004 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:13:03.739 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:13:14.172 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:13:17.288 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:13:19.062 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:13:29.436 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:13:32.574 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:13:34.444 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:13:44.718 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:13:47.860 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:13:49.689 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:14:00.000 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:14:03.137 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:14:05.024 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:14:15.517 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:14:18.372 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:14:20.236 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:14:30.784 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:14:33.612 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:14:35.426 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:14:46.036 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:14:48.878 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:14:50.672 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:15:01.260 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:15:04.124 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:15:05.910 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:15:16.520 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:15:19.323 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:15:21.118 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:15:31.744 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:15:34.525 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:15:36.340 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:15:46.948 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:15:49.708 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:15:51.544 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:16:02.132 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:16:04.843 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:16:06.728 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:16:17.317 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:16:20.012 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:16:21.892 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:16:32.484 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:16:35.178 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:16:37.068 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:16:47.644 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:16:50.342 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:16:52.222 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:17:02.813 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:17:05.492 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:17:07.351 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:17:17.997 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:17:20.647 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:17:22.514 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:17:33.160 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:17:35.812 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:17:37.684 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:17:48.280 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:17:50.972 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:17:52.853 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:18:03.432 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:18:06.132 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:18:07.998 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:18:18.590 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:18:21.267 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:18:23.140 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:18:33.732 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:18:36.391 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:18:38.283 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:18:48.856 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:18:51.528 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:18:53.395 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:19:03.984 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:19:06.644 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:19:08.519 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:19:19.088 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:19:21.748 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:19:23.632 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:19:34.196 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-24T05:19:34.281 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:19:34.360 ERROR:teuthology.orchestra.connection:Error authenticating with smithi008.front.sepia.ceph.com: Authentication failed. 2023-07-24T05:19:34.362 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-24T05:19:34.362 DEBUG:teuthology.orchestra.run.smithi008:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-24T05:19:34.363 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-24T05:19:36.837 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:19:38.720 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:19:51.930 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:19:53.790 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:20:07.019 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:20:08.874 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-24T05:20:08.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:20:12.016 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-07-24T05:20:18.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:20:21.072 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-07-24T05:20:22.107 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:20:27.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:20:30.128 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-07-24T05:20:36.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:20:37.188 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-24T05:20:37.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:20:39.188 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-07-24T05:20:40.336 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2023-07-24T05:20:45.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:20:46.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:20:48.240 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-07-24T05:20:49.396 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2023-07-24T05:20:54.241 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:20:55.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:20:57.296 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-07-24T05:20:58.448 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2023-07-24T05:21:03.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:21:04.450 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:21:07.504 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2023-07-24T05:21:13.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:21:16.564 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2023-07-24T05:21:22.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:21:26.128 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-07-24T05:21:26.129 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi008 2023-07-24T05:21:35.138 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-07-24T05:21:35.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:21:35.405 DEBUG:teuthology.orchestra.run.smithi008:> true 2023-07-24T05:21:35.695 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-07-24T05:21:35.695 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-24T05:21:35.695 DEBUG:teuthology.orchestra.run.smithi008:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-24T05:21:35.709 INFO:teuthology.provision.fog.smithi008:Node is ready 2023-07-24T05:21:35.710 DEBUG:teuthology.orchestra.run.smithi008:> hostname 2023-07-24T05:21:35.764 INFO:teuthology.orchestra.run.smithi008.stdout:smithi008.front.sepia.ceph.com 2023-07-24T05:21:35.765 DEBUG:teuthology.orchestra.run.smithi008:> grep smithi008.front.sepia.ceph.com /etc/hosts 2023-07-24T05:21:35.820 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8 smithi008.front.sepia.ceph.com smithi008 2023-07-24T05:21:35.820 DEBUG:teuthology.orchestra.run.smithi008:> sudo hostname smithi008 2023-07-24T05:21:35.929 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/smithi008.front.sepia.ceph.com/smithi008/g' /etc/hosts 2023-07-24T05:21:35.961 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/172.21.15.8/172.21.15.8/g' /etc/hosts 2023-07-24T05:21:36.031 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/smithi008.front.sepia.ceph.com/smithi008/g' /etc/hostname 2023-07-24T05:21:36.102 DEBUG:teuthology.orchestra.run.smithi008:> sudo hostname smithi008 2023-07-24T05:21:36.172 DEBUG:teuthology.orchestra.run.smithi008:> cat /etc/os-release 2023-07-24T05:21:36.227 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="CentOS Stream" 2023-07-24T05:21:36.228 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="9" 2023-07-24T05:21:36.228 INFO:teuthology.orchestra.run.smithi008.stdout:ID="centos" 2023-07-24T05:21:36.228 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="rhel fedora" 2023-07-24T05:21:36.228 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="9" 2023-07-24T05:21:36.228 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el9" 2023-07-24T05:21:36.228 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-24T05:21:36.228 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31" 2023-07-24T05:21:36.229 INFO:teuthology.orchestra.run.smithi008.stdout:LOGO="fedora-logo-icon" 2023-07-24T05:21:36.229 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-24T05:21:36.229 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://centos.org/" 2023-07-24T05:21:36.229 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-24T05:21:36.229 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-24T05:21:36.229 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-24T05:21:36.230 INFO:teuthology.provision.fog.smithi008:Deploy complete! 2023-07-24T05:21:36.231 DEBUG:teuthology.parallel:result is None 2023-07-24T05:22:03.324 WARNING:teuthology.provision.fog.smithi098:timed out 2023-07-24T05:22:09.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:22:09.518 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-24T05:22:09.519 DEBUG:teuthology.orchestra.run.smithi098:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-24T05:22:09.887 INFO:teuthology.provision.fog.smithi098:Node is ready 2023-07-24T05:22:09.887 DEBUG:teuthology.orchestra.run.smithi098:> hostname 2023-07-24T05:22:09.901 INFO:teuthology.orchestra.run.smithi098.stdout:smithi098.front.sepia.ceph.com 2023-07-24T05:22:09.902 DEBUG:teuthology.orchestra.run.smithi098:> grep smithi098.front.sepia.ceph.com /etc/hosts 2023-07-24T05:22:09.956 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98 smithi098.front.sepia.ceph.com smithi098 2023-07-24T05:22:09.957 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098 2023-07-24T05:22:10.076 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098.front.sepia.ceph.com/smithi098/g' /etc/hosts 2023-07-24T05:22:10.105 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/172.21.15.98/172.21.15.98/g' /etc/hosts 2023-07-24T05:22:10.173 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098.front.sepia.ceph.com/smithi098/g' /etc/hostname 2023-07-24T05:22:10.240 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098 2023-07-24T05:22:10.307 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2023-07-24T05:22:10.362 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream" 2023-07-24T05:22:10.363 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="9" 2023-07-24T05:22:10.363 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos" 2023-07-24T05:22:10.363 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora" 2023-07-24T05:22:10.364 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="9" 2023-07-24T05:22:10.364 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el9" 2023-07-24T05:22:10.364 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-24T05:22:10.365 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31" 2023-07-24T05:22:10.365 INFO:teuthology.orchestra.run.smithi098.stdout:LOGO="fedora-logo-icon" 2023-07-24T05:22:10.365 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-24T05:22:10.365 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/" 2023-07-24T05:22:10.365 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-24T05:22:10.366 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-24T05:22:10.366 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-24T05:22:10.366 INFO:teuthology.provision.fog.smithi098:Deploy complete! 2023-07-24T05:22:10.367 DEBUG:teuthology.parallel:result is None 2023-07-24T05:22:22.576 WARNING:teuthology.provision.fog.smithi006:timed out 2023-07-24T05:22:28.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:22:28.840 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-24T05:22:28.841 DEBUG:teuthology.orchestra.run.smithi006:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-24T05:22:29.170 INFO:teuthology.provision.fog.smithi006:Node is ready 2023-07-24T05:22:29.170 DEBUG:teuthology.orchestra.run.smithi006:> hostname 2023-07-24T05:22:29.184 INFO:teuthology.orchestra.run.smithi006.stdout:smithi006.front.sepia.ceph.com 2023-07-24T05:22:29.184 DEBUG:teuthology.orchestra.run.smithi006:> grep smithi006.front.sepia.ceph.com /etc/hosts 2023-07-24T05:22:29.239 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6 smithi006.front.sepia.ceph.com smithi006 2023-07-24T05:22:29.241 DEBUG:teuthology.orchestra.run.smithi006:> sudo hostname smithi006 2023-07-24T05:22:29.352 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/smithi006.front.sepia.ceph.com/smithi006/g' /etc/hosts 2023-07-24T05:22:29.384 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/172.21.15.6/172.21.15.6/g' /etc/hosts 2023-07-24T05:22:29.454 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/smithi006.front.sepia.ceph.com/smithi006/g' /etc/hostname 2023-07-24T05:22:29.525 DEBUG:teuthology.orchestra.run.smithi006:> sudo hostname smithi006 2023-07-24T05:22:29.595 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2023-07-24T05:22:29.650 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="CentOS Stream" 2023-07-24T05:22:29.650 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="9" 2023-07-24T05:22:29.650 INFO:teuthology.orchestra.run.smithi006.stdout:ID="centos" 2023-07-24T05:22:29.651 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="rhel fedora" 2023-07-24T05:22:29.651 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="9" 2023-07-24T05:22:29.651 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el9" 2023-07-24T05:22:29.651 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-24T05:22:29.651 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31" 2023-07-24T05:22:29.651 INFO:teuthology.orchestra.run.smithi006.stdout:LOGO="fedora-logo-icon" 2023-07-24T05:22:29.651 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-24T05:22:29.651 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://centos.org/" 2023-07-24T05:22:29.652 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-24T05:22:29.652 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-24T05:22:29.652 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-24T05:22:29.652 INFO:teuthology.provision.fog.smithi006:Deploy complete! 2023-07-24T05:22:29.653 DEBUG:teuthology.parallel:result is None 2023-07-24T05:22:29.839 INFO:teuthology.lock.ops:Checking smithi006.front.sepia.ceph.com 2023-07-24T05:22:29.840 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-24T05:22:29.880 INFO:teuthology.lock.ops:Checking smithi008.front.sepia.ceph.com 2023-07-24T05:22:29.881 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-24T05:22:29.905 INFO:teuthology.lock.ops:Checking smithi098.front.sepia.ceph.com 2023-07-24T05:22:29.905 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-24T05:22:29.932 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: set os type and version on server 2023-07-24T05:22:29.932 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-07-24T05:22:29.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:22:30.027 DEBUG:teuthology.orchestra.run.smithi006:> true 2023-07-24T05:22:30.051 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-07-24T05:22:30.051 DEBUG:teuthology.orchestra.run.smithi006:> uname -m 2023-07-24T05:22:30.106 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64 2023-07-24T05:22:30.106 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2023-07-24T05:22:30.160 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="CentOS Stream" 2023-07-24T05:22:30.161 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="9" 2023-07-24T05:22:30.161 INFO:teuthology.orchestra.run.smithi006.stdout:ID="centos" 2023-07-24T05:22:30.161 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="rhel fedora" 2023-07-24T05:22:30.161 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="9" 2023-07-24T05:22:30.161 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el9" 2023-07-24T05:22:30.161 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-24T05:22:30.162 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31" 2023-07-24T05:22:30.162 INFO:teuthology.orchestra.run.smithi006.stdout:LOGO="fedora-logo-icon" 2023-07-24T05:22:30.162 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-24T05:22:30.163 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://centos.org/" 2023-07-24T05:22:30.163 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-24T05:22:30.163 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-24T05:22:30.163 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-24T05:22:30.164 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2023-07-24T05:22:30.189 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: set os type and version on server 2023-07-24T05:22:30.189 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-07-24T05:22:30.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:22:30.287 DEBUG:teuthology.orchestra.run.smithi008:> true 2023-07-24T05:22:30.471 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-07-24T05:22:30.471 DEBUG:teuthology.orchestra.run.smithi008:> uname -m 2023-07-24T05:22:30.525 INFO:teuthology.orchestra.run.smithi008.stdout:x86_64 2023-07-24T05:22:30.525 DEBUG:teuthology.orchestra.run.smithi008:> cat /etc/os-release 2023-07-24T05:22:30.580 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="CentOS Stream" 2023-07-24T05:22:30.580 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="9" 2023-07-24T05:22:30.581 INFO:teuthology.orchestra.run.smithi008.stdout:ID="centos" 2023-07-24T05:22:30.581 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="rhel fedora" 2023-07-24T05:22:30.581 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="9" 2023-07-24T05:22:30.581 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el9" 2023-07-24T05:22:30.581 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-24T05:22:30.581 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31" 2023-07-24T05:22:30.581 INFO:teuthology.orchestra.run.smithi008.stdout:LOGO="fedora-logo-icon" 2023-07-24T05:22:30.581 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-24T05:22:30.582 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://centos.org/" 2023-07-24T05:22:30.582 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-24T05:22:30.582 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-24T05:22:30.582 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-24T05:22:30.583 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2023-07-24T05:22:30.605 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: set os type and version on server 2023-07-24T05:22:30.606 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2023-07-24T05:22:30.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:22:30.687 DEBUG:teuthology.orchestra.run.smithi098:> true 2023-07-24T05:22:30.854 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2023-07-24T05:22:30.855 DEBUG:teuthology.orchestra.run.smithi098:> uname -m 2023-07-24T05:22:30.909 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64 2023-07-24T05:22:30.909 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2023-07-24T05:22:30.963 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream" 2023-07-24T05:22:30.963 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="9" 2023-07-24T05:22:30.963 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos" 2023-07-24T05:22:30.963 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora" 2023-07-24T05:22:30.964 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="9" 2023-07-24T05:22:30.964 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el9" 2023-07-24T05:22:30.964 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-24T05:22:30.964 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31" 2023-07-24T05:22:30.964 INFO:teuthology.orchestra.run.smithi098.stdout:LOGO="fedora-logo-icon" 2023-07-24T05:22:30.964 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-24T05:22:30.965 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/" 2023-07-24T05:22:30.965 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-24T05:22:30.965 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-24T05:22:30.965 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-24T05:22:30.965 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2023-07-24T05:22:30.989 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-24T05:22:30.989 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-24T05:22:31.093 INFO:teuthology.dispatcher.supervisor:Running job 7349247 2023-07-24T05:22:31.093 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_1426592083662fef3e03bbeec33624331f0fdbc1/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-07-24_05:02:48-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7349247 --name vshankar-2023-07-24_05:02:48-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi --description fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} -- /home/teuthworker/archive/vshankar-2023-07-24_05:02:48-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7349247/orig.config.yaml 2023-07-24T05:22:31.097 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-07-24_05:02:48-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7349247 2023-07-24T05:22:31.098 INFO:teuthology.dispatcher.supervisor:Job PID: 27294 2023-07-24T05:22:31.098 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-24T05:24:31.198 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-24T05:24:31.199 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-24T05:24:31.278 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120