2023-07-26T23:32:31.278 INFO:root:teuthology version: 0.0.1.dev160+g407880c 2023-07-26T23:32:31.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T23:32:31.280 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T23:33:01.038 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fcf88806310>, signals=[15]) 2023-07-26T23:33:01.040 INFO:teuthology.lock.ops:Start node 'smithi003.front.sepia.ceph.com' reimaging 2023-07-26T23:33:01.040 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: reset os type and version on server 2023-07-26T23:33:01.040 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2023-07-26T23:33:06.065 INFO:teuthology.lock.ops:Start node 'smithi118.front.sepia.ceph.com' reimaging 2023-07-26T23:33:06.065 INFO:teuthology.lock.ops:Updating [smithi118.front.sepia.ceph.com]: reset os type and version on server 2023-07-26T23:33:06.066 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2023-07-26T23:33:06.067 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /host {"name": "smithi003"} 2023-07-26T23:33:07.198 INFO:teuthology.lock.ops:Start node 'smithi203.front.sepia.ceph.com' reimaging 2023-07-26T23:33:07.198 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: reset os type and version on server 2023-07-26T23:33:07.198 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server 2023-07-26T23:33:07.199 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /host {"name": "smithi118"} 2023-07-26T23:33:07.225 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /host {"name": "smithi203"} 2023-07-26T23:33:07.237 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-07-26T23:33:07.263 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-07-26T23:33:07.278 DEBUG:teuthology.provision.fog.smithi003:Requesting image smithi_centos_9.stream (ID 10) 2023-07-26T23:33:07.278 DEBUG:teuthology.provision.fog.smithi003:FOG request: PUT /host/109 {"imageID": 10} 2023-07-26T23:33:07.285 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-07-26T23:33:07.300 DEBUG:teuthology.provision.fog.smithi118:Requesting image smithi_centos_9.stream (ID 10) 2023-07-26T23:33:07.300 DEBUG:teuthology.provision.fog.smithi118:FOG request: PUT /host/223 {"imageID": 10} 2023-07-26T23:33:07.321 DEBUG:teuthology.provision.fog.smithi203:Requesting image smithi_centos_9.stream (ID 10) 2023-07-26T23:33:07.321 DEBUG:teuthology.provision.fog.smithi203:FOG request: PUT /host/307 {"imageID": 10} 2023-07-26T23:33:07.331 INFO:teuthology.provision.fog.smithi003:Scheduling deploy of centos 9.stream 2023-07-26T23:33:07.332 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-26T23:33:07.340 INFO:teuthology.provision.fog.smithi118:Scheduling deploy of centos 9.stream 2023-07-26T23:33:07.340 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-26T23:33:07.362 INFO:teuthology.provision.fog.smithi203:Scheduling deploy of centos 9.stream 2023-07-26T23:33:07.362 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-26T23:33:07.368 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /tasktype {"name": "deploy"} 2023-07-26T23:33:07.373 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /tasktype {"name": "deploy"} 2023-07-26T23:33:07.395 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /tasktype {"name": "deploy"} 2023-07-26T23:33:07.399 DEBUG:teuthology.provision.fog.smithi003:FOG request: POST /host/109/task {"taskTypeID": 1} 2023-07-26T23:33:07.408 DEBUG:teuthology.provision.fog.smithi118:FOG request: POST /host/223/task {"taskTypeID": 1} 2023-07-26T23:33:07.427 DEBUG:teuthology.provision.fog.smithi203:FOG request: POST /host/307/task {"taskTypeID": 1} 2023-07-26T23:33:07.550 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-26T23:33:07.582 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-26T23:33:07.594 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-26T23:33:07.638 INFO:teuthology.orchestra.console:Power off smithi003 2023-07-26T23:33:07.640 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-26T23:33:07.661 INFO:teuthology.orchestra.console:Power off smithi118 2023-07-26T23:33:07.662 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-26T23:33:07.672 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-26T23:33:07.673 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T23:33:07.683 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-26T23:33:07.684 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T23:33:07.698 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-26T23:33:07.704 INFO:teuthology.orchestra.console:Power off smithi203 2023-07-26T23:33:07.705 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-26T23:33:07.715 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T23:33:07.727 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-26T23:33:07.727 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T23:33:07.750 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T23:33:07.817 INFO:teuthology.orchestra.console:Power off for smithi118 completed 2023-07-26T23:33:07.851 INFO:teuthology.orchestra.console:Power off for smithi203 completed 2023-07-26T23:33:07.918 INFO:teuthology.orchestra.console:Power on smithi118 2023-07-26T23:33:07.919 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-26T23:33:07.941 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On 2023-07-26T23:33:07.942 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T23:33:07.953 INFO:teuthology.orchestra.console:Power on smithi203 2023-07-26T23:33:07.954 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-26T23:33:07.964 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T23:33:07.975 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On 2023-07-26T23:33:07.976 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T23:33:07.998 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T23:33:11.700 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T23:33:11.966 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T23:33:11.999 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T23:33:12.109 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T23:33:12.809 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T23:33:13.076 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T23:33:16.112 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T23:33:16.222 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-26T23:33:16.323 INFO:teuthology.orchestra.console:Power on for smithi203 completed 2023-07-26T23:33:16.424 INFO:teuthology.provision.fog.smithi203:Waiting for deploy to finish 2023-07-26T23:33:16.424 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-26T23:33:21.428 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T23:33:21.436 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T23:33:21.547 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-26T23:33:21.648 INFO:teuthology.orchestra.console:Power on for smithi118 completed 2023-07-26T23:33:21.749 INFO:teuthology.provision.fog.smithi118:Waiting for deploy to finish 2023-07-26T23:33:21.750 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-26T23:33:26.757 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T23:33:30.760 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T23:33:31.869 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T23:33:35.871 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T23:33:36.507 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-26T23:33:41.516 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T23:33:41.809 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-26T23:33:45.520 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T23:33:46.630 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T23:33:50.633 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T23:33:51.743 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T23:33:55.744 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T23:33:56.578 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-26T23:34:01.585 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-26T23:34:06.592 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T23:34:06.693 INFO:teuthology.orchestra.console:Power off for smithi003 completed 2023-07-26T23:34:06.795 INFO:teuthology.orchestra.console:Power on smithi003 2023-07-26T23:34:06.795 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-26T23:34:06.818 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On 2023-07-26T23:34:06.819 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T23:34:06.841 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T23:34:10.844 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T23:34:10.954 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T23:34:14.956 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T23:34:16.067 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T23:34:20.068 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T23:34:21.179 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T23:34:21.649 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-26T23:34:21.654 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-26T23:34:25.180 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T23:34:26.292 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T23:34:30.294 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T23:34:31.404 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T23:34:35.406 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T23:34:35.517 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-26T23:34:35.618 INFO:teuthology.orchestra.console:Power on for smithi003 completed 2023-07-26T23:34:35.719 INFO:teuthology.provision.fog.smithi003:Waiting for deploy to finish 2023-07-26T23:34:35.720 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-26T23:34:40.725 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-26T23:34:40.726 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-26T23:34:59.316 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-26T23:34:59.317 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-26T23:34:59.318 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-26T23:35:17.564 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-26T23:35:17.565 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-26T23:35:17.566 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-26T23:35:37.564 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-26T23:35:37.565 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-26T23:35:47.577 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-26T23:36:02.649 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-26T23:36:02.651 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-26T23:36:09.946 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-26T23:36:10.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T23:36:13.076 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-07-26T23:36:19.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T23:36:25.020 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-26T23:36:25.021 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-26T23:36:35.032 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-07-26T23:36:35.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T23:36:40.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T23:36:45.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T23:36:50.105 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-07-26T23:36:53.168 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-07-26T23:36:56.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T23:36:58.480 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-07-26T23:36:59.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T23:37:00.247 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-07-26T23:37:04.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T23:37:06.250 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T23:37:11.257 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-07-26T23:37:14.320 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-07-26T23:37:17.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T23:37:22.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T23:37:27.269 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-07-26T23:37:30.320 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-07-26T23:37:33.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T23:37:38.279 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T23:37:56.595 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-07-26T23:38:00.248 WARNING:teuthology.provision.fog.smithi203:timed out 2023-07-26T23:38:02.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T23:38:05.680 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-07-26T23:38:06.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T23:38:11.524 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-26T23:38:11.525 DEBUG:teuthology.orchestra.run.smithi203:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-26T23:38:11.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T23:38:16.756 INFO:teuthology.provision.fog.smithi203:Node is ready 2023-07-26T23:38:16.756 DEBUG:teuthology.orchestra.run.smithi203:> hostname 2023-07-26T23:38:16.773 INFO:teuthology.orchestra.run.smithi203.stdout:smithi203.front.sepia.ceph.com 2023-07-26T23:38:16.773 DEBUG:teuthology.orchestra.run.smithi203:> grep smithi203.front.sepia.ceph.com /etc/hosts 2023-07-26T23:38:16.830 INFO:teuthology.orchestra.run.smithi203.stdout:172.21.15.203 smithi203.front.sepia.ceph.com smithi203 2023-07-26T23:38:16.831 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203 2023-07-26T23:38:16.933 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-26T23:38:16.934 DEBUG:teuthology.orchestra.run.smithi118:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-26T23:38:16.944 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-26T23:38:16.945 DEBUG:teuthology.orchestra.run.smithi003:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-26T23:38:16.964 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi203.front.sepia.ceph.com/smithi203/g' /etc/hosts 2023-07-26T23:38:16.996 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/172.21.15.203/172.21.15.203/g' /etc/hosts 2023-07-26T23:38:17.067 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi203.front.sepia.ceph.com/smithi203/g' /etc/hostname 2023-07-26T23:38:17.138 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203 2023-07-26T23:38:17.207 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release 2023-07-26T23:38:17.263 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="CentOS Stream" 2023-07-26T23:38:17.263 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="9" 2023-07-26T23:38:17.263 INFO:teuthology.orchestra.run.smithi203.stdout:ID="centos" 2023-07-26T23:38:17.264 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="rhel fedora" 2023-07-26T23:38:17.264 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="9" 2023-07-26T23:38:17.264 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el9" 2023-07-26T23:38:17.264 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-26T23:38:17.264 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31" 2023-07-26T23:38:17.264 INFO:teuthology.orchestra.run.smithi203.stdout:LOGO="fedora-logo-icon" 2023-07-26T23:38:17.264 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-26T23:38:17.265 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://centos.org/" 2023-07-26T23:38:17.265 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-26T23:38:17.265 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-26T23:38:17.265 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-26T23:38:17.266 INFO:teuthology.provision.fog.smithi203:Deploy complete! 2023-07-26T23:38:17.267 DEBUG:teuthology.parallel:result is None 2023-07-26T23:38:32.259 INFO:teuthology.provision.fog.smithi003:Node is ready 2023-07-26T23:38:32.259 DEBUG:teuthology.orchestra.run.smithi003:> hostname 2023-07-26T23:38:32.279 INFO:teuthology.orchestra.run.smithi003.stdout:smithi003.front.sepia.ceph.com 2023-07-26T23:38:32.279 DEBUG:teuthology.orchestra.run.smithi003:> grep smithi003.front.sepia.ceph.com /etc/hosts 2023-07-26T23:38:32.336 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3 smithi003.front.sepia.ceph.com smithi003 2023-07-26T23:38:32.336 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname smithi003 2023-07-26T23:38:32.463 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/smithi003.front.sepia.ceph.com/smithi003/g' /etc/hosts 2023-07-26T23:38:32.499 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/172.21.15.3/172.21.15.3/g' /etc/hosts 2023-07-26T23:38:32.571 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/smithi003.front.sepia.ceph.com/smithi003/g' /etc/hostname 2023-07-26T23:38:32.644 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname smithi003 2023-07-26T23:38:32.716 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2023-07-26T23:38:32.771 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="CentOS Stream" 2023-07-26T23:38:32.771 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="9" 2023-07-26T23:38:32.771 INFO:teuthology.orchestra.run.smithi003.stdout:ID="centos" 2023-07-26T23:38:32.771 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="rhel fedora" 2023-07-26T23:38:32.772 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="9" 2023-07-26T23:38:32.772 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el9" 2023-07-26T23:38:32.772 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-26T23:38:32.772 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31" 2023-07-26T23:38:32.772 INFO:teuthology.orchestra.run.smithi003.stdout:LOGO="fedora-logo-icon" 2023-07-26T23:38:32.772 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-26T23:38:32.773 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://centos.org/" 2023-07-26T23:38:32.773 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-26T23:38:32.773 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-26T23:38:32.773 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-26T23:38:32.773 INFO:teuthology.provision.fog.smithi003:Deploy complete! 2023-07-26T23:38:32.774 DEBUG:teuthology.parallel:result is None 2023-07-26T23:38:37.226 INFO:teuthology.provision.fog.smithi118:Node is ready 2023-07-26T23:38:37.226 DEBUG:teuthology.orchestra.run.smithi118:> hostname 2023-07-26T23:38:37.244 INFO:teuthology.orchestra.run.smithi118.stdout:smithi118.front.sepia.ceph.com 2023-07-26T23:38:37.244 DEBUG:teuthology.orchestra.run.smithi118:> grep smithi118.front.sepia.ceph.com /etc/hosts 2023-07-26T23:38:37.302 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118 smithi118.front.sepia.ceph.com smithi118 2023-07-26T23:38:37.302 DEBUG:teuthology.orchestra.run.smithi118:> sudo hostname smithi118 2023-07-26T23:38:37.419 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/smithi118.front.sepia.ceph.com/smithi118/g' /etc/hosts 2023-07-26T23:38:37.452 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/172.21.15.118/172.21.15.118/g' /etc/hosts 2023-07-26T23:38:37.523 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/smithi118.front.sepia.ceph.com/smithi118/g' /etc/hostname 2023-07-26T23:38:37.594 DEBUG:teuthology.orchestra.run.smithi118:> sudo hostname smithi118 2023-07-26T23:38:37.663 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release 2023-07-26T23:38:37.719 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="CentOS Stream" 2023-07-26T23:38:37.720 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="9" 2023-07-26T23:38:37.720 INFO:teuthology.orchestra.run.smithi118.stdout:ID="centos" 2023-07-26T23:38:37.720 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE="rhel fedora" 2023-07-26T23:38:37.720 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="9" 2023-07-26T23:38:37.720 INFO:teuthology.orchestra.run.smithi118.stdout:PLATFORM_ID="platform:el9" 2023-07-26T23:38:37.720 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-26T23:38:37.720 INFO:teuthology.orchestra.run.smithi118.stdout:ANSI_COLOR="0;31" 2023-07-26T23:38:37.721 INFO:teuthology.orchestra.run.smithi118.stdout:LOGO="fedora-logo-icon" 2023-07-26T23:38:37.721 INFO:teuthology.orchestra.run.smithi118.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-26T23:38:37.721 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://centos.org/" 2023-07-26T23:38:37.721 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-26T23:38:37.721 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-26T23:38:37.721 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-26T23:38:37.722 INFO:teuthology.provision.fog.smithi118:Deploy complete! 2023-07-26T23:38:37.722 DEBUG:teuthology.parallel:result is None 2023-07-26T23:38:39.499 INFO:teuthology.lock.ops:Checking smithi003.front.sepia.ceph.com 2023-07-26T23:38:39.500 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-26T23:38:39.521 INFO:teuthology.lock.ops:Checking smithi118.front.sepia.ceph.com 2023-07-26T23:38:39.522 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-26T23:38:39.546 INFO:teuthology.lock.ops:Checking smithi203.front.sepia.ceph.com 2023-07-26T23:38:39.547 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-26T23:38:39.564 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: set os type and version on server 2023-07-26T23:38:39.565 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-07-26T23:38:39.565 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T23:38:39.664 DEBUG:teuthology.orchestra.run.smithi003:> true 2023-07-26T23:38:39.736 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-07-26T23:38:39.737 DEBUG:teuthology.orchestra.run.smithi003:> uname -m 2023-07-26T23:38:39.793 INFO:teuthology.orchestra.run.smithi003.stdout:x86_64 2023-07-26T23:38:39.794 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2023-07-26T23:38:39.849 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="CentOS Stream" 2023-07-26T23:38:39.850 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="9" 2023-07-26T23:38:39.850 INFO:teuthology.orchestra.run.smithi003.stdout:ID="centos" 2023-07-26T23:38:39.850 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="rhel fedora" 2023-07-26T23:38:39.850 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="9" 2023-07-26T23:38:39.850 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el9" 2023-07-26T23:38:39.850 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-26T23:38:39.851 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31" 2023-07-26T23:38:39.851 INFO:teuthology.orchestra.run.smithi003.stdout:LOGO="fedora-logo-icon" 2023-07-26T23:38:39.851 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-26T23:38:39.851 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://centos.org/" 2023-07-26T23:38:39.851 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-26T23:38:39.851 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-26T23:38:39.851 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-26T23:38:39.852 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2023-07-26T23:38:39.880 INFO:teuthology.lock.ops:Updating [smithi118.front.sepia.ceph.com]: set os type and version on server 2023-07-26T23:38:39.880 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-07-26T23:38:39.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T23:38:39.964 DEBUG:teuthology.orchestra.run.smithi118:> true 2023-07-26T23:38:40.032 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-07-26T23:38:40.032 DEBUG:teuthology.orchestra.run.smithi118:> uname -m 2023-07-26T23:38:40.087 INFO:teuthology.orchestra.run.smithi118.stdout:x86_64 2023-07-26T23:38:40.087 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release 2023-07-26T23:38:40.142 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="CentOS Stream" 2023-07-26T23:38:40.142 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="9" 2023-07-26T23:38:40.143 INFO:teuthology.orchestra.run.smithi118.stdout:ID="centos" 2023-07-26T23:38:40.143 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE="rhel fedora" 2023-07-26T23:38:40.143 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="9" 2023-07-26T23:38:40.143 INFO:teuthology.orchestra.run.smithi118.stdout:PLATFORM_ID="platform:el9" 2023-07-26T23:38:40.143 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-26T23:38:40.143 INFO:teuthology.orchestra.run.smithi118.stdout:ANSI_COLOR="0;31" 2023-07-26T23:38:40.143 INFO:teuthology.orchestra.run.smithi118.stdout:LOGO="fedora-logo-icon" 2023-07-26T23:38:40.144 INFO:teuthology.orchestra.run.smithi118.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-26T23:38:40.144 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://centos.org/" 2023-07-26T23:38:40.144 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-26T23:38:40.144 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-26T23:38:40.144 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-26T23:38:40.145 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2023-07-26T23:38:40.172 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: set os type and version on server 2023-07-26T23:38:40.172 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2023-07-26T23:38:40.173 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T23:38:40.253 DEBUG:teuthology.orchestra.run.smithi203:> true 2023-07-26T23:38:40.423 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi203.front.sepia.ceph.com' 2023-07-26T23:38:40.423 DEBUG:teuthology.orchestra.run.smithi203:> uname -m 2023-07-26T23:38:40.477 INFO:teuthology.orchestra.run.smithi203.stdout:x86_64 2023-07-26T23:38:40.478 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release 2023-07-26T23:38:40.532 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="CentOS Stream" 2023-07-26T23:38:40.532 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="9" 2023-07-26T23:38:40.533 INFO:teuthology.orchestra.run.smithi203.stdout:ID="centos" 2023-07-26T23:38:40.533 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="rhel fedora" 2023-07-26T23:38:40.533 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="9" 2023-07-26T23:38:40.534 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el9" 2023-07-26T23:38:40.534 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-26T23:38:40.534 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31" 2023-07-26T23:38:40.534 INFO:teuthology.orchestra.run.smithi203.stdout:LOGO="fedora-logo-icon" 2023-07-26T23:38:40.535 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-26T23:38:40.535 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://centos.org/" 2023-07-26T23:38:40.535 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-26T23:38:40.535 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-26T23:38:40.536 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-26T23:38:40.536 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server 2023-07-26T23:38:45.564 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T23:38:45.564 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T23:38:50.664 INFO:teuthology.dispatcher.supervisor:Running job 7353251 2023-07-26T23:38:50.664 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-07-26_14:34:38-fs-reef-release-distro-default-smithi/7353251 --name yuriw-2023-07-26_14:34:38-fs-reef-release-distro-default-smithi --description fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} -- /home/teuthworker/archive/yuriw-2023-07-26_14:34:38-fs-reef-release-distro-default-smithi/7353251/orig.config.yaml 2023-07-26T23:38:50.668 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-07-26_14:34:38-fs-reef-release-distro-default-smithi/7353251 2023-07-26T23:38:50.669 INFO:teuthology.dispatcher.supervisor:Job PID: 5288 2023-07-26T23:38:50.669 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-26T23:40:50.769 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T23:40:50.770 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T23:42:51.933 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T23:42:51.934 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T23:44:52.116 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T23:44:52.117 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T23:46:57.293 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T23:46:57.294 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T23:48:57.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T23:48:57.466 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T23:50:58.401 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T23:50:58.402 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T23:53:01.424 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T23:53:01.425 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T23:53:06.501 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-26T23:53:21.666 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-26T23:53:21.667 INFO:teuthology.nuke:Checking targets against current locks 2023-07-26T23:53:25.686 DEBUG:teuthology.nuke:shortname: smithi003 2023-07-26T23:53:25.686 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-26T23:53:25.702 DEBUG:teuthology.nuke:shortname: smithi118 2023-07-26T23:53:25.703 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-26T23:53:25.715 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi003.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-26_14:34:38-fs-reef-release-distro-default-smithi/7353251', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-26 23:32:20.293151', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLKMf3USLvxVEWb2rNxQOEKG9GGnCdYffA28h9bzg7aveiAxYWbdd9lO3+debXnzfxcYKKAEHoAwTushyE746Hw='} 2023-07-26T23:53:25.730 DEBUG:teuthology.nuke:shortname: smithi203 2023-07-26T23:53:25.730 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-26T23:53:25.733 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi118.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-26_14:34:38-fs-reef-release-distro-default-smithi/7353251', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-26 23:32:20.291852', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB2DrwJ+3YGsR+aEuDE5Oa/ku0j3lgeIGM84c4MUUw2UWuNCWyEbwI5wqcjhf55yM+quD9vFJbhj+qiCUE3Aqxg='} 2023-07-26T23:53:25.752 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi203.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-26_14:34:38-fs-reef-release-distro-default-smithi/7353251', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-26 23:32:20.289739', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHd+IeCSN0sGfBZEXLn5Tv/KnH+MMEAuf2A5bje8BB8quegBQ110HVa5FqCKPyGIx3+H4znMaQcDB1c7GPU0i6U='} 2023-07-26T23:53:25.765 INFO:teuthology.orchestra.console:Power off smithi003 2023-07-26T23:53:25.766 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-26T23:53:25.786 INFO:teuthology.orchestra.console:Power off smithi118 2023-07-26T23:53:25.786 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-26T23:53:25.798 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-26T23:53:25.799 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T23:53:25.808 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-26T23:53:25.809 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T23:53:25.820 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T23:53:25.829 INFO:teuthology.orchestra.console:Power off smithi203 2023-07-26T23:53:25.829 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-26T23:53:25.841 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T23:53:25.854 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-26T23:53:25.855 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T23:53:25.875 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T23:53:25.921 INFO:teuthology.orchestra.console:Power off for smithi003 completed 2023-07-26T23:53:25.943 INFO:teuthology.orchestra.console:Power off for smithi118 completed 2023-07-26T23:53:25.977 INFO:teuthology.orchestra.console:Power off for smithi203 completed 2023-07-26T23:53:26.070 INFO:teuthology.lock.ops:unlocked: smithi003.front.sepia.ceph.com 2023-07-26T23:53:26.087 INFO:teuthology.lock.ops:unlocked: smithi118.front.sepia.ceph.com 2023-07-26T23:53:26.130 INFO:teuthology.lock.ops:unlocked: smithi203.front.sepia.ceph.com