2023-07-26T09:27:32.311 INFO:root:teuthology version: 0.0.1.dev160+g407880c 2023-07-26T09:27:32.313 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T09:27:32.314 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T09:28:02.553 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5f729a41f0>, signals=[15]) 2023-07-26T09:28:02.555 INFO:teuthology.lock.ops:Start node 'smithi073.front.sepia.ceph.com' reimaging 2023-07-26T09:28:02.555 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: reset os type and version on server 2023-07-26T09:28:02.555 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2023-07-26T09:28:07.587 INFO:teuthology.lock.ops:Start node 'smithi083.front.sepia.ceph.com' reimaging 2023-07-26T09:28:07.588 INFO:teuthology.lock.ops:Updating [smithi083.front.sepia.ceph.com]: reset os type and version on server 2023-07-26T09:28:07.588 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server 2023-07-26T09:28:07.589 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /host {"name": "smithi073"} 2023-07-26T09:28:07.629 INFO:teuthology.lock.ops:Start node 'smithi123.front.sepia.ceph.com' reimaging 2023-07-26T09:28:07.629 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: reset os type and version on server 2023-07-26T09:28:07.630 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2023-07-26T09:28:07.632 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /host {"name": "smithi083"} 2023-07-26T09:28:07.654 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /host {"name": "smithi123"} 2023-07-26T09:28:07.660 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-26T09:28:07.691 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-26T09:28:07.703 DEBUG:teuthology.provision.fog.smithi073:Requesting image smithi_centos_8.stream (ID 3) 2023-07-26T09:28:07.704 DEBUG:teuthology.provision.fog.smithi073:FOG request: PUT /host/178 {"imageID": 3} 2023-07-26T09:28:07.726 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-26T09:28:07.732 DEBUG:teuthology.provision.fog.smithi083:Requesting image smithi_centos_8.stream (ID 3) 2023-07-26T09:28:07.733 DEBUG:teuthology.provision.fog.smithi083:FOG request: PUT /host/188 {"imageID": 3} 2023-07-26T09:28:07.740 INFO:teuthology.provision.fog.smithi073:Scheduling deploy of centos 8.stream 2023-07-26T09:28:07.740 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-07-26T09:28:07.770 DEBUG:teuthology.provision.fog.smithi123:Requesting image smithi_centos_8.stream (ID 3) 2023-07-26T09:28:07.770 DEBUG:teuthology.provision.fog.smithi123:FOG request: PUT /host/228 {"imageID": 3} 2023-07-26T09:28:07.774 INFO:teuthology.provision.fog.smithi083:Scheduling deploy of centos 8.stream 2023-07-26T09:28:07.775 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-26T09:28:07.781 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /tasktype {"name": "deploy"} 2023-07-26T09:28:07.807 INFO:teuthology.provision.fog.smithi123:Scheduling deploy of centos 8.stream 2023-07-26T09:28:07.808 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-07-26T09:28:07.814 DEBUG:teuthology.provision.fog.smithi073:FOG request: POST /host/178/task {"taskTypeID": 1} 2023-07-26T09:28:07.818 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /tasktype {"name": "deploy"} 2023-07-26T09:28:07.845 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /tasktype {"name": "deploy"} 2023-07-26T09:28:07.848 DEBUG:teuthology.provision.fog.smithi083:FOG request: POST /host/188/task {"taskTypeID": 1} 2023-07-26T09:28:07.861 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-07-26T09:28:07.885 DEBUG:teuthology.provision.fog.smithi123:FOG request: POST /host/228/task {"taskTypeID": 1} 2023-07-26T09:28:07.899 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-26T09:28:07.935 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-07-26T09:28:07.948 INFO:teuthology.orchestra.console:Power off smithi073 2023-07-26T09:28:07.950 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-26T09:28:12.980 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-26T09:28:12.981 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T09:28:12.995 INFO:teuthology.orchestra.console:Power off smithi083 2023-07-26T09:28:12.996 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-26T09:28:13.006 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T09:28:13.038 INFO:teuthology.orchestra.console:Power off smithi123 2023-07-26T09:28:13.039 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-26T09:28:13.108 INFO:teuthology.orchestra.console:Power off for smithi073 completed 2023-07-26T09:28:13.209 INFO:teuthology.orchestra.console:Power on smithi073 2023-07-26T09:28:13.209 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-26T09:28:18.023 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-26T09:28:18.024 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T09:28:18.062 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-26T09:28:18.063 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T09:28:18.234 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On 2023-07-26T09:28:18.235 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T09:28:19.032 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T09:28:19.071 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T09:28:19.243 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T09:28:23.036 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T09:28:23.073 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T09:28:23.184 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-26T09:28:23.244 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T09:28:24.146 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T09:28:24.354 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T09:28:27.189 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T09:28:28.148 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T09:28:28.299 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T09:28:28.355 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T09:28:29.259 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T09:28:29.466 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T09:28:32.300 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T09:28:33.261 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T09:28:33.410 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T09:28:33.466 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T09:28:34.372 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T09:28:34.577 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T09:28:37.415 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T09:28:38.375 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T09:28:38.527 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T09:28:38.578 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T09:28:39.485 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T09:28:39.688 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T09:28:42.531 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T09:28:43.486 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T09:28:43.640 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T09:28:43.688 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T09:28:44.596 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T09:28:44.798 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T09:28:47.644 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T09:28:48.597 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T09:28:48.709 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T09:28:48.755 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T09:28:48.799 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T09:28:48.811 INFO:teuthology.orchestra.console:Power off for smithi083 completed 2023-07-26T09:28:48.912 INFO:teuthology.orchestra.console:Power on smithi083 2023-07-26T09:28:48.913 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-26T09:28:49.911 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T09:28:52.756 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T09:28:53.865 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T09:28:53.912 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T09:28:54.022 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-26T09:28:54.123 INFO:teuthology.orchestra.console:Power on for smithi073 completed 2023-07-26T09:28:54.224 INFO:teuthology.provision.fog.smithi073:Waiting for deploy to finish 2023-07-26T09:28:54.225 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-07-26T09:28:57.868 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T09:28:58.976 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T09:29:02.978 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T09:29:03.946 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On 2023-07-26T09:29:03.947 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T09:29:04.087 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T09:29:04.958 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T09:29:08.089 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T09:29:08.199 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T09:29:08.300 INFO:teuthology.orchestra.console:Power off for smithi123 completed 2023-07-26T09:29:08.401 INFO:teuthology.orchestra.console:Power on smithi123 2023-07-26T09:29:08.402 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-26T09:29:08.423 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On 2023-07-26T09:29:08.423 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T09:29:08.442 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T09:29:08.960 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T09:29:09.290 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-07-26T09:29:14.300 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T09:29:14.308 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T09:29:15.410 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T09:29:18.312 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T09:29:19.411 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T09:29:19.421 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T09:29:19.520 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-26T09:29:19.621 INFO:teuthology.orchestra.console:Power on for smithi123 completed 2023-07-26T09:29:19.722 INFO:teuthology.provision.fog.smithi123:Waiting for deploy to finish 2023-07-26T09:29:19.722 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-07-26T09:29:24.247 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T09:29:25.357 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T09:29:29.359 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T09:29:29.367 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-07-26T09:29:34.383 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-26T09:29:34.485 INFO:teuthology.orchestra.console:Power on for smithi083 completed 2023-07-26T09:29:34.585 INFO:teuthology.provision.fog.smithi083:Waiting for deploy to finish 2023-07-26T09:29:34.586 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-26T09:29:39.312 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-07-26T09:29:49.444 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-07-26T09:29:54.452 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-26T09:29:54.454 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-07-26T09:30:19.540 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-07-26T09:30:19.542 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-26T09:30:19.543 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-07-26T09:30:47.096 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-07-26T09:30:47.097 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-07-26T09:30:57.109 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-26T09:30:58.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T09:30:58.583 ERROR:teuthology.orchestra.connection:Error authenticating with smithi073.front.sepia.ceph.com: Authentication failed. 2023-07-26T09:30:58.585 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-26T09:30:58.585 DEBUG:teuthology.orchestra.run.smithi073:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-26T09:30:58.586 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T09:31:13.433 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-07-26T09:31:18.441 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-26T09:31:38.507 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-26T09:31:41.998 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-07-26T09:31:57.076 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-26T09:32:02.080 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-07-26T09:32:02.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T09:32:02.153 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T09:32:05.200 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-07-26T09:32:05.232 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-07-26T09:32:11.202 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T09:32:11.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T09:32:14.256 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-07-26T09:32:14.288 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-07-26T09:32:20.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T09:32:25.261 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T09:32:30.265 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-07-26T09:32:33.332 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-07-26T09:32:36.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T09:32:41.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T09:32:46.277 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-07-26T09:32:49.652 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-07-26T09:32:49.654 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi073 2023-07-26T09:32:52.281 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T09:32:58.656 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-07-26T09:32:58.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T09:32:58.880 DEBUG:teuthology.orchestra.run.smithi073:> true 2023-07-26T09:32:59.124 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-07-26T09:32:59.125 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-26T09:32:59.125 DEBUG:teuthology.orchestra.run.smithi073:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-26T09:33:04.148 INFO:teuthology.provision.fog.smithi073:Node is ready 2023-07-26T09:33:04.149 DEBUG:teuthology.orchestra.run.smithi073:> hostname 2023-07-26T09:33:04.172 INFO:teuthology.orchestra.run.smithi073.stdout:smithi073.front.sepia.ceph.com 2023-07-26T09:33:04.173 DEBUG:teuthology.orchestra.run.smithi073:> grep smithi073.front.sepia.ceph.com /etc/hosts 2023-07-26T09:33:04.233 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73 smithi073.front.sepia.ceph.com smithi073 2023-07-26T09:33:04.234 DEBUG:teuthology.orchestra.run.smithi073:> sudo hostname smithi073 2023-07-26T09:33:04.356 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/smithi073.front.sepia.ceph.com/smithi073/g' /etc/hosts 2023-07-26T09:33:04.387 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/172.21.15.73/172.21.15.73/g' /etc/hosts 2023-07-26T09:33:04.456 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/smithi073.front.sepia.ceph.com/smithi073/g' /etc/hostname 2023-07-26T09:33:04.525 DEBUG:teuthology.orchestra.run.smithi073:> sudo hostname smithi073 2023-07-26T09:33:04.592 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2023-07-26T09:33:04.651 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="CentOS Stream" 2023-07-26T09:33:04.651 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="8" 2023-07-26T09:33:04.651 INFO:teuthology.orchestra.run.smithi073.stdout:ID="centos" 2023-07-26T09:33:04.651 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="rhel fedora" 2023-07-26T09:33:04.652 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="8" 2023-07-26T09:33:04.652 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el8" 2023-07-26T09:33:04.652 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-26T09:33:04.652 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31" 2023-07-26T09:33:04.652 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-26T09:33:04.652 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://centos.org/" 2023-07-26T09:33:04.652 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-26T09:33:04.653 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-26T09:33:04.653 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-26T09:33:04.653 INFO:teuthology.provision.fog.smithi073:Deploy complete! 2023-07-26T09:33:04.655 DEBUG:teuthology.parallel:result is None 2023-07-26T09:33:29.039 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-26T09:33:29.040 DEBUG:teuthology.orchestra.run.smithi123:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-26T09:33:46.277 WARNING:teuthology.provision.fog.smithi083:timed out 2023-07-26T09:33:49.359 INFO:teuthology.provision.fog.smithi123:Node is ready 2023-07-26T09:33:49.360 DEBUG:teuthology.orchestra.run.smithi123:> hostname 2023-07-26T09:33:49.385 INFO:teuthology.orchestra.run.smithi123.stdout:smithi123.front.sepia.ceph.com 2023-07-26T09:33:49.386 DEBUG:teuthology.orchestra.run.smithi123:> grep smithi123.front.sepia.ceph.com /etc/hosts 2023-07-26T09:33:49.447 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123 smithi123.front.sepia.ceph.com smithi123 2023-07-26T09:33:49.448 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123 2023-07-26T09:33:49.583 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi123.front.sepia.ceph.com/smithi123/g' /etc/hosts 2023-07-26T09:33:49.618 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/172.21.15.123/172.21.15.123/g' /etc/hosts 2023-07-26T09:33:49.692 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi123.front.sepia.ceph.com/smithi123/g' /etc/hostname 2023-07-26T09:33:49.766 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123 2023-07-26T09:33:49.839 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2023-07-26T09:33:49.901 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="CentOS Stream" 2023-07-26T09:33:49.901 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="8" 2023-07-26T09:33:49.901 INFO:teuthology.orchestra.run.smithi123.stdout:ID="centos" 2023-07-26T09:33:49.901 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="rhel fedora" 2023-07-26T09:33:49.902 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="8" 2023-07-26T09:33:49.902 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el8" 2023-07-26T09:33:49.902 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-26T09:33:49.902 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31" 2023-07-26T09:33:49.902 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-26T09:33:49.902 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://centos.org/" 2023-07-26T09:33:49.902 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-26T09:33:49.903 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-26T09:33:49.903 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-26T09:33:49.903 INFO:teuthology.provision.fog.smithi123:Deploy complete! 2023-07-26T09:33:49.904 DEBUG:teuthology.parallel:result is None 2023-07-26T09:33:52.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T09:33:57.503 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-26T09:33:57.504 DEBUG:teuthology.orchestra.run.smithi083:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-26T09:33:57.737 INFO:teuthology.provision.fog.smithi083:Node is ready 2023-07-26T09:33:57.738 DEBUG:teuthology.orchestra.run.smithi083:> hostname 2023-07-26T09:33:57.756 INFO:teuthology.orchestra.run.smithi083.stdout:smithi083.front.sepia.ceph.com 2023-07-26T09:33:57.756 DEBUG:teuthology.orchestra.run.smithi083:> grep smithi083.front.sepia.ceph.com /etc/hosts 2023-07-26T09:33:57.815 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83 smithi083.front.sepia.ceph.com smithi083 2023-07-26T09:33:57.815 DEBUG:teuthology.orchestra.run.smithi083:> sudo hostname smithi083 2023-07-26T09:33:57.914 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i -e 's/smithi083.front.sepia.ceph.com/smithi083/g' /etc/hosts 2023-07-26T09:33:57.943 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i -e 's/172.21.15.83/172.21.15.83/g' /etc/hosts 2023-07-26T09:33:58.012 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i -e 's/smithi083.front.sepia.ceph.com/smithi083/g' /etc/hostname 2023-07-26T09:33:58.078 DEBUG:teuthology.orchestra.run.smithi083:> sudo hostname smithi083 2023-07-26T09:33:58.146 DEBUG:teuthology.orchestra.run.smithi083:> cat /etc/os-release 2023-07-26T09:33:58.204 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="CentOS Stream" 2023-07-26T09:33:58.204 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="8" 2023-07-26T09:33:58.204 INFO:teuthology.orchestra.run.smithi083.stdout:ID="centos" 2023-07-26T09:33:58.205 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE="rhel fedora" 2023-07-26T09:33:58.205 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="8" 2023-07-26T09:33:58.205 INFO:teuthology.orchestra.run.smithi083.stdout:PLATFORM_ID="platform:el8" 2023-07-26T09:33:58.205 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-26T09:33:58.205 INFO:teuthology.orchestra.run.smithi083.stdout:ANSI_COLOR="0;31" 2023-07-26T09:33:58.205 INFO:teuthology.orchestra.run.smithi083.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-26T09:33:58.205 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://centos.org/" 2023-07-26T09:33:58.206 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-26T09:33:58.206 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-26T09:33:58.206 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-26T09:33:58.206 INFO:teuthology.provision.fog.smithi083:Deploy complete! 2023-07-26T09:33:58.207 DEBUG:teuthology.parallel:result is None 2023-07-26T09:34:02.546 INFO:teuthology.lock.ops:Checking smithi073.front.sepia.ceph.com 2023-07-26T09:34:02.546 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-26T09:34:07.572 INFO:teuthology.lock.ops:Checking smithi083.front.sepia.ceph.com 2023-07-26T09:34:07.573 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-26T09:34:12.596 INFO:teuthology.lock.ops:Checking smithi123.front.sepia.ceph.com 2023-07-26T09:34:12.596 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-26T09:34:17.623 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: set os type and version on server 2023-07-26T09:34:17.623 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-07-26T09:34:17.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T09:34:22.698 DEBUG:teuthology.orchestra.run.smithi073:> true 2023-07-26T09:34:22.835 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-07-26T09:34:22.836 DEBUG:teuthology.orchestra.run.smithi073:> uname -m 2023-07-26T09:34:22.895 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64 2023-07-26T09:34:22.895 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2023-07-26T09:34:22.954 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="CentOS Stream" 2023-07-26T09:34:22.954 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="8" 2023-07-26T09:34:22.955 INFO:teuthology.orchestra.run.smithi073.stdout:ID="centos" 2023-07-26T09:34:22.955 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="rhel fedora" 2023-07-26T09:34:22.955 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="8" 2023-07-26T09:34:22.955 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el8" 2023-07-26T09:34:22.956 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-26T09:34:22.956 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31" 2023-07-26T09:34:22.956 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-26T09:34:22.957 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://centos.org/" 2023-07-26T09:34:22.957 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-26T09:34:22.957 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-26T09:34:22.957 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-26T09:34:22.959 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2023-07-26T09:34:27.985 INFO:teuthology.lock.ops:Updating [smithi083.front.sepia.ceph.com]: set os type and version on server 2023-07-26T09:34:27.985 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2023-07-26T09:34:27.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T09:34:33.055 DEBUG:teuthology.orchestra.run.smithi083:> true 2023-07-26T09:34:33.196 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi083.front.sepia.ceph.com' 2023-07-26T09:34:33.196 DEBUG:teuthology.orchestra.run.smithi083:> uname -m 2023-07-26T09:34:33.256 INFO:teuthology.orchestra.run.smithi083.stdout:x86_64 2023-07-26T09:34:33.257 DEBUG:teuthology.orchestra.run.smithi083:> cat /etc/os-release 2023-07-26T09:34:33.315 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="CentOS Stream" 2023-07-26T09:34:33.316 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="8" 2023-07-26T09:34:33.316 INFO:teuthology.orchestra.run.smithi083.stdout:ID="centos" 2023-07-26T09:34:33.316 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE="rhel fedora" 2023-07-26T09:34:33.317 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="8" 2023-07-26T09:34:33.317 INFO:teuthology.orchestra.run.smithi083.stdout:PLATFORM_ID="platform:el8" 2023-07-26T09:34:33.317 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-26T09:34:33.317 INFO:teuthology.orchestra.run.smithi083.stdout:ANSI_COLOR="0;31" 2023-07-26T09:34:33.317 INFO:teuthology.orchestra.run.smithi083.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-26T09:34:33.317 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://centos.org/" 2023-07-26T09:34:33.318 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-26T09:34:33.318 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-26T09:34:33.318 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-26T09:34:33.318 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server 2023-07-26T09:34:34.526 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: set os type and version on server 2023-07-26T09:34:34.526 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-07-26T09:34:34.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T09:34:34.594 DEBUG:teuthology.orchestra.run.smithi123:> true 2023-07-26T09:34:34.740 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-07-26T09:34:34.741 DEBUG:teuthology.orchestra.run.smithi123:> uname -m 2023-07-26T09:34:34.802 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64 2023-07-26T09:34:34.803 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2023-07-26T09:34:34.864 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="CentOS Stream" 2023-07-26T09:34:34.864 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="8" 2023-07-26T09:34:34.865 INFO:teuthology.orchestra.run.smithi123.stdout:ID="centos" 2023-07-26T09:34:34.865 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="rhel fedora" 2023-07-26T09:34:34.865 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="8" 2023-07-26T09:34:34.865 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el8" 2023-07-26T09:34:34.865 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-26T09:34:34.865 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31" 2023-07-26T09:34:34.866 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-26T09:34:34.866 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://centos.org/" 2023-07-26T09:34:34.866 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-26T09:34:34.866 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-26T09:34:34.867 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-26T09:34:34.867 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2023-07-26T09:34:34.893 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T09:34:34.893 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T09:34:34.986 INFO:teuthology.dispatcher.supervisor:Running job 7352730 2023-07-26T09:34:34.987 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/virtualenv/bin/teuthology -v --owner scheduled_gabrioux@teuthology --archive /home/teuthworker/archive/gabrioux-2023-07-26_05:19:21-orch:cephadm-wip-guits-testing-2023-07-25-0942-distro-default-smithi/7352730 --name gabrioux-2023-07-26_05:19:21-orch:cephadm-wip-guits-testing-2023-07-25-0942-distro-default-smithi --description orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_set_mon_crush_locations} -- /home/teuthworker/archive/gabrioux-2023-07-26_05:19:21-orch:cephadm-wip-guits-testing-2023-07-25-0942-distro-default-smithi/7352730/orig.config.yaml 2023-07-26T09:34:34.992 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/gabrioux-2023-07-26_05:19:21-orch:cephadm-wip-guits-testing-2023-07-25-0942-distro-default-smithi/7352730 2023-07-26T09:34:34.993 INFO:teuthology.dispatcher.supervisor:Job PID: 27684 2023-07-26T09:34:34.993 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-26T09:36:35.092 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T09:36:35.094 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T09:38:40.268 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T09:38:40.269 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T09:40:44.485 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T09:40:44.486 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T09:42:49.668 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T09:42:49.669 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T09:44:51.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T09:44:51.356 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T09:46:52.372 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T09:46:52.373 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T09:48:57.544 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T09:48:57.545 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T09:51:02.737 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T09:51:02.738 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T09:53:07.909 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T09:53:07.909 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T09:55:13.081 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T09:55:13.081 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T09:57:13.329 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T09:57:13.329 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T09:59:18.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T09:59:18.509 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T10:01:23.692 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T10:01:23.693 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T10:03:28.877 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T10:03:28.878 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T10:05:34.057 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T10:05:34.067 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T10:07:39.246 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T10:07:39.247 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T10:07:44.314 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-26T10:07:58.427 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-26T10:07:58.427 INFO:teuthology.nuke:Checking targets against current locks 2023-07-26T10:08:11.914 DEBUG:teuthology.nuke:shortname: smithi073 2023-07-26T10:08:11.915 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-26T10:08:25.227 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-07-26_05:19:21-orch:cephadm-wip-guits-testing-2023-07-25-0942-distro-default-smithi/7352730', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-26 09:27:21.839079', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE2LcgSgeaoVboxhf8crTclYvl8BY5Txp6mwwfOuG8f/neOcNxQMWppPD3o557DQqhBG0Hw9xQ1qqvCrsxJvQKs='} 2023-07-26T10:08:25.234 DEBUG:teuthology.nuke:shortname: smithi083 2023-07-26T10:08:25.234 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-26T10:08:25.273 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi083.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-07-26_05:19:21-orch:cephadm-wip-guits-testing-2023-07-25-0942-distro-default-smithi/7352730', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-26 09:27:21.837845', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHnxGEgjYsS09JtM4B6JZ/RDSFlW1eSfzyGr2r/XRhpT2Viv+mT1hvFadEojNx2FzvZGUNs6cMIjHA7GX9ddYgAONcs5YMgeAxdZSbOVtUiG9y44vMsfhuLAHOIV+Ht5ghuEcdRtrBqJfrE/MoW3MvXXnXx4Q7H4dxIAcyEIP8MnN6kzLaPrhk+oNPrPIjLgHcdiiQAK7LuQViD20Lqv93jD3C5ULP220Eog1BLq0VZQBs4kCW/U/zIvCFhIkYD4KP6PDDdTmXhTBDSFXNnGDwtlAfjCg5ali85zhDPaN+zemqNMOVPS1MlSqImvsT80/bD9b4z7n46Xr5o/yWzeWg0Q/975ATa67NfjyuVDexpihz6i5159SZiAuCE25t9UpLnXcNY4fF/BVI2eqrr+QqGoHQMgi47xmlNV8rWLk5iHB7nJedwP6vGH2xqFjLHp2sfH1CTnAGX8WW2uM40PdLxjm7JaXIntahufk45nXzOrWY2sbeyboDcYLA8XTMJ6c='} 2023-07-26T10:08:25.294 INFO:teuthology.orchestra.console:Power off smithi073 2023-07-26T10:08:25.295 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-26T10:08:25.309 DEBUG:teuthology.nuke:shortname: smithi123 2023-07-26T10:08:25.310 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-26T10:08:25.319 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-26T10:08:25.320 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T10:08:25.333 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi123.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-07-26_05:19:21-orch:cephadm-wip-guits-testing-2023-07-25-0942-distro-default-smithi/7352730', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-26 09:27:21.835800', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHV7X3hFr1VTh/9iFA4OBy+hYFCp/be2xhryk2e4VYh8f3YCNAmXz4+vd61K/yMjgtXThgCAuaOnd43Y8w6RG5Y='} 2023-07-26T10:08:25.343 INFO:teuthology.orchestra.console:Power off smithi083 2023-07-26T10:08:25.344 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-26T10:08:25.354 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T10:08:25.366 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-26T10:08:25.367 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T10:08:25.388 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T10:08:25.404 INFO:teuthology.orchestra.console:Power off smithi123 2023-07-26T10:08:25.405 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-26T10:08:25.430 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-26T10:08:25.431 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T10:08:25.456 INFO:teuthology.orchestra.console:Power off for smithi073 completed 2023-07-26T10:08:25.458 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T10:08:25.490 INFO:teuthology.orchestra.console:Power off for smithi083 completed 2023-07-26T10:08:25.561 INFO:teuthology.orchestra.console:Power off for smithi123 completed 2023-07-26T10:08:25.616 INFO:teuthology.lock.ops:unlocked: smithi073.front.sepia.ceph.com 2023-07-26T10:08:25.649 INFO:teuthology.lock.ops:unlocked: smithi083.front.sepia.ceph.com 2023-07-26T10:08:25.717 INFO:teuthology.lock.ops:unlocked: smithi123.front.sepia.ceph.com