2023-07-27T12:10:23.298 INFO:root:teuthology version: 0.0.1.dev160+g407880c 2023-07-27T12:10:23.300 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-27T12:10:23.300 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-27T12:10:43.487 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff04e330430>, signals=[15]) 2023-07-27T12:10:43.490 INFO:teuthology.lock.ops:Start node 'smithi093.front.sepia.ceph.com' reimaging 2023-07-27T12:10:43.490 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: reset os type and version on server 2023-07-27T12:10:43.490 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server 2023-07-27T12:10:48.522 INFO:teuthology.lock.ops:Start node 'smithi146.front.sepia.ceph.com' reimaging 2023-07-27T12:10:48.523 INFO:teuthology.lock.ops:Updating [smithi146.front.sepia.ceph.com]: reset os type and version on server 2023-07-27T12:10:48.523 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2023-07-27T12:10:48.526 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /host {"name": "smithi093"} 2023-07-27T12:11:03.594 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /host {"name": "smithi146"} 2023-07-27T12:11:08.629 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-27T12:11:18.149 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-27T12:11:18.178 DEBUG:teuthology.provision.fog.smithi093:Requesting image smithi_centos_8.stream (ID 3) 2023-07-27T12:11:18.178 DEBUG:teuthology.provision.fog.smithi093:FOG request: PUT /host/198 {"imageID": 3} 2023-07-27T12:11:18.206 DEBUG:teuthology.provision.fog.smithi146:Requesting image smithi_centos_8.stream (ID 3) 2023-07-27T12:11:18.206 DEBUG:teuthology.provision.fog.smithi146:FOG request: PUT /host/251 {"imageID": 3} 2023-07-27T12:11:18.234 INFO:teuthology.provision.fog.smithi093:Scheduling deploy of centos 8.stream 2023-07-27T12:11:18.234 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-27T12:11:18.253 INFO:teuthology.provision.fog.smithi146:Scheduling deploy of centos 8.stream 2023-07-27T12:11:18.254 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-07-27T12:11:18.277 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /tasktype {"name": "deploy"} 2023-07-27T12:11:18.310 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /tasktype {"name": "deploy"} 2023-07-27T12:11:18.326 DEBUG:teuthology.provision.fog.smithi093:FOG request: POST /host/198/task {"taskTypeID": 1} 2023-07-27T12:11:18.347 DEBUG:teuthology.provision.fog.smithi146:FOG request: POST /host/251/task {"taskTypeID": 1} 2023-07-27T12:11:18.374 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-27T12:11:18.424 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-07-27T12:11:23.208 INFO:teuthology.orchestra.console:Power off smithi093 2023-07-27T12:11:23.210 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-27T12:11:23.231 INFO:teuthology.orchestra.console:Power off smithi146 2023-07-27T12:11:23.231 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-27T12:11:23.241 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-27T12:11:23.241 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T12:11:23.255 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-27T12:11:23.255 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T12:11:23.266 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-27T12:11:23.277 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-27T12:11:27.268 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T12:11:27.278 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T12:11:28.380 DEBUG:teuthology.orchestra.console:check power output: 2023-07-27T12:11:28.389 DEBUG:teuthology.orchestra.console:check power output: 2023-07-27T12:11:32.381 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T12:11:32.390 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T12:11:32.505 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-27T12:11:32.606 INFO:teuthology.orchestra.console:Power off for smithi146 completed 2023-07-27T12:11:32.707 INFO:teuthology.orchestra.console:Power on smithi146 2023-07-27T12:11:32.707 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-27T12:11:33.493 DEBUG:teuthology.orchestra.console:check power output: 2023-07-27T12:11:37.494 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T12:11:37.604 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-27T12:11:37.705 INFO:teuthology.orchestra.console:Power off for smithi093 completed 2023-07-27T12:11:37.734 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On 2023-07-27T12:11:37.735 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T12:11:37.807 INFO:teuthology.orchestra.console:Power on smithi093 2023-07-27T12:11:37.808 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-27T12:11:37.828 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On 2023-07-27T12:11:37.829 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T12:11:37.849 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-27T12:11:38.746 DEBUG:teuthology.orchestra.console:check power output: 2023-07-27T12:11:41.852 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T12:11:41.962 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-27T12:11:42.747 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T12:11:43.856 DEBUG:teuthology.orchestra.console:check power output: 2023-07-27T12:11:45.964 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T12:11:47.072 DEBUG:teuthology.orchestra.console:check power output: 2023-07-27T12:11:47.858 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T12:11:48.968 DEBUG:teuthology.orchestra.console:check power output: 2023-07-27T12:11:51.073 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T12:11:52.184 DEBUG:teuthology.orchestra.console:check power output: 2023-07-27T12:11:52.969 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T12:11:53.079 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-27T12:11:53.180 INFO:teuthology.orchestra.console:Power on for smithi146 completed 2023-07-27T12:11:53.281 INFO:teuthology.provision.fog.smithi146:Waiting for deploy to finish 2023-07-27T12:11:53.282 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-07-27T12:11:53.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T12:11:56.187 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T12:11:56.720 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-07-27T12:11:57.355 DEBUG:teuthology.orchestra.console:check power output: 2023-07-27T12:12:01.356 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T12:12:02.468 DEBUG:teuthology.orchestra.console:check power output: 2023-07-27T12:12:02.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T12:12:12.733 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T12:12:13.844 DEBUG:teuthology.orchestra.console:check power output: 2023-07-27T12:12:15.796 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-07-27T12:12:17.846 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T12:12:18.956 DEBUG:teuthology.orchestra.console:check power output: 2023-07-27T12:12:21.801 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T12:12:26.805 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T12:12:27.914 DEBUG:teuthology.orchestra.console:check power output: 2023-07-27T12:12:29.876 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-07-27T12:12:31.916 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T12:12:32.027 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-27T12:12:32.128 INFO:teuthology.orchestra.console:Power on for smithi093 completed 2023-07-27T12:12:32.229 INFO:teuthology.provision.fog.smithi093:Waiting for deploy to finish 2023-07-27T12:12:32.229 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-27T12:12:35.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T12:12:43.952 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-07-27T12:12:49.646 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-27T12:12:54.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T12:13:14.748 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-27T12:13:19.752 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-07-27T12:13:25.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T12:13:25.877 ERROR:teuthology.orchestra.connection:Error authenticating with smithi146.front.sepia.ceph.com: Authentication failed. 2023-07-27T12:13:25.880 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-27T12:13:25.881 DEBUG:teuthology.orchestra.run.smithi146:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-27T12:13:25.882 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:13:26.888 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:13:27.893 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:13:28.898 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:13:29.903 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:13:30.908 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:13:31.913 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:13:32.919 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:13:33.924 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:13:34.856 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-27T12:13:39.858 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:13:40.864 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:13:41.869 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:13:42.875 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:13:43.884 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:13:44.889 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:13:45.895 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:13:46.901 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:13:47.906 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:13:48.913 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:13:49.919 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:13:50.925 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:13:51.930 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:13:52.935 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:13:53.940 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:13:54.946 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:13:54.949 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-27T12:13:55.969 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:13:56.974 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:13:57.980 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:13:58.985 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:13:59.990 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:00.995 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:02.001 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:03.007 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:04.013 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:05.018 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:06.024 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:07.030 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:08.035 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:09.041 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:10.047 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:10.274 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-27T12:14:15.112 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:16.118 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:17.124 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:18.129 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:19.134 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:20.139 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:21.145 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:22.151 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:23.156 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:24.161 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:25.167 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:26.172 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:27.177 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:28.182 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:29.188 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:30.194 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:30.228 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-27T12:14:35.137 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:35.193 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T12:14:35.271 ERROR:teuthology.orchestra.connection:Error authenticating with smithi093.front.sepia.ceph.com: Authentication failed. 2023-07-27T12:14:35.272 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-27T12:14:35.272 DEBUG:teuthology.orchestra.run.smithi093:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-27T12:14:35.273 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:36.145 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:36.281 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:37.153 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:37.289 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:38.161 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:38.298 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:39.170 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:39.307 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:40.179 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:40.316 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:41.189 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:41.325 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:42.197 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:42.332 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:43.206 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:43.341 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:44.215 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:44.350 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:45.223 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:45.358 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:46.232 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:46.366 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:47.241 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:47.375 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:48.250 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:48.384 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:49.259 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:49.393 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:50.268 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:50.403 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:51.277 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:51.411 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:52.286 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:52.420 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:53.294 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:53.429 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:54.303 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:54.437 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:55.311 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:55.445 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:56.320 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:56.455 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:57.329 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:57.464 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:58.338 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:58.473 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:59.348 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:14:59.483 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:00.358 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:00.493 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:01.365 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:01.557 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:02.373 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:02.567 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:03.381 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:03.575 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:04.390 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:04.584 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:05.398 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:05.592 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:06.407 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:06.600 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:07.416 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:07.609 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:08.424 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:08.617 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:09.431 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:09.625 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:10.440 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:10.633 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:11.448 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:11.641 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:12.457 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:12.650 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:13.464 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:13.657 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:14.472 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:14.665 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:15.481 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:15.674 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:16.488 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:16.681 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:17.496 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:17.689 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:18.505 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:18.698 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:19.513 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:19.707 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:20.522 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:20.715 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:21.530 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:21.723 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:22.538 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:22.731 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:23.546 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:23.741 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:24.555 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:24.750 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:25.564 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:25.758 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:25.768 ERROR:teuthology.provision.fog: on smithi146 2023-07-27T12:15:26.764 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:27.769 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:28.774 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:29.780 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:15:34.770 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-07-27T12:15:34.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T12:15:39.851 ERROR:teuthology.orchestra.connection:Error authenticating with smithi146.front.sepia.ceph.com: Authentication failed. 2023-07-27T12:15:39.852 DEBUG:teuthology.orchestra.run.smithi146:> true 2023-07-27T12:15:39.853 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T12:17:44.560 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-07-27T12:17:44.562 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi093 2023-07-27T12:17:53.563 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-07-27T12:17:53.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T12:17:58.821 DEBUG:teuthology.orchestra.run.smithi093:> true 2023-07-27T12:17:59.092 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-07-27T12:17:59.092 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-27T12:17:59.092 DEBUG:teuthology.orchestra.run.smithi093:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-27T12:17:59.113 INFO:teuthology.provision.fog.smithi093:Node is ready 2023-07-27T12:17:59.114 DEBUG:teuthology.orchestra.run.smithi093:> hostname 2023-07-27T12:17:59.174 INFO:teuthology.orchestra.run.smithi093.stdout:smithi093.front.sepia.ceph.com 2023-07-27T12:17:59.174 DEBUG:teuthology.orchestra.run.smithi093:> grep smithi093.front.sepia.ceph.com /etc/hosts 2023-07-27T12:17:59.235 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93 smithi093.front.sepia.ceph.com smithi093 2023-07-27T12:17:59.236 DEBUG:teuthology.orchestra.run.smithi093:> sudo hostname smithi093 2023-07-27T12:17:59.331 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/smithi093.front.sepia.ceph.com/smithi093/g' /etc/hosts 2023-07-27T12:17:59.366 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/172.21.15.93/172.21.15.93/g' /etc/hosts 2023-07-27T12:17:59.439 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/smithi093.front.sepia.ceph.com/smithi093/g' /etc/hostname 2023-07-27T12:17:59.514 DEBUG:teuthology.orchestra.run.smithi093:> sudo hostname smithi093 2023-07-27T12:17:59.586 DEBUG:teuthology.orchestra.run.smithi093:> cat /etc/os-release 2023-07-27T12:17:59.648 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="CentOS Stream" 2023-07-27T12:17:59.648 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="8" 2023-07-27T12:17:59.648 INFO:teuthology.orchestra.run.smithi093.stdout:ID="centos" 2023-07-27T12:17:59.648 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE="rhel fedora" 2023-07-27T12:17:59.649 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="8" 2023-07-27T12:17:59.649 INFO:teuthology.orchestra.run.smithi093.stdout:PLATFORM_ID="platform:el8" 2023-07-27T12:17:59.649 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-27T12:17:59.649 INFO:teuthology.orchestra.run.smithi093.stdout:ANSI_COLOR="0;31" 2023-07-27T12:17:59.649 INFO:teuthology.orchestra.run.smithi093.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-27T12:17:59.649 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://centos.org/" 2023-07-27T12:17:59.649 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-27T12:17:59.650 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-27T12:17:59.650 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-27T12:17:59.651 INFO:teuthology.provision.fog.smithi093:Deploy complete! 2023-07-27T12:17:59.652 DEBUG:teuthology.parallel:result is None 2023-07-27T13:15:48.885 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-07-27T13:15:48.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T13:15:49.324 DEBUG:teuthology.orchestra.run.smithi146:> true 2023-07-27T13:15:49.592 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-07-27T13:15:49.592 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-27T13:15:49.592 DEBUG:teuthology.orchestra.run.smithi146:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-27T13:15:49.653 INFO:teuthology.provision.fog.smithi146:Node is ready 2023-07-27T13:15:49.653 DEBUG:teuthology.orchestra.run.smithi146:> hostname 2023-07-27T13:15:49.714 INFO:teuthology.orchestra.run.smithi146.stdout:smithi146.front.sepia.ceph.com 2023-07-27T13:15:49.714 DEBUG:teuthology.orchestra.run.smithi146:> grep smithi146.front.sepia.ceph.com /etc/hosts 2023-07-27T13:15:49.774 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146 smithi146.front.sepia.ceph.com smithi146 2023-07-27T13:15:49.774 DEBUG:teuthology.orchestra.run.smithi146:> sudo hostname smithi146 2023-07-27T13:15:49.873 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i -e 's/smithi146.front.sepia.ceph.com/smithi146/g' /etc/hosts 2023-07-27T13:15:49.903 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i -e 's/172.21.15.146/172.21.15.146/g' /etc/hosts 2023-07-27T13:15:49.973 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i -e 's/smithi146.front.sepia.ceph.com/smithi146/g' /etc/hostname 2023-07-27T13:15:50.042 DEBUG:teuthology.orchestra.run.smithi146:> sudo hostname smithi146 2023-07-27T13:15:50.109 DEBUG:teuthology.orchestra.run.smithi146:> cat /etc/os-release 2023-07-27T13:15:50.167 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="CentOS Stream" 2023-07-27T13:15:50.168 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="8" 2023-07-27T13:15:50.168 INFO:teuthology.orchestra.run.smithi146.stdout:ID="centos" 2023-07-27T13:15:50.169 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE="rhel fedora" 2023-07-27T13:15:50.169 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="8" 2023-07-27T13:15:50.169 INFO:teuthology.orchestra.run.smithi146.stdout:PLATFORM_ID="platform:el8" 2023-07-27T13:15:50.169 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-27T13:15:50.170 INFO:teuthology.orchestra.run.smithi146.stdout:ANSI_COLOR="0;31" 2023-07-27T13:15:50.170 INFO:teuthology.orchestra.run.smithi146.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-27T13:15:50.170 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://centos.org/" 2023-07-27T13:15:50.171 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-27T13:15:50.171 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-27T13:15:50.171 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-27T13:15:50.172 INFO:teuthology.provision.fog.smithi146:Deploy complete! 2023-07-27T13:15:50.173 DEBUG:teuthology.parallel:result is None 2023-07-27T13:16:10.348 INFO:teuthology.lock.ops:Checking smithi093.front.sepia.ceph.com 2023-07-27T13:16:10.349 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-27T13:16:13.587 INFO:teuthology.lock.ops:Checking smithi146.front.sepia.ceph.com 2023-07-27T13:16:13.588 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-27T13:16:18.621 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: set os type and version on server 2023-07-27T13:16:18.622 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-07-27T13:16:18.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T13:16:23.697 DEBUG:teuthology.orchestra.run.smithi093:> true 2023-07-27T13:16:23.842 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-07-27T13:16:23.843 DEBUG:teuthology.orchestra.run.smithi093:> uname -m 2023-07-27T13:16:23.905 INFO:teuthology.orchestra.run.smithi093.stdout:x86_64 2023-07-27T13:16:23.906 DEBUG:teuthology.orchestra.run.smithi093:> cat /etc/os-release 2023-07-27T13:16:23.967 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="CentOS Stream" 2023-07-27T13:16:23.968 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="8" 2023-07-27T13:16:23.968 INFO:teuthology.orchestra.run.smithi093.stdout:ID="centos" 2023-07-27T13:16:23.968 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE="rhel fedora" 2023-07-27T13:16:23.968 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="8" 2023-07-27T13:16:23.968 INFO:teuthology.orchestra.run.smithi093.stdout:PLATFORM_ID="platform:el8" 2023-07-27T13:16:23.969 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-27T13:16:23.969 INFO:teuthology.orchestra.run.smithi093.stdout:ANSI_COLOR="0;31" 2023-07-27T13:16:23.970 INFO:teuthology.orchestra.run.smithi093.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-27T13:16:23.970 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://centos.org/" 2023-07-27T13:16:23.971 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-27T13:16:23.971 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-27T13:16:23.971 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-27T13:16:23.972 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server 2023-07-27T13:16:23.993 INFO:teuthology.lock.ops:Updating [smithi146.front.sepia.ceph.com]: set os type and version on server 2023-07-27T13:16:23.994 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-07-27T13:16:23.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T13:16:24.061 DEBUG:teuthology.orchestra.run.smithi146:> true 2023-07-27T13:16:24.195 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-07-27T13:16:24.196 DEBUG:teuthology.orchestra.run.smithi146:> uname -m 2023-07-27T13:16:24.254 INFO:teuthology.orchestra.run.smithi146.stdout:x86_64 2023-07-27T13:16:24.255 DEBUG:teuthology.orchestra.run.smithi146:> cat /etc/os-release 2023-07-27T13:16:24.313 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="CentOS Stream" 2023-07-27T13:16:24.314 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="8" 2023-07-27T13:16:24.314 INFO:teuthology.orchestra.run.smithi146.stdout:ID="centos" 2023-07-27T13:16:24.314 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE="rhel fedora" 2023-07-27T13:16:24.315 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="8" 2023-07-27T13:16:24.315 INFO:teuthology.orchestra.run.smithi146.stdout:PLATFORM_ID="platform:el8" 2023-07-27T13:16:24.315 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-27T13:16:24.315 INFO:teuthology.orchestra.run.smithi146.stdout:ANSI_COLOR="0;31" 2023-07-27T13:16:24.316 INFO:teuthology.orchestra.run.smithi146.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-27T13:16:24.316 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://centos.org/" 2023-07-27T13:16:24.316 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-27T13:16:24.316 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-27T13:16:24.317 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-27T13:16:24.317 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2023-07-27T13:16:24.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-27T13:16:24.344 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-27T13:16:24.452 INFO:teuthology.dispatcher.supervisor:Running job 7354270 2023-07-27T13:16:24.452 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-07-27_03:42:08-fs-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi/7354270 --name yuriw-2023-07-27_03:42:08-fs-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi --description fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/fragment} -- /home/teuthworker/archive/yuriw-2023-07-27_03:42:08-fs-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi/7354270/orig.config.yaml 2023-07-27T13:16:24.457 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-07-27_03:42:08-fs-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi/7354270 2023-07-27T13:16:24.458 INFO:teuthology.dispatcher.supervisor:Job PID: 17796 2023-07-27T13:16:24.458 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-27T13:18:24.459 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-27T13:18:24.460 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-27T13:20:27.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-27T13:20:27.076 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-27T13:22:27.156 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-27T13:22:27.157 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-27T13:24:32.301 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-27T13:24:32.302 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-27T13:26:35.256 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-27T13:26:35.257 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-27T13:28:40.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-27T13:28:40.338 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-27T13:30:45.424 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-27T13:30:45.425 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-27T13:32:50.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-27T13:32:50.532 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-27T13:34:55.694 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-27T13:34:55.695 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-27T13:37:00.783 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-27T13:37:00.784 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-27T13:39:05.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-27T13:39:05.856 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-27T13:39:10.921 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-27T13:39:16.037 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-27T13:39:16.038 INFO:teuthology.nuke:Checking targets against current locks 2023-07-27T13:39:16.086 DEBUG:teuthology.nuke:shortname: smithi093 2023-07-27T13:39:16.086 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-27T13:39:16.107 DEBUG:teuthology.nuke:shortname: smithi146 2023-07-27T13:39:16.108 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-27T13:39:16.110 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi093.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-27_03:42:08-fs-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi/7354270', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-27 12:10:07.403002', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD6u0ngg5pPebNHzkhM6SXJlzU0+V0dwFfrW6JU3u+l/TUFCYcR9xjJwiwX7FWO9xz69MAViYYdV2KgpILYISMVuMxVz3qmDt6kHsyomYwZUlDVi+GuxX7cowXG9bOEZiwEYZlZacZZBnZIHuZWoLGXYejWcrrmEhscHCSd9wZ6c+OshHw8JWFnNO7CFigvtUDs/5rFikTkV9wvUaO9svig82z8kYVrqkM+m9qLwaAQKTGpwlVmN1CHweaLkC44ndzisV70iGBUmDihLB4nmIy+cnv4SoQoXc2I1rLtKwmDl5tzazsF4QdYrXpFaXBfsMfJIoick7ziczwQ+sHe5eJn6Tgo4eOEA91HnvIIBmyCGzKRc8NHG1RjtRLGCpQ8jRdh6bFmh5ve+bZRFFhNbOabiX0YY08AHWsF8gGlGW3NmTjBmV9RnAnj3kgBdDvnY2OAFB0Ily79r+uJ3XXUHSVO7zxDDRH53+6QFfCnVNAwFkLX/YsZ/uky05qrkStd+5E='} 2023-07-27T13:39:16.130 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi146.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-27_03:42:08-fs-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi/7354270', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-27 12:10:07.400673', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCfMF4LeZhSR6X5MCQSavV43BTZ7d8xLz5Iqpohi38paPKbCowNfvRwZCKX3KCIqcCsCv1Bm/bsulJBkGQNKnU4lNclDRbQeCZFtGGHOtzWY77Rqh0STyspx6rzgUTLTUt8lAtwv1r52mhAuDIedTARWaIS6avwZgoIJkpK87m+rvc+3pMPKJXbArqOAY6dXkQTDXbW92uS8b5EDm1CrfYRwxWkFV9HmhfrHOwTlPaV30aHEVKrJ0ejxOt85eQEA/IWSgeJlNBIrs70W7qhrhgu5V85UNuOp5jwjJw3vkbPYrJOAPFGCE+7qTIYQbhbXmouUi8HLy14YSZkvmIcQdqGsV3q8qoZGOD1uIq3oaEWNbNn4cTzG/YbJn5+djEmR6j58f7OAKMn/rv4KZMMqLqV7wuDq5Ai9KwV99LNNFV1o0+YPS4dTHvSrmY/pLh/MMP9XGxAXYYc9ECWRObMKkE8KfcNuwhvtUctd7YOeWsDfcQqRGJ4ZwpXsjhSai/Vo+s='} 2023-07-27T13:39:16.162 INFO:teuthology.orchestra.console:Power off smithi093 2023-07-27T13:39:16.162 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-27T13:39:16.186 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-27T13:39:16.187 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T13:39:16.201 INFO:teuthology.orchestra.console:Power off smithi146 2023-07-27T13:39:16.202 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-27T13:39:16.210 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-27T13:39:16.221 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-27T13:39:16.222 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T13:39:16.243 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-27T13:39:16.312 INFO:teuthology.orchestra.console:Power off for smithi093 completed 2023-07-27T13:39:16.344 INFO:teuthology.orchestra.console:Power off for smithi146 completed 2023-07-27T13:39:16.462 INFO:teuthology.lock.ops:unlocked: smithi093.front.sepia.ceph.com 2023-07-27T13:39:16.495 INFO:teuthology.lock.ops:unlocked: smithi146.front.sepia.ceph.com