2023-08-16T10:56:59.230 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-16T10:56:59.232 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-16T10:56:59.369 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb0a4b72310>, signals=[15]) 2023-08-16T10:56:59.370 INFO:teuthology.lock.ops:Start node 'smithi066.front.sepia.ceph.com' reimaging 2023-08-16T10:56:59.371 INFO:teuthology.lock.ops:Updating [smithi066.front.sepia.ceph.com]: reset os type and version on server 2023-08-16T10:56:59.372 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server 2023-08-16T10:56:59.398 INFO:teuthology.lock.ops:Start node 'smithi193.front.sepia.ceph.com' reimaging 2023-08-16T10:56:59.399 INFO:teuthology.lock.ops:Updating [smithi193.front.sepia.ceph.com]: reset os type and version on server 2023-08-16T10:56:59.399 INFO:teuthology.lock.ops:Updating smithi193.front.sepia.ceph.com on lock server 2023-08-16T10:56:59.400 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /host {"name": "smithi066"} 2023-08-16T10:56:59.423 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /host {"name": "smithi193"} 2023-08-16T10:56:59.477 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-16T10:56:59.482 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-16T10:56:59.522 DEBUG:teuthology.provision.fog.smithi066:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-16T10:56:59.523 DEBUG:teuthology.provision.fog.smithi066:FOG request: PUT /host/171 {"imageID": 5} 2023-08-16T10:56:59.526 DEBUG:teuthology.provision.fog.smithi193:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-16T10:56:59.526 DEBUG:teuthology.provision.fog.smithi193:FOG request: PUT /host/298 {"imageID": 5} 2023-08-16T10:56:59.571 INFO:teuthology.provision.fog.smithi193:Scheduling deploy of rhel 8.6 2023-08-16T10:56:59.571 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-16T10:56:59.574 INFO:teuthology.provision.fog.smithi066:Scheduling deploy of rhel 8.6 2023-08-16T10:56:59.574 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-08-16T10:56:59.653 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /tasktype {"name": "deploy"} 2023-08-16T10:56:59.658 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /tasktype {"name": "deploy"} 2023-08-16T10:56:59.690 DEBUG:teuthology.provision.fog.smithi193:FOG request: POST /host/298/task {"taskTypeID": 1} 2023-08-16T10:56:59.693 DEBUG:teuthology.provision.fog.smithi066:FOG request: POST /host/171/task {"taskTypeID": 1} 2023-08-16T10:56:59.739 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-08-16T10:56:59.742 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-16T10:56:59.869 INFO:teuthology.orchestra.console.smithi193:Power off 2023-08-16T10:56:59.870 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-16T10:56:59.895 INFO:teuthology.orchestra.console.smithi066:Power off 2023-08-16T10:56:59.896 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-16T10:56:59.912 DEBUG:teuthology.orchestra.console.smithi193:power off output: Chassis Power Control: Down/Off 2023-08-16T10:56:59.912 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T10:56:59.926 DEBUG:teuthology.orchestra.console.smithi066:power off output: Chassis Power Control: Down/Off 2023-08-16T10:56:59.927 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T10:56:59.939 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is on 2023-08-16T10:56:59.954 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on 2023-08-16T10:57:03.944 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T10:57:03.954 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T10:57:04.056 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is on 2023-08-16T10:57:04.065 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on 2023-08-16T10:57:08.060 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T10:57:08.068 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T10:57:08.170 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is on 2023-08-16T10:57:08.179 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off 2023-08-16T10:57:08.280 INFO:teuthology.orchestra.console.smithi066:Power off completed 2023-08-16T10:57:08.381 INFO:teuthology.orchestra.console.smithi066:Power on 2023-08-16T10:57:08.381 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-16T10:57:08.401 DEBUG:teuthology.orchestra.console.smithi066:power on output: Chassis Power Control: Up/On 2023-08-16T10:57:08.402 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T10:57:08.423 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off 2023-08-16T10:57:12.172 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T10:57:12.282 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is off 2023-08-16T10:57:12.383 INFO:teuthology.orchestra.console.smithi193:Power off completed 2023-08-16T10:57:12.424 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T10:57:12.485 INFO:teuthology.orchestra.console.smithi193:Power on 2023-08-16T10:57:12.486 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-16T10:57:12.510 DEBUG:teuthology.orchestra.console.smithi193:power on output: Chassis Power Control: Up/On 2023-08-16T10:57:12.511 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T10:57:12.533 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is off 2023-08-16T10:57:12.535 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off 2023-08-16T10:57:16.536 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T10:57:16.545 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T10:57:16.647 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is on 2023-08-16T10:57:16.654 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on 2023-08-16T10:57:16.749 INFO:teuthology.orchestra.console.smithi193:Power on completed 2023-08-16T10:57:16.756 INFO:teuthology.orchestra.console.smithi066:Power on completed 2023-08-16T10:57:16.850 INFO:teuthology.provision.fog.smithi193:Waiting for deploy to finish 2023-08-16T10:57:16.851 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-16T10:57:16.857 INFO:teuthology.provision.fog.smithi066:Waiting for deploy to finish 2023-08-16T10:57:16.857 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-08-16T10:57:17.041 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T10:57:32.048 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-08-16T10:57:35.604 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-08-16T10:57:41.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T10:57:44.688 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-08-16T10:57:47.204 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-08-16T10:57:50.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T10:57:53.744 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-08-16T10:57:59.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T10:58:02.354 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-08-16T10:58:02.832 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-08-16T10:58:08.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T10:58:11.920 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-08-16T10:58:17.496 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-08-16T10:58:17.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T10:58:20.976 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-08-16T10:58:26.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T10:58:32.646 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-08-16T10:58:45.488 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-08-16T10:58:47.797 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-08-16T10:58:51.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T10:58:53.999 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-08-16T10:59:00.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T10:59:00.072 ERROR:teuthology.orchestra.connection:Error authenticating with smithi193.front.sepia.ceph.com: Authentication failed. 2023-08-16T10:59:00.074 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-16T10:59:00.074 DEBUG:teuthology.orchestra.run.smithi193:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-16T10:59:00.075 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:01.079 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:02.082 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:02.984 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-08-16T10:59:03.087 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:04.092 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:05.096 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:06.100 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:07.104 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:08.108 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:09.112 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:10.116 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:11.120 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:12.123 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:13.127 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:14.131 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:15.135 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:16.139 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:17.143 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:18.147 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:18.159 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-08-16T10:59:19.152 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:20.156 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:21.159 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:22.163 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:23.167 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:24.172 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:25.176 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:26.181 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:27.185 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:28.189 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:29.193 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:30.197 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:31.201 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:32.205 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:33.209 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:33.342 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-08-16T10:59:34.215 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:35.219 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:36.223 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:37.227 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:38.232 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:39.237 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:40.242 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:41.246 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:42.251 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:43.256 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:44.260 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:45.263 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:46.267 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:47.271 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:48.274 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:48.521 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-08-16T10:59:49.279 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:50.284 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:51.290 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:52.294 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:53.298 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:54.301 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:55.305 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:56.309 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:57.312 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:58.316 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T10:59:59.320 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:00.324 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:01.328 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:02.331 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:03.335 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:03.739 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-08-16T11:00:04.339 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:05.343 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:06.346 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:07.349 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:08.352 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:09.356 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:10.360 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:11.363 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:12.367 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:13.370 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:14.374 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:15.378 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:16.382 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:17.385 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:18.389 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:18.915 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-08-16T11:00:19.396 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:20.400 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:21.405 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:22.410 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:23.414 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:24.417 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:25.420 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:26.423 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:27.427 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:28.430 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:29.435 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:30.440 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:31.444 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:32.449 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:33.453 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:34.062 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-08-16T11:00:34.458 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:35.463 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:36.466 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:37.469 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:38.473 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:39.477 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:40.480 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:41.484 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:42.488 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:43.491 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:44.495 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:45.499 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:46.503 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:47.507 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:48.511 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:49.227 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-08-16T11:00:49.517 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:50.521 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:51.525 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:52.530 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:53.535 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:54.539 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:55.542 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:56.546 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:57.550 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:58.556 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:00:59.561 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:01:00.005 ERROR:teuthology.provision.fog: on smithi193 2023-08-16T11:01:04.356 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-08-16T11:01:09.009 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com' 2023-08-16T11:01:09.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T11:01:09.121 ERROR:teuthology.orchestra.connection:Error authenticating with smithi193.front.sepia.ceph.com: Authentication failed. 2023-08-16T11:01:09.122 DEBUG:teuthology.orchestra.run.smithi193:> true 2023-08-16T11:01:09.123 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T11:01:19.498 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-08-16T11:01:19.634 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T11:01:22.704 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-08-16T11:01:28.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T11:01:31.760 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-08-16T11:01:37.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T11:01:40.816 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-08-16T11:01:46.818 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T11:01:49.872 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-08-16T11:01:55.873 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T11:01:58.928 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-08-16T11:02:04.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T11:02:07.984 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-08-16T11:02:13.985 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T11:02:17.040 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-08-16T11:02:23.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T11:02:26.096 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-08-16T11:02:32.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T11:02:35.152 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-08-16T11:02:41.153 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T11:02:44.208 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-08-16T11:02:50.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T11:03:08.656 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-08-16T11:03:14.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T11:03:17.712 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-08-16T11:03:18.015 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com' 2023-08-16T11:03:18.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T11:03:23.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T11:03:26.758 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-16T11:03:26.758 DEBUG:teuthology.orchestra.run.smithi066:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-16T11:03:27.048 INFO:teuthology.provision.fog.smithi066:Node is ready 2023-08-16T11:03:27.048 DEBUG:teuthology.orchestra.run.smithi066:> hostname 2023-08-16T11:03:27.064 INFO:teuthology.orchestra.run.smithi066.stdout:smithi022 2023-08-16T11:03:27.065 DEBUG:teuthology.orchestra.run.smithi066:> grep smithi022 /etc/hosts 2023-08-16T11:03:27.121 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-08-16T11:03:27.122 DEBUG:teuthology.orchestra.run.smithi066:> sudo hostname smithi066 2023-08-16T11:03:27.260 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/smithi022/smithi066/g' /etc/hosts 2023-08-16T11:03:27.289 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/172.21.15.22/172.21.15.66/g' /etc/hosts 2023-08-16T11:03:27.356 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/smithi022/smithi066/g' /etc/hostname 2023-08-16T11:03:27.424 DEBUG:teuthology.orchestra.run.smithi066:> sudo hostname smithi066 2023-08-16T11:03:27.490 DEBUG:teuthology.orchestra.run.smithi066:> cat /etc/os-release 2023-08-16T11:03:27.547 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="Red Hat Enterprise Linux" 2023-08-16T11:03:27.547 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="8.6 (Ootpa)" 2023-08-16T11:03:27.547 INFO:teuthology.orchestra.run.smithi066.stdout:ID="rhel" 2023-08-16T11:03:27.547 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE="fedora" 2023-08-16T11:03:27.547 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="8.6" 2023-08-16T11:03:27.548 INFO:teuthology.orchestra.run.smithi066.stdout:PLATFORM_ID="platform:el8" 2023-08-16T11:03:27.548 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-16T11:03:27.548 INFO:teuthology.orchestra.run.smithi066.stdout:ANSI_COLOR="0;31" 2023-08-16T11:03:27.548 INFO:teuthology.orchestra.run.smithi066.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-16T11:03:27.548 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://www.redhat.com/" 2023-08-16T11:03:27.548 INFO:teuthology.orchestra.run.smithi066.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-16T11:03:27.548 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-16T11:03:27.549 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-08-16T11:03:27.549 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-16T11:03:27.549 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-16T11:03:27.549 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-16T11:03:27.549 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-16T11:03:27.550 INFO:teuthology.provision.fog.smithi066:Deploy complete! 2023-08-16T11:03:27.551 DEBUG:teuthology.parallel:result is None 2023-08-16T11:03:51.764 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-08-16T11:04:03.776 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com' 2023-08-16T11:04:03.777 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T11:04:06.800 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-08-16T11:04:09.804 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com' 2023-08-16T11:04:09.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T11:04:09.872 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-08-16T11:04:09.873 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-08-16T11:04:09.873 ERROR:teuthology.provision.fog:Failed to reconnect to smithi193 on smithi193 2023-08-16T11:04:21.884 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com' 2023-08-16T11:04:21.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T11:04:25.968 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-08-16T11:04:34.974 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com' 2023-08-16T11:04:34.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T11:04:38.032 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-08-16T11:04:50.044 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com' 2023-08-16T11:04:50.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T11:04:50.160 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-08-16T11:04:53.164 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com' 2023-08-16T11:04:53.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T11:04:53.424 DEBUG:teuthology.orchestra.run.smithi193:> true 2023-08-16T11:04:53.718 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi193.front.sepia.ceph.com' 2023-08-16T11:04:53.719 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-16T11:04:53.719 DEBUG:teuthology.orchestra.run.smithi193:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-16T11:04:53.735 INFO:teuthology.provision.fog.smithi193:Node is ready 2023-08-16T11:04:53.735 DEBUG:teuthology.orchestra.run.smithi193:> hostname 2023-08-16T11:04:53.790 INFO:teuthology.orchestra.run.smithi193.stdout:smithi193.front.sepia.ceph.com 2023-08-16T11:04:53.791 DEBUG:teuthology.orchestra.run.smithi193:> grep smithi193.front.sepia.ceph.com /etc/hosts 2023-08-16T11:04:53.846 INFO:teuthology.orchestra.run.smithi193.stdout:172.21.15.193 smithi193.front.sepia.ceph.com smithi193 2023-08-16T11:04:53.846 DEBUG:teuthology.orchestra.run.smithi193:> sudo hostname smithi193 2023-08-16T11:04:53.918 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/smithi193.front.sepia.ceph.com/smithi193/g' /etc/hosts 2023-08-16T11:04:53.985 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/172.21.15.193/172.21.15.193/g' /etc/hosts 2023-08-16T11:04:54.053 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/smithi193.front.sepia.ceph.com/smithi193/g' /etc/hostname 2023-08-16T11:04:54.119 DEBUG:teuthology.orchestra.run.smithi193:> sudo hostname smithi193 2023-08-16T11:04:54.185 DEBUG:teuthology.orchestra.run.smithi193:> cat /etc/os-release 2023-08-16T11:04:54.242 INFO:teuthology.orchestra.run.smithi193.stdout:NAME="Red Hat Enterprise Linux" 2023-08-16T11:04:54.242 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION="8.6 (Ootpa)" 2023-08-16T11:04:54.243 INFO:teuthology.orchestra.run.smithi193.stdout:ID="rhel" 2023-08-16T11:04:54.243 INFO:teuthology.orchestra.run.smithi193.stdout:ID_LIKE="fedora" 2023-08-16T11:04:54.243 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_ID="8.6" 2023-08-16T11:04:54.243 INFO:teuthology.orchestra.run.smithi193.stdout:PLATFORM_ID="platform:el8" 2023-08-16T11:04:54.243 INFO:teuthology.orchestra.run.smithi193.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-16T11:04:54.243 INFO:teuthology.orchestra.run.smithi193.stdout:ANSI_COLOR="0;31" 2023-08-16T11:04:54.243 INFO:teuthology.orchestra.run.smithi193.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-16T11:04:54.244 INFO:teuthology.orchestra.run.smithi193.stdout:HOME_URL="https://www.redhat.com/" 2023-08-16T11:04:54.244 INFO:teuthology.orchestra.run.smithi193.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-16T11:04:54.244 INFO:teuthology.orchestra.run.smithi193.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-16T11:04:54.244 INFO:teuthology.orchestra.run.smithi193.stdout: 2023-08-16T11:04:54.244 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-16T11:04:54.244 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-16T11:04:54.244 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-16T11:04:54.245 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-16T11:04:54.245 INFO:teuthology.provision.fog.smithi193:Deploy complete! 2023-08-16T11:04:54.245 DEBUG:teuthology.parallel:result is None 2023-08-16T11:04:54.394 INFO:teuthology.lock.ops:Checking smithi066.front.sepia.ceph.com 2023-08-16T11:04:54.395 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-16T11:04:54.412 INFO:teuthology.lock.ops:Checking smithi193.front.sepia.ceph.com 2023-08-16T11:04:54.412 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-16T11:04:54.438 INFO:teuthology.lock.ops:Updating [smithi066.front.sepia.ceph.com]: set os type and version on server 2023-08-16T11:04:54.438 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2023-08-16T11:04:54.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T11:04:54.505 DEBUG:teuthology.orchestra.run.smithi066:> true 2023-08-16T11:04:54.642 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi066.front.sepia.ceph.com' 2023-08-16T11:04:54.642 DEBUG:teuthology.orchestra.run.smithi066:> uname -m 2023-08-16T11:04:54.700 INFO:teuthology.orchestra.run.smithi066.stdout:x86_64 2023-08-16T11:04:54.701 DEBUG:teuthology.orchestra.run.smithi066:> cat /etc/os-release 2023-08-16T11:04:54.758 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="Red Hat Enterprise Linux" 2023-08-16T11:04:54.758 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="8.6 (Ootpa)" 2023-08-16T11:04:54.759 INFO:teuthology.orchestra.run.smithi066.stdout:ID="rhel" 2023-08-16T11:04:54.759 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE="fedora" 2023-08-16T11:04:54.759 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="8.6" 2023-08-16T11:04:54.759 INFO:teuthology.orchestra.run.smithi066.stdout:PLATFORM_ID="platform:el8" 2023-08-16T11:04:54.759 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-16T11:04:54.760 INFO:teuthology.orchestra.run.smithi066.stdout:ANSI_COLOR="0;31" 2023-08-16T11:04:54.760 INFO:teuthology.orchestra.run.smithi066.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-16T11:04:54.760 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://www.redhat.com/" 2023-08-16T11:04:54.761 INFO:teuthology.orchestra.run.smithi066.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-16T11:04:54.761 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-16T11:04:54.762 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-08-16T11:04:54.762 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-16T11:04:54.762 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-16T11:04:54.762 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-16T11:04:54.762 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-16T11:04:54.763 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server 2023-08-16T11:04:54.787 INFO:teuthology.lock.ops:Updating [smithi193.front.sepia.ceph.com]: set os type and version on server 2023-08-16T11:04:54.788 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com' 2023-08-16T11:04:54.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T11:04:54.855 DEBUG:teuthology.orchestra.run.smithi193:> true 2023-08-16T11:04:54.925 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi193.front.sepia.ceph.com' 2023-08-16T11:04:54.925 DEBUG:teuthology.orchestra.run.smithi193:> uname -m 2023-08-16T11:04:54.981 INFO:teuthology.orchestra.run.smithi193.stdout:x86_64 2023-08-16T11:04:54.981 DEBUG:teuthology.orchestra.run.smithi193:> cat /etc/os-release 2023-08-16T11:04:55.037 INFO:teuthology.orchestra.run.smithi193.stdout:NAME="Red Hat Enterprise Linux" 2023-08-16T11:04:55.037 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION="8.6 (Ootpa)" 2023-08-16T11:04:55.037 INFO:teuthology.orchestra.run.smithi193.stdout:ID="rhel" 2023-08-16T11:04:55.037 INFO:teuthology.orchestra.run.smithi193.stdout:ID_LIKE="fedora" 2023-08-16T11:04:55.038 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_ID="8.6" 2023-08-16T11:04:55.038 INFO:teuthology.orchestra.run.smithi193.stdout:PLATFORM_ID="platform:el8" 2023-08-16T11:04:55.038 INFO:teuthology.orchestra.run.smithi193.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-16T11:04:55.038 INFO:teuthology.orchestra.run.smithi193.stdout:ANSI_COLOR="0;31" 2023-08-16T11:04:55.038 INFO:teuthology.orchestra.run.smithi193.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-16T11:04:55.038 INFO:teuthology.orchestra.run.smithi193.stdout:HOME_URL="https://www.redhat.com/" 2023-08-16T11:04:55.039 INFO:teuthology.orchestra.run.smithi193.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-16T11:04:55.039 INFO:teuthology.orchestra.run.smithi193.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-16T11:04:55.039 INFO:teuthology.orchestra.run.smithi193.stdout: 2023-08-16T11:04:55.039 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-16T11:04:55.039 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-16T11:04:55.039 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-16T11:04:55.039 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-16T11:04:55.040 INFO:teuthology.lock.ops:Updating smithi193.front.sepia.ceph.com on lock server 2023-08-16T11:04:55.062 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-16T11:04:55.162 INFO:teuthology.dispatcher.supervisor:Running job 7369620 2023-08-16T11:04:55.162 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-08-16_10:55:44-fs-wip-vshankar-testing-20230816.054905-testing-default-smithi/7369620 --name vshankar-2023-08-16_10:55:44-fs-wip-vshankar-testing-20230816.054905-testing-default-smithi --description fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}} -- /home/teuthworker/archive/vshankar-2023-08-16_10:55:44-fs-wip-vshankar-testing-20230816.054905-testing-default-smithi/7369620/orig.config.yaml 2023-08-16T11:04:55.166 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-08-16_10:55:44-fs-wip-vshankar-testing-20230816.054905-testing-default-smithi/7369620 2023-08-16T11:04:55.167 INFO:teuthology.dispatcher.supervisor:Job PID: 28879 2023-08-16T11:04:55.167 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-16T11:06:55.259 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-16T11:08:55.433 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-16T11:10:55.605 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-16T11:12:55.769 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-16T11:14:56.052 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-16T11:16:56.213 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-16T11:18:56.380 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-16T11:20:56.541 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-16T11:22:56.717 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-16T11:22:56.786 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-16T11:22:56.959 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi193 but it was locked by another job: /home/teuthworker/archive/vshankar-2023-08-16_10:55:44-fs-wip-vshankar-testing-20230816.054905-testing-default-smithi/7369621 2023-08-16T11:22:56.959 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-16T11:22:56.959 INFO:teuthology.nuke:Checking targets against current locks 2023-08-16T11:22:57.009 DEBUG:teuthology.nuke:shortname: smithi066 2023-08-16T11:22:57.009 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-16T11:22:57.029 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi066.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-08-16_10:55:44-fs-wip-vshankar-testing-20230816.054905-testing-default-smithi/7369620', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-16 10:56:58.411278', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-08-16T11:22:57.032 DEBUG:teuthology.nuke:shortname: smithi193 2023-08-16T11:22:57.032 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-16T11:22:57.052 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi193.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-08-16_10:55:44-fs-wip-vshankar-testing-20230816.054905-testing-default-smithi/7369621', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-16 10:56:58.811057', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-08-16T11:22:57.070 INFO:teuthology.orchestra.console.smithi066:Power off 2023-08-16T11:22:57.071 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-16T11:22:57.091 DEBUG:teuthology.orchestra.console.smithi066:power off output: Chassis Power Control: Down/Off 2023-08-16T11:22:57.092 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T11:22:57.109 INFO:teuthology.orchestra.console.smithi193:Power off 2023-08-16T11:22:57.110 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-16T11:22:57.119 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off 2023-08-16T11:22:57.132 DEBUG:teuthology.orchestra.console.smithi193:power off output: Chassis Power Control: Down/Off 2023-08-16T11:22:57.132 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T11:22:57.154 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is off 2023-08-16T11:22:57.220 INFO:teuthology.orchestra.console.smithi066:Power off completed 2023-08-16T11:22:57.256 INFO:teuthology.orchestra.console.smithi193:Power off completed 2023-08-16T11:22:57.368 INFO:teuthology.lock.ops:unlocked: smithi066.front.sepia.ceph.com 2023-08-16T11:22:57.402 INFO:teuthology.lock.ops:unlocked: smithi193.front.sepia.ceph.com