2023-06-28T05:15:49.341 INFO:root:teuthology version: 0.0.1.dev132+gaa9345a
2023-06-28T05:15:49.342 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-28T05:15:49.343 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-28T05:15:49.498 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fe31f7b9670>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fe31f15f430>, signals=[15])
2023-06-28T05:15:49.500 INFO:teuthology.lock.ops:Start node 'smithi171.front.sepia.ceph.com' reimaging
2023-06-28T05:15:49.500 INFO:teuthology.lock.ops:Updating [smithi171.front.sepia.ceph.com]: reset os type and version on server
2023-06-28T05:15:49.500 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server
2023-06-28T05:15:49.519 INFO:teuthology.lock.ops:Start node 'smithi191.front.sepia.ceph.com' reimaging
2023-06-28T05:15:49.520 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: reset os type and version on server
2023-06-28T05:15:49.520 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server
2023-06-28T05:15:49.521 DEBUG:teuthology.provision.fog.smithi171:FOG request: GET /host {"name": "smithi171"}
2023-06-28T05:15:49.544 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /host {"name": "smithi191"}
2023-06-28T05:15:49.595 DEBUG:teuthology.provision.fog.smithi171:FOG request: GET /image {"name": "smithi_ubuntu_22.04"}
2023-06-28T05:15:49.612 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /image {"name": "smithi_ubuntu_22.04"}
2023-06-28T05:15:49.646 DEBUG:teuthology.provision.fog.smithi171:Requesting image smithi_ubuntu_22.04 (ID 6)
2023-06-28T05:15:49.646 DEBUG:teuthology.provision.fog.smithi171:FOG request: PUT /host/276 {"imageID": 6}
2023-06-28T05:15:49.660 DEBUG:teuthology.provision.fog.smithi191:Requesting image smithi_ubuntu_22.04 (ID 6)
2023-06-28T05:15:49.661 DEBUG:teuthology.provision.fog.smithi191:FOG request: PUT /host/296 {"imageID": 6}
2023-06-28T05:15:49.689 INFO:teuthology.provision.fog.smithi171:Scheduling deploy of ubuntu 22.04
2023-06-28T05:15:49.690 DEBUG:teuthology.provision.fog.smithi171:FOG request: GET /task/active None
2023-06-28T05:15:49.704 INFO:teuthology.provision.fog.smithi191:Scheduling deploy of ubuntu 22.04
2023-06-28T05:15:49.704 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None
2023-06-28T05:15:49.786 DEBUG:teuthology.provision.fog.smithi171:FOG request: GET /tasktype {"name": "deploy"}
2023-06-28T05:15:49.799 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /tasktype {"name": "deploy"}
2023-06-28T05:15:49.831 DEBUG:teuthology.provision.fog.smithi171:FOG request: POST /host/276/task {"taskTypeID": 1}
2023-06-28T05:15:49.837 DEBUG:teuthology.provision.fog.smithi191:FOG request: POST /host/296/task {"taskTypeID": 1}
2023-06-28T05:15:49.890 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None
2023-06-28T05:15:49.891 DEBUG:teuthology.provision.fog.smithi171:FOG request: GET /task/active None
2023-06-28T05:16:00.014 INFO:teuthology.orchestra.console:Power off smithi171
2023-06-28T05:16:00.015 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-28T05:16:00.059 INFO:teuthology.orchestra.console:Power off smithi191
2023-06-28T05:16:00.060 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-28T05:16:05.040 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T05:16:05.087 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T05:16:10.056 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T05:16:10.097 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T05:16:10.309 INFO:teuthology.orchestra.console:Power off for smithi191 completed
2023-06-28T05:16:10.410 INFO:teuthology.orchestra.console:Power on smithi191
2023-06-28T05:16:10.411 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-06-28T05:16:10.431 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T05:16:14.455 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T05:16:15.168 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T05:16:19.568 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T05:16:20.279 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T05:16:24.678 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T05:16:24.887 INFO:teuthology.orchestra.console:Power on for smithi191 completed
2023-06-28T05:16:24.989 INFO:teuthology.provision.fog.smithi191:Waiting for deploy to finish
2023-06-28T05:16:24.989 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None
2023-06-28T05:16:29.272 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T05:16:29.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T05:16:34.387 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T05:16:39.496 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T05:16:44.607 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T05:16:47.856 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2023-06-28T05:16:49.719 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T05:16:53.861 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T05:16:58.866 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T05:17:01.936 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2023-06-28T05:17:03.976 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T05:17:07.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T05:17:22.954 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T05:17:26.032 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2023-06-28T05:17:28.066 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T05:17:32.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T05:17:37.041 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T05:17:40.116 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2023-06-28T05:17:42.155 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T05:17:43.266 WARNING:teuthology.contextutil:'wait for power off' reached maximum tries (16) after waiting for 60.0 seconds
2023-06-28T05:17:43.267 ERROR:teuthology.orchestra.console:Failed to power off smithi171
2023-06-28T05:17:43.267 INFO:teuthology.orchestra.console:Power on smithi171
2023-06-28T05:17:43.267 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-06-28T05:17:46.121 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T05:17:49.204 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2023-06-28T05:17:52.268 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T05:17:55.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T05:17:55.323 ERROR:teuthology.orchestra.connection:Error authenticating with smithi191.front.sepia.ceph.com: Authentication failed.
2023-06-28T05:17:55.324 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-06-28T05:17:55.325 DEBUG:teuthology.orchestra.run.smithi191:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-06-28T05:17:55.326 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:17:56.289 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T05:17:56.331 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:17:57.337 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:17:58.343 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:17:59.348 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:18:00.353 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:18:01.358 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:18:01.402 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T05:18:02.365 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:18:03.371 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:18:04.376 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:18:05.381 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:18:06.387 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:18:06.512 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T05:18:07.393 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:18:08.399 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:18:09.405 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:18:10.410 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:18:11.416 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:18:11.625 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T05:18:12.423 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:18:13.429 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:18:14.434 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:18:15.439 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:18:16.445 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:18:16.735 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T05:18:17.452 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:18:18.458 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:18:19.464 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:18:20.469 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:18:21.475 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:18:21.847 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T05:18:22.058 INFO:teuthology.orchestra.console:Power on for smithi171 completed
2023-06-28T05:18:22.159 INFO:teuthology.provision.fog.smithi171:Waiting for deploy to finish
2023-06-28T05:18:22.160 DEBUG:teuthology.provision.fog.smithi171:FOG request: GET /task/active None
2023-06-28T05:18:22.482 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:18:23.488 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:18:24.493 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:18:25.498 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:18:26.504 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:18:27.510 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:18:28.515 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:18:29.521 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:18:30.526 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:18:31.531 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:18:32.536 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:18:33.542 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:18:34.547 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:18:35.552 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:18:36.557 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:18:37.257 DEBUG:teuthology.provision.fog.smithi171:FOG request: GET /task/active None
2023-06-28T05:18:42.260 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:18:43.265 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:18:44.270 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:18:45.275 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:18:46.280 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:18:47.284 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:18:48.289 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:18:49.295 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:18:50.299 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:18:51.305 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:18:52.309 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:18:53.314 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:18:54.319 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:18:55.324 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:18:56.329 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:18:57.335 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:18:57.349 DEBUG:teuthology.provision.fog.smithi171:FOG request: GET /task/active None
2023-06-28T05:19:02.357 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:19:03.362 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:19:04.367 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:19:05.372 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:19:06.377 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:19:07.383 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:19:08.388 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:19:09.393 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:19:10.398 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:19:11.403 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:19:12.408 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:19:13.413 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:19:14.418 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:19:15.424 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:19:16.429 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:19:17.434 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:19:17.441 DEBUG:teuthology.provision.fog.smithi171:FOG request: GET /task/active None
2023-06-28T05:19:18.440 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:19:19.445 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:19:20.451 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:19:21.457 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:19:22.463 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:19:23.468 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:19:24.474 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:19:25.479 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:19:26.484 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:19:27.489 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:19:28.494 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:19:29.500 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:19:30.505 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:19:31.510 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:19:32.515 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:19:32.526 DEBUG:teuthology.provision.fog.smithi171:FOG request: GET /task/active None
2023-06-28T05:19:37.534 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:19:38.539 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:19:39.544 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:19:40.549 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:19:41.554 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:19:42.559 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:19:43.563 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:19:44.568 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:19:45.573 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:19:46.578 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:19:47.583 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:19:48.588 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:19:49.594 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:19:50.599 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:19:51.606 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:19:52.605 DEBUG:teuthology.provision.fog.smithi171:FOG request: GET /task/active None
2023-06-28T05:19:57.615 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 90, in create
    self._wait_for_ready()
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 295, in _wait_for_ready
    self.remote.run(args=cmd, timeout=600)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/remote.py", line 525, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/run.py", line 450, in run
    r.execute()
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/run.py", line 97, in execute
    self.client.exec_command(self.command, timeout=self.timeout)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 510, in exec_command
    chan = self._transport.open_session(timeout=timeout)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 919, in open_session
    return self.open_channel(
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1050, in open_channel
    raise e
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2109, in run
    ptype, m = self.packetizer.read_message()
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 459, in read_message
    header = self.read_all(self.__block_size_in, check_rekey=True)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 303, in read_all
    raise EOFError()
EOFError
2023-06-28T05:19:57.616 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-28T05:19:57.617 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-28T05:20:02.665 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T05:20:07.671 INFO:teuthology.nuke:Checking targets against current locks
2023-06-28T05:20:22.731 ERROR:teuthology.orchestra.connection:Error authenticating with smithi171.front.sepia.ceph.com: Authentication failed.
2023-06-28T05:20:22.732 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-06-28T05:20:22.732 DEBUG:teuthology.orchestra.run.smithi171:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-06-28T05:20:27.737 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:20:27.738 DEBUG:teuthology.nuke:shortname: smithi171
2023-06-28T05:20:27.738 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-06-28T05:20:32.746 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:20:32.769 DEBUG:teuthology.nuke:shortname: smithi191
2023-06-28T05:20:32.769 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-06-28T05:20:37.773 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi171.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-27_22:53:17-rbd-reef-release-distro-default-smithi/7318918', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-28 05:15:48.509223', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}
2023-06-28T05:20:38.742 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:20:43.776 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi191.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-27_22:53:17-rbd-reef-release-distro-default-smithi/7318918', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-28 05:15:48.507153', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}
2023-06-28T05:20:43.779 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:20:43.811 INFO:teuthology.orchestra.console:Power off smithi171
2023-06-28T05:20:43.811 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-28T05:20:43.836 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T05:20:43.854 INFO:teuthology.orchestra.console:Power off smithi191
2023-06-28T05:20:43.855 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-28T05:20:43.877 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T05:20:44.792 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:20:45.797 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:20:46.802 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:20:47.808 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:20:47.867 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T05:20:47.902 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T05:20:48.816 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:20:49.822 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:20:50.828 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T05:20:52.976 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T05:20:53.014 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T05:20:58.088 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T05:20:58.125 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T05:21:03.199 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T05:21:03.235 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T05:21:03.411 INFO:teuthology.orchestra.console:Power off for smithi171 completed
2023-06-28T05:21:03.562 INFO:teuthology.lock.ops:unlocked: smithi171.front.sepia.ceph.com
2023-06-28T05:21:08.346 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T05:21:08.558 INFO:teuthology.orchestra.console:Power off for smithi191 completed
2023-06-28T05:21:18.520 INFO:teuthology.lock.ops:unlocked: smithi191.front.sepia.ceph.com
2023-06-28T05:21:18.761 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/supervisor.py", line 57, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 90, in create
    self._wait_for_ready()
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 295, in _wait_for_ready
    self.remote.run(args=cmd, timeout=600)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/remote.py", line 525, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/run.py", line 450, in run
    r.execute()
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/run.py", line 97, in execute
    self.client.exec_command(self.command, timeout=self.timeout)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 510, in exec_command
    chan = self._transport.open_session(timeout=timeout)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 919, in open_session
    return self.open_channel(
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1050, in open_channel
    raise e
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2109, in run
    ptype, m = self.packetizer.read_message()
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 459, in read_message
    header = self.read_all(self.__block_size_in, check_rekey=True)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 303, in read_all
    raise EOFError()
EOFError