2023-07-15T06:31:48.592 INFO:root:teuthology version: 0.0.1.dev147+gff9991b
2023-07-15T06:31:48.594 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-15T06:31:48.594 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-15T06:31:58.671 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f87cbaa25e0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f87cccc48b0>, signals=[15])
2023-07-15T06:31:58.672 INFO:teuthology.lock.ops:Start node 'smithi079.front.sepia.ceph.com' reimaging
2023-07-15T06:31:58.673 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: reset os type and version on server
2023-07-15T06:31:58.673 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server
2023-07-15T06:32:09.547 INFO:teuthology.lock.ops:Start node 'smithi083.front.sepia.ceph.com' reimaging
2023-07-15T06:32:09.547 INFO:teuthology.lock.ops:Updating [smithi083.front.sepia.ceph.com]: reset os type and version on server
2023-07-15T06:32:09.548 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server
2023-07-15T06:32:09.549 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /host {"name": "smithi079"}
2023-07-15T06:32:19.579 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /host {"name": "smithi083"}
2023-07-15T06:32:29.620 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /image {"name": "smithi_ubuntu_20.04"}
2023-07-15T06:32:35.528 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /image {"name": "smithi_ubuntu_20.04"}
2023-07-15T06:32:40.534 DEBUG:teuthology.provision.fog.smithi079:Requesting image smithi_ubuntu_20.04 (ID 2)
2023-07-15T06:32:40.534 DEBUG:teuthology.provision.fog.smithi079:FOG request: PUT /host/184 {"imageID": 2}
2023-07-15T06:32:40.592 DEBUG:teuthology.provision.fog.smithi083:Requesting image smithi_ubuntu_20.04 (ID 2)
2023-07-15T06:32:40.592 DEBUG:teuthology.provision.fog.smithi083:FOG request: PUT /host/188 {"imageID": 2}
2023-07-15T06:32:40.594 INFO:teuthology.provision.fog.smithi079:Scheduling deploy of ubuntu 20.04
2023-07-15T06:32:40.595 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-07-15T06:32:40.643 INFO:teuthology.provision.fog.smithi083:Scheduling deploy of ubuntu 20.04
2023-07-15T06:32:40.644 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None
2023-07-15T06:32:40.678 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /tasktype {"name": "deploy"}
2023-07-15T06:32:40.726 DEBUG:teuthology.provision.fog.smithi079:FOG request: POST /host/184/task {"taskTypeID": 1}
2023-07-15T06:32:40.730 DEBUG:teuthology.provision.fog.smithi083:Canceling deploy task with ID 386447
2023-07-15T06:32:40.730 DEBUG:teuthology.provision.fog.smithi083:FOG request: DELETE /task/cancel {"id": 386447}
2023-07-15T06:32:40.772 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /tasktype {"name": "deploy"}
2023-07-15T06:32:40.793 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-07-15T06:32:40.815 DEBUG:teuthology.provision.fog.smithi083:FOG request: POST /host/188/task {"taskTypeID": 1}
2023-07-15T06:32:45.300 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None
2023-07-15T06:32:50.339 INFO:teuthology.orchestra.console:Power off smithi079
2023-07-15T06:32:50.340 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-15T06:32:50.363 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T06:32:55.401 INFO:teuthology.orchestra.console:Power off for smithi079 completed
2023-07-15T06:32:55.429 INFO:teuthology.orchestra.console:Power off smithi083
2023-07-15T06:32:55.429 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-15T06:32:55.502 INFO:teuthology.orchestra.console:Power on smithi079
2023-07-15T06:32:55.503 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-15T06:33:00.458 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T06:33:00.526 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T06:33:05.472 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T06:33:05.537 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T06:33:10.584 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T06:33:10.647 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T06:33:10.858 INFO:teuthology.orchestra.console:Power on for smithi079 completed
2023-07-15T06:33:10.959 INFO:teuthology.provision.fog.smithi079:Waiting for deploy to finish
2023-07-15T06:33:10.960 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-07-15T06:33:16.068 INFO:teuthology.orchestra.console:Power off for smithi083 completed
2023-07-15T06:33:16.168 INFO:teuthology.orchestra.console:Power on smithi083
2023-07-15T06:33:16.169 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-15T06:33:31.059 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-07-15T06:33:35.996 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T06:33:41.012 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T06:33:46.124 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T06:33:51.080 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-07-15T06:33:56.089 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T06:34:01.201 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T06:34:06.313 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T06:34:11.172 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-07-15T06:34:11.426 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T06:34:16.536 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T06:34:21.652 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T06:34:26.256 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-07-15T06:34:31.265 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T06:34:36.377 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T06:34:41.492 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T06:34:41.703 INFO:teuthology.orchestra.console:Power on for smithi083 completed
2023-07-15T06:34:41.804 INFO:teuthology.provision.fog.smithi083:Waiting for deploy to finish
2023-07-15T06:34:41.804 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None
2023-07-15T06:34:51.817 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-07-15T06:34:56.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-15T06:34:59.953 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83
2023-07-15T06:35:05.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-15T06:35:09.008 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83
2023-07-15T06:35:11.908 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-07-15T06:35:15.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-15T06:35:15.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-15T06:35:15.318 ERROR:teuthology.orchestra.connection:Error authenticating with smithi083.front.sepia.ceph.com: Authentication failed.
2023-07-15T06:35:15.320 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-15T06:35:15.321 DEBUG:teuthology.orchestra.run.smithi083:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-15T06:35:15.322 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:15.326 ERROR:teuthology.orchestra.connection:Error authenticating with smithi079.front.sepia.ceph.com: Authentication failed.
2023-07-15T06:35:15.326 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-15T06:35:15.326 DEBUG:teuthology.orchestra.run.smithi079:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-15T06:35:15.327 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:16.330 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:16.334 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:17.338 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:17.342 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:18.346 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:18.349 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:19.354 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:19.357 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:20.360 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:20.363 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:21.369 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:21.372 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:22.377 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:22.379 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:23.385 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:23.386 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:24.394 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:24.395 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:25.401 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:25.401 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:26.407 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:26.408 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:27.413 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:27.414 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:28.421 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:28.421 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:29.429 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:29.429 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:30.436 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:30.436 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:31.443 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:31.443 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:32.449 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:32.450 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:33.456 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:33.457 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:34.465 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:34.466 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:35.473 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:35.474 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:36.481 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:36.482 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:37.488 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:37.489 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:38.495 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:38.496 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:39.502 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:39.502 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:40.509 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:40.509 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:41.515 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:41.515 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:42.521 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:42.522 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:43.528 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:43.528 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:44.536 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:44.536 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:45.542 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:45.543 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:46.548 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:46.548 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:47.554 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:47.555 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:48.562 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:48.562 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:49.568 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:49.569 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:50.577 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:50.578 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:51.584 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:51.584 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:52.591 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:52.592 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:53.597 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:53.598 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:54.604 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:54.605 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:55.610 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:55.611 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:56.618 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:56.618 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:57.627 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:57.628 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:58.634 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:58.635 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:59.641 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:35:59.641 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:00.648 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:00.648 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:01.655 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:01.656 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:02.664 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:02.665 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:03.672 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:03.672 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:04.678 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:04.679 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:05.685 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:05.685 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:06.692 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:06.692 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:07.698 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:07.699 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:08.705 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:08.705 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:09.715 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:09.715 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:10.723 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:10.724 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:11.730 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:11.730 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:12.737 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:12.737 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:13.744 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:13.745 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:14.752 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:14.752 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:15.763 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:15.763 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:16.770 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:16.771 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:17.777 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:17.783 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:18.787 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:18.793 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:19.795 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:19.801 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:20.805 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:20.810 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:21.815 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:21.818 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:22.825 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:22.826 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:23.833 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:23.835 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:24.842 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:24.844 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:25.851 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:25.853 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:26.858 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:26.861 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:27.867 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:27.869 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:28.874 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:28.876 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:29.884 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:29.884 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:30.891 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:30.891 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:31.898 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:31.899 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:32.906 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:32.906 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:33.913 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:33.913 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:34.919 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:34.920 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:35.925 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:35.925 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:36.930 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:36.930 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:37.937 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:37.938 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:38.943 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:38.943 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:39.949 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:39.950 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:40.959 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:40.960 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:41.965 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:41.966 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:42.972 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:42.972 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:43.978 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:43.979 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:44.985 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:44.985 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:45.991 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:45.992 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:46.998 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:46.998 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:48.005 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:48.005 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:49.013 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:49.014 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:50.020 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:50.020 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:51.027 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:51.028 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:52.036 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:52.036 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:53.043 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:53.044 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:54.051 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:54.051 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:55.058 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:55.058 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:56.064 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:56.065 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:57.072 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:57.073 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:58.081 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:58.082 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:59.092 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:36:59.092 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:37:00.098 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:37:00.099 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:37:01.106 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:37:01.106 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:37:02.115 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:37:02.115 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:37:03.122 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:37:03.122 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:37:04.130 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:37:04.130 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:37:05.139 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:37:05.140 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:37:06.147 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:37:06.147 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:37:07.154 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:37:07.155 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:37:08.162 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:37:08.163 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:37:09.169 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:37:09.170 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:37:10.177 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:37:10.178 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:37:11.185 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:37:11.185 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:37:12.192 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:37:12.192 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:37:13.202 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:37:13.202 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:37:14.211 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:37:14.212 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:37:15.208 ERROR:teuthology.provision.fog: on smithi083
2023-07-15T06:37:15.220 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:37:15.252 ERROR:teuthology.provision.fog: on smithi079
2023-07-15T06:37:24.216 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com'
2023-07-15T06:37:24.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-15T06:37:29.223 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com'
2023-07-15T06:37:29.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-15T06:37:34.301 ERROR:teuthology.orchestra.connection:Error authenticating with smithi083.front.sepia.ceph.com: Authentication failed.
2023-07-15T06:37:34.301 DEBUG:teuthology.orchestra.run.smithi083:> true
2023-07-15T06:37:34.302 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:37:34.306 ERROR:teuthology.orchestra.connection:Error authenticating with smithi079.front.sepia.ceph.com: Authentication failed.
2023-07-15T06:37:34.307 DEBUG:teuthology.orchestra.run.smithi079:> true
2023-07-15T06:37:34.308 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:39:38.228 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com'
2023-07-15T06:39:38.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-15T06:39:38.346 ERROR:teuthology.orchestra.connection:Error authenticating with smithi083.front.sepia.ceph.com: Authentication failed.
2023-07-15T06:39:38.347 DEBUG:teuthology.orchestra.run.smithi083:> true
2023-07-15T06:39:38.353 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:41:50.236 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com'
2023-07-15T06:41:50.237 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-15T06:41:50.312 ERROR:teuthology.orchestra.connection:Error authenticating with smithi083.front.sepia.ceph.com: Authentication failed.
2023-07-15T06:41:50.313 DEBUG:teuthology.orchestra.run.smithi083:> true
2023-07-15T06:41:50.313 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:43:53.243 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com'
2023-07-15T06:43:53.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-15T06:43:58.360 ERROR:teuthology.orchestra.connection:Error authenticating with smithi083.front.sepia.ceph.com: Authentication failed.
2023-07-15T06:43:58.361 DEBUG:teuthology.orchestra.run.smithi083:> true
2023-07-15T06:43:58.362 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T06:45:58.250 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds
2023-07-15T06:45:58.253 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/fog.py", line 90, in create
    self._wait_for_ready()
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/fog.py", line 299, in _wait_for_ready
    self.remote.run(args=cmd, timeout=600)
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/orchestra/remote.py", line 521, in run
    raise Exception(f'Cannot connect to remote host {self.shortname}')
Exception: Cannot connect to remote host smithi083
2023-07-15T06:45:58.253 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-15T06:45:58.254 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-15T06:46:03.353 INFO:teuthology.nuke:Checking targets against current locks
2023-07-15T06:46:03.405 DEBUG:teuthology.nuke:shortname: smithi079
2023-07-15T06:46:03.405 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-15T06:46:03.426 DEBUG:teuthology.nuke:shortname: smithi083
2023-07-15T06:46:03.427 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-15T06:46:03.429 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi079.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-14_23:39:06-rados-wip-yuri5-testing-2023-07-14-0757-distro-default-smithi/7338624', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-15 06:31:47.689099', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}
2023-07-15T06:46:03.451 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi083.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-14_23:39:06-rados-wip-yuri5-testing-2023-07-14-0757-distro-default-smithi/7338624', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-15 06:31:47.690842', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}
2023-07-15T06:46:03.488 INFO:teuthology.orchestra.console:Power off smithi079
2023-07-15T06:46:03.489 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-15T06:46:03.514 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T06:46:03.538 INFO:teuthology.orchestra.console:Power off smithi083
2023-07-15T06:46:03.539 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-15T06:46:03.570 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T06:46:07.551 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T06:46:07.594 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T06:46:11.664 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T06:46:11.709 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T06:46:16.778 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T06:46:16.822 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T06:46:21.889 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T06:46:21.933 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T06:46:22.104 INFO:teuthology.orchestra.console:Power off for smithi079 completed
2023-07-15T06:46:22.263 INFO:teuthology.lock.ops:unlocked: smithi079.front.sepia.ceph.com
2023-07-15T06:46:27.045 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T06:46:32.156 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T06:46:37.270 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T06:46:42.381 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T06:46:47.494 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T06:46:52.607 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T06:46:57.719 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T06:47:02.831 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T06:47:07.944 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T06:47:13.055 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T06:47:14.166 WARNING:teuthology.contextutil:'wait for power off' reached maximum tries (16) after waiting for 60.0 seconds
2023-07-15T06:47:14.167 ERROR:teuthology.orchestra.console:Failed to power off smithi083
2023-07-15T06:47:24.245 INFO:teuthology.lock.ops:unlocked: smithi083.front.sepia.ceph.com
2023-07-15T06:47:27.148 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/dispatcher/supervisor.py", line 57, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/fog.py", line 90, in create
    self._wait_for_ready()
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/fog.py", line 299, in _wait_for_ready
    self.remote.run(args=cmd, timeout=600)
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/orchestra/remote.py", line 521, in run
    raise Exception(f'Cannot connect to remote host {self.shortname}')
Exception: Cannot connect to remote host smithi083