2023-07-15T07:36:33.262 INFO:root:teuthology version: 0.0.1.dev147+gff9991b
2023-07-15T07:36:33.264 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-15T07:36:33.265 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-15T07:36:52.734 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f2d4591c550>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f2d46b388b0>, signals=[15])
2023-07-15T07:36:52.736 INFO:teuthology.lock.ops:Start node 'smithi016.front.sepia.ceph.com' reimaging
2023-07-15T07:36:52.736 INFO:teuthology.lock.ops:Updating [smithi016.front.sepia.ceph.com]: reset os type and version on server
2023-07-15T07:36:52.737 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server
2023-07-15T07:36:52.765 INFO:teuthology.lock.ops:Start node 'smithi093.front.sepia.ceph.com' reimaging
2023-07-15T07:36:52.766 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: reset os type and version on server
2023-07-15T07:36:52.766 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server
2023-07-15T07:36:52.768 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /host {"name": "smithi016"}
2023-07-15T07:37:02.807 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /host {"name": "smithi093"}
2023-07-15T07:37:12.806 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-07-15T07:37:22.845 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-07-15T07:37:27.851 DEBUG:teuthology.provision.fog.smithi016:Requesting image smithi_centos_8.stream (ID 3)
2023-07-15T07:37:27.852 DEBUG:teuthology.provision.fog.smithi016:FOG request: PUT /host/122 {"imageID": 3}
2023-07-15T07:37:32.905 DEBUG:teuthology.provision.fog.smithi093:Requesting image smithi_centos_8.stream (ID 3)
2023-07-15T07:37:32.905 DEBUG:teuthology.provision.fog.smithi093:FOG request: PUT /host/198 {"imageID": 3}
2023-07-15T07:37:37.913 INFO:teuthology.provision.fog.smithi016:Scheduling deploy of centos 8.stream
2023-07-15T07:37:37.914 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None
2023-07-15T07:37:42.975 INFO:teuthology.provision.fog.smithi093:Scheduling deploy of centos 8.stream
2023-07-15T07:37:42.976 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-07-15T07:37:47.983 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /tasktype {"name": "deploy"}
2023-07-15T07:37:53.033 DEBUG:teuthology.provision.fog.smithi016:FOG request: POST /host/122/task {"taskTypeID": 1}
2023-07-15T07:37:53.173 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /tasktype {"name": "deploy"}
2023-07-15T07:37:53.236 DEBUG:teuthology.provision.fog.smithi093:FOG request: POST /host/198/task {"taskTypeID": 1}
2023-07-15T07:37:58.239 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None
2023-07-15T07:38:03.317 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-07-15T07:38:18.333 INFO:teuthology.orchestra.console:Power off smithi016
2023-07-15T07:38:18.334 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-15T07:38:18.357 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T07:38:18.374 INFO:teuthology.orchestra.console:Power off smithi093
2023-07-15T07:38:18.374 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-15T07:38:18.400 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T07:38:18.485 INFO:teuthology.orchestra.console:Power off for smithi016 completed
2023-07-15T07:38:18.587 INFO:teuthology.orchestra.console:Power on smithi016
2023-07-15T07:38:18.587 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-15T07:38:23.416 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T07:38:23.616 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T07:38:28.531 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T07:38:28.627 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T07:38:28.743 INFO:teuthology.orchestra.console:Power off for smithi093 completed
2023-07-15T07:38:28.844 INFO:teuthology.orchestra.console:Power on smithi093
2023-07-15T07:38:28.845 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-15T07:38:28.868 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T07:38:32.896 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T07:38:33.742 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T07:38:38.009 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T07:38:38.856 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T07:38:43.123 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T07:38:43.973 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T07:38:44.185 INFO:teuthology.orchestra.console:Power on for smithi016 completed
2023-07-15T07:38:44.287 INFO:teuthology.provision.fog.smithi016:Waiting for deploy to finish
2023-07-15T07:38:44.288 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None
2023-07-15T07:38:49.297 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T07:38:49.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-15T07:38:54.535 INFO:teuthology.orchestra.console:Power on for smithi093 completed
2023-07-15T07:38:54.636 INFO:teuthology.provision.fog.smithi093:Waiting for deploy to finish
2023-07-15T07:38:54.636 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-07-15T07:38:59.641 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16
2023-07-15T07:38:59.748 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-15T07:39:05.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-15T07:39:10.649 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2023-07-15T07:39:13.712 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16
2023-07-15T07:39:16.653 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-15T07:39:21.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-15T07:39:26.664 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2023-07-15T07:39:32.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-15T07:39:39.824 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2023-07-15T07:39:45.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-15T07:39:58.309 ERROR:teuthology.orchestra.connection:Error authenticating with smithi016.front.sepia.ceph.com: Authentication failed.
2023-07-15T07:39:58.312 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-15T07:39:58.313 DEBUG:teuthology.orchestra.run.smithi016:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-15T07:39:58.314 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:39:59.320 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:00.326 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:01.332 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:02.338 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:03.344 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:04.337 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2023-07-15T07:40:04.350 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:05.356 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:06.362 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:07.368 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:08.376 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:09.381 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:10.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-15T07:40:10.389 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:10.456 ERROR:teuthology.orchestra.connection:Error authenticating with smithi093.front.sepia.ceph.com: Authentication failed.
2023-07-15T07:40:10.457 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-15T07:40:10.457 DEBUG:teuthology.orchestra.run.smithi093:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-15T07:40:10.459 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:11.398 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:11.468 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:12.407 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:12.477 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:13.417 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:13.486 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:14.426 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:14.496 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:15.436 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:15.505 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:16.445 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:16.513 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:17.454 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:17.523 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:18.463 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:18.531 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:19.472 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:19.539 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:20.481 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:20.548 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:21.489 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:21.557 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:22.498 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:22.566 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:23.508 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:23.576 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:24.516 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:24.585 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:25.526 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:25.594 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:26.538 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:26.604 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:27.546 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:27.614 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:28.554 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:28.622 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:29.563 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:29.630 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:30.572 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:30.639 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:31.580 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:31.648 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:32.590 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:32.656 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:33.599 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:33.665 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:34.608 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:34.674 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:35.617 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:35.684 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:36.629 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:36.694 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:37.637 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:37.702 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:38.646 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:38.712 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:39.655 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:39.722 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:40.665 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:40.731 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:41.674 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:41.741 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:42.686 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:42.750 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:43.696 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:43.759 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:44.705 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:44.769 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:45.714 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:45.778 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:46.723 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:46.786 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:47.731 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:47.795 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:48.739 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:48.804 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:49.748 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:49.813 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:50.757 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:50.823 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:51.767 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:51.833 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:52.776 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:52.841 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:53.785 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:53.850 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:54.793 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:54.859 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:55.802 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:55.868 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:56.812 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:56.877 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:57.821 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:57.887 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:58.831 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:58.898 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:59.840 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:40:59.908 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:00.849 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:00.916 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:01.859 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:01.926 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:02.870 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:02.937 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:03.879 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:03.945 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:04.888 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:04.954 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:05.897 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:05.965 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:06.906 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:06.973 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:07.916 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:07.983 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:08.924 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:08.992 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:09.933 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:10.001 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:10.943 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:11.011 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:11.953 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:12.020 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:12.961 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:13.028 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:13.970 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:14.037 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:14.979 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:15.046 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:15.990 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:16.055 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:16.999 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:17.065 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:18.009 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:18.074 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:19.018 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:19.088 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:20.029 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:20.097 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:21.039 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:21.108 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:22.049 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:22.117 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:23.057 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:23.126 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:24.064 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:24.134 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:25.073 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:25.145 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:26.082 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:26.156 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:27.093 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:27.166 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:28.101 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:28.175 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:29.112 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:29.186 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:30.121 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:30.196 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:31.131 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:31.206 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:32.140 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:32.214 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:33.149 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:33.223 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:34.157 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:34.232 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:35.165 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:35.242 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:36.175 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:36.250 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:37.185 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:37.259 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:38.194 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:38.267 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:39.203 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:39.280 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:40.212 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:40.289 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:41.221 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:41.298 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:42.230 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:42.306 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:43.238 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:43.315 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:44.246 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:44.324 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:45.256 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:45.331 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:46.266 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:46.340 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:47.274 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:47.349 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:48.282 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:48.358 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:49.291 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:49.367 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:50.300 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:50.377 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:51.309 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:51.386 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:52.318 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:52.395 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:53.327 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:53.403 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:54.335 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:54.412 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:55.345 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:55.420 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:56.354 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:56.429 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:57.362 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:57.438 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:58.197 ERROR:teuthology.provision.fog: on smithi016
2023-07-15T07:41:58.446 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:41:59.453 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:42:00.459 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:42:01.465 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:42:02.470 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:42:03.476 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:42:04.482 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:42:05.487 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:42:06.493 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:42:07.198 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com'
2023-07-15T07:42:07.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-15T07:42:12.206 ERROR:teuthology.provision.fog: on smithi093
2023-07-15T07:42:12.326 ERROR:teuthology.orchestra.connection:Error authenticating with smithi016.front.sepia.ceph.com: Authentication failed.
2023-07-15T07:42:12.327 DEBUG:teuthology.orchestra.run.smithi016:> true
2023-07-15T07:42:12.328 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:42:21.207 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com'
2023-07-15T07:42:21.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-15T07:42:26.328 ERROR:teuthology.orchestra.connection:Error authenticating with smithi093.front.sepia.ceph.com: Authentication failed.
2023-07-15T07:42:26.329 DEBUG:teuthology.orchestra.run.smithi093:> true
2023-07-15T07:42:26.330 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:44:21.211 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com'
2023-07-15T07:44:21.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-15T07:44:21.289 ERROR:teuthology.orchestra.connection:Error authenticating with smithi016.front.sepia.ceph.com: Authentication failed.
2023-07-15T07:44:21.290 DEBUG:teuthology.orchestra.run.smithi016:> true
2023-07-15T07:44:21.291 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:44:35.219 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com'
2023-07-15T07:44:35.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-15T07:44:35.295 ERROR:teuthology.orchestra.connection:Error authenticating with smithi093.front.sepia.ceph.com: Authentication failed.
2023-07-15T07:44:35.295 DEBUG:teuthology.orchestra.run.smithi093:> true
2023-07-15T07:44:35.296 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:46:33.221 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com'
2023-07-15T07:46:33.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-15T07:46:33.340 ERROR:teuthology.orchestra.connection:Error authenticating with smithi016.front.sepia.ceph.com: Authentication failed.
2023-07-15T07:46:33.341 DEBUG:teuthology.orchestra.run.smithi016:> true
2023-07-15T07:46:33.341 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:46:47.225 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com'
2023-07-15T07:46:47.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-15T07:46:52.347 ERROR:teuthology.orchestra.connection:Error authenticating with smithi093.front.sepia.ceph.com: Authentication failed.
2023-07-15T07:46:52.348 DEBUG:teuthology.orchestra.run.smithi093:> true
2023-07-15T07:46:52.349 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:48:36.230 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com'
2023-07-15T07:48:36.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-15T07:48:41.352 ERROR:teuthology.orchestra.connection:Error authenticating with smithi016.front.sepia.ceph.com: Authentication failed.
2023-07-15T07:48:41.352 DEBUG:teuthology.orchestra.run.smithi016:> true
2023-07-15T07:48:41.353 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:48:55.237 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com'
2023-07-15T07:48:55.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-15T07:48:55.353 ERROR:teuthology.orchestra.connection:Error authenticating with smithi093.front.sepia.ceph.com: Authentication failed.
2023-07-15T07:48:55.354 DEBUG:teuthology.orchestra.run.smithi093:> true
2023-07-15T07:48:55.355 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:50:55.245 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds
2023-07-15T07:50:55.248 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/fog.py", line 90, in create
    self._wait_for_ready()
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/fog.py", line 299, in _wait_for_ready
    self.remote.run(args=cmd, timeout=600)
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/orchestra/remote.py", line 521, in run
    raise Exception(f'Cannot connect to remote host {self.shortname}')
Exception: Cannot connect to remote host smithi093
2023-07-15T07:50:55.249 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-15T07:50:55.250 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-15T07:51:00.338 INFO:teuthology.nuke:Checking targets against current locks
2023-07-15T07:51:02.139 DEBUG:teuthology.nuke:shortname: smithi016
2023-07-15T07:51:02.139 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-15T07:51:02.168 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi016.front.sepia.ceph.com', 'description': None, 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': False, 'locked_since': None, 'locked_by': None, 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLc1R+mgu7vHw9QqMgHLb+SMwaXej30ZKrzcEzzmoYRB1m6V+lyr5HghV57Z6EjpSxSpu1Rr802QD9HBCRuESoP18+/kw0639ORyF6mLhW51WWtMz+Sg7cyx2gCw6FpdKEOwMtwxh0op9RWzewUT3rVC6g7h/sw2A83rEviTfxbyJLtfGxm6UZ8lw4otnhHxZHu3Fcid96fXLbtNyT8Wk3cwzX4ucuiF10lt9lMfKW3YTQmtP8SPfMugMeFMOyUEcjYuoEqVTULfRVOAkBw7K7d2zcbCvx+8lz6a6VBXCIp+WQp7lIQhad88J/5rxmkV70Ca2obq6qyelOkQ/95jdE0WEDXKDcNA2Tg6ElkvP/o+k1WxPYQBiPizDJDkDSvblt8SaFK3hldjemeaEUnM5wtbEeu34EoNAomQJECMalVX9VCAAvCbvLcMW3+5Dp+6b2m7z7v5aeWNfmAE59bPYXddx80N2gy/ISPJvgPvKwSxB/acAB390wTCiDW2ll5Rc='}
2023-07-15T07:51:02.168 ERROR:teuthology.nuke:Could not nuke {'smithi016.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLc1R+mgu7vHw9QqMgHLb+SMwaXej30ZKrzcEzzmoYRB1m6V+lyr5HghV57Z6EjpSxSpu1Rr802QD9HBCRuESoP18+/kw0639ORyF6mLhW51WWtMz+Sg7cyx2gCw6FpdKEOwMtwxh0op9RWzewUT3rVC6g7h/sw2A83rEviTfxbyJLtfGxm6UZ8lw4otnhHxZHu3Fcid96fXLbtNyT8Wk3cwzX4ucuiF10lt9lMfKW3YTQmtP8SPfMugMeFMOyUEcjYuoEqVTULfRVOAkBw7K7d2zcbCvx+8lz6a6VBXCIp+WQp7lIQhad88J/5rxmkV70Ca2obq6qyelOkQ/95jdE0WEDXKDcNA2Tg6ElkvP/o+k1WxPYQBiPizDJDkDSvblt8SaFK3hldjemeaEUnM5wtbEeu34EoNAomQJECMalVX9VCAAvCbvLcMW3+5Dp+6b2m7z7v5aeWNfmAE59bPYXddx80N2gy/ISPJvgPvKwSxB/acAB390wTCiDW2ll5Rc='}
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/nuke/__init__.py", line 294, in nuke_one
    nuke_helper(ctx, should_unlock, keep_logs, should_reboot)
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/nuke/__init__.py", line 318, in nuke_helper
    check_lock.check_lock(ctx, None, check_up=False)
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/task/internal/check_lock.py", line 28, in check_lock
    assert status['locked'], \
AssertionError: machine smithi016.front.sepia.ceph.com is not locked
2023-07-15T07:51:02.189 DEBUG:teuthology.nuke:shortname: smithi093
2023-07-15T07:51:02.190 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-15T07:51:02.219 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi093.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-14_23:39:06-rados-wip-yuri5-testing-2023-07-14-0757-distro-default-smithi/7338771', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-15 07:36:32.402493', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='}
2023-07-15T07:51:02.278 INFO:teuthology.orchestra.console:Power off smithi093
2023-07-15T07:51:02.279 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-15T07:51:02.308 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T07:51:06.341 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T07:51:11.452 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T07:51:16.565 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T07:51:21.682 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T07:51:21.894 INFO:teuthology.orchestra.console:Power off for smithi093 completed
2023-07-15T07:51:28.633 INFO:teuthology.lock.ops:unlocked: smithi093.front.sepia.ceph.com
2023-07-15T07:51:28.635 ERROR:teuthology.nuke:Could not nuke the following targets:
targets:
  smithi016.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLc1R+mgu7vHw9QqMgHLb+SMwaXej30ZKrzcEzzmoYRB1m6V+lyr5HghV57Z6EjpSxSpu1Rr802QD9HBCRuESoP18+/kw0639ORyF6mLhW51WWtMz+Sg7cyx2gCw6FpdKEOwMtwxh0op9RWzewUT3rVC6g7h/sw2A83rEviTfxbyJLtfGxm6UZ8lw4otnhHxZHu3Fcid96fXLbtNyT8Wk3cwzX4ucuiF10lt9lMfKW3YTQmtP8SPfMugMeFMOyUEcjYuoEqVTULfRVOAkBw7K7d2zcbCvx+8lz6a6VBXCIp+WQp7lIQhad88J/5rxmkV70Ca2obq6qyelOkQ/95jdE0WEDXKDcNA2Tg6ElkvP/o+k1WxPYQBiPizDJDkDSvblt8SaFK3hldjemeaEUnM5wtbEeu34EoNAomQJECMalVX9VCAAvCbvLcMW3+5Dp+6b2m7z7v5aeWNfmAE59bPYXddx80N2gy/ISPJvgPvKwSxB/acAB390wTCiDW2ll5Rc=
2023-07-15T07:51:38.790 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/dispatcher/supervisor.py", line 57, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/fog.py", line 90, in create
    self._wait_for_ready()
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/fog.py", line 299, in _wait_for_ready
    self.remote.run(args=cmd, timeout=600)
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/orchestra/remote.py", line 521, in run
    raise Exception(f'Cannot connect to remote host {self.shortname}')
Exception: Cannot connect to remote host smithi093