2023-07-14T04:40:22.800 INFO:root:teuthology version: 0.0.1.dev143+g073e6eb
2023-07-14T04:40:22.801 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T04:40:22.802 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T04:40:27.773 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7ffb7c1e75e0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7ffb7c250e50>, signals=[15])
2023-07-14T04:40:27.774 INFO:teuthology.lock.ops:Start node 'smithi008.front.sepia.ceph.com' reimaging
2023-07-14T04:40:27.774 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: reset os type and version on server
2023-07-14T04:40:27.775 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server
2023-07-14T04:40:27.875 INFO:teuthology.lock.ops:Start node 'smithi137.front.sepia.ceph.com' reimaging
2023-07-14T04:40:27.875 INFO:teuthology.lock.ops:Updating [smithi137.front.sepia.ceph.com]: reset os type and version on server
2023-07-14T04:40:27.875 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server
2023-07-14T04:40:27.877 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /host {"name": "smithi008"}
2023-07-14T04:40:27.899 INFO:teuthology.lock.ops:Start node 'smithi174.front.sepia.ceph.com' reimaging
2023-07-14T04:40:27.899 INFO:teuthology.lock.ops:Updating [smithi174.front.sepia.ceph.com]: reset os type and version on server
2023-07-14T04:40:27.899 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server
2023-07-14T04:40:27.901 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /host {"name": "smithi137"}
2023-07-14T04:40:27.916 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /host {"name": "smithi174"}
2023-07-14T04:40:27.953 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-07-14T04:40:28.000 DEBUG:teuthology.provision.fog.smithi008:Requesting image smithi_rhel_8.6 (ID 5)
2023-07-14T04:40:28.001 DEBUG:teuthology.provision.fog.smithi008:FOG request: PUT /host/114 {"imageID": 5}
2023-07-14T04:40:28.014 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-07-14T04:40:28.017 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-07-14T04:40:28.051 INFO:teuthology.provision.fog.smithi008:Scheduling deploy of rhel 8.6
2023-07-14T04:40:28.051 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None
2023-07-14T04:40:28.053 DEBUG:teuthology.provision.fog.smithi137:Requesting image smithi_rhel_8.6 (ID 5)
2023-07-14T04:40:28.054 DEBUG:teuthology.provision.fog.smithi137:FOG request: PUT /host/242 {"imageID": 5}
2023-07-14T04:40:28.058 DEBUG:teuthology.provision.fog.smithi174:Requesting image smithi_rhel_8.6 (ID 5)
2023-07-14T04:40:28.059 DEBUG:teuthology.provision.fog.smithi174:FOG request: PUT /host/279 {"imageID": 5}
2023-07-14T04:40:28.102 INFO:teuthology.provision.fog.smithi137:Scheduling deploy of rhel 8.6
2023-07-14T04:40:28.103 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None
2023-07-14T04:40:28.109 INFO:teuthology.provision.fog.smithi174:Scheduling deploy of rhel 8.6
2023-07-14T04:40:28.109 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None
2023-07-14T04:40:28.134 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /tasktype {"name": "deploy"}
2023-07-14T04:40:28.167 DEBUG:teuthology.provision.fog.smithi008:FOG request: POST /host/114/task {"taskTypeID": 1}
2023-07-14T04:40:28.171 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /tasktype {"name": "deploy"}
2023-07-14T04:40:28.174 DEBUG:teuthology.provision.fog.smithi174:Canceling deploy task with ID 383448
2023-07-14T04:40:28.175 DEBUG:teuthology.provision.fog.smithi174:FOG request: DELETE /task/cancel {"id": 383448}
2023-07-14T04:40:28.217 DEBUG:teuthology.provision.fog.smithi137:FOG request: POST /host/242/task {"taskTypeID": 1}
2023-07-14T04:40:28.222 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None
2023-07-14T04:40:28.225 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /tasktype {"name": "deploy"}
2023-07-14T04:40:28.253 DEBUG:teuthology.provision.fog.smithi174:FOG request: POST /host/279/task {"taskTypeID": 1}
2023-07-14T04:40:28.272 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None
2023-07-14T04:40:28.298 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None
2023-07-14T04:40:28.344 INFO:teuthology.orchestra.console:Power off smithi008
2023-07-14T04:40:28.345 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-14T04:40:28.367 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:40:28.389 INFO:teuthology.orchestra.console:Power off smithi137
2023-07-14T04:40:28.390 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-14T04:40:28.409 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:40:28.425 INFO:teuthology.orchestra.console:Power off smithi174
2023-07-14T04:40:28.426 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-14T04:40:28.448 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:40:28.500 INFO:teuthology.orchestra.console:Power off for smithi008 completed
2023-07-14T04:40:28.537 INFO:teuthology.orchestra.console:Power off for smithi137 completed
2023-07-14T04:40:28.571 INFO:teuthology.orchestra.console:Power off for smithi174 completed
2023-07-14T04:40:28.601 INFO:teuthology.orchestra.console:Power on smithi008
2023-07-14T04:40:28.602 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-14T04:40:28.623 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:40:28.638 INFO:teuthology.orchestra.console:Power on smithi137
2023-07-14T04:40:28.639 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-14T04:40:28.660 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:40:28.672 INFO:teuthology.orchestra.console:Power on smithi174
2023-07-14T04:40:28.673 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-14T04:40:28.693 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:40:32.649 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:40:32.683 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:40:32.714 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:40:36.794 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:40:37.090 INFO:teuthology.orchestra.console:Power on for smithi137 completed
2023-07-14T04:40:37.191 INFO:teuthology.provision.fog.smithi137:Waiting for deploy to finish
2023-07-14T04:40:37.192 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None
2023-07-14T04:40:39.394 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:40:39.401 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:40:44.505 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:40:44.513 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:40:49.616 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:40:49.625 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:40:54.508 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None
2023-07-14T04:41:04.519 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:41:04.526 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:41:09.629 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:41:09.637 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:41:14.744 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:41:14.751 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:41:19.621 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None
2023-07-14T04:41:24.625 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:41:24.634 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:41:29.740 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:41:29.748 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:41:34.852 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:41:34.860 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:41:39.734 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None
2023-07-14T04:41:44.739 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:41:44.747 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:41:44.958 INFO:teuthology.orchestra.console:Power on for smithi174 completed
2023-07-14T04:41:45.059 INFO:teuthology.provision.fog.smithi174:Waiting for deploy to finish
2023-07-14T04:41:45.059 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None
2023-07-14T04:41:49.854 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:41:54.964 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:41:59.879 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None
2023-07-14T04:42:04.885 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:42:04.892 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None
2023-07-14T04:42:05.271 INFO:teuthology.orchestra.console:Power on for smithi008 completed
2023-07-14T04:42:05.372 INFO:teuthology.provision.fog.smithi008:Waiting for deploy to finish
2023-07-14T04:42:05.373 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None
2023-07-14T04:42:20.424 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None
2023-07-14T04:42:30.152 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None
2023-07-14T04:42:30.203 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None
2023-07-14T04:42:46.404 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None
2023-07-14T04:42:46.405 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None
2023-07-14T04:42:51.007 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None
2023-07-14T04:43:06.260 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None
2023-07-14T04:43:06.297 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None
2023-07-14T04:43:06.408 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None
2023-07-14T04:43:06.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-14T04:43:21.765 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None
2023-07-14T04:43:26.773 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None
2023-07-14T04:43:26.775 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137
2023-07-14T04:43:31.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-14T04:43:31.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-14T04:43:31.901 ERROR:teuthology.orchestra.connection:Error authenticating with smithi008.front.sepia.ceph.com: Authentication failed.
2023-07-14T04:43:31.902 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-14T04:43:31.903 DEBUG:teuthology.orchestra.run.smithi008:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-14T04:43:31.904 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:43:32.777 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-14T04:43:37.785 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:43:38.789 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:43:39.793 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:43:40.796 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:43:40.848 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137
2023-07-14T04:43:41.800 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:43:42.803 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:43:43.807 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:43:44.810 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:43:45.813 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:43:46.816 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:43:46.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-14T04:43:51.854 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:43:52.858 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:43:53.863 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:43:54.867 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:43:54.928 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137
2023-07-14T04:43:55.871 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:43:56.876 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:43:57.880 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:43:58.885 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:43:59.890 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:44:00.895 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:44:00.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-14T04:44:05.935 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:44:06.939 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:44:07.942 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:44:08.946 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:44:09.949 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:44:10.952 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:44:11.956 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:44:12.959 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:44:13.963 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:44:14.968 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:44:15.973 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:44:16.977 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:44:17.982 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:44:18.987 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:44:19.992 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:44:20.996 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:44:22.001 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:44:23.006 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:44:24.010 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:44:25.015 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:44:26.019 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:44:27.025 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:44:28.029 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:44:29.034 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:44:30.040 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:44:31.045 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:44:31.831 WARNING:teuthology.provision.fog.smithi174:timed out
2023-07-14T04:44:32.050 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:44:33.055 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:44:34.061 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:44:35.066 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:44:36.071 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:44:37.077 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:44:37.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-14T04:44:38.083 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:44:39.088 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:44:40.093 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:44:41.098 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:44:42.103 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:44:43.109 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:44:44.115 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:44:45.120 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:44:46.125 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:44:47.130 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:44:48.136 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:44:49.142 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:44:50.147 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:44:51.152 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:44:52.157 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:44:53.162 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:44:53.672 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-14T04:44:53.673 DEBUG:teuthology.orchestra.run.smithi174:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-14T04:44:53.948 INFO:teuthology.provision.fog.smithi174:Node is ready
2023-07-14T04:44:53.949 DEBUG:teuthology.orchestra.run.smithi174:> hostname
2023-07-14T04:44:53.964 INFO:teuthology.orchestra.run.smithi174.stdout:smithi022
2023-07-14T04:44:53.965 DEBUG:teuthology.orchestra.run.smithi174:> grep smithi022 /etc/hosts
2023-07-14T04:44:54.020 INFO:teuthology.orchestra.run.smithi174.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022
2023-07-14T04:44:54.020 DEBUG:teuthology.orchestra.run.smithi174:> sudo hostname smithi174
2023-07-14T04:44:54.133 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/smithi022/smithi174/g' /etc/hosts
2023-07-14T04:44:54.160 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/172.21.15.22/172.21.15.174/g' /etc/hosts
2023-07-14T04:44:54.171 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:44:54.226 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/smithi022/smithi174/g' /etc/hostname
2023-07-14T04:44:54.292 DEBUG:teuthology.orchestra.run.smithi174:> sudo hostname smithi174
2023-07-14T04:44:54.357 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release
2023-07-14T04:44:54.413 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="Red Hat Enterprise Linux"
2023-07-14T04:44:54.413 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="8.6 (Ootpa)"
2023-07-14T04:44:54.414 INFO:teuthology.orchestra.run.smithi174.stdout:ID="rhel"
2023-07-14T04:44:54.414 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE="fedora"
2023-07-14T04:44:54.414 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="8.6"
2023-07-14T04:44:54.414 INFO:teuthology.orchestra.run.smithi174.stdout:PLATFORM_ID="platform:el8"
2023-07-14T04:44:54.414 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-14T04:44:54.415 INFO:teuthology.orchestra.run.smithi174.stdout:ANSI_COLOR="0;31"
2023-07-14T04:44:54.415 INFO:teuthology.orchestra.run.smithi174.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-14T04:44:54.415 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://www.redhat.com/"
2023-07-14T04:44:54.415 INFO:teuthology.orchestra.run.smithi174.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-14T04:44:54.416 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-14T04:44:54.416 INFO:teuthology.orchestra.run.smithi174.stdout:
2023-07-14T04:44:54.416 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-14T04:44:54.416 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-14T04:44:54.417 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-14T04:44:54.417 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-14T04:44:54.418 INFO:teuthology.provision.fog.smithi174:Deploy complete!
2023-07-14T04:44:54.419 DEBUG:teuthology.parallel:result is None
2023-07-14T04:44:55.177 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:44:56.182 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:44:57.187 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:44:58.192 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:45:05.936 WARNING:teuthology.provision.fog.smithi137:timed out
2023-07-14T04:45:11.937 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-14T04:45:12.280 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-14T04:45:12.280 DEBUG:teuthology.orchestra.run.smithi137:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-14T04:45:12.551 INFO:teuthology.provision.fog.smithi137:Node is ready
2023-07-14T04:45:12.552 DEBUG:teuthology.orchestra.run.smithi137:> hostname
2023-07-14T04:45:12.570 INFO:teuthology.orchestra.run.smithi137.stdout:smithi137
2023-07-14T04:45:12.570 DEBUG:teuthology.orchestra.run.smithi137:> grep smithi137 /etc/hosts
2023-07-14T04:45:12.628 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.137 smithi137.front.sepia.ceph.com smithi137
2023-07-14T04:45:12.628 DEBUG:teuthology.orchestra.run.smithi137:> sudo hostname smithi137
2023-07-14T04:45:12.749 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i -e 's/smithi137/smithi137/g' /etc/hosts
2023-07-14T04:45:12.777 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i -e 's/172.21.15.137/172.21.15.137/g' /etc/hosts
2023-07-14T04:45:12.844 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i -e 's/smithi137/smithi137/g' /etc/hostname
2023-07-14T04:45:12.911 DEBUG:teuthology.orchestra.run.smithi137:> sudo hostname smithi137
2023-07-14T04:45:12.976 DEBUG:teuthology.orchestra.run.smithi137:> cat /etc/os-release
2023-07-14T04:45:13.029 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="Red Hat Enterprise Linux"
2023-07-14T04:45:13.029 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="8.6 (Ootpa)"
2023-07-14T04:45:13.030 INFO:teuthology.orchestra.run.smithi137.stdout:ID="rhel"
2023-07-14T04:45:13.030 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE="fedora"
2023-07-14T04:45:13.030 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="8.6"
2023-07-14T04:45:13.030 INFO:teuthology.orchestra.run.smithi137.stdout:PLATFORM_ID="platform:el8"
2023-07-14T04:45:13.030 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-14T04:45:13.030 INFO:teuthology.orchestra.run.smithi137.stdout:ANSI_COLOR="0;31"
2023-07-14T04:45:13.030 INFO:teuthology.orchestra.run.smithi137.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-14T04:45:13.031 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://www.redhat.com/"
2023-07-14T04:45:13.031 INFO:teuthology.orchestra.run.smithi137.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-14T04:45:13.031 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-14T04:45:13.031 INFO:teuthology.orchestra.run.smithi137.stdout:
2023-07-14T04:45:13.031 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-14T04:45:13.031 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-14T04:45:13.031 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-14T04:45:13.031 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-14T04:45:13.032 INFO:teuthology.provision.fog.smithi137:Deploy complete!
2023-07-14T04:45:13.032 DEBUG:teuthology.parallel:result is None
2023-07-14T04:46:47.408 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2023-07-14T04:46:47.410 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi008
2023-07-14T04:46:56.411 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com'
2023-07-14T04:46:56.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-14T04:47:01.766 DEBUG:teuthology.orchestra.run.smithi008:> true
2023-07-14T04:47:02.053 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi008.front.sepia.ceph.com'
2023-07-14T04:47:02.053 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-14T04:47:02.053 DEBUG:teuthology.orchestra.run.smithi008:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-14T04:47:02.071 INFO:teuthology.provision.fog.smithi008:Node is ready
2023-07-14T04:47:02.072 DEBUG:teuthology.orchestra.run.smithi008:> hostname
2023-07-14T04:47:02.130 INFO:teuthology.orchestra.run.smithi008.stdout:smithi008.front.sepia.ceph.com
2023-07-14T04:47:02.130 DEBUG:teuthology.orchestra.run.smithi008:> grep smithi008.front.sepia.ceph.com /etc/hosts
2023-07-14T04:47:02.188 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8 smithi008.front.sepia.ceph.com smithi008
2023-07-14T04:47:02.188 DEBUG:teuthology.orchestra.run.smithi008:> sudo hostname smithi008
2023-07-14T04:47:02.307 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/smithi008.front.sepia.ceph.com/smithi008/g' /etc/hosts
2023-07-14T04:47:02.336 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/172.21.15.8/172.21.15.8/g' /etc/hosts
2023-07-14T04:47:02.405 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/smithi008.front.sepia.ceph.com/smithi008/g' /etc/hostname
2023-07-14T04:47:02.475 DEBUG:teuthology.orchestra.run.smithi008:> sudo hostname smithi008
2023-07-14T04:47:02.543 DEBUG:teuthology.orchestra.run.smithi008:> cat /etc/os-release
2023-07-14T04:47:02.600 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="Red Hat Enterprise Linux"
2023-07-14T04:47:02.600 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="8.6 (Ootpa)"
2023-07-14T04:47:02.600 INFO:teuthology.orchestra.run.smithi008.stdout:ID="rhel"
2023-07-14T04:47:02.601 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="fedora"
2023-07-14T04:47:02.601 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="8.6"
2023-07-14T04:47:02.601 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el8"
2023-07-14T04:47:02.601 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-14T04:47:02.601 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31"
2023-07-14T04:47:02.601 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-14T04:47:02.601 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://www.redhat.com/"
2023-07-14T04:47:02.602 INFO:teuthology.orchestra.run.smithi008.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-14T04:47:02.602 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-14T04:47:02.602 INFO:teuthology.orchestra.run.smithi008.stdout:
2023-07-14T04:47:02.602 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-14T04:47:02.602 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-14T04:47:02.602 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-14T04:47:02.602 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-14T04:47:02.603 INFO:teuthology.provision.fog.smithi008:Deploy complete!
2023-07-14T04:47:02.603 DEBUG:teuthology.parallel:result is None
2023-07-14T04:48:12.820 ERROR:teuthology.misc:write (smithi174.front.sepia.ceph.com): No route to host
2023-07-14T04:48:34.846 ERROR:teuthology.misc:write (smithi174.front.sepia.ceph.com): No route to host
2023-07-14T04:48:51.868 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/lock/ops.py", line 326, in reimage_machines
    reimaged = do_update_keys(list(reimaged.keys()))[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/lock/ops.py", line 290, in do_update_keys
    keys_dict = misc.ssh_keyscan(machines, _raise=_raise)
  File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/misc.py", line 1106, in ssh_keyscan
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: 'ssh_keyscan smithi174.front.sepia.ceph.com' reached maximum tries (6) after waiting for 5 seconds
2023-07-14T04:48:51.869 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T04:48:51.870 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T04:48:55.462 INFO:teuthology.nuke:Checking targets against current locks
2023-07-14T04:49:20.538 DEBUG:teuthology.nuke:shortname: smithi008
2023-07-14T04:49:20.538 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-14T04:49:30.552 DEBUG:teuthology.nuke:shortname: smithi137
2023-07-14T04:49:30.552 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-14T04:49:35.559 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi008.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-13_23:28:44-rbd-wip-yuri2-testing-2023-07-13-1236-distro-default-smithi/7337055', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 04:40:22.023086', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD1k5ikCVpZr6pI8mILb6eUzStihJ0uyJXzlmSLMSItnglE6lA2n6tZ+Slu6toMuQaMV5u/3Lh6KZFd/wgW45rU='}
2023-07-14T04:49:40.565 DEBUG:teuthology.nuke:shortname: smithi174
2023-07-14T04:49:40.566 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-14T04:49:45.574 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi137.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-13_23:28:44-rbd-wip-yuri2-testing-2023-07-13-1236-distro-default-smithi/7337055', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 04:40:22.021743', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}
2023-07-14T04:49:53.893 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi174.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-13_23:28:44-rbd-wip-yuri2-testing-2023-07-13-1236-distro-default-smithi/7337087', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 04:46:47.036851', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9nOQcVUrB4JcDCMGRRTQjSLFlCDTO7wjRiiZCCtyItjfNZhaOA39uQRKpJOkbyU2KzvT4pxV6g+cxQ13DHffvquukpdAhsUnak/FilRcCRyMoX1okqWO7YHsrkJY/g9kE739rjbZUul+v0wE0Zq64dGCIgltec42w9WbMiVv5MegUgnDq4R4RrBEaBynY4+HBlL0SPdYatRgwu4mDrX1AO4r6fmxpel/sJ2+N9waBeN+g40X5C6Z74iCQ5ONr83nQO25cDt6KnnougDFsFqtEt+o8GJXgYelea0lu1Fj6hU0QHLVSgbqDcaAogYP76CeWUL3Dr854Yfff2eLgKns5c6h2JnbtLzSxHKAduSe0KAY4T5MjQVrWfZ79CGIfXADCwCi/iXkxsXv5Ew6ByYWZVcVksqY1mwZiCnujnaDAhloAmKcVDEVtM8hWpRAduAmU0ce8l/P0C0bSEdMCwrG1cG0wXjwAmqqkEDJQEiV7ziTHvuQagXYh0C4V53qKhd8='}
2023-07-14T04:49:53.942 INFO:teuthology.orchestra.console:Power off smithi008
2023-07-14T04:49:53.943 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-14T04:49:53.959 INFO:teuthology.orchestra.console:Power off smithi137
2023-07-14T04:49:53.959 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-14T04:49:53.978 INFO:teuthology.orchestra.console:Power off smithi174
2023-07-14T04:49:53.979 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-14T04:49:53.987 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:49:53.998 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:49:54.010 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:49:58.024 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:49:58.033 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:49:58.041 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:50:02.140 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:50:02.148 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:50:02.160 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:50:07.251 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:50:07.261 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:50:07.270 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:50:12.363 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:50:12.372 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:50:12.382 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:50:12.575 INFO:teuthology.orchestra.console:Power off for smithi008 completed
2023-07-14T04:50:12.583 INFO:teuthology.orchestra.console:Power off for smithi137 completed
2023-07-14T04:50:22.129 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:50:22.186 INFO:teuthology.lock.ops:unlocked: smithi008.front.sepia.ceph.com
2023-07-14T04:50:22.196 INFO:teuthology.lock.ops:unlocked: smithi137.front.sepia.ceph.com
2023-07-14T04:50:27.243 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:50:32.356 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:50:37.471 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:50:42.582 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:50:47.692 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:50:52.804 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:50:57.916 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:51:03.027 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:51:08.139 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:51:09.248 WARNING:teuthology.contextutil:'wait for power off' reached maximum tries (16) after waiting for 60.0 seconds
2023-07-14T04:51:09.249 ERROR:teuthology.orchestra.console:Failed to power off smithi174
2023-07-14T04:51:09.305 INFO:teuthology.lock.ops:unlocked: smithi174.front.sepia.ceph.com
2023-07-14T04:51:19.672 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/dispatcher/supervisor.py", line 57, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/lock/ops.py", line 326, in reimage_machines
    reimaged = do_update_keys(list(reimaged.keys()))[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/lock/ops.py", line 290, in do_update_keys
    keys_dict = misc.ssh_keyscan(machines, _raise=_raise)
  File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/misc.py", line 1106, in ssh_keyscan
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: 'ssh_keyscan smithi174.front.sepia.ceph.com' reached maximum tries (6) after waiting for 5 seconds