2023-06-28T18:29:41.264 INFO:root:teuthology version: 0.0.1.dev132+gaa9345a
2023-06-28T18:29:41.265 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-28T18:29:41.266 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-28T18:29:41.421 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7ff15c677550>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7ff15c01d3a0>, signals=[15])
2023-06-28T18:29:41.423 INFO:teuthology.lock.ops:Start node 'smithi086.front.sepia.ceph.com' reimaging
2023-06-28T18:29:41.423 INFO:teuthology.lock.ops:Updating [smithi086.front.sepia.ceph.com]: reset os type and version on server
2023-06-28T18:29:41.423 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server
2023-06-28T18:29:41.444 INFO:teuthology.lock.ops:Start node 'smithi107.front.sepia.ceph.com' reimaging
2023-06-28T18:29:41.445 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: reset os type and version on server
2023-06-28T18:29:41.445 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server
2023-06-28T18:29:41.446 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /host {"name": "smithi086"}
2023-06-28T18:29:51.485 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /host {"name": "smithi107"}
2023-06-28T18:30:01.528 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-06-28T18:30:06.794 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-06-28T18:30:16.802 DEBUG:teuthology.provision.fog.smithi086:Requesting image smithi_centos_8.stream (ID 3)
2023-06-28T18:30:16.803 DEBUG:teuthology.provision.fog.smithi086:FOG request: PUT /host/191 {"imageID": 3}
2023-06-28T18:30:21.078 DEBUG:teuthology.provision.fog.smithi107:Requesting image smithi_centos_8.stream (ID 3)
2023-06-28T18:30:21.079 DEBUG:teuthology.provision.fog.smithi107:FOG request: PUT /host/212 {"imageID": 3}
2023-06-28T18:30:21.101 INFO:teuthology.provision.fog.smithi086:Scheduling deploy of centos 8.stream
2023-06-28T18:30:21.102 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None
2023-06-28T18:30:21.181 INFO:teuthology.provision.fog.smithi107:Scheduling deploy of centos 8.stream
2023-06-28T18:30:21.181 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None
2023-06-28T18:30:21.237 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /tasktype {"name": "deploy"}
2023-06-28T18:30:21.270 DEBUG:teuthology.provision.fog.smithi086:FOG request: POST /host/191/task {"taskTypeID": 1}
2023-06-28T18:30:21.275 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /tasktype {"name": "deploy"}
2023-06-28T18:30:21.320 DEBUG:teuthology.provision.fog.smithi107:FOG request: POST /host/212/task {"taskTypeID": 1}
2023-06-28T18:30:21.333 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None
2023-06-28T18:30:21.459 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None
2023-06-28T18:30:31.514 INFO:teuthology.orchestra.console:Power off smithi086
2023-06-28T18:30:31.515 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-28T18:30:31.548 INFO:teuthology.orchestra.console:Power off smithi107
2023-06-28T18:30:31.549 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-28T18:30:36.537 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T18:30:36.574 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T18:30:41.552 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T18:30:41.583 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T18:30:46.664 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T18:30:46.692 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T18:30:46.874 INFO:teuthology.orchestra.console:Power off for smithi086 completed
2023-06-28T18:30:46.903 INFO:teuthology.orchestra.console:Power off for smithi107 completed
2023-06-28T18:30:46.976 INFO:teuthology.orchestra.console:Power on smithi086
2023-06-28T18:30:46.976 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-06-28T18:30:46.996 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T18:30:47.004 INFO:teuthology.orchestra.console:Power on smithi107
2023-06-28T18:30:47.005 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-06-28T18:30:47.025 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T18:30:51.020 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T18:30:51.048 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T18:30:51.231 INFO:teuthology.orchestra.console:Power on for smithi086 completed
2023-06-28T18:30:51.259 INFO:teuthology.orchestra.console:Power on for smithi107 completed
2023-06-28T18:30:51.332 INFO:teuthology.provision.fog.smithi086:Waiting for deploy to finish
2023-06-28T18:30:51.333 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None
2023-06-28T18:30:51.360 INFO:teuthology.provision.fog.smithi107:Waiting for deploy to finish
2023-06-28T18:30:51.360 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None
2023-06-28T18:30:51.485 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T18:31:06.508 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None
2023-06-28T18:31:11.513 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2023-06-28T18:31:17.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T18:31:25.584 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2023-06-28T18:31:26.620 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None
2023-06-28T18:31:31.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T18:31:34.704 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2023-06-28T18:31:40.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T18:31:43.760 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2023-06-28T18:31:46.737 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None
2023-06-28T18:31:51.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T18:31:59.828 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2023-06-28T18:32:05.835 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T18:32:11.847 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None
2023-06-28T18:32:24.176 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2023-06-28T18:32:30.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T18:32:31.874 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None
2023-06-28T18:32:36.881 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2023-06-28T18:32:42.884 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T18:32:42.964 ERROR:teuthology.orchestra.connection:Error authenticating with smithi107.front.sepia.ceph.com: Authentication failed.
2023-06-28T18:32:42.965 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-06-28T18:32:42.966 DEBUG:teuthology.orchestra.run.smithi107:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-06-28T18:32:42.967 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:32:43.971 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:32:44.976 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:32:45.981 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:32:46.986 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:32:47.991 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:32:48.996 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:32:50.001 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:32:51.007 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:32:51.985 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None
2023-06-28T18:32:56.949 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:32:57.954 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:32:58.959 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:32:59.964 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:33:00.969 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:33:01.975 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:33:02.980 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:33:03.986 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:33:04.991 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:33:05.996 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:33:07.001 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:33:08.007 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:33:09.013 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:33:10.018 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:33:11.024 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:33:12.029 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:33:12.061 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None
2023-06-28T18:33:17.067 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:33:18.072 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:33:19.077 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:33:20.083 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:33:21.088 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:33:22.094 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:33:23.098 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:33:24.103 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:33:25.108 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:33:26.114 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:33:27.119 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:33:28.124 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:33:29.129 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:33:30.134 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:33:31.138 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:33:32.143 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:33:32.184 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None
2023-06-28T18:33:37.189 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:33:38.195 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:33:39.237 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:33:40.242 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:33:41.246 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:33:42.251 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:33:43.256 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:33:44.261 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:33:45.267 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:33:46.272 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:33:47.277 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:33:48.282 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:33:49.287 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:33:50.292 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:33:51.298 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:33:52.289 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None
2023-06-28T18:33:57.297 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:33:57.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T18:34:02.354 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:02.429 ERROR:teuthology.orchestra.connection:Error authenticating with smithi086.front.sepia.ceph.com: Authentication failed.
2023-06-28T18:34:02.430 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-06-28T18:34:02.430 DEBUG:teuthology.orchestra.run.smithi086:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-06-28T18:34:02.431 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:03.362 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:03.438 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:04.370 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:04.446 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:05.378 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:05.454 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:06.386 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:06.463 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:07.395 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:07.471 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:08.405 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:08.480 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:09.413 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:09.488 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:10.420 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:10.496 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:11.429 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:11.504 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:12.438 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:12.513 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:13.447 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:13.522 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:14.455 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:14.530 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:15.463 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:15.538 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:16.471 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:16.547 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:17.480 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:17.555 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:18.489 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:18.564 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:19.498 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:19.573 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:20.507 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:20.581 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:21.516 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:21.591 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:22.525 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:22.599 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:23.535 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:23.608 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:24.542 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:24.616 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:25.550 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:25.624 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:26.558 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:26.631 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:27.567 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:27.640 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:28.575 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:28.648 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:29.582 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:29.656 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:30.595 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:30.665 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:31.604 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:31.674 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:32.617 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:32.683 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:33.626 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:33.692 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:34.634 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:34.700 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:35.642 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:35.709 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:36.651 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:36.718 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:37.660 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:37.727 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:38.668 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:38.736 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:39.677 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:39.745 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:40.686 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:40.754 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:41.694 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:41.762 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:42.703 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:42.770 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:42.892 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 90, in create
    self._wait_for_ready()
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 295, in _wait_for_ready
    self.remote.run(args=cmd, timeout=600)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/remote.py", line 525, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/run.py", line 450, in run
    r.execute()
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/run.py", line 97, in execute
    self.client.exec_command(self.command, timeout=self.timeout)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 510, in exec_command
    chan = self._transport.open_session(timeout=timeout)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 919, in open_session
    return self.open_channel(
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1050, in open_channel
    raise e
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2109, in run
    ptype, m = self.packetizer.read_message()
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 459, in read_message
    header = self.read_all(self.__block_size_in, check_rekey=True)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 303, in read_all
    raise EOFError()
EOFError
2023-06-28T18:34:42.893 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-28T18:34:42.894 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-28T18:34:47.910 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:47.973 INFO:teuthology.nuke:Checking targets against current locks
2023-06-28T18:34:52.982 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T18:34:55.315 DEBUG:teuthology.nuke:shortname: smithi086
2023-06-28T18:34:55.316 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-06-28T18:34:55.351 DEBUG:teuthology.nuke:shortname: smithi107
2023-06-28T18:34:55.351 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-06-28T18:34:55.364 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi086.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-06-28_17:10:32-rados:mgr-wip-pdonnell-testing-20230627.204243-distro-default-smithi/7320972', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-28 18:29:40.491478', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCx7radrmXMziao4PC51mmjo7CyY9dZQCv3Z7dC8qpL+v3YYc9NKO0O+yH/0LXsq699xsV61iKLX8/cDK1go99c='}
2023-06-28T18:34:55.431 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-06-28_17:10:32-rados:mgr-wip-pdonnell-testing-20230627.204243-distro-default-smithi/7320972', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-28 18:29:40.493262', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCZqT71gJnVFeN1XfUUFnLd5XVRPEU2F4PBc48iKM3L8YuIkd8QFg1tlUiHWPwaHEqengAagsuoSw5XM9Lfs7ZAY7uFhD6RdPefAXqpDsvNgmvLczwJwwKHQm+I1ph3jGF4JCfZuy6LdpUhgvqFQREf2lBGnijYJaX4bTajw5cY/3I3MQviBL9Pxcac2pqDl0AJW7EaSMI2C7OH3laABOAA/FoIHuLPVS/0wXo/0AEDNmqcJGGg+e8N44ryIRwoJMQQd0cquIt4G5ccVwhXjOr4byBwhfuwe73xqxZvkvHrE5c0q9q4WYwsYPGP6hpnpfHKli27BrCa2evW+Ox1B0OmC+kAH1pQv+r/cWfR4K1ulCTtCKxWb1WNJ6ZpH8IMx2u76NBDgsrFVa1Z8Jj0JgY9Fw0s3CV6F18y3MRBzyM4WOcueqtoHwSl/r5Z5nXTux7WmzyrC0YZ1rwB76jll2eeHZmOMcu2E0N6sFlJoLot4yth8F149rKZYmoYfPrHiDc='}
2023-06-28T18:34:55.451 INFO:teuthology.orchestra.console:Power off smithi086
2023-06-28T18:34:55.452 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-28T18:34:55.473 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T18:34:55.493 INFO:teuthology.orchestra.console:Power off smithi107
2023-06-28T18:34:55.494 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-28T18:34:55.520 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T18:34:59.508 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T18:34:59.542 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T18:35:03.619 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T18:35:03.653 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T18:35:08.732 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T18:35:08.769 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T18:35:13.841 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T18:35:13.881 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T18:35:14.053 INFO:teuthology.orchestra.console:Power off for smithi086 completed
2023-06-28T18:35:14.091 INFO:teuthology.orchestra.console:Power off for smithi107 completed
2023-06-28T18:35:32.299 INFO:teuthology.lock.ops:unlocked: smithi107.front.sepia.ceph.com
2023-06-28T18:35:32.324 INFO:teuthology.lock.ops:unlocked: smithi086.front.sepia.ceph.com
2023-06-28T18:35:42.572 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/supervisor.py", line 57, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 90, in create
    self._wait_for_ready()
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 295, in _wait_for_ready
    self.remote.run(args=cmd, timeout=600)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/remote.py", line 525, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/run.py", line 450, in run
    r.execute()
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/run.py", line 97, in execute
    self.client.exec_command(self.command, timeout=self.timeout)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 510, in exec_command
    chan = self._transport.open_session(timeout=timeout)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 919, in open_session
    return self.open_channel(
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1050, in open_channel
    raise e
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2109, in run
    ptype, m = self.packetizer.read_message()
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 459, in read_message
    header = self.read_all(self.__block_size_in, check_rekey=True)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 303, in read_all
    raise EOFError()
EOFError