2023-06-30T07:37:13.918 INFO:root:teuthology version: 0.0.1.dev134+ge25bf39 2023-06-30T07:37:13.920 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-30T07:37:13.920 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-30T07:37:14.065 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fbfee095ca0>, signals=[15]) 2023-06-30T07:37:14.066 INFO:teuthology.lock.ops:Start node 'smithi105.front.sepia.ceph.com' reimaging 2023-06-30T07:37:14.066 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: reset os type and version on server 2023-06-30T07:37:14.067 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2023-06-30T07:37:14.094 INFO:teuthology.lock.ops:Start node 'smithi192.front.sepia.ceph.com' reimaging 2023-06-30T07:37:14.095 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: reset os type and version on server 2023-06-30T07:37:14.095 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2023-06-30T07:37:14.097 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /host {"name": "smithi105"} 2023-06-30T07:37:14.119 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /host {"name": "smithi192"} 2023-06-30T07:37:14.172 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-06-30T07:37:14.182 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-06-30T07:37:14.211 DEBUG:teuthology.provision.fog.smithi105:Requesting image smithi_rhel_8.6 (ID 5) 2023-06-30T07:37:14.212 DEBUG:teuthology.provision.fog.smithi105:FOG request: PUT /host/210 {"imageID": 5} 2023-06-30T07:37:14.230 DEBUG:teuthology.provision.fog.smithi192:Requesting image smithi_rhel_8.6 (ID 5) 2023-06-30T07:37:14.230 DEBUG:teuthology.provision.fog.smithi192:FOG request: PUT /host/297 {"imageID": 5} 2023-06-30T07:37:14.264 INFO:teuthology.provision.fog.smithi105:Scheduling deploy of rhel 8.6 2023-06-30T07:37:14.265 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-06-30T07:37:14.267 INFO:teuthology.provision.fog.smithi192:Scheduling deploy of rhel 8.6 2023-06-30T07:37:14.268 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-06-30T07:37:14.323 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /tasktype {"name": "deploy"} 2023-06-30T07:37:14.327 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /tasktype {"name": "deploy"} 2023-06-30T07:37:14.358 DEBUG:teuthology.provision.fog.smithi105:FOG request: POST /host/210/task {"taskTypeID": 1} 2023-06-30T07:37:14.361 DEBUG:teuthology.provision.fog.smithi192:FOG request: POST /host/297/task {"taskTypeID": 1} 2023-06-30T07:37:14.420 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-06-30T07:37:14.422 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-06-30T07:37:14.524 INFO:teuthology.orchestra.console:Power off smithi192 2023-06-30T07:37:14.525 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-30T07:37:14.541 INFO:teuthology.orchestra.console:Power off smithi105 2023-06-30T07:37:14.542 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-30T07:37:14.553 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-30T07:37:14.566 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-30T07:37:18.581 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-30T07:37:18.591 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-30T07:37:22.696 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-30T07:37:22.704 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-30T07:37:26.808 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-30T07:37:26.816 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-30T07:37:27.019 INFO:teuthology.orchestra.console:Power off for smithi192 completed 2023-06-30T07:37:27.026 INFO:teuthology.orchestra.console:Power off for smithi105 completed 2023-06-30T07:37:27.120 INFO:teuthology.orchestra.console:Power on smithi192 2023-06-30T07:37:27.121 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-30T07:37:27.129 INFO:teuthology.orchestra.console:Power on smithi105 2023-06-30T07:37:27.130 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-30T07:37:27.142 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-30T07:37:27.151 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-30T07:37:31.164 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-30T07:37:31.174 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-30T07:37:35.276 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-30T07:37:35.284 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-30T07:37:35.487 INFO:teuthology.orchestra.console:Power on for smithi192 completed 2023-06-30T07:37:35.495 INFO:teuthology.orchestra.console:Power on for smithi105 completed 2023-06-30T07:37:35.589 INFO:teuthology.provision.fog.smithi192:Waiting for deploy to finish 2023-06-30T07:37:35.589 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-06-30T07:37:35.596 INFO:teuthology.provision.fog.smithi105:Waiting for deploy to finish 2023-06-30T07:37:35.596 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-06-30T07:37:50.708 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-06-30T07:37:50.710 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-06-30T07:38:05.829 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-06-30T07:38:05.831 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-06-30T07:38:20.944 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-06-30T07:38:20.946 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-06-30T07:38:36.066 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-06-30T07:38:36.068 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-06-30T07:38:51.204 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-06-30T07:38:51.206 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-06-30T07:39:06.324 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-06-30T07:39:06.325 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-06-30T07:39:21.456 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-06-30T07:39:21.457 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-06-30T07:39:36.559 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-06-30T07:39:36.560 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-06-30T07:39:51.680 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-06-30T07:39:51.681 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-06-30T07:40:06.800 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-06-30T07:40:06.801 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-06-30T07:40:21.912 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-06-30T07:40:21.914 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-06-30T07:40:22.050 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-30T07:40:37.070 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-06-30T07:40:40.432 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-06-30T07:40:46.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-30T07:40:49.488 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-06-30T07:40:52.176 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-06-30T07:40:55.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-30T07:40:58.544 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-06-30T07:41:04.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-30T07:41:07.280 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-06-30T07:41:07.600 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-06-30T07:41:13.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-30T07:41:16.656 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-06-30T07:41:22.384 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-06-30T07:41:22.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-30T07:41:25.716 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-06-30T07:41:31.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-30T07:41:34.800 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-06-30T07:41:37.492 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-06-30T07:41:40.805 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-30T07:41:52.600 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-06-30T07:41:59.280 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-06-30T07:42:05.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-30T07:42:07.708 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-06-30T07:42:08.336 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-06-30T07:42:14.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-30T07:42:14.455 ERROR:teuthology.orchestra.connection:Error authenticating with smithi105.front.sepia.ceph.com: Authentication failed. 2023-06-30T07:42:14.457 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-30T07:42:14.458 DEBUG:teuthology.orchestra.run.smithi105:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-30T07:42:14.458 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:42:15.466 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:42:16.471 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:42:17.477 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:42:18.482 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:42:19.487 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:42:20.493 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:42:21.499 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:42:22.505 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:42:22.817 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-06-30T07:42:23.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-30T07:42:23.510 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:42:24.515 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:42:25.521 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:42:26.526 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:42:27.531 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:42:28.535 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:42:29.540 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:42:30.544 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:42:31.549 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:42:32.554 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:42:33.560 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:42:34.565 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:42:35.570 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:42:36.575 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:42:37.579 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:42:38.584 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:42:39.588 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:42:40.593 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:42:41.524 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-06-30T07:42:41.598 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:42:42.603 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:42:43.607 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:42:44.611 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:42:45.615 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:42:46.619 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:42:47.525 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-30T07:42:47.627 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:42:48.631 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:42:49.637 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:42:50.576 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-06-30T07:42:50.642 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:42:51.647 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:42:52.651 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:42:53.656 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:42:54.661 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:42:55.666 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:42:56.577 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-30T07:42:56.672 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:42:57.676 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:42:58.681 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:42:59.636 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-06-30T07:42:59.685 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:00.690 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:01.694 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:02.698 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:03.703 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:04.707 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:05.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-30T07:43:05.711 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:06.716 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:07.720 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:08.692 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-06-30T07:43:08.724 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:09.729 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:10.734 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:11.740 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:12.746 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:13.751 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:14.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-30T07:43:14.755 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:15.759 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:16.763 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:17.748 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-06-30T07:43:17.767 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:18.771 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:19.777 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:20.781 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:21.785 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:22.789 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:23.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-30T07:43:23.793 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:24.797 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:25.802 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:26.800 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-06-30T07:43:26.807 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:27.812 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:28.816 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:29.821 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:30.825 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:31.830 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:32.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-30T07:43:32.834 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:33.839 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:34.843 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:35.847 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:36.851 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:37.856 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:38.861 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:39.865 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:40.870 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:41.874 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:42.878 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:43.882 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:44.886 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:45.890 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:46.894 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:47.899 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:48.903 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:49.908 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:50.912 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:51.156 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-06-30T07:43:51.916 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:52.921 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:53.925 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:54.929 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:55.933 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:56.938 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:57.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-30T07:43:57.943 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:58.947 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:43:59.807 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-06-30T07:43:59.952 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:44:00.956 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:44:01.960 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:44:02.964 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:44:03.968 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:44:04.972 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:44:05.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-30T07:44:05.922 ERROR:teuthology.orchestra.connection:Error authenticating with smithi192.front.sepia.ceph.com: Authentication failed. 2023-06-30T07:44:05.922 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-30T07:44:05.923 DEBUG:teuthology.orchestra.run.smithi192:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-30T07:44:05.923 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:44:05.976 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:44:06.928 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:44:06.981 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:44:07.933 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:44:07.987 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:44:08.940 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:44:08.992 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:44:09.945 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:44:09.998 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:44:10.950 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:44:11.003 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:44:11.957 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:44:12.010 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:44:12.964 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:44:13.017 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:44:13.969 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:44:14.022 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-30T07:44:14.347 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/teuthology/provision/fog.py", line 295, in _wait_for_ready self.remote.run(args=cmd, timeout=600) File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/teuthology/orchestra/run.py", line 450, in run r.execute() File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/teuthology/orchestra/run.py", line 97, in execute self.client.exec_command(self.command, timeout=self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 510, in exec_command chan = self._transport.open_session(timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 919, in open_session return self.open_channel( File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1050, in open_channel raise e File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2109, in run ptype, m = self.packetizer.read_message() File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 459, in read_message header = self.read_all(self.__block_size_in, check_rekey=True) File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 303, in read_all raise EOFError() EOFError 2023-06-30T07:44:14.348 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-30T07:44:14.349 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-30T07:44:14.415 INFO:teuthology.nuke:Checking targets against current locks 2023-06-30T07:44:14.438 INFO:teuthology.nuke:Not nuking smithi105.front.sepia.ceph.com because description doesn't match: rishabh-2023-06-30_07:36:48-fs-wip-rishabh-readdir-testing-default-smithi != /home/teuthworker/archive/rishabh-2023-06-30_07:40:12-fs-wip-rishabh-readdir-testing-default-smithi/7322361 2023-06-30T07:44:14.459 INFO:teuthology.nuke:Not nuking smithi192.front.sepia.ceph.com because description doesn't match: rishabh-2023-06-30_07:36:48-fs-wip-rishabh-readdir-testing-default-smithi != /home/teuthworker/archive/rishabh-2023-06-30_07:41:51-fs-wip-rishabh-rename-testing-default-smithi/7322376 2023-06-30T07:44:14.461 ERROR:teuthology.nuke:Could not nuke the following targets: targets: smithi105.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCVYYk4ZPWab3sWthQwKK0LrUnUjyoy3WBWvdMMVx+GFpTfJpSDLw/AD1LLxc08ppsO75vBlCnOGFMx9quivnx7HU1K6YmjNOLq23GujOpek14fyOuZ+W7fFunygU0HpFjbrj2WUpAcRpbMwyP0dxAy1+PVfB72CHXF/Y6rBl6g2+P8K1MaB1bDQydEJbqgHG8RIJxBo0/B06O1TiQVqTjJfKwqJP/4FwkrW/uwfE+oUztRJ4Ks18oxkwm5ZUkDePD+LJVwTcIxPNd/+RJrjBBvEBfD/PPV5O21vCZ+zT7OuF0MSaXJokcIHDSDMsa6qpwgdhC2FtfFdsOxgtBxkL8wr6fmHuBtZLtIjIO0mhaTw/I8Y4hB8q4wguJIh8U85Q6oiL07Az9ZC8+r1p41OEPGA9si+7sm15vgG9zBYo/kD4RaN3wmao0TtZFeexIm/w+bASu/EQOUlJAl7vWLDCIKVZLgDOirwOglIdJJHrB/aTqzGFXNfY6YwujBJlRXg6U= smithi192.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDgHiHxOn8eI01ANI54fuNdV3n9R2AA2ocko2qfPNuaFAX44mJWz5a2J7w7vgRL3ek5gAaQ3q1yc8VDVSQ/OpVsWBPIiPolrEDJ0wtKRcMG8JjcXP3GdHXQegrvbk5oQbm3FE4pLMWU5W293xbE2sSFItkG4oiIN7u3u4762bT91hxtSJXI/oRRdRcrqY8KcBiiIZlbYR4E8/SYFRvwHQknjS5fEKW3ydrReWRfILsf1ZzXp6qqC9OMrktAAlHXn7OzPZAVVPYvmKpgkoyClTTTFeo9UmPyBe1KZKmlNICYJvT33ZJBgrAbMlcUwiKBEt1SXlXDRkgQpYZV9y62lViLKjm5Pj3DzuwboXpnoH7ZgmKiRQHJjytvzo6lWmcWVQBT7aIW32A6+CJ8UOVe/90m9QBuc5Ey1ISQXZRg9w4DvsP2Dnw+8ISlVvpsVQW5qwPB1Fh549m5CWA9lAFrco8xWcC1Ao6Aa8r6LzYqJM8zsVQMEsreATDazEFewfOhzqU= 2023-06-30T07:44:14.674 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/teuthology/dispatcher/supervisor.py", line 57, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/teuthology/provision/fog.py", line 295, in _wait_for_ready self.remote.run(args=cmd, timeout=600) File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/teuthology/orchestra/run.py", line 450, in run r.execute() File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/teuthology/orchestra/run.py", line 97, in execute self.client.exec_command(self.command, timeout=self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 510, in exec_command chan = self._transport.open_session(timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 919, in open_session return self.open_channel( File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1050, in open_channel raise e File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2109, in run ptype, m = self.packetizer.read_message() File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 459, in read_message header = self.read_all(self.__block_size_in, check_rekey=True) File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 303, in read_all raise EOFError() EOFError