2023-06-28T18:48:24.555 INFO:root:teuthology version: 0.0.1.dev132+gaa9345a 2023-06-28T18:48:24.556 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-28T18:48:24.557 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-28T18:48:24.703 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2d34730430>, signals=[15]) 2023-06-28T18:48:24.705 INFO:teuthology.lock.ops:Start node 'smithi107.front.sepia.ceph.com' reimaging 2023-06-28T18:48:24.706 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: reset os type and version on server 2023-06-28T18:48:24.706 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2023-06-28T18:48:24.728 INFO:teuthology.lock.ops:Start node 'smithi195.front.sepia.ceph.com' reimaging 2023-06-28T18:48:24.729 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: reset os type and version on server 2023-06-28T18:48:24.729 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2023-06-28T18:48:24.731 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /host {"name": "smithi107"} 2023-06-28T18:48:24.753 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /host {"name": "smithi195"} 2023-06-28T18:48:24.810 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-06-28T18:48:24.818 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-06-28T18:48:24.851 DEBUG:teuthology.provision.fog.smithi107:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-06-28T18:48:24.851 DEBUG:teuthology.provision.fog.smithi107:FOG request: PUT /host/212 {"imageID": 2} 2023-06-28T18:48:24.858 DEBUG:teuthology.provision.fog.smithi195:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-06-28T18:48:24.858 DEBUG:teuthology.provision.fog.smithi195:FOG request: PUT /host/300 {"imageID": 2} 2023-06-28T18:48:24.886 INFO:teuthology.provision.fog.smithi107:Scheduling deploy of ubuntu 20.04 2023-06-28T18:48:24.886 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-06-28T18:48:24.908 INFO:teuthology.provision.fog.smithi195:Scheduling deploy of ubuntu 20.04 2023-06-28T18:48:24.908 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-06-28T18:48:24.958 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /tasktype {"name": "deploy"} 2023-06-28T18:48:24.972 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /tasktype {"name": "deploy"} 2023-06-28T18:48:24.992 DEBUG:teuthology.provision.fog.smithi107:FOG request: POST /host/212/task {"taskTypeID": 1} 2023-06-28T18:48:25.007 DEBUG:teuthology.provision.fog.smithi195:FOG request: POST /host/300/task {"taskTypeID": 1} 2023-06-28T18:48:30.013 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-06-28T18:48:35.082 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-06-28T18:48:50.132 INFO:teuthology.orchestra.console:Power off smithi107 2023-06-28T18:48:50.133 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-28T18:48:51.286 INFO:teuthology.orchestra.console:Power off smithi195 2023-06-28T18:48:51.287 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-28T18:48:51.308 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:48:51.429 INFO:teuthology.orchestra.console:Power off for smithi195 completed 2023-06-28T18:48:51.531 INFO:teuthology.orchestra.console:Power on smithi195 2023-06-28T18:48:51.531 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-28T18:48:55.155 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:48:55.281 INFO:teuthology.orchestra.console:Power off for smithi107 completed 2023-06-28T18:48:55.382 INFO:teuthology.orchestra.console:Power on smithi107 2023-06-28T18:48:55.382 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-28T18:48:56.553 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:49:00.407 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:49:00.574 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:49:05.420 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:49:05.630 INFO:teuthology.orchestra.console:Power on for smithi107 completed 2023-06-28T18:49:05.683 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:49:05.731 INFO:teuthology.provision.fog.smithi107:Waiting for deploy to finish 2023-06-28T18:49:05.732 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-06-28T18:49:09.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:49:14.472 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:49:19.583 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:49:24.693 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:49:25.856 INFO:teuthology.orchestra.console:Power on for smithi195 completed 2023-06-28T18:49:25.957 INFO:teuthology.provision.fog.smithi195:Waiting for deploy to finish 2023-06-28T18:49:25.957 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-06-28T18:49:26.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:49:28.176 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-06-28T18:49:34.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:49:42.256 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-06-28T18:49:44.560 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-06-28T18:49:48.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:49:50.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:49:51.312 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-06-28T18:49:53.616 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-06-28T18:49:57.316 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:50:02.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:50:05.392 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-06-28T18:50:05.393 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-06-28T18:50:11.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:50:16.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:50:34.736 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-06-28T18:50:40.737 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:50:45.741 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-06-28T18:50:45.814 ERROR:teuthology.orchestra.connection:Error authenticating with smithi195.front.sepia.ceph.com: Authentication failed. 2023-06-28T18:50:45.815 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-28T18:50:45.816 DEBUG:teuthology.orchestra.run.smithi195:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-28T18:50:45.817 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:50:46.822 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:50:47.826 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:50:48.832 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:50:49.836 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:50:50.841 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:50:51.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:50:51.814 ERROR:teuthology.orchestra.connection:Error authenticating with smithi107.front.sepia.ceph.com: Authentication failed. 2023-06-28T18:50:51.815 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-28T18:50:51.815 DEBUG:teuthology.orchestra.run.smithi107:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-28T18:50:51.816 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:50:51.846 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:50:52.822 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:50:52.853 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:50:53.831 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:50:53.861 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:50:54.839 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:50:54.869 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:50:55.847 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:50:55.878 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:50:56.856 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:50:56.886 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:50:57.864 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:50:57.894 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:50:58.873 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:50:58.903 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:50:59.881 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:50:59.912 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:00.890 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:00.920 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:01.899 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:01.929 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:02.907 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:02.937 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:03.914 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:03.944 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:04.922 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:04.952 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:05.931 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:05.961 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:06.938 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:06.968 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:07.945 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:07.975 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:08.953 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:08.983 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:09.961 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:09.991 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:10.969 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:10.999 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:11.977 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:12.007 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:12.984 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:13.014 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:13.992 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:14.022 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:15.000 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:15.030 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:16.007 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:16.037 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:17.014 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:17.044 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:18.021 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:18.051 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:19.028 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:19.058 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:20.035 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:20.065 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:21.041 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:21.071 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:22.048 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:22.078 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:23.055 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:23.085 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:24.062 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:24.092 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:25.069 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:25.099 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:26.076 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:26.106 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:27.084 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:27.114 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:28.091 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:28.121 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:29.098 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:29.128 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:30.106 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:30.136 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:31.113 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:31.143 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:32.121 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:32.151 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:33.128 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:33.158 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:34.136 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:34.166 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:35.144 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:35.174 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:36.151 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:36.181 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:37.158 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:37.188 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:38.166 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:38.196 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:39.174 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:39.204 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:40.182 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:40.211 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:41.188 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:41.219 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:42.196 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:42.227 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:43.203 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:43.235 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:44.211 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:44.242 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:45.219 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:45.250 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:46.228 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:46.259 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:47.236 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:47.267 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:48.244 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:48.275 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:49.251 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:49.282 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:50.259 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:50.290 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:51.267 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:51.298 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:52.276 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:52.306 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:53.284 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:53.314 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:54.292 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:54.322 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:55.300 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:55.330 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:56.308 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:56.338 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:57.315 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:57.345 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:58.322 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:58.352 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:59.328 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:51:59.358 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:00.336 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:00.366 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:01.343 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:01.372 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:02.350 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:02.380 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:03.357 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:03.387 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:04.366 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:04.396 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:05.374 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:05.404 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:06.380 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:06.410 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:07.388 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:07.418 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:08.396 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:08.427 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:09.404 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:09.434 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:10.412 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:10.443 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:11.419 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:11.450 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:12.426 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:12.457 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:13.434 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:13.466 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:14.443 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:14.475 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:15.451 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:15.483 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:16.458 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:16.491 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:17.467 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:17.499 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:18.476 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:18.507 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:19.484 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:19.515 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:20.493 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:20.524 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:21.501 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:21.532 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:22.510 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:22.541 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:23.518 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:23.550 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:24.527 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:24.559 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:25.535 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:25.566 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:26.543 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:26.574 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:27.552 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:27.583 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:28.560 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:28.592 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:29.568 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:29.600 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:30.576 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:30.609 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:31.584 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:31.617 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:32.593 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:32.625 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:33.601 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:33.634 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:34.609 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:34.641 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:35.618 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:35.650 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:36.626 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:36.659 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:37.635 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:37.668 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:38.644 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:38.676 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:39.652 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:39.684 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:40.662 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:40.693 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:41.670 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:41.701 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:42.678 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:42.709 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:43.686 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:43.718 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:44.695 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:44.726 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:45.703 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:45.734 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:45.747 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 295, in _wait_for_ready self.remote.run(args=cmd, timeout=600) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/run.py", line 450, in run r.execute() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/run.py", line 97, in execute self.client.exec_command(self.command, timeout=self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 510, in exec_command chan = self._transport.open_session(timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 919, in open_session return self.open_channel( File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1050, in open_channel raise e File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2109, in run ptype, m = self.packetizer.read_message() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 459, in read_message header = self.read_all(self.__block_size_in, check_rekey=True) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 303, in read_all raise EOFError() EOFError 2023-06-28T18:52:45.748 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-28T18:52:45.749 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-28T18:52:50.759 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:52:50.831 INFO:teuthology.nuke:Checking targets against current locks 2023-06-28T18:53:00.904 DEBUG:teuthology.nuke:shortname: smithi107 2023-06-28T18:53:00.904 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-28T18:53:00.931 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-06-28_10:04:29-fs-wip-vshankar-testing-20230628.043830-testing-default-smithi/7319912', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-28 18:48:18.686361', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCZqT71gJnVFeN1XfUUFnLd5XVRPEU2F4PBc48iKM3L8YuIkd8QFg1tlUiHWPwaHEqengAagsuoSw5XM9Lfs7ZAY7uFhD6RdPefAXqpDsvNgmvLczwJwwKHQm+I1ph3jGF4JCfZuy6LdpUhgvqFQREf2lBGnijYJaX4bTajw5cY/3I3MQviBL9Pxcac2pqDl0AJW7EaSMI2C7OH3laABOAA/FoIHuLPVS/0wXo/0AEDNmqcJGGg+e8N44ryIRwoJMQQd0cquIt4G5ccVwhXjOr4byBwhfuwe73xqxZvkvHrE5c0q9q4WYwsYPGP6hpnpfHKli27BrCa2evW+Ox1B0OmC+kAH1pQv+r/cWfR4K1ulCTtCKxWb1WNJ6ZpH8IMx2u76NBDgsrFVa1Z8Jj0JgY9Fw0s3CV6F18y3MRBzyM4WOcueqtoHwSl/r5Z5nXTux7WmzyrC0YZ1rwB76jll2eeHZmOMcu2E0N6sFlJoLot4yth8F149rKZYmoYfPrHiDc='} 2023-06-28T18:53:00.933 DEBUG:teuthology.nuke:shortname: smithi195 2023-06-28T18:53:00.934 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-28T18:53:00.957 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-06-28_10:04:29-fs-wip-vshankar-testing-20230628.043830-testing-default-smithi/7319912', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-28 18:48:18.684773', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGDyGX6HAgzCofbSAhd5e6/tS/jrKRz5FV89mqg5hAjNPxH2iGUT/4mZ4Yd27Su6XIBxpfTvfHnjaH1VOKx92OI='} 2023-06-28T18:53:00.979 INFO:teuthology.orchestra.console:Power off smithi107 2023-06-28T18:53:00.980 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-28T18:53:01.000 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:53:01.024 INFO:teuthology.orchestra.console:Power off smithi195 2023-06-28T18:53:01.025 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-28T18:53:01.049 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:53:05.043 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:53:05.071 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:53:09.184 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:53:10.155 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:53:10.366 INFO:teuthology.orchestra.console:Power off for smithi107 completed 2023-06-28T18:53:15.472 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:53:20.533 INFO:teuthology.lock.ops:unlocked: smithi107.front.sepia.ceph.com 2023-06-28T18:53:25.518 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:53:30.629 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:53:35.739 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:53:40.852 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:53:45.966 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:53:51.080 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:53:56.192 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:54:01.303 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:54:06.413 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:54:06.625 INFO:teuthology.orchestra.console:Power off for smithi195 completed 2023-06-28T18:54:16.794 INFO:teuthology.lock.ops:unlocked: smithi195.front.sepia.ceph.com 2023-06-28T18:54:20.553 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/supervisor.py", line 57, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 295, in _wait_for_ready self.remote.run(args=cmd, timeout=600) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/run.py", line 450, in run r.execute() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/run.py", line 97, in execute self.client.exec_command(self.command, timeout=self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 510, in exec_command chan = self._transport.open_session(timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 919, in open_session return self.open_channel( File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1050, in open_channel raise e File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2109, in run ptype, m = self.packetizer.read_message() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 459, in read_message header = self.read_all(self.__block_size_in, check_rekey=True) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 303, in read_all raise EOFError() EOFError