2023-07-09T08:24:56.999 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-09T08:24:57.000 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T08:24:57.001 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T08:25:02.493 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f0a080dcf70>, signals=[15]) 2023-07-09T08:25:02.495 INFO:teuthology.lock.ops:Start node 'smithi093.front.sepia.ceph.com' reimaging 2023-07-09T08:25:02.495 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: reset os type and version on server 2023-07-09T08:25:02.496 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server 2023-07-09T08:25:02.518 INFO:teuthology.lock.ops:Start node 'smithi163.front.sepia.ceph.com' reimaging 2023-07-09T08:25:02.519 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: reset os type and version on server 2023-07-09T08:25:02.519 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2023-07-09T08:25:02.520 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /host {"name": "smithi093"} 2023-07-09T08:25:03.093 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /host {"name": "smithi163"} 2023-07-09T08:25:08.168 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-07-09T08:25:18.173 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-07-09T08:25:23.229 DEBUG:teuthology.provision.fog.smithi093:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-07-09T08:25:23.229 DEBUG:teuthology.provision.fog.smithi093:FOG request: PUT /host/198 {"imageID": 2} 2023-07-09T08:25:28.194 DEBUG:teuthology.provision.fog.smithi163:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-07-09T08:25:28.195 DEBUG:teuthology.provision.fog.smithi163:FOG request: PUT /host/268 {"imageID": 2} 2023-07-09T08:25:33.274 INFO:teuthology.provision.fog.smithi093:Scheduling deploy of ubuntu 20.04 2023-07-09T08:25:33.274 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-09T08:25:38.248 INFO:teuthology.provision.fog.smithi163:Scheduling deploy of ubuntu 20.04 2023-07-09T08:25:38.249 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-07-09T08:25:38.328 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /tasktype {"name": "deploy"} 2023-07-09T08:25:38.332 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /tasktype {"name": "deploy"} 2023-07-09T08:25:38.377 DEBUG:teuthology.provision.fog.smithi163:FOG request: POST /host/268/task {"taskTypeID": 1} 2023-07-09T08:25:38.379 DEBUG:teuthology.provision.fog.smithi093:FOG request: POST /host/198/task {"taskTypeID": 1} 2023-07-09T08:25:38.456 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-07-09T08:25:38.459 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-09T08:25:38.565 INFO:teuthology.orchestra.console:Power off smithi163 2023-07-09T08:25:38.566 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-09T08:25:38.585 INFO:teuthology.orchestra.console:Power off smithi093 2023-07-09T08:25:38.586 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-09T08:25:38.597 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T08:25:38.611 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T08:25:42.624 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T08:25:42.634 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T08:25:47.736 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T08:25:47.747 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T08:25:52.850 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T08:25:52.859 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T08:25:57.965 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T08:25:57.974 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T08:26:03.080 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T08:26:03.091 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T08:26:08.195 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T08:26:08.203 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T08:26:13.308 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T08:26:13.316 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T08:26:18.420 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T08:26:18.429 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T08:26:18.642 INFO:teuthology.orchestra.console:Power off for smithi093 completed 2023-07-09T08:26:18.744 INFO:teuthology.orchestra.console:Power on smithi093 2023-07-09T08:26:18.744 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-09T08:26:18.763 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T08:26:22.788 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T08:26:22.999 INFO:teuthology.orchestra.console:Power on for smithi093 completed 2023-07-09T08:26:23.100 INFO:teuthology.provision.fog.smithi093:Waiting for deploy to finish 2023-07-09T08:26:23.100 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-09T08:26:28.108 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T08:26:33.222 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T08:26:38.332 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T08:26:43.192 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-09T08:26:48.201 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T08:26:53.316 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T08:26:58.428 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T08:26:59.539 WARNING:teuthology.contextutil:'wait for power off' reached maximum tries (16) after waiting for 60.0 seconds 2023-07-09T08:26:59.540 ERROR:teuthology.orchestra.console:Failed to power off smithi163 2023-07-09T08:26:59.541 INFO:teuthology.orchestra.console:Power on smithi163 2023-07-09T08:26:59.541 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-09T08:27:03.288 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-09T08:27:08.508 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T08:27:13.520 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T08:27:18.368 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-09T08:27:23.377 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T08:27:28.488 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T08:27:33.606 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T08:27:38.472 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-09T08:27:38.723 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T08:27:43.840 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T08:27:48.956 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T08:27:53.558 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-09T08:27:58.565 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T08:28:03.676 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T08:28:08.787 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T08:28:08.999 INFO:teuthology.orchestra.console:Power on for smithi163 completed 2023-07-09T08:28:09.100 INFO:teuthology.provision.fog.smithi163:Waiting for deploy to finish 2023-07-09T08:28:09.101 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-07-09T08:28:13.659 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-09T08:28:24.196 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-07-09T08:28:28.749 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-09T08:28:28.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T08:28:28.945 ERROR:teuthology.orchestra.connection:Error authenticating with smithi093.front.sepia.ceph.com: Authentication failed. 2023-07-09T08:28:28.948 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-09T08:28:28.949 DEBUG:teuthology.orchestra.run.smithi093:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-09T08:28:28.950 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:28:29.957 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:28:30.963 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:28:31.969 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:28:32.975 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:28:33.981 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:28:34.986 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:28:35.993 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:28:36.999 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:28:38.005 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:28:39.012 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:28:40.022 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:28:41.027 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:28:42.034 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:28:43.039 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:28:43.832 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-07-09T08:28:48.838 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:28:48.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T08:28:49.844 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:28:50.850 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:28:51.856 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:28:52.861 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:28:53.868 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:28:54.874 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:28:55.879 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:28:56.885 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:28:57.891 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:28:58.899 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:28:59.905 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:00.912 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:01.917 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:02.923 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:03.929 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:04.935 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:05.941 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:06.947 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:07.952 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:08.958 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:09.963 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:10.969 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:11.976 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:12.982 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:13.989 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:14.995 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:16.000 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:17.006 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:18.013 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:19.018 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:20.024 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:21.030 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:22.036 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:23.041 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:24.046 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:25.051 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:26.056 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:27.062 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:28.067 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:29.072 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:30.079 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:31.084 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:32.089 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:33.094 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:34.100 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:35.105 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:36.111 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:37.117 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:38.122 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:39.127 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:40.132 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:41.137 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:42.141 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:43.146 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:44.151 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:45.157 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:46.163 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:47.168 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:48.173 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:48.884 WARNING:teuthology.provision.fog.smithi163:timed out 2023-07-09T08:29:49.178 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:50.183 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:51.189 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:52.194 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:53.199 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:54.204 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:29:54.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T08:29:59.894 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:30:00.229 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-09T08:30:00.229 DEBUG:teuthology.orchestra.run.smithi163:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-09T08:30:00.476 INFO:teuthology.provision.fog.smithi163:Node is ready 2023-07-09T08:30:00.477 DEBUG:teuthology.orchestra.run.smithi163:> hostname 2023-07-09T08:30:00.495 INFO:teuthology.orchestra.run.smithi163.stdout:smithi163 2023-07-09T08:30:00.496 DEBUG:teuthology.orchestra.run.smithi163:> grep smithi163 /etc/hosts 2023-07-09T08:30:00.553 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163 smithi163.front.sepia.ceph.com smithi163 2023-07-09T08:30:00.554 DEBUG:teuthology.orchestra.run.smithi163:> sudo hostname smithi163 2023-07-09T08:30:00.671 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/smithi163/smithi163/g' /etc/hosts 2023-07-09T08:30:00.700 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/172.21.15.163/172.21.15.163/g' /etc/hosts 2023-07-09T08:30:00.768 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/smithi163/smithi163/g' /etc/hostname 2023-07-09T08:30:00.850 DEBUG:teuthology.orchestra.run.smithi163:> sudo hostname smithi163 2023-07-09T08:30:00.901 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:30:00.916 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release 2023-07-09T08:30:00.974 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="Red Hat Enterprise Linux" 2023-07-09T08:30:00.974 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="8.6 (Ootpa)" 2023-07-09T08:30:00.974 INFO:teuthology.orchestra.run.smithi163.stdout:ID="rhel" 2023-07-09T08:30:00.974 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="fedora" 2023-07-09T08:30:00.975 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="8.6" 2023-07-09T08:30:00.975 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el8" 2023-07-09T08:30:00.975 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-09T08:30:00.975 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31" 2023-07-09T08:30:00.975 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-09T08:30:00.975 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://www.redhat.com/" 2023-07-09T08:30:00.975 INFO:teuthology.orchestra.run.smithi163.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-09T08:30:00.976 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-09T08:30:00.976 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-09T08:30:00.976 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-09T08:30:00.976 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-09T08:30:00.977 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-09T08:30:00.977 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-09T08:30:00.979 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/provision/fog.py", line 348, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi163's OS to be ubuntu 20.04 but found rhel 8.6 2023-07-09T08:30:00.980 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T08:30:00.980 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T08:30:03.571 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:30:03.654 INFO:teuthology.nuke:Checking targets against current locks 2023-07-09T08:30:08.662 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:30:18.498 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:30:18.532 DEBUG:teuthology.nuke:shortname: smithi093 2023-07-09T08:30:18.533 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-09T08:30:18.563 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi093.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-07-09_07:44:21-orch:cephadm-wip-adk4-testing-2023-07-08-2258-distro-default-smithi/7331500', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-09 08:24:56.141235', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-09T08:30:18.564 DEBUG:teuthology.nuke:shortname: smithi163 2023-07-09T08:30:18.565 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-09T08:30:18.586 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi163.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-07-09_07:44:21-orch:cephadm-wip-adk4-testing-2023-07-08-2258-distro-default-smithi/7331500', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-09 08:24:56.143067', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-09T08:30:18.618 INFO:teuthology.orchestra.console:Power off smithi093 2023-07-09T08:30:18.619 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-09T08:30:18.639 INFO:teuthology.orchestra.console:Power off smithi163 2023-07-09T08:30:18.640 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-09T08:30:18.653 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T08:30:18.669 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T08:30:19.506 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:30:20.512 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:30:21.519 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:30:22.526 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:30:22.682 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T08:30:22.694 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T08:30:23.532 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:30:24.538 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:30:25.543 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:30:26.549 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T08:30:26.794 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T08:30:26.806 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T08:30:27.006 INFO:teuthology.orchestra.console:Power off for smithi093 completed 2023-07-09T08:30:27.158 INFO:teuthology.lock.ops:unlocked: smithi093.front.sepia.ceph.com 2023-07-09T08:30:30.918 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T08:30:31.129 INFO:teuthology.orchestra.console:Power off for smithi163 completed 2023-07-09T08:30:31.289 INFO:teuthology.lock.ops:unlocked: smithi163.front.sepia.ceph.com 2023-07-09T08:30:31.535 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/dispatcher/supervisor.py", line 57, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/provision/fog.py", line 348, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi163's OS to be ubuntu 20.04 but found rhel 8.6