2023-06-28T13:43:14.985 INFO:root:teuthology version: 0.0.1.dev132+gaa9345a 2023-06-28T13:43:14.986 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-28T13:43:14.987 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-28T13:43:26.651 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fcb403d1430>, signals=[15]) 2023-06-28T13:43:26.653 INFO:teuthology.lock.ops:Start node 'smithi033.front.sepia.ceph.com' reimaging 2023-06-28T13:43:26.653 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: reset os type and version on server 2023-06-28T13:43:26.654 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2023-06-28T13:43:26.670 INFO:teuthology.lock.ops:Start node 'smithi125.front.sepia.ceph.com' reimaging 2023-06-28T13:43:26.670 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: reset os type and version on server 2023-06-28T13:43:26.671 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server 2023-06-28T13:43:26.672 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /host {"name": "smithi033"} 2023-06-28T13:43:31.704 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /host {"name": "smithi125"} 2023-06-28T13:43:36.737 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-06-28T13:43:46.775 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-06-28T13:43:51.782 DEBUG:teuthology.provision.fog.smithi033:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-06-28T13:43:51.782 DEBUG:teuthology.provision.fog.smithi033:FOG request: PUT /host/138 {"imageID": 6} 2023-06-28T13:43:56.828 DEBUG:teuthology.provision.fog.smithi125:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-06-28T13:43:56.828 DEBUG:teuthology.provision.fog.smithi125:FOG request: PUT /host/230 {"imageID": 6} 2023-06-28T13:43:56.841 INFO:teuthology.provision.fog.smithi033:Scheduling deploy of ubuntu 22.04 2023-06-28T13:43:56.842 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-06-28T13:43:56.874 INFO:teuthology.provision.fog.smithi125:Scheduling deploy of ubuntu 22.04 2023-06-28T13:43:56.874 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-06-28T13:43:56.899 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /tasktype {"name": "deploy"} 2023-06-28T13:43:56.934 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /tasktype {"name": "deploy"} 2023-06-28T13:43:56.936 DEBUG:teuthology.provision.fog.smithi033:FOG request: POST /host/138/task {"taskTypeID": 1} 2023-06-28T13:43:56.978 DEBUG:teuthology.provision.fog.smithi125:FOG request: POST /host/230/task {"taskTypeID": 1} 2023-06-28T13:43:56.985 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-06-28T13:43:57.035 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-06-28T13:44:07.088 INFO:teuthology.orchestra.console:Power off smithi033 2023-06-28T13:44:07.089 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-28T13:44:07.105 INFO:teuthology.orchestra.console:Power off smithi125 2023-06-28T13:44:07.106 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-28T13:44:12.116 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T13:44:12.130 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T13:44:12.239 INFO:teuthology.orchestra.console:Power off for smithi033 completed 2023-06-28T13:44:12.340 INFO:teuthology.orchestra.console:Power on smithi033 2023-06-28T13:44:12.340 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-28T13:44:12.362 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T13:44:16.385 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T13:44:16.595 INFO:teuthology.orchestra.console:Power on for smithi033 completed 2023-06-28T13:44:16.696 INFO:teuthology.provision.fog.smithi033:Waiting for deploy to finish 2023-06-28T13:44:16.696 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-06-28T13:44:17.139 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T13:44:22.249 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T13:44:22.460 INFO:teuthology.orchestra.console:Power off for smithi125 completed 2023-06-28T13:44:22.561 INFO:teuthology.orchestra.console:Power on smithi125 2023-06-28T13:44:22.561 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-28T13:44:22.584 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T13:44:26.608 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T13:44:31.718 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T13:44:31.980 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-06-28T13:44:36.832 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T13:44:41.944 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T13:44:47.046 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-06-28T13:44:47.055 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T13:44:47.267 INFO:teuthology.orchestra.console:Power on for smithi125 completed 2023-06-28T13:44:47.368 INFO:teuthology.provision.fog.smithi125:Waiting for deploy to finish 2023-06-28T13:44:47.368 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-06-28T13:44:47.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T13:45:02.133 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-06-28T13:45:07.141 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-06-28T13:45:13.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T13:45:21.232 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-06-28T13:45:22.224 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-06-28T13:45:27.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T13:45:35.312 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-06-28T13:45:39.824 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-06-28T13:45:44.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T13:45:52.912 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-06-28T13:45:58.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T13:46:04.907 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-06-28T13:46:09.915 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-06-28T13:46:15.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T13:46:20.999 ERROR:teuthology.orchestra.connection:Error authenticating with smithi125.front.sepia.ceph.com: Authentication failed. 2023-06-28T13:46:21.001 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-28T13:46:21.002 DEBUG:teuthology.orchestra.run.smithi125:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-28T13:46:21.002 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:46:22.008 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:46:23.013 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:46:24.018 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:46:24.969 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-06-28T13:46:25.023 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:46:26.029 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:46:27.034 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:46:28.040 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:46:29.045 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:46:30.056 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:46:31.062 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:46:32.067 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:46:33.072 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:46:34.080 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:46:35.086 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:46:36.092 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:46:37.098 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:46:38.104 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:46:39.109 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:46:40.040 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-06-28T13:46:40.115 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:46:41.121 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:46:42.128 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:46:43.134 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:46:44.141 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:46:45.148 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:46:46.154 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:46:47.159 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:46:48.165 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:46:49.170 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:46:50.176 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:46:51.183 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:46:52.189 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:46:53.194 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:46:54.201 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:46:55.099 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-06-28T13:47:00.106 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:47:01.111 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:47:02.117 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:47:03.122 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:47:04.127 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:47:05.133 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:47:06.138 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:47:07.144 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:47:08.152 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:47:09.158 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:47:10.163 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:47:11.169 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:47:12.175 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:47:13.180 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:47:14.186 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:47:15.154 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-06-28T13:47:20.161 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:47:20.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T13:47:25.213 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:47:26.217 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:47:27.221 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:47:28.230 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:47:29.235 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:47:30.244 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:47:31.249 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:47:32.255 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:47:33.260 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:47:34.266 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:47:35.272 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:47:36.278 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:47:37.283 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:47:43.601 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-06-28T13:47:49.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T13:47:57.684 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-06-28T13:48:03.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T13:49:04.998 WARNING:teuthology.provision.fog.smithi033:timed out 2023-06-28T13:49:11.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T13:49:16.005 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-06-28T13:49:22.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T13:49:27.248 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-28T13:49:27.249 DEBUG:teuthology.orchestra.run.smithi033:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-28T13:49:27.696 INFO:teuthology.provision.fog.smithi033:Node is ready 2023-06-28T13:49:27.696 DEBUG:teuthology.orchestra.run.smithi033:> hostname 2023-06-28T13:49:27.747 INFO:teuthology.orchestra.run.smithi033.stdout:smithi033.front.sepia.ceph.com 2023-06-28T13:49:27.747 DEBUG:teuthology.orchestra.run.smithi033:> grep smithi033.front.sepia.ceph.com /etc/hosts 2023-06-28T13:49:27.795 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33 smithi033.front.sepia.ceph.com smithi033 2023-06-28T13:49:27.796 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033 2023-06-28T13:49:27.946 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi033.front.sepia.ceph.com/smithi033/g' /etc/hosts 2023-06-28T13:49:27.964 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/172.21.15.33/172.21.15.33/g' /etc/hosts 2023-06-28T13:49:28.023 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi033.front.sepia.ceph.com/smithi033/g' /etc/hostname 2023-06-28T13:49:28.084 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033 2023-06-28T13:49:28.138 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2023-06-28T13:49:28.187 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-28T13:49:28.187 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="Ubuntu" 2023-06-28T13:49:28.188 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="22.04" 2023-06-28T13:49:28.188 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-28T13:49:28.188 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_CODENAME=jammy 2023-06-28T13:49:28.188 INFO:teuthology.orchestra.run.smithi033.stdout:ID=ubuntu 2023-06-28T13:49:28.188 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE=debian 2023-06-28T13:49:28.188 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-28T13:49:28.189 INFO:teuthology.orchestra.run.smithi033.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-28T13:49:28.189 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-28T13:49:28.189 INFO:teuthology.orchestra.run.smithi033.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-28T13:49:28.189 INFO:teuthology.orchestra.run.smithi033.stdout:UBUNTU_CODENAME=jammy 2023-06-28T13:49:28.190 INFO:teuthology.provision.fog.smithi033:Deploy complete! 2023-06-28T13:49:28.191 DEBUG:teuthology.parallel:result is None 2023-06-28T13:49:53.140 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-06-28T13:49:53.143 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 295, in _wait_for_ready self.remote.run(args=cmd, timeout=600) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/run.py", line 450, in run r.execute() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/run.py", line 97, in execute self.client.exec_command(self.command, timeout=self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 510, in exec_command chan = self._transport.open_session(timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 919, in open_session return self.open_channel( File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1050, in open_channel raise e File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2109, in run ptype, m = self.packetizer.read_message() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 459, in read_message header = self.read_all(self.__block_size_in, check_rekey=True) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 301, in read_all x = self.__socket.recv(n) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 657, in recv return self._sock.recv(*args) ConnectionResetError: [Errno 104] Connection reset by peer 2023-06-28T13:49:53.144 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-28T13:49:53.145 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-28T13:49:53.220 INFO:teuthology.nuke:Checking targets against current locks 2023-06-28T13:49:53.274 DEBUG:teuthology.nuke:shortname: smithi033 2023-06-28T13:49:53.275 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-28T13:49:53.299 DEBUG:teuthology.nuke:shortname: smithi125 2023-06-28T13:49:53.300 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-28T13:49:53.303 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi033.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-06-28_10:04:29-fs-wip-vshankar-testing-20230628.043830-testing-default-smithi/7319833', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-28 13:42:59.174793', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDVacGiMKfbhq7SXBkEWg8WiT3k/DxsgdZKeMemfUDR7Fm1Ttd5U1vXW6d0Kh+ehLmtPoXE2qZxcrcla4EjaillzGRBa/3YtggMz9WRucB6zsfm/Yd7Q9WMWuptvrG9Y9Ap3PcPNRXKyzj5i1TeAWVJ/MuBFAkMbkUtjnW0rXk2xYYlrJ4Mbr4qS9NiXFxke9cFPfO+PfFjJu62glsJ7PpIcwf4YW1/90FuhHckR84BUVlgdIE3H42dozWv8b/0TA269BLLBq5JD+0dw3DJB4469gRFXeZjGKQubxS2cbSms3R4Bp7WFHkKXUS8EwLTxqr3vhSTy6pHiX2zkhzTZO/sDlIYQbnjedllesx2iSFZUFMNVK+6osHg/rUAbvA4yX2RgRU6YUSwgKE0vvQKq/NE8TGs+aBL2vy2F4UVejKLDMFRUKW8kGGdJCqtnGdstIDHYCiuW/rjI+LansiCX91gHUBzBTP3SvAEaaUHeeRAsxoaoqfH1YUrQMVvCmWjXSk='} 2023-06-28T13:49:53.328 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi125.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-06-28_10:04:29-fs-wip-vshankar-testing-20230628.043830-testing-default-smithi/7319833', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-28 13:42:59.172145', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFwsw8bUB6XCsMsNqWMZUvZP7cF9aMQEzst114KCtb4j6nWMcDWqNh6VzsXOV6gPaEdoNsyYQjRD2nBCUzk4E+A='} 2023-06-28T13:49:53.355 INFO:teuthology.orchestra.console:Power off smithi033 2023-06-28T13:49:53.356 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-28T13:49:53.380 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T13:49:53.401 INFO:teuthology.orchestra.console:Power off smithi125 2023-06-28T13:49:53.402 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-28T13:49:53.425 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T13:49:57.416 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T13:49:57.454 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T13:50:02.529 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T13:50:02.567 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T13:50:07.641 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T13:50:07.677 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T13:50:12.754 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T13:50:12.789 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T13:50:12.965 INFO:teuthology.orchestra.console:Power off for smithi033 completed 2023-06-28T13:50:23.105 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T13:50:23.149 INFO:teuthology.lock.ops:unlocked: smithi033.front.sepia.ceph.com 2023-06-28T13:50:28.216 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T13:50:33.328 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T13:50:38.440 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T13:50:38.650 INFO:teuthology.orchestra.console:Power off for smithi125 completed 2023-06-28T13:50:39.944 INFO:teuthology.lock.ops:unlocked: smithi125.front.sepia.ceph.com 2023-06-28T13:50:40.165 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/supervisor.py", line 57, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 295, in _wait_for_ready self.remote.run(args=cmd, timeout=600) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/run.py", line 450, in run r.execute() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/run.py", line 97, in execute self.client.exec_command(self.command, timeout=self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 510, in exec_command chan = self._transport.open_session(timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 919, in open_session return self.open_channel( File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1050, in open_channel raise e File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2109, in run ptype, m = self.packetizer.read_message() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 459, in read_message header = self.read_all(self.__block_size_in, check_rekey=True) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 301, in read_all x = self.__socket.recv(n) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 657, in recv return self._sock.recv(*args) ConnectionResetError: [Errno 104] Connection reset by peer