2023-12-01T15:12:20.022 INFO:root:teuthology version: 0.0.1.dev212+g595fad1 2023-12-01T15:12:20.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:12:20.166 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7b2644e550>, signals=[15]) 2023-12-01T15:12:20.166 INFO:teuthology.lock.ops:Start node 'smithi037.front.sepia.ceph.com' reimaging 2023-12-01T15:12:20.167 INFO:teuthology.lock.ops:Updating [smithi037.front.sepia.ceph.com]: reset os type and version on server 2023-12-01T15:12:20.167 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2023-12-01T15:12:20.189 INFO:teuthology.lock.ops:Start node 'smithi140.front.sepia.ceph.com' reimaging 2023-12-01T15:12:20.190 INFO:teuthology.lock.ops:Updating [smithi140.front.sepia.ceph.com]: reset os type and version on server 2023-12-01T15:12:20.190 INFO:teuthology.lock.ops:Updating smithi140.front.sepia.ceph.com on lock server 2023-12-01T15:12:20.645 DEBUG:teuthology.provision.fog.smithi037:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-12-01T15:12:20.662 DEBUG:teuthology.provision.fog.smithi140:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-12-01T15:12:21.035 INFO:teuthology.provision.fog.smithi037:Scheduling deploy of ubuntu 22.04 2023-12-01T15:12:21.038 INFO:teuthology.provision.fog.smithi140:Scheduling deploy of ubuntu 22.04 2023-12-01T15:12:22.334 INFO:teuthology.orchestra.console.smithi037:Power off 2023-12-01T15:12:22.334 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-01T15:12:22.356 DEBUG:teuthology.orchestra.console.smithi037:power off output: Chassis Power Control: Down/Off 2023-12-01T15:12:22.357 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T15:12:22.378 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on 2023-12-01T15:12:22.393 INFO:teuthology.orchestra.console.smithi140:Power off 2023-12-01T15:12:22.393 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-01T15:12:22.414 DEBUG:teuthology.orchestra.console.smithi140:power off output: Chassis Power Control: Down/Off 2023-12-01T15:12:22.414 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T15:12:22.435 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-12-01T15:12:26.382 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T15:12:26.436 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T15:12:26.491 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on 2023-12-01T15:12:26.545 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-12-01T15:12:30.494 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T15:12:30.546 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T15:12:30.603 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on 2023-12-01T15:12:30.655 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off 2023-12-01T15:12:30.756 INFO:teuthology.orchestra.console.smithi140:Power off completed 2023-12-01T15:12:30.856 INFO:teuthology.orchestra.console.smithi140:Power on 2023-12-01T15:12:30.857 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-01T15:12:30.879 DEBUG:teuthology.orchestra.console.smithi140:power on output: Chassis Power Control: Up/On 2023-12-01T15:12:30.879 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T15:12:30.900 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off 2023-12-01T15:12:34.606 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T15:12:34.714 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off 2023-12-01T15:12:34.814 INFO:teuthology.orchestra.console.smithi037:Power off completed 2023-12-01T15:12:34.901 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T15:12:34.915 INFO:teuthology.orchestra.console.smithi037:Power on 2023-12-01T15:12:34.916 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-01T15:12:34.935 DEBUG:teuthology.orchestra.console.smithi037:power on output: Chassis Power Control: Up/On 2023-12-01T15:12:34.935 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T15:12:34.955 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off 2023-12-01T15:12:35.009 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off 2023-12-01T15:12:38.960 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T15:12:39.009 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T15:12:39.068 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off 2023-12-01T15:12:39.117 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-12-01T15:12:39.218 INFO:teuthology.orchestra.console.smithi140:Power on completed 2023-12-01T15:12:39.319 INFO:teuthology.provision.fog.smithi140:Waiting for deploy to finish 2023-12-01T15:12:43.073 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T15:12:43.181 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on 2023-12-01T15:12:43.282 INFO:teuthology.orchestra.console.smithi037:Power on completed 2023-12-01T15:12:43.382 INFO:teuthology.provision.fog.smithi037:Waiting for deploy to finish 2023-12-01T15:15:35.993 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:15:36.243 ERROR:teuthology.orchestra.connection:Error authenticating with smithi037.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-01T15:16:40.247 WARNING:teuthology.provision.fog.smithi037:timed out 2023-12-01T15:16:46.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:17:04.738 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-12-01T15:17:10.740 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:17:10.742 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-12-01T15:17:16.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:17:16.746 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-12-01T15:17:22.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:17:22.749 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-12-01T15:17:28.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:17:44.430 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-01T15:17:44.431 DEBUG:teuthology.orchestra.run.smithi037:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-01T15:17:44.958 INFO:teuthology.provision.fog.smithi037:Node is ready 2023-12-01T15:17:44.958 DEBUG:teuthology.orchestra.run.smithi037:> hostname 2023-12-01T15:17:45.005 INFO:teuthology.orchestra.run.smithi037.stdout:smithi037.front.sepia.ceph.com 2023-12-01T15:17:45.006 DEBUG:teuthology.orchestra.run.smithi037:> grep smithi037.front.sepia.ceph.com /etc/hosts 2023-12-01T15:17:45.054 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37 smithi037.front.sepia.ceph.com smithi037 2023-12-01T15:17:45.054 DEBUG:teuthology.orchestra.run.smithi037:> sudo hostname smithi037 2023-12-01T15:17:45.213 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/smithi037.front.sepia.ceph.com/smithi037/g' /etc/hosts 2023-12-01T15:17:45.228 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/172.21.15.37/172.21.15.37/g' /etc/hosts 2023-12-01T15:17:45.282 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/smithi037.front.sepia.ceph.com/smithi037/g' /etc/hostname 2023-12-01T15:17:45.343 DEBUG:teuthology.orchestra.run.smithi037:> sudo hostname smithi037 2023-12-01T15:17:45.397 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2023-12-01T15:17:45.446 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-01T15:17:45.446 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="Ubuntu" 2023-12-01T15:17:45.446 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="22.04" 2023-12-01T15:17:45.446 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-01T15:17:45.446 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_CODENAME=jammy 2023-12-01T15:17:45.446 INFO:teuthology.orchestra.run.smithi037.stdout:ID=ubuntu 2023-12-01T15:17:45.447 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE=debian 2023-12-01T15:17:45.447 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-01T15:17:45.447 INFO:teuthology.orchestra.run.smithi037.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-01T15:17:45.447 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-01T15:17:45.447 INFO:teuthology.orchestra.run.smithi037.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-01T15:17:45.447 INFO:teuthology.orchestra.run.smithi037.stdout:UBUNTU_CODENAME=jammy 2023-12-01T15:17:45.448 INFO:teuthology.provision.fog.smithi037:Deploy complete! 2023-12-01T15:17:45.449 DEBUG:teuthology.parallel:result is None 2023-12-01T15:18:23.489 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:18:23.620 ERROR:teuthology.orchestra.connection:Error authenticating with smithi140.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-01T15:19:27.624 WARNING:teuthology.provision.fog.smithi140:timed out 2023-12-01T15:19:33.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:20:33.628 WARNING:teuthology.provision.fog.smithi140:timed out 2023-12-01T15:20:39.629 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:20:42.694 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-12-01T15:20:48.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:20:51.750 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-12-01T15:20:57.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:21:00.802 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-12-01T15:21:06.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:21:09.858 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-12-01T15:21:15.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:21:18.918 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-12-01T15:21:24.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:21:27.970 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-12-01T15:21:33.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:21:37.026 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-12-01T15:21:43.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:21:46.086 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-12-01T15:21:52.087 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:21:55.138 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-12-01T15:22:01.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:22:04.198 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-12-01T15:22:10.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:22:13.251 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-12-01T15:22:19.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:22:22.306 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-12-01T15:22:28.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:22:31.362 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-12-01T15:22:37.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:22:40.422 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-12-01T15:22:46.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:22:49.474 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-12-01T15:22:55.476 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:22:58.530 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-12-01T15:23:04.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:23:07.586 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-12-01T15:23:13.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:23:16.646 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-12-01T15:23:22.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:23:25.698 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-12-01T15:23:31.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:23:34.754 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-12-01T15:23:40.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:23:43.814 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-12-01T15:23:49.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:23:52.866 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-12-01T15:23:58.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:24:01.922 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-12-01T15:24:07.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:24:10.979 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-12-01T15:24:16.981 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:24:20.034 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-12-01T15:24:26.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:24:29.090 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-12-01T15:24:35.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:24:38.146 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-12-01T15:24:44.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:24:47.266 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-12-01T15:24:53.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:24:56.322 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-12-01T15:25:02.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:25:05.382 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-12-01T15:25:11.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:25:14.466 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-12-01T15:25:20.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:25:23.522 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-12-01T15:25:29.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:25:29.526 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-12-01T15:25:35.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:25:35.790 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-01T15:25:35.790 DEBUG:teuthology.orchestra.run.smithi140:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-01T15:25:36.276 INFO:teuthology.provision.fog.smithi140:Node is ready 2023-12-01T15:25:36.277 DEBUG:teuthology.orchestra.run.smithi140:> hostname 2023-12-01T15:25:36.323 INFO:teuthology.orchestra.run.smithi140.stdout:smithi140.front.sepia.ceph.com 2023-12-01T15:25:36.324 DEBUG:teuthology.orchestra.run.smithi140:> grep smithi140.front.sepia.ceph.com /etc/hosts 2023-12-01T15:25:36.373 INFO:teuthology.orchestra.run.smithi140.stdout:172.21.15.140 smithi140.front.sepia.ceph.com smithi140 2023-12-01T15:25:36.374 DEBUG:teuthology.orchestra.run.smithi140:> sudo hostname smithi140 2023-12-01T15:25:36.482 DEBUG:teuthology.orchestra.run.smithi140:> sudo sed -i -e 's/smithi140.front.sepia.ceph.com/smithi140/g' /etc/hosts 2023-12-01T15:25:36.496 DEBUG:teuthology.orchestra.run.smithi140:> sudo sed -i -e 's/172.21.15.140/172.21.15.140/g' /etc/hosts 2023-12-01T15:25:36.551 DEBUG:teuthology.orchestra.run.smithi140:> sudo sed -i -e 's/smithi140.front.sepia.ceph.com/smithi140/g' /etc/hostname 2023-12-01T15:25:36.609 DEBUG:teuthology.orchestra.run.smithi140:> sudo hostname smithi140 2023-12-01T15:25:36.667 DEBUG:teuthology.orchestra.run.smithi140:> cat /etc/os-release 2023-12-01T15:25:36.728 INFO:teuthology.orchestra.run.smithi140.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-01T15:25:36.728 INFO:teuthology.orchestra.run.smithi140.stdout:NAME="Ubuntu" 2023-12-01T15:25:36.728 INFO:teuthology.orchestra.run.smithi140.stdout:VERSION_ID="22.04" 2023-12-01T15:25:36.728 INFO:teuthology.orchestra.run.smithi140.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-01T15:25:36.729 INFO:teuthology.orchestra.run.smithi140.stdout:VERSION_CODENAME=jammy 2023-12-01T15:25:36.729 INFO:teuthology.orchestra.run.smithi140.stdout:ID=ubuntu 2023-12-01T15:25:36.729 INFO:teuthology.orchestra.run.smithi140.stdout:ID_LIKE=debian 2023-12-01T15:25:36.729 INFO:teuthology.orchestra.run.smithi140.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-01T15:25:36.729 INFO:teuthology.orchestra.run.smithi140.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-01T15:25:36.730 INFO:teuthology.orchestra.run.smithi140.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-01T15:25:36.731 INFO:teuthology.orchestra.run.smithi140.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-01T15:25:36.731 INFO:teuthology.orchestra.run.smithi140.stdout:UBUNTU_CODENAME=jammy 2023-12-01T15:25:36.731 INFO:teuthology.provision.fog.smithi140:Deploy complete! 2023-12-01T15:25:36.732 DEBUG:teuthology.parallel:result is None 2023-12-01T15:25:37.024 INFO:teuthology.lock.ops:Checking smithi037.front.sepia.ceph.com 2023-12-01T15:25:37.025 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-01T15:25:37.051 INFO:teuthology.lock.ops:Checking smithi140.front.sepia.ceph.com 2023-12-01T15:25:37.051 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-01T15:25:37.069 INFO:teuthology.lock.ops:Updating [smithi037.front.sepia.ceph.com]: set os type and version on server 2023-12-01T15:25:37.069 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-12-01T15:25:37.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:25:37.191 DEBUG:teuthology.orchestra.run.smithi037:> true 2023-12-01T15:25:37.406 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-12-01T15:25:37.407 DEBUG:teuthology.orchestra.run.smithi037:> uname -m 2023-12-01T15:25:37.460 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64 2023-12-01T15:25:37.461 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2023-12-01T15:25:37.512 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-01T15:25:37.513 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="Ubuntu" 2023-12-01T15:25:37.513 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="22.04" 2023-12-01T15:25:37.513 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-01T15:25:37.514 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_CODENAME=jammy 2023-12-01T15:25:37.514 INFO:teuthology.orchestra.run.smithi037.stdout:ID=ubuntu 2023-12-01T15:25:37.514 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE=debian 2023-12-01T15:25:37.514 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-01T15:25:37.515 INFO:teuthology.orchestra.run.smithi037.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-01T15:25:37.515 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-01T15:25:37.515 INFO:teuthology.orchestra.run.smithi037.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-01T15:25:37.516 INFO:teuthology.orchestra.run.smithi037.stdout:UBUNTU_CODENAME=jammy 2023-12-01T15:25:37.516 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2023-12-01T15:25:37.543 INFO:teuthology.lock.ops:Updating [smithi140.front.sepia.ceph.com]: set os type and version on server 2023-12-01T15:25:37.543 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi140.front.sepia.ceph.com' 2023-12-01T15:25:37.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:25:37.673 DEBUG:teuthology.orchestra.run.smithi140:> true 2023-12-01T15:25:37.772 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi140.front.sepia.ceph.com' 2023-12-01T15:25:37.773 DEBUG:teuthology.orchestra.run.smithi140:> uname -m 2023-12-01T15:25:37.821 INFO:teuthology.orchestra.run.smithi140.stdout:x86_64 2023-12-01T15:25:37.822 DEBUG:teuthology.orchestra.run.smithi140:> cat /etc/os-release 2023-12-01T15:25:37.868 INFO:teuthology.orchestra.run.smithi140.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-01T15:25:37.868 INFO:teuthology.orchestra.run.smithi140.stdout:NAME="Ubuntu" 2023-12-01T15:25:37.868 INFO:teuthology.orchestra.run.smithi140.stdout:VERSION_ID="22.04" 2023-12-01T15:25:37.868 INFO:teuthology.orchestra.run.smithi140.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-01T15:25:37.868 INFO:teuthology.orchestra.run.smithi140.stdout:VERSION_CODENAME=jammy 2023-12-01T15:25:37.868 INFO:teuthology.orchestra.run.smithi140.stdout:ID=ubuntu 2023-12-01T15:25:37.869 INFO:teuthology.orchestra.run.smithi140.stdout:ID_LIKE=debian 2023-12-01T15:25:37.869 INFO:teuthology.orchestra.run.smithi140.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-01T15:25:37.869 INFO:teuthology.orchestra.run.smithi140.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-01T15:25:37.869 INFO:teuthology.orchestra.run.smithi140.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-01T15:25:37.869 INFO:teuthology.orchestra.run.smithi140.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-01T15:25:37.869 INFO:teuthology.orchestra.run.smithi140.stdout:UBUNTU_CODENAME=jammy 2023-12-01T15:25:37.869 INFO:teuthology.lock.ops:Updating smithi140.front.sepia.ceph.com on lock server 2023-12-01T15:25:37.893 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:25:38.173 INFO:teuthology.dispatcher.supervisor:Running job 7473767 2023-12-01T15:25:38.176 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_595fad1080bd379e3c0231a8e02595924c59a9da/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-01_15:11:43-fs-reef-release-distro-default-smithi/7473767 --name yuriw-2023-12-01_15:11:43-fs-reef-release-distro-default-smithi --description fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} kclient-overrides/{distro/testing/k-testing ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_untarbuild_blogbench} -- /home/teuthworker/archive/yuriw-2023-12-01_15:11:43-fs-reef-release-distro-default-smithi/7473767/orig.config.yaml 2023-12-01T15:25:38.196 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-01_15:11:43-fs-reef-release-distro-default-smithi/7473767 2023-12-01T15:25:38.197 INFO:teuthology.dispatcher.supervisor:Job PID: 1075142 2023-12-01T15:25:38.197 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-01T15:27:38.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:29:38.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:31:38.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:33:38.418 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:35:38.482 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:37:38.569 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:39:38.641 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:41:38.717 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:43:38.778 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:45:38.844 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:47:38.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:49:38.988 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:51:39.060 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:53:39.117 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:55:39.185 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:57:39.249 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:59:39.318 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:01:39.376 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:01:39.436 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-01T16:01:39.544 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-01T16:01:39.545 INFO:teuthology.nuke:Checking targets against current locks 2023-12-01T16:01:39.590 DEBUG:teuthology.nuke:shortname: smithi037 2023-12-01T16:01:39.590 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-01T16:01:39.611 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-01_15:11:43-fs-reef-release-distro-default-smithi/7473767', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-01 15:12:19.246630', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLdX6Go8Wb0az0Oyn/pEF6+2/ZryZ5AG6z/JJDD6QfqVzi8INPiG//eOJocyJC/HkoZQRGfeYXtO2vxswf89gh0='} 2023-12-01T16:01:39.614 DEBUG:teuthology.nuke:shortname: smithi140 2023-12-01T16:01:39.615 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-01T16:01:39.635 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi140.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-01_15:11:43-fs-reef-release-distro-default-smithi/7473767', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-01 15:12:19.248821', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJlicR0O07uzzKCN5gc+wYSKv1zBi7FSaHLPIQtyRR9Q1zDemvsQbMly8q0z5hA/c5XN7dLEVIRHsD0oQtjr0tQ='} 2023-12-01T16:01:39.662 INFO:teuthology.orchestra.console.smithi037:Power off 2023-12-01T16:01:39.663 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-01T16:01:39.684 DEBUG:teuthology.orchestra.console.smithi037:power off output: Chassis Power Control: Down/Off 2023-12-01T16:01:39.685 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T16:01:39.700 INFO:teuthology.orchestra.console.smithi140:Power off 2023-12-01T16:01:39.700 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-01T16:01:39.709 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off 2023-12-01T16:01:39.720 DEBUG:teuthology.orchestra.console.smithi140:power off output: Chassis Power Control: Down/Off 2023-12-01T16:01:39.721 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T16:01:39.743 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off 2023-12-01T16:01:39.810 INFO:teuthology.orchestra.console.smithi037:Power off completed 2023-12-01T16:01:39.843 INFO:teuthology.orchestra.console.smithi140:Power off completed 2023-12-01T16:01:39.960 INFO:teuthology.lock.ops:unlocked: smithi037.front.sepia.ceph.com 2023-12-01T16:01:39.985 INFO:teuthology.lock.ops:unlocked: smithi140.front.sepia.ceph.com