2023-11-29T09:42:06.014 INFO:root:teuthology version: 0.0.1.dev212+g735a43c 2023-11-29T09:42:06.014 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T09:42:06.144 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f60ca3fbdc0>, signals=[15]) 2023-11-29T09:42:06.144 INFO:teuthology.lock.ops:Start node 'smithi123.front.sepia.ceph.com' reimaging 2023-11-29T09:42:06.144 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: reset os type and version on server 2023-11-29T09:42:06.144 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2023-11-29T09:42:06.167 INFO:teuthology.lock.ops:Start node 'smithi174.front.sepia.ceph.com' reimaging 2023-11-29T09:42:06.167 INFO:teuthology.lock.ops:Updating [smithi174.front.sepia.ceph.com]: reset os type and version on server 2023-11-29T09:42:06.167 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2023-11-29T09:42:06.285 DEBUG:teuthology.provision.fog.smithi123:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-11-29T09:42:06.294 DEBUG:teuthology.provision.fog.smithi174:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-11-29T09:42:06.325 INFO:teuthology.provision.fog.smithi123:Scheduling deploy of ubuntu 22.04 2023-11-29T09:42:06.344 INFO:teuthology.provision.fog.smithi174:Scheduling deploy of ubuntu 22.04 2023-11-29T09:42:06.824 INFO:teuthology.orchestra.console.smithi174:Power off 2023-11-29T09:42:06.824 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-29T09:42:06.837 INFO:teuthology.orchestra.console.smithi123:Power off 2023-11-29T09:42:06.837 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-29T09:42:06.846 DEBUG:teuthology.orchestra.console.smithi174:power off output: Chassis Power Control: Down/Off 2023-11-29T09:42:06.847 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T09:42:06.857 DEBUG:teuthology.orchestra.console.smithi123:power off output: Chassis Power Control: Down/Off 2023-11-29T09:42:06.858 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T09:42:06.866 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2023-11-29T09:42:06.877 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on 2023-11-29T09:42:10.870 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T09:42:10.878 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T09:42:10.980 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2023-11-29T09:42:10.987 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on 2023-11-29T09:42:14.985 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T09:42:14.992 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T09:42:15.095 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2023-11-29T09:42:15.100 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on 2023-11-29T09:42:15.196 INFO:teuthology.orchestra.console.smithi174:Power off completed 2023-11-29T09:42:15.297 INFO:teuthology.orchestra.console.smithi174:Power on 2023-11-29T09:42:15.297 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-29T09:42:15.320 DEBUG:teuthology.orchestra.console.smithi174:power on output: Chassis Power Control: Up/On 2023-11-29T09:42:15.321 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T09:42:15.340 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2023-11-29T09:42:19.102 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T09:42:19.211 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off 2023-11-29T09:42:19.311 INFO:teuthology.orchestra.console.smithi123:Power off completed 2023-11-29T09:42:19.341 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T09:42:19.412 INFO:teuthology.orchestra.console.smithi123:Power on 2023-11-29T09:42:19.413 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-29T09:42:19.433 DEBUG:teuthology.orchestra.console.smithi123:power on output: Chassis Power Control: Up/On 2023-11-29T09:42:19.433 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T09:42:19.450 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2023-11-29T09:42:19.452 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off 2023-11-29T09:42:23.455 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T09:42:23.462 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T09:42:23.564 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2023-11-29T09:42:23.570 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on 2023-11-29T09:42:23.665 INFO:teuthology.orchestra.console.smithi174:Power on completed 2023-11-29T09:42:23.671 INFO:teuthology.orchestra.console.smithi123:Power on completed 2023-11-29T09:42:23.766 INFO:teuthology.provision.fog.smithi174:Waiting for deploy to finish 2023-11-29T09:42:23.771 INFO:teuthology.provision.fog.smithi123:Waiting for deploy to finish 2023-11-29T09:48:23.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T09:48:26.722 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-11-29T09:48:32.729 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T09:48:35.810 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-11-29T09:48:41.817 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T09:48:44.898 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-11-29T09:48:50.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T09:48:53.986 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-11-29T09:48:59.993 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T09:49:03.074 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-11-29T09:49:09.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T09:49:12.131 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-11-29T09:49:18.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T09:49:22.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T09:49:25.474 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-11-29T09:49:31.481 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T09:49:34.562 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-11-29T09:49:40.569 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T09:49:43.650 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-11-29T09:49:49.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T09:49:52.706 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-11-29T09:49:58.713 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T09:50:01.794 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-11-29T09:50:07.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T09:50:10.850 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-11-29T09:50:16.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T09:50:18.143 WARNING:teuthology.provision.fog.smithi174:timed out 2023-11-29T09:50:19.906 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-11-29T09:50:24.146 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T09:50:24.391 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-29T09:50:24.392 DEBUG:teuthology.orchestra.run.smithi174:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-29T09:50:24.846 INFO:teuthology.provision.fog.smithi174:Node is ready 2023-11-29T09:50:24.846 DEBUG:teuthology.orchestra.run.smithi174:> hostname 2023-11-29T09:50:24.893 INFO:teuthology.orchestra.run.smithi174.stdout:smithi174.front.sepia.ceph.com 2023-11-29T09:50:24.893 DEBUG:teuthology.orchestra.run.smithi174:> grep smithi174.front.sepia.ceph.com /etc/hosts 2023-11-29T09:50:24.941 INFO:teuthology.orchestra.run.smithi174.stdout:172.21.15.174 smithi174.front.sepia.ceph.com smithi174 2023-11-29T09:50:24.941 DEBUG:teuthology.orchestra.run.smithi174:> sudo hostname smithi174 2023-11-29T09:50:25.076 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/smithi174.front.sepia.ceph.com/smithi174/g' /etc/hosts 2023-11-29T09:50:25.090 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/172.21.15.174/172.21.15.174/g' /etc/hosts 2023-11-29T09:50:25.144 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/smithi174.front.sepia.ceph.com/smithi174/g' /etc/hostname 2023-11-29T09:50:25.205 DEBUG:teuthology.orchestra.run.smithi174:> sudo hostname smithi174 2023-11-29T09:50:25.264 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2023-11-29T09:50:25.318 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-29T09:50:25.318 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="Ubuntu" 2023-11-29T09:50:25.318 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="22.04" 2023-11-29T09:50:25.318 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-29T09:50:25.318 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_CODENAME=jammy 2023-11-29T09:50:25.318 INFO:teuthology.orchestra.run.smithi174.stdout:ID=ubuntu 2023-11-29T09:50:25.318 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE=debian 2023-11-29T09:50:25.319 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-29T09:50:25.319 INFO:teuthology.orchestra.run.smithi174.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-29T09:50:25.319 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-29T09:50:25.319 INFO:teuthology.orchestra.run.smithi174.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-29T09:50:25.319 INFO:teuthology.orchestra.run.smithi174.stdout:UBUNTU_CODENAME=jammy 2023-11-29T09:50:25.320 INFO:teuthology.provision.fog.smithi174:Deploy complete! 2023-11-29T09:50:25.321 DEBUG:teuthology.parallel:result is None 2023-11-29T09:50:25.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T09:50:44.322 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-11-29T09:50:50.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T09:50:53.382 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-11-29T09:50:59.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T09:51:01.442 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-11-29T09:51:07.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T09:51:07.448 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-11-29T09:51:13.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T09:51:13.457 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-11-29T09:51:19.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T09:51:19.464 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-11-29T09:51:25.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T09:51:25.472 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-11-29T09:51:31.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T09:51:31.679 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-29T09:51:31.679 DEBUG:teuthology.orchestra.run.smithi123:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-29T09:51:32.102 INFO:teuthology.provision.fog.smithi123:Node is ready 2023-11-29T09:51:32.103 DEBUG:teuthology.orchestra.run.smithi123:> hostname 2023-11-29T09:51:32.150 INFO:teuthology.orchestra.run.smithi123.stdout:smithi123.front.sepia.ceph.com 2023-11-29T09:51:32.150 DEBUG:teuthology.orchestra.run.smithi123:> grep smithi123.front.sepia.ceph.com /etc/hosts 2023-11-29T09:51:32.199 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123 smithi123.front.sepia.ceph.com smithi123 2023-11-29T09:51:32.199 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123 2023-11-29T09:51:32.324 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi123.front.sepia.ceph.com/smithi123/g' /etc/hosts 2023-11-29T09:51:32.337 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/172.21.15.123/172.21.15.123/g' /etc/hosts 2023-11-29T09:51:32.390 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi123.front.sepia.ceph.com/smithi123/g' /etc/hostname 2023-11-29T09:51:32.445 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123 2023-11-29T09:51:32.501 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2023-11-29T09:51:32.546 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-29T09:51:32.547 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="Ubuntu" 2023-11-29T09:51:32.547 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="22.04" 2023-11-29T09:51:32.547 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-29T09:51:32.547 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_CODENAME=jammy 2023-11-29T09:51:32.547 INFO:teuthology.orchestra.run.smithi123.stdout:ID=ubuntu 2023-11-29T09:51:32.547 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE=debian 2023-11-29T09:51:32.547 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-29T09:51:32.547 INFO:teuthology.orchestra.run.smithi123.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-29T09:51:32.547 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-29T09:51:32.547 INFO:teuthology.orchestra.run.smithi123.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-29T09:51:32.548 INFO:teuthology.orchestra.run.smithi123.stdout:UBUNTU_CODENAME=jammy 2023-11-29T09:51:32.548 INFO:teuthology.provision.fog.smithi123:Deploy complete! 2023-11-29T09:51:32.548 DEBUG:teuthology.parallel:result is None 2023-11-29T09:51:32.726 INFO:teuthology.lock.ops:Checking smithi123.front.sepia.ceph.com 2023-11-29T09:51:32.727 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-29T09:51:32.746 INFO:teuthology.lock.ops:Checking smithi174.front.sepia.ceph.com 2023-11-29T09:51:32.746 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-29T09:51:32.764 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: set os type and version on server 2023-11-29T09:51:32.764 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-11-29T09:51:32.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T09:51:32.840 DEBUG:teuthology.orchestra.run.smithi123:> true 2023-11-29T09:51:32.954 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-11-29T09:51:32.955 DEBUG:teuthology.orchestra.run.smithi123:> uname -m 2023-11-29T09:51:33.002 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64 2023-11-29T09:51:33.003 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2023-11-29T09:51:33.050 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-29T09:51:33.050 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="Ubuntu" 2023-11-29T09:51:33.050 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="22.04" 2023-11-29T09:51:33.050 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-29T09:51:33.051 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_CODENAME=jammy 2023-11-29T09:51:33.051 INFO:teuthology.orchestra.run.smithi123.stdout:ID=ubuntu 2023-11-29T09:51:33.051 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE=debian 2023-11-29T09:51:33.051 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-29T09:51:33.051 INFO:teuthology.orchestra.run.smithi123.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-29T09:51:33.051 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-29T09:51:33.051 INFO:teuthology.orchestra.run.smithi123.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-29T09:51:33.051 INFO:teuthology.orchestra.run.smithi123.stdout:UBUNTU_CODENAME=jammy 2023-11-29T09:51:33.051 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2023-11-29T09:51:33.071 INFO:teuthology.lock.ops:Updating [smithi174.front.sepia.ceph.com]: set os type and version on server 2023-11-29T09:51:33.071 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2023-11-29T09:51:33.071 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T09:51:33.144 DEBUG:teuthology.orchestra.run.smithi174:> true 2023-11-29T09:51:33.366 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi174.front.sepia.ceph.com' 2023-11-29T09:51:33.366 DEBUG:teuthology.orchestra.run.smithi174:> uname -m 2023-11-29T09:51:33.412 INFO:teuthology.orchestra.run.smithi174.stdout:x86_64 2023-11-29T09:51:33.412 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2023-11-29T09:51:33.460 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-29T09:51:33.460 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="Ubuntu" 2023-11-29T09:51:33.460 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="22.04" 2023-11-29T09:51:33.460 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-29T09:51:33.460 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_CODENAME=jammy 2023-11-29T09:51:33.460 INFO:teuthology.orchestra.run.smithi174.stdout:ID=ubuntu 2023-11-29T09:51:33.460 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE=debian 2023-11-29T09:51:33.460 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-29T09:51:33.461 INFO:teuthology.orchestra.run.smithi174.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-29T09:51:33.461 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-29T09:51:33.461 INFO:teuthology.orchestra.run.smithi174.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-29T09:51:33.461 INFO:teuthology.orchestra.run.smithi174.stdout:UBUNTU_CODENAME=jammy 2023-11-29T09:51:33.461 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2023-11-29T09:51:33.479 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T09:51:33.563 INFO:teuthology.dispatcher.supervisor:Running job 7470561 2023-11-29T09:51:33.563 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/virtualenv/bin/teuthology -v --owner scheduled_mkogan@teuthology --archive /home/teuthworker/archive/mkogan-2023-11-29_09:41:25-rgw-rgw-wip-t63445-valg-supp_i002-distro-default-smithi/7470561 --name mkogan-2023-11-29_09:41:25-rgw-rgw-wip-t63445-valg-supp_i002-distro-default-smithi --description rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} -- /home/teuthworker/archive/mkogan-2023-11-29_09:41:25-rgw-rgw-wip-t63445-valg-supp_i002-distro-default-smithi/7470561/orig.config.yaml 2023-11-29T09:51:33.566 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mkogan-2023-11-29_09:41:25-rgw-rgw-wip-t63445-valg-supp_i002-distro-default-smithi/7470561 2023-11-29T09:51:33.566 INFO:teuthology.dispatcher.supervisor:Job PID: 2122787 2023-11-29T09:51:33.566 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-29T09:53:33.667 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T09:55:33.843 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T09:57:34.008 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T09:59:34.201 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:01:34.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:03:34.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:05:34.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:07:34.927 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:09:35.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:11:35.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:13:35.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:15:35.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:17:35.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:19:36.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:21:36.179 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:23:36.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:25:36.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:27:36.676 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:29:36.844 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:31:37.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:33:37.179 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:35:37.325 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:37:37.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:39:37.615 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:41:37.785 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:43:37.933 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:45:38.103 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:47:38.243 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:49:38.407 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:51:38.571 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:51:38.645 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-11-29T10:51:38.751 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-29T10:51:38.751 INFO:teuthology.nuke:Checking targets against current locks 2023-11-29T10:51:38.801 DEBUG:teuthology.nuke:shortname: smithi123 2023-11-29T10:51:38.801 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-29T10:51:38.818 DEBUG:teuthology.nuke:shortname: smithi174 2023-11-29T10:51:38.819 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-29T10:51:38.821 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi123.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mkogan-2023-11-29_09:41:25-rgw-rgw-wip-t63445-valg-supp_i002-distro-default-smithi/7470561', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-29 09:42:05.257688', 'locked_by': 'scheduled_mkogan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLjYig+hhlxnv3frBrP0vZv/tAAL20AwdEP027Sa7Zb9BxfaT654/WRtJjqIx4N6dekdHmu9akx0Y2iHjkQXiIc='} 2023-11-29T10:51:38.841 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi174.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mkogan-2023-11-29_09:41:25-rgw-rgw-wip-t63445-valg-supp_i002-distro-default-smithi/7470561', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-29 09:42:05.258841', 'locked_by': 'scheduled_mkogan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO+kNY5tL8pZfi0ueUduwiG7qiyL75XSa0Fhek/ddBczQf8e4boJdc5VRT6+QyJNY5Yge1D0OYWrLyBk3VXtgXA='} 2023-11-29T10:51:38.870 INFO:teuthology.orchestra.console.smithi123:Power off 2023-11-29T10:51:38.871 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-29T10:51:38.895 DEBUG:teuthology.orchestra.console.smithi123:power off output: Chassis Power Control: Down/Off 2023-11-29T10:51:38.895 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T10:51:38.906 INFO:teuthology.orchestra.console.smithi174:Power off 2023-11-29T10:51:38.907 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-29T10:51:38.914 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off 2023-11-29T10:51:38.927 DEBUG:teuthology.orchestra.console.smithi174:power off output: Chassis Power Control: Down/Off 2023-11-29T10:51:38.927 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T10:51:38.947 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2023-11-29T10:51:39.015 INFO:teuthology.orchestra.console.smithi123:Power off completed 2023-11-29T10:51:39.048 INFO:teuthology.orchestra.console.smithi174:Power off completed 2023-11-29T10:51:39.168 INFO:teuthology.lock.ops:unlocked: smithi123.front.sepia.ceph.com 2023-11-29T10:51:39.192 INFO:teuthology.lock.ops:unlocked: smithi174.front.sepia.ceph.com