2024-01-18T10:56:30.797 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-18T10:56:30.798 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T10:56:30.939 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff6b4084c10>, signals=[15]) 2024-01-18T10:56:30.939 INFO:teuthology.lock.ops:Start node 'smithi047.front.sepia.ceph.com' reimaging 2024-01-18T10:56:30.940 INFO:teuthology.lock.ops:Updating [smithi047.front.sepia.ceph.com]: reset os type and version on server 2024-01-18T10:56:30.940 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server 2024-01-18T10:56:30.959 INFO:teuthology.lock.ops:Start node 'smithi194.front.sepia.ceph.com' reimaging 2024-01-18T10:56:30.959 INFO:teuthology.lock.ops:Updating [smithi194.front.sepia.ceph.com]: reset os type and version on server 2024-01-18T10:56:30.959 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2024-01-18T10:56:31.074 DEBUG:teuthology.provision.fog.smithi047:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-01-18T10:56:31.092 DEBUG:teuthology.provision.fog.smithi194:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-01-18T10:56:31.122 INFO:teuthology.provision.fog.smithi047:Scheduling deploy of ubuntu 22.04 2024-01-18T10:56:31.131 INFO:teuthology.provision.fog.smithi194:Scheduling deploy of ubuntu 22.04 2024-01-18T10:56:31.360 INFO:teuthology.orchestra.console.smithi194:Power off 2024-01-18T10:56:31.360 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-18T10:56:31.372 INFO:teuthology.orchestra.console.smithi047:Power off 2024-01-18T10:56:31.373 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-18T10:56:31.383 DEBUG:teuthology.orchestra.console.smithi194:power off output: Chassis Power Control: Down/Off 2024-01-18T10:56:31.384 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T10:56:31.398 DEBUG:teuthology.orchestra.console.smithi047:power off output: Chassis Power Control: Down/Off 2024-01-18T10:56:31.399 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T10:56:31.409 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on 2024-01-18T10:56:31.421 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is on 2024-01-18T10:56:35.412 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T10:56:35.422 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T10:56:35.523 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on 2024-01-18T10:56:35.531 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is on 2024-01-18T10:56:39.528 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T10:56:39.536 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T10:56:39.639 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on 2024-01-18T10:56:39.645 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is off 2024-01-18T10:56:39.745 INFO:teuthology.orchestra.console.smithi047:Power off completed 2024-01-18T10:56:39.846 INFO:teuthology.orchestra.console.smithi047:Power on 2024-01-18T10:56:39.846 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-18T10:56:39.867 DEBUG:teuthology.orchestra.console.smithi047:power on output: Chassis Power Control: Up/On 2024-01-18T10:56:39.867 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T10:56:39.887 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is off 2024-01-18T10:56:43.644 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T10:56:43.753 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2024-01-18T10:56:43.853 INFO:teuthology.orchestra.console.smithi194:Power off completed 2024-01-18T10:56:43.889 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T10:56:43.954 INFO:teuthology.orchestra.console.smithi194:Power on 2024-01-18T10:56:43.955 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-18T10:56:43.977 DEBUG:teuthology.orchestra.console.smithi194:power on output: Chassis Power Control: Up/On 2024-01-18T10:56:43.977 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T10:56:43.997 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is off 2024-01-18T10:56:43.998 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2024-01-18T10:56:48.000 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T10:56:48.007 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T10:56:48.109 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is on 2024-01-18T10:56:48.115 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2024-01-18T10:56:48.211 INFO:teuthology.orchestra.console.smithi047:Power on completed 2024-01-18T10:56:48.311 INFO:teuthology.provision.fog.smithi047:Waiting for deploy to finish 2024-01-18T10:56:52.120 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T10:56:52.229 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on 2024-01-18T10:56:52.330 INFO:teuthology.orchestra.console.smithi194:Power on completed 2024-01-18T10:56:52.430 INFO:teuthology.provision.fog.smithi194:Waiting for deploy to finish 2024-01-18T10:59:49.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T10:59:53.389 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T11:00:07.868 WARNING:teuthology.provision.fog.smithi047:[Errno None] Unable to connect to port 22 on 172.21.15.47 2024-01-18T11:00:11.708 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-01-18T11:00:13.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T11:00:16.924 WARNING:teuthology.provision.fog.smithi047:[Errno None] Unable to connect to port 22 on 172.21.15.47 2024-01-18T11:00:17.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T11:00:20.764 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-01-18T11:00:22.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T11:00:25.980 WARNING:teuthology.provision.fog.smithi047:[Errno None] Unable to connect to port 22 on 172.21.15.47 2024-01-18T11:00:26.767 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T11:00:29.820 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-01-18T11:00:31.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T11:00:35.036 WARNING:teuthology.provision.fog.smithi047:[Errno None] Unable to connect to port 22 on 172.21.15.47 2024-01-18T11:00:35.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T11:00:38.876 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-01-18T11:00:41.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T11:00:44.092 WARNING:teuthology.provision.fog.smithi047:[Errno None] Unable to connect to port 22 on 172.21.15.47 2024-01-18T11:00:44.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T11:00:47.932 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-01-18T11:00:50.095 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T11:00:53.148 WARNING:teuthology.provision.fog.smithi047:[Errno None] Unable to connect to port 22 on 172.21.15.47 2024-01-18T11:00:53.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T11:00:59.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T11:01:02.236 WARNING:teuthology.provision.fog.smithi047:[Errno None] Unable to connect to port 22 on 172.21.15.47 2024-01-18T11:01:08.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T11:01:53.981 WARNING:teuthology.provision.fog.smithi194:timed out 2024-01-18T11:01:59.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T11:02:00.161 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-18T11:02:00.162 DEBUG:teuthology.orchestra.run.smithi194:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-18T11:02:00.633 INFO:teuthology.provision.fog.smithi194:Node is ready 2024-01-18T11:02:00.633 DEBUG:teuthology.orchestra.run.smithi194:> hostname 2024-01-18T11:02:00.682 INFO:teuthology.orchestra.run.smithi194.stdout:smithi194.front.sepia.ceph.com 2024-01-18T11:02:00.682 DEBUG:teuthology.orchestra.run.smithi194:> grep smithi194.front.sepia.ceph.com /etc/hosts 2024-01-18T11:02:00.730 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.15.194 smithi194.front.sepia.ceph.com smithi194 2024-01-18T11:02:00.730 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname smithi194 2024-01-18T11:02:00.846 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/smithi194.front.sepia.ceph.com/smithi194/g' /etc/hosts 2024-01-18T11:02:00.860 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/172.21.15.194/172.21.15.194/g' /etc/hosts 2024-01-18T11:02:00.915 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/smithi194.front.sepia.ceph.com/smithi194/g' /etc/hostname 2024-01-18T11:02:00.969 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname smithi194 2024-01-18T11:02:01.028 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2024-01-18T11:02:01.078 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-01-18T11:02:01.078 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="Ubuntu" 2024-01-18T11:02:01.078 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="22.04" 2024-01-18T11:02:01.078 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-01-18T11:02:01.079 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_CODENAME=jammy 2024-01-18T11:02:01.079 INFO:teuthology.orchestra.run.smithi194.stdout:ID=ubuntu 2024-01-18T11:02:01.079 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE=debian 2024-01-18T11:02:01.079 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://www.ubuntu.com/" 2024-01-18T11:02:01.079 INFO:teuthology.orchestra.run.smithi194.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-01-18T11:02:01.079 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-01-18T11:02:01.079 INFO:teuthology.orchestra.run.smithi194.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-01-18T11:02:01.079 INFO:teuthology.orchestra.run.smithi194.stdout:UBUNTU_CODENAME=jammy 2024-01-18T11:02:01.080 INFO:teuthology.provision.fog.smithi194:Deploy complete! 2024-01-18T11:02:01.082 DEBUG:teuthology.parallel:result is None 2024-01-18T11:02:08.251 WARNING:teuthology.provision.fog.smithi047:timed out 2024-01-18T11:02:14.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T11:02:14.258 WARNING:teuthology.provision.fog.smithi047:[Errno None] Unable to connect to port 22 on 172.21.15.47 2024-01-18T11:02:20.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T11:02:20.465 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-18T11:02:20.465 DEBUG:teuthology.orchestra.run.smithi047:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-18T11:02:20.919 INFO:teuthology.provision.fog.smithi047:Node is ready 2024-01-18T11:02:20.920 DEBUG:teuthology.orchestra.run.smithi047:> hostname 2024-01-18T11:02:20.968 INFO:teuthology.orchestra.run.smithi047.stdout:smithi047.front.sepia.ceph.com 2024-01-18T11:02:20.969 DEBUG:teuthology.orchestra.run.smithi047:> grep smithi047.front.sepia.ceph.com /etc/hosts 2024-01-18T11:02:21.017 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47 smithi047.front.sepia.ceph.com smithi047 2024-01-18T11:02:21.017 DEBUG:teuthology.orchestra.run.smithi047:> sudo hostname smithi047 2024-01-18T11:02:21.147 DEBUG:teuthology.orchestra.run.smithi047:> sudo sed -i -e 's/smithi047.front.sepia.ceph.com/smithi047/g' /etc/hosts 2024-01-18T11:02:21.161 DEBUG:teuthology.orchestra.run.smithi047:> sudo sed -i -e 's/172.21.15.47/172.21.15.47/g' /etc/hosts 2024-01-18T11:02:21.216 DEBUG:teuthology.orchestra.run.smithi047:> sudo sed -i -e 's/smithi047.front.sepia.ceph.com/smithi047/g' /etc/hostname 2024-01-18T11:02:21.273 DEBUG:teuthology.orchestra.run.smithi047:> sudo hostname smithi047 2024-01-18T11:02:21.328 DEBUG:teuthology.orchestra.run.smithi047:> cat /etc/os-release 2024-01-18T11:02:21.381 INFO:teuthology.orchestra.run.smithi047.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-01-18T11:02:21.381 INFO:teuthology.orchestra.run.smithi047.stdout:NAME="Ubuntu" 2024-01-18T11:02:21.381 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_ID="22.04" 2024-01-18T11:02:21.381 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-01-18T11:02:21.382 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_CODENAME=jammy 2024-01-18T11:02:21.382 INFO:teuthology.orchestra.run.smithi047.stdout:ID=ubuntu 2024-01-18T11:02:21.382 INFO:teuthology.orchestra.run.smithi047.stdout:ID_LIKE=debian 2024-01-18T11:02:21.382 INFO:teuthology.orchestra.run.smithi047.stdout:HOME_URL="https://www.ubuntu.com/" 2024-01-18T11:02:21.382 INFO:teuthology.orchestra.run.smithi047.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-01-18T11:02:21.382 INFO:teuthology.orchestra.run.smithi047.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-01-18T11:02:21.382 INFO:teuthology.orchestra.run.smithi047.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-01-18T11:02:21.382 INFO:teuthology.orchestra.run.smithi047.stdout:UBUNTU_CODENAME=jammy 2024-01-18T11:02:21.382 INFO:teuthology.provision.fog.smithi047:Deploy complete! 2024-01-18T11:02:21.383 DEBUG:teuthology.parallel:result is None 2024-01-18T11:02:21.560 INFO:teuthology.lock.ops:Checking smithi047.front.sepia.ceph.com 2024-01-18T11:02:21.561 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-18T11:02:21.587 INFO:teuthology.lock.ops:Checking smithi194.front.sepia.ceph.com 2024-01-18T11:02:21.587 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-18T11:02:21.604 INFO:teuthology.lock.ops:Updating [smithi047.front.sepia.ceph.com]: set os type and version on server 2024-01-18T11:02:21.605 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-01-18T11:02:21.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T11:02:21.686 DEBUG:teuthology.orchestra.run.smithi047:> true 2024-01-18T11:02:21.788 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-01-18T11:02:21.788 DEBUG:teuthology.orchestra.run.smithi047:> uname -m 2024-01-18T11:02:21.836 INFO:teuthology.orchestra.run.smithi047.stdout:x86_64 2024-01-18T11:02:21.836 DEBUG:teuthology.orchestra.run.smithi047:> cat /etc/os-release 2024-01-18T11:02:21.884 INFO:teuthology.orchestra.run.smithi047.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-01-18T11:02:21.884 INFO:teuthology.orchestra.run.smithi047.stdout:NAME="Ubuntu" 2024-01-18T11:02:21.884 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_ID="22.04" 2024-01-18T11:02:21.884 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-01-18T11:02:21.884 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_CODENAME=jammy 2024-01-18T11:02:21.884 INFO:teuthology.orchestra.run.smithi047.stdout:ID=ubuntu 2024-01-18T11:02:21.884 INFO:teuthology.orchestra.run.smithi047.stdout:ID_LIKE=debian 2024-01-18T11:02:21.884 INFO:teuthology.orchestra.run.smithi047.stdout:HOME_URL="https://www.ubuntu.com/" 2024-01-18T11:02:21.885 INFO:teuthology.orchestra.run.smithi047.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-01-18T11:02:21.885 INFO:teuthology.orchestra.run.smithi047.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-01-18T11:02:21.885 INFO:teuthology.orchestra.run.smithi047.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-01-18T11:02:21.885 INFO:teuthology.orchestra.run.smithi047.stdout:UBUNTU_CODENAME=jammy 2024-01-18T11:02:21.885 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server 2024-01-18T11:02:21.904 INFO:teuthology.lock.ops:Updating [smithi194.front.sepia.ceph.com]: set os type and version on server 2024-01-18T11:02:21.904 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-01-18T11:02:21.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T11:02:21.990 DEBUG:teuthology.orchestra.run.smithi194:> true 2024-01-18T11:02:22.244 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-01-18T11:02:22.244 DEBUG:teuthology.orchestra.run.smithi194:> uname -m 2024-01-18T11:02:22.289 INFO:teuthology.orchestra.run.smithi194.stdout:x86_64 2024-01-18T11:02:22.289 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2024-01-18T11:02:22.337 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-01-18T11:02:22.337 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="Ubuntu" 2024-01-18T11:02:22.338 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="22.04" 2024-01-18T11:02:22.338 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-01-18T11:02:22.338 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_CODENAME=jammy 2024-01-18T11:02:22.338 INFO:teuthology.orchestra.run.smithi194.stdout:ID=ubuntu 2024-01-18T11:02:22.338 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE=debian 2024-01-18T11:02:22.338 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://www.ubuntu.com/" 2024-01-18T11:02:22.338 INFO:teuthology.orchestra.run.smithi194.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-01-18T11:02:22.338 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-01-18T11:02:22.338 INFO:teuthology.orchestra.run.smithi194.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-01-18T11:02:22.338 INFO:teuthology.orchestra.run.smithi194.stdout:UBUNTU_CODENAME=jammy 2024-01-18T11:02:22.339 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2024-01-18T11:02:22.362 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:02:22.446 INFO:teuthology.dispatcher.supervisor:Running job 7520074 2024-01-18T11:02:22.447 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_gsalomon@teuthology --archive /home/teuthworker/archive/gsalomon-2024-01-18_10:43:24-rgw:verify-s3select_fixes_QE_bugs-distro-default-smithi/7520074 --name gsalomon-2024-01-18_10:43:24-rgw:verify-s3select_fixes_QE_bugs-distro-default-smithi --description rgw:verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} -- /home/teuthworker/archive/gsalomon-2024-01-18_10:43:24-rgw:verify-s3select_fixes_QE_bugs-distro-default-smithi/7520074/orig.config.yaml 2024-01-18T11:02:22.449 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/gsalomon-2024-01-18_10:43:24-rgw:verify-s3select_fixes_QE_bugs-distro-default-smithi/7520074 2024-01-18T11:02:22.450 INFO:teuthology.dispatcher.supervisor:Job PID: 690249 2024-01-18T11:02:22.450 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-18T11:04:22.549 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:06:22.720 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:08:22.892 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:10:23.065 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:12:23.238 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:14:23.445 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:16:23.612 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:18:23.786 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:20:23.944 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:22:24.113 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:24:24.208 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:26:24.369 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:28:24.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:30:24.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:32:24.850 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:34:24.976 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:36:25.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:38:25.295 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:40:25.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:42:25.632 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:44:25.800 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:46:25.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:48:26.132 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:50:26.296 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:52:26.457 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:54:26.581 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:56:26.756 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:58:26.928 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T12:00:27.089 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T12:02:27.264 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T12:04:27.400 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T12:06:27.737 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T12:08:27.904 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T12:10:28.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T12:12:28.256 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T12:14:28.430 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T12:16:28.592 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T12:18:28.729 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T12:20:28.892 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T12:22:29.049 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T12:24:29.200 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T12:26:29.384 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T12:28:29.544 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T12:30:29.709 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T12:32:29.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T12:34:29.956 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T12:36:30.119 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T12:38:30.288 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T12:40:30.454 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T12:42:30.620 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T12:44:30.798 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T12:46:30.952 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T12:48:31.116 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T12:50:31.260 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T12:52:31.430 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T12:54:31.604 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T12:56:31.768 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T12:58:31.936 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T13:00:32.108 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T13:02:32.256 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T13:04:32.350 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T13:06:32.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T13:08:32.658 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T13:10:32.824 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T13:12:32.992 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T13:14:33.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T13:16:33.336 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T13:18:33.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T13:20:33.684 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T13:22:33.825 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T13:24:33.991 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T13:26:34.140 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T13:28:34.312 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T13:30:34.468 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T13:32:34.633 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T13:34:34.804 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T13:36:34.972 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T13:38:35.156 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T13:40:35.330 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T13:42:35.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T13:44:35.644 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T13:46:35.812 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T13:48:35.976 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T13:50:36.152 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T13:52:36.256 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T13:54:36.436 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T13:56:36.604 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T13:58:36.780 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T14:00:36.940 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T14:02:37.109 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T14:04:37.266 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T14:06:37.417 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T14:08:37.580 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T14:10:37.748 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T14:12:37.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T14:14:38.096 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T14:16:38.264 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T14:18:38.434 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T14:20:38.610 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T14:22:38.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T14:24:38.953 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T14:26:39.112 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T14:26:39.205 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-01-18T14:26:39.363 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2024-01-18T14:26:39.363 INFO:teuthology.nuke:Checking targets against current locks 2024-01-18T14:26:39.414 DEBUG:teuthology.nuke:shortname: smithi047 2024-01-18T14:26:39.414 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-18T14:26:39.438 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi047.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gsalomon-2024-01-18_10:43:24-rgw:verify-s3select_fixes_QE_bugs-distro-default-smithi/7520074', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-18 10:56:29.804487', 'locked_by': 'scheduled_gsalomon@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD4ROvOjSKJZQt2E946pR1r0g5l8c64Kl00oXqZO+nxnGbLLAor7MnvSmonEbBmc3qGoBiit8V+YN7Sl2TjMAPs='} 2024-01-18T14:26:39.441 DEBUG:teuthology.nuke:shortname: smithi194 2024-01-18T14:26:39.441 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-18T14:26:39.459 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi194.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gsalomon-2024-01-18_10:43:24-rgw:verify-s3select_fixes_QE_bugs-distro-default-smithi/7520074', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-18 10:56:29.802778', 'locked_by': 'scheduled_gsalomon@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBe+NVC+ypQOPMg5Qc7UlF9i5gC96UsPw9JkFzFopvAx7Ir13dAq3pRohlr0U/0y3Mxd60OoqTdFC+cvrqeYmnQ='} 2024-01-18T14:26:39.491 INFO:teuthology.orchestra.console.smithi047:Power off 2024-01-18T14:26:39.491 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-18T14:26:39.513 DEBUG:teuthology.orchestra.console.smithi047:power off output: Chassis Power Control: Down/Off 2024-01-18T14:26:39.513 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T14:26:39.527 INFO:teuthology.orchestra.console.smithi194:Power off 2024-01-18T14:26:39.527 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-18T14:26:39.537 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is off 2024-01-18T14:26:39.549 DEBUG:teuthology.orchestra.console.smithi194:power off output: Chassis Power Control: Down/Off 2024-01-18T14:26:39.550 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T14:26:39.574 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2024-01-18T14:26:39.638 INFO:teuthology.orchestra.console.smithi047:Power off completed 2024-01-18T14:26:39.675 INFO:teuthology.orchestra.console.smithi194:Power off completed 2024-01-18T14:26:39.786 INFO:teuthology.lock.ops:unlocked: smithi047.front.sepia.ceph.com 2024-01-18T14:26:39.827 INFO:teuthology.lock.ops:unlocked: smithi194.front.sepia.ceph.com