2024-04-18T12:56:57.093 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-18T12:56:57.093 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T12:56:57.251 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fef19f8cc10>, signals=[15]) 2024-04-18T12:56:57.251 INFO:teuthology.lock.ops:Start node 'smithi083.front.sepia.ceph.com' reimaging 2024-04-18T12:56:57.252 INFO:teuthology.lock.ops:Updating [smithi083.front.sepia.ceph.com]: reset os type and version on server 2024-04-18T12:56:57.252 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server 2024-04-18T12:56:57.272 INFO:teuthology.lock.ops:Start node 'smithi156.front.sepia.ceph.com' reimaging 2024-04-18T12:56:57.272 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: reset os type and version on server 2024-04-18T12:56:57.272 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2024-04-18T12:56:57.390 DEBUG:teuthology.provision.fog.smithi083:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-04-18T12:56:57.395 DEBUG:teuthology.provision.fog.smithi156:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-04-18T12:56:57.445 INFO:teuthology.provision.fog.smithi083:Scheduling deploy of ubuntu 22.04 2024-04-18T12:56:57.449 INFO:teuthology.provision.fog.smithi156:Scheduling deploy of ubuntu 22.04 2024-04-18T12:56:57.692 INFO:teuthology.orchestra.console.smithi156:Power off 2024-04-18T12:56:57.692 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T12:56:57.705 INFO:teuthology.orchestra.console.smithi083:Power off 2024-04-18T12:56:57.705 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T12:56:57.712 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off 2024-04-18T12:56:57.713 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T12:56:57.725 DEBUG:teuthology.orchestra.console.smithi083:power off output: Chassis Power Control: Down/Off 2024-04-18T12:56:57.725 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T12:56:57.733 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2024-04-18T12:56:57.745 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is off 2024-04-18T12:56:57.834 INFO:teuthology.orchestra.console.smithi156:Power off completed 2024-04-18T12:56:57.846 INFO:teuthology.orchestra.console.smithi083:Power off completed 2024-04-18T12:56:57.935 INFO:teuthology.orchestra.console.smithi156:Power on 2024-04-18T12:56:57.935 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-18T12:56:57.947 INFO:teuthology.orchestra.console.smithi083:Power on 2024-04-18T12:56:57.947 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-18T12:56:57.955 DEBUG:teuthology.orchestra.console.smithi156:power on output: Chassis Power Control: Up/On 2024-04-18T12:56:57.955 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T12:56:57.968 DEBUG:teuthology.orchestra.console.smithi083:power on output: Chassis Power Control: Up/On 2024-04-18T12:56:57.968 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T12:56:57.975 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2024-04-18T12:56:57.987 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is off 2024-04-18T12:57:01.981 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T12:57:01.988 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T12:57:02.090 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2024-04-18T12:57:02.097 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is off 2024-04-18T12:57:06.094 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T12:57:06.101 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T12:57:06.202 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2024-04-18T12:57:06.209 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is on 2024-04-18T12:57:06.304 INFO:teuthology.orchestra.console.smithi156:Power on completed 2024-04-18T12:57:06.309 INFO:teuthology.orchestra.console.smithi083:Power on completed 2024-04-18T12:57:06.405 INFO:teuthology.provision.fog.smithi156:Waiting for deploy to finish 2024-04-18T12:57:06.410 INFO:teuthology.provision.fog.smithi083:Waiting for deploy to finish 2024-04-18T13:01:47.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:01:50.110 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2024-04-18T13:01:56.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:01:59.166 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2024-04-18T13:02:05.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:02:08.222 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2024-04-18T13:02:14.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:02:17.310 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2024-04-18T13:02:23.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:02:26.398 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2024-04-18T13:02:32.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:02:35.454 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2024-04-18T13:02:41.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:03:19.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:03:19.591 ERROR:teuthology.orchestra.connection:Error authenticating with smithi083.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-04-18T13:03:41.462 WARNING:teuthology.provision.fog.smithi156:timed out 2024-04-18T13:03:47.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:03:47.700 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-18T13:03:47.701 DEBUG:teuthology.orchestra.run.smithi156:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-18T13:03:48.160 INFO:teuthology.provision.fog.smithi156:Node is ready 2024-04-18T13:03:48.160 DEBUG:teuthology.orchestra.run.smithi156:> hostname 2024-04-18T13:03:48.208 INFO:teuthology.orchestra.run.smithi156.stdout:smithi156.front.sepia.ceph.com 2024-04-18T13:03:48.208 DEBUG:teuthology.orchestra.run.smithi156:> grep smithi156.front.sepia.ceph.com /etc/hosts 2024-04-18T13:03:48.261 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156 smithi156.front.sepia.ceph.com smithi156 2024-04-18T13:03:48.261 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156 2024-04-18T13:03:48.397 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hosts 2024-04-18T13:03:48.410 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/172.21.15.156/172.21.15.156/g' /etc/hosts 2024-04-18T13:03:48.465 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hostname 2024-04-18T13:03:48.521 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156 2024-04-18T13:03:48.574 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2024-04-18T13:03:48.624 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-18T13:03:48.625 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="Ubuntu" 2024-04-18T13:03:48.625 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="22.04" 2024-04-18T13:03:48.625 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-18T13:03:48.625 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_CODENAME=jammy 2024-04-18T13:03:48.625 INFO:teuthology.orchestra.run.smithi156.stdout:ID=ubuntu 2024-04-18T13:03:48.625 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE=debian 2024-04-18T13:03:48.625 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-18T13:03:48.625 INFO:teuthology.orchestra.run.smithi156.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-18T13:03:48.625 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-18T13:03:48.625 INFO:teuthology.orchestra.run.smithi156.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-18T13:03:48.625 INFO:teuthology.orchestra.run.smithi156.stdout:UBUNTU_CODENAME=jammy 2024-04-18T13:03:48.626 INFO:teuthology.provision.fog.smithi156:Deploy complete! 2024-04-18T13:03:48.627 DEBUG:teuthology.parallel:result is None 2024-04-18T13:03:58.238 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2024-04-18T13:04:04.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:04:07.294 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2024-04-18T13:04:13.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:04:16.350 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2024-04-18T13:04:22.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:04:40.734 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2024-04-18T13:04:46.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:04:49.790 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2024-04-18T13:04:55.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:04:58.851 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2024-04-18T13:05:04.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:05:04.855 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2024-04-18T13:05:10.856 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:05:10.859 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2024-04-18T13:05:16.861 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:05:16.863 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2024-04-18T13:05:22.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:05:22.866 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2024-04-18T13:05:28.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:05:29.032 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-18T13:05:29.032 DEBUG:teuthology.orchestra.run.smithi083:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-18T13:05:29.518 INFO:teuthology.provision.fog.smithi083:Node is ready 2024-04-18T13:05:29.518 DEBUG:teuthology.orchestra.run.smithi083:> hostname 2024-04-18T13:05:29.567 INFO:teuthology.orchestra.run.smithi083.stdout:smithi083.front.sepia.ceph.com 2024-04-18T13:05:29.567 DEBUG:teuthology.orchestra.run.smithi083:> grep smithi083.front.sepia.ceph.com /etc/hosts 2024-04-18T13:05:29.615 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83 smithi083.front.sepia.ceph.com smithi083 2024-04-18T13:05:29.615 DEBUG:teuthology.orchestra.run.smithi083:> sudo hostname smithi083 2024-04-18T13:05:29.763 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i -e 's/smithi083.front.sepia.ceph.com/smithi083/g' /etc/hosts 2024-04-18T13:05:29.777 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i -e 's/172.21.15.83/172.21.15.83/g' /etc/hosts 2024-04-18T13:05:29.831 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i -e 's/smithi083.front.sepia.ceph.com/smithi083/g' /etc/hostname 2024-04-18T13:05:29.891 DEBUG:teuthology.orchestra.run.smithi083:> sudo hostname smithi083 2024-04-18T13:05:29.946 DEBUG:teuthology.orchestra.run.smithi083:> cat /etc/os-release 2024-04-18T13:05:29.998 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-18T13:05:29.999 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="Ubuntu" 2024-04-18T13:05:29.999 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="22.04" 2024-04-18T13:05:29.999 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-18T13:05:29.999 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_CODENAME=jammy 2024-04-18T13:05:29.999 INFO:teuthology.orchestra.run.smithi083.stdout:ID=ubuntu 2024-04-18T13:05:29.999 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE=debian 2024-04-18T13:05:29.999 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-18T13:05:29.999 INFO:teuthology.orchestra.run.smithi083.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-18T13:05:29.999 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-18T13:05:29.999 INFO:teuthology.orchestra.run.smithi083.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-18T13:05:29.999 INFO:teuthology.orchestra.run.smithi083.stdout:UBUNTU_CODENAME=jammy 2024-04-18T13:05:29.999 INFO:teuthology.provision.fog.smithi083:Deploy complete! 2024-04-18T13:05:30.000 DEBUG:teuthology.parallel:result is None 2024-04-18T13:05:30.179 INFO:teuthology.lock.ops:Checking smithi083.front.sepia.ceph.com 2024-04-18T13:05:30.179 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-18T13:05:30.203 INFO:teuthology.lock.ops:Checking smithi156.front.sepia.ceph.com 2024-04-18T13:05:30.203 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-18T13:05:30.220 INFO:teuthology.lock.ops:Updating [smithi083.front.sepia.ceph.com]: set os type and version on server 2024-04-18T13:05:30.221 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2024-04-18T13:05:30.221 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:05:30.295 DEBUG:teuthology.orchestra.run.smithi083:> true 2024-04-18T13:05:30.390 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi083.front.sepia.ceph.com' 2024-04-18T13:05:30.390 DEBUG:teuthology.orchestra.run.smithi083:> uname -m 2024-04-18T13:05:30.439 INFO:teuthology.orchestra.run.smithi083.stdout:x86_64 2024-04-18T13:05:30.439 DEBUG:teuthology.orchestra.run.smithi083:> cat /etc/os-release 2024-04-18T13:05:30.487 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-18T13:05:30.487 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="Ubuntu" 2024-04-18T13:05:30.487 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="22.04" 2024-04-18T13:05:30.487 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-18T13:05:30.487 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_CODENAME=jammy 2024-04-18T13:05:30.487 INFO:teuthology.orchestra.run.smithi083.stdout:ID=ubuntu 2024-04-18T13:05:30.487 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE=debian 2024-04-18T13:05:30.487 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-18T13:05:30.487 INFO:teuthology.orchestra.run.smithi083.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-18T13:05:30.487 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-18T13:05:30.487 INFO:teuthology.orchestra.run.smithi083.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-18T13:05:30.487 INFO:teuthology.orchestra.run.smithi083.stdout:UBUNTU_CODENAME=jammy 2024-04-18T13:05:30.488 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server 2024-04-18T13:05:30.511 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: set os type and version on server 2024-04-18T13:05:30.512 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2024-04-18T13:05:30.512 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:05:30.591 DEBUG:teuthology.orchestra.run.smithi156:> true 2024-04-18T13:05:30.806 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi156.front.sepia.ceph.com' 2024-04-18T13:05:30.806 DEBUG:teuthology.orchestra.run.smithi156:> uname -m 2024-04-18T13:05:30.854 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64 2024-04-18T13:05:30.854 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2024-04-18T13:05:30.902 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-18T13:05:30.902 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="Ubuntu" 2024-04-18T13:05:30.902 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="22.04" 2024-04-18T13:05:30.902 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-18T13:05:30.903 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_CODENAME=jammy 2024-04-18T13:05:30.903 INFO:teuthology.orchestra.run.smithi156.stdout:ID=ubuntu 2024-04-18T13:05:30.903 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE=debian 2024-04-18T13:05:30.903 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-18T13:05:30.903 INFO:teuthology.orchestra.run.smithi156.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-18T13:05:30.903 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-18T13:05:30.903 INFO:teuthology.orchestra.run.smithi156.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-18T13:05:30.903 INFO:teuthology.orchestra.run.smithi156.stdout:UBUNTU_CODENAME=jammy 2024-04-18T13:05:30.904 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2024-04-18T13:05:30.928 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T13:05:31.017 INFO:teuthology.dispatcher.supervisor:Running job 7661989 2024-04-18T13:05:31.017 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/virtualenv/bin/teuthology -v --owner scheduled_cbodley@teuthology --archive /home/teuthworker/archive/cbodley-2024-04-18_12:55:49-rgw-wip-cbodley2-testing-distro-default-smithi/7661989 --name cbodley-2024-04-18_12:55:49-rgw-wip-cbodley2-testing-distro-default-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/three-zones supported-random-distro$/{ubuntu_latest} tasks/test_multi} -- /home/teuthworker/archive/cbodley-2024-04-18_12:55:49-rgw-wip-cbodley2-testing-distro-default-smithi/7661989/orig.config.yaml 2024-04-18T13:05:31.020 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/cbodley-2024-04-18_12:55:49-rgw-wip-cbodley2-testing-distro-default-smithi/7661989 2024-04-18T13:05:31.021 INFO:teuthology.dispatcher.supervisor:Job PID: 3682964 2024-04-18T13:05:31.021 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-18T13:07:31.022 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T13:09:31.097 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T13:11:31.166 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T13:13:31.249 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T13:15:31.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T13:17:31.521 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T13:19:31.595 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T13:21:31.677 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T13:23:31.744 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T13:25:31.810 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T13:27:31.883 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T13:29:31.941 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T13:31:32.014 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T13:33:32.097 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T13:35:32.202 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T13:37:32.273 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T13:39:32.336 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T13:41:32.410 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T13:43:32.542 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T13:45:32.611 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T13:47:32.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T13:49:32.771 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T13:51:32.842 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T13:53:32.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T13:55:32.985 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T13:57:33.057 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T13:59:33.128 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T14:01:33.200 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T14:03:33.280 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T14:05:33.364 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T14:07:33.438 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T14:09:33.506 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T14:11:33.588 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T14:13:33.737 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T14:15:33.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T14:17:33.892 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T14:19:33.964 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T14:21:34.036 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T14:23:34.103 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T14:25:34.246 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T14:27:34.320 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T14:29:34.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T14:31:34.478 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T14:33:34.550 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T14:35:34.625 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T14:37:34.709 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T14:39:34.790 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T14:41:34.869 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T14:43:34.947 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T14:45:35.009 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T14:47:35.093 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T14:49:35.160 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T14:51:35.232 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T14:53:35.306 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T14:55:35.385 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T14:57:35.459 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T14:59:35.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T15:01:35.603 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T15:03:35.682 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T15:05:35.759 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T15:07:35.816 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T15:09:35.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T15:11:35.954 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T15:13:36.021 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T15:15:36.086 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T15:17:36.146 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T15:19:36.224 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T15:21:36.290 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T15:23:36.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T15:25:36.893 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T15:27:36.964 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T15:29:37.028 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T15:31:37.097 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T15:33:37.176 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T15:35:37.269 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T15:37:37.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T15:39:37.410 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T15:41:37.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T15:43:37.582 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T15:45:37.666 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T15:47:37.742 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T15:49:37.807 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T15:51:37.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T15:53:37.940 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T15:55:38.016 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T15:57:38.093 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T15:59:38.161 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T16:01:38.220 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T16:03:38.277 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T16:05:38.356 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T16:07:38.433 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T16:09:38.529 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T16:11:38.605 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T16:13:38.672 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T16:15:38.741 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T16:17:38.816 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T16:19:38.910 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T16:21:38.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T16:23:39.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T16:25:39.155 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T16:27:39.236 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T16:29:39.302 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T16:31:39.382 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T16:33:39.458 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T16:35:39.528 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T16:37:39.610 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T16:39:39.692 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T16:41:39.756 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T16:43:39.822 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T16:45:39.896 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T16:47:39.960 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T16:49:40.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T16:51:40.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T16:53:40.202 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T16:55:40.276 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T16:57:40.349 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T16:59:40.452 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T17:01:40.520 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T17:03:40.594 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T17:05:40.668 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T17:07:40.741 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T17:09:40.813 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T17:11:40.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T17:11:40.973 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1