2024-02-18T16:48:23.805 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-18T16:48:23.806 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T16:48:23.940 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6d9ad40c10>, signals=[15]) 2024-02-18T16:48:23.940 INFO:teuthology.lock.ops:Start node 'smithi084.front.sepia.ceph.com' reimaging 2024-02-18T16:48:23.940 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: reset os type and version on server 2024-02-18T16:48:23.940 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2024-02-18T16:48:23.965 INFO:teuthology.lock.ops:Start node 'smithi181.front.sepia.ceph.com' reimaging 2024-02-18T16:48:23.965 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: reset os type and version on server 2024-02-18T16:48:23.965 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2024-02-18T16:48:24.069 DEBUG:teuthology.provision.fog.smithi084:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-02-18T16:48:24.101 DEBUG:teuthology.provision.fog.smithi181:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-02-18T16:48:24.107 INFO:teuthology.provision.fog.smithi084:Scheduling deploy of ubuntu 22.04 2024-02-18T16:48:24.144 INFO:teuthology.provision.fog.smithi181:Scheduling deploy of ubuntu 22.04 2024-02-18T16:48:24.370 INFO:teuthology.orchestra.console.smithi084:Power off 2024-02-18T16:48:24.370 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-18T16:48:24.382 INFO:teuthology.orchestra.console.smithi181:Power off 2024-02-18T16:48:24.383 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-18T16:48:24.391 DEBUG:teuthology.orchestra.console.smithi084:power off output: Chassis Power Control: Down/Off 2024-02-18T16:48:24.392 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-18T16:48:24.404 DEBUG:teuthology.orchestra.console.smithi181:power off output: Chassis Power Control: Down/Off 2024-02-18T16:48:24.404 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-18T16:48:24.412 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2024-02-18T16:48:24.425 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off 2024-02-18T16:48:24.513 INFO:teuthology.orchestra.console.smithi084:Power off completed 2024-02-18T16:48:24.526 INFO:teuthology.orchestra.console.smithi181:Power off completed 2024-02-18T16:48:24.614 INFO:teuthology.orchestra.console.smithi084:Power on 2024-02-18T16:48:24.614 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-18T16:48:24.627 INFO:teuthology.orchestra.console.smithi181:Power on 2024-02-18T16:48:24.627 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-18T16:48:24.636 DEBUG:teuthology.orchestra.console.smithi084:power on output: Chassis Power Control: Up/On 2024-02-18T16:48:24.636 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-18T16:48:24.649 DEBUG:teuthology.orchestra.console.smithi181:power on output: Chassis Power Control: Up/On 2024-02-18T16:48:24.649 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-18T16:48:24.657 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2024-02-18T16:48:24.670 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off 2024-02-18T16:48:28.663 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-18T16:48:28.671 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-18T16:48:28.771 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2024-02-18T16:48:28.779 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off 2024-02-18T16:48:28.873 INFO:teuthology.orchestra.console.smithi084:Power on completed 2024-02-18T16:48:28.973 INFO:teuthology.provision.fog.smithi084:Waiting for deploy to finish 2024-02-18T16:48:32.781 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-18T16:48:32.891 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on 2024-02-18T16:48:32.991 INFO:teuthology.orchestra.console.smithi181:Power on completed 2024-02-18T16:48:33.092 INFO:teuthology.provision.fog.smithi181:Waiting for deploy to finish 2024-02-18T16:51:34.077 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T16:51:37.148 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-02-18T16:51:43.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T16:51:45.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T16:51:46.204 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-02-18T16:51:48.128 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-02-18T16:51:52.210 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T16:51:54.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T16:51:55.264 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-02-18T16:51:57.212 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-02-18T16:52:01.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T16:52:03.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T16:52:04.352 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-02-18T16:52:06.268 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-02-18T16:52:10.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T16:52:12.271 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T16:52:13.436 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-02-18T16:52:15.324 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-02-18T16:52:19.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T16:52:21.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T16:52:22.492 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-02-18T16:52:24.380 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-02-18T16:52:28.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T16:52:30.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T16:52:31.548 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-02-18T16:52:33.436 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-02-18T16:52:37.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T16:52:39.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T16:53:09.053 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-02-18T16:53:15.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T16:53:15.060 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-02-18T16:53:21.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T16:53:21.069 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-02-18T16:53:27.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T16:53:27.077 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-02-18T16:53:33.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T16:53:33.083 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-02-18T16:53:39.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T16:53:39.442 WARNING:teuthology.provision.fog.smithi084:timed out 2024-02-18T16:53:39.475 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-18T16:53:39.475 DEBUG:teuthology.orchestra.run.smithi181:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-18T16:53:39.931 INFO:teuthology.provision.fog.smithi181:Node is ready 2024-02-18T16:53:39.932 DEBUG:teuthology.orchestra.run.smithi181:> hostname 2024-02-18T16:53:39.979 INFO:teuthology.orchestra.run.smithi181.stdout:smithi181.front.sepia.ceph.com 2024-02-18T16:53:39.980 DEBUG:teuthology.orchestra.run.smithi181:> grep smithi181.front.sepia.ceph.com /etc/hosts 2024-02-18T16:53:40.027 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.15.181 smithi181.front.sepia.ceph.com smithi181 2024-02-18T16:53:40.028 DEBUG:teuthology.orchestra.run.smithi181:> sudo hostname smithi181 2024-02-18T16:53:40.147 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/smithi181.front.sepia.ceph.com/smithi181/g' /etc/hosts 2024-02-18T16:53:40.160 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/172.21.15.181/172.21.15.181/g' /etc/hosts 2024-02-18T16:53:40.215 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/smithi181.front.sepia.ceph.com/smithi181/g' /etc/hostname 2024-02-18T16:53:40.271 DEBUG:teuthology.orchestra.run.smithi181:> sudo hostname smithi181 2024-02-18T16:53:40.327 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release 2024-02-18T16:53:40.380 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-02-18T16:53:40.380 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="Ubuntu" 2024-02-18T16:53:40.380 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="22.04" 2024-02-18T16:53:40.380 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-02-18T16:53:40.380 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_CODENAME=jammy 2024-02-18T16:53:40.380 INFO:teuthology.orchestra.run.smithi181.stdout:ID=ubuntu 2024-02-18T16:53:40.380 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE=debian 2024-02-18T16:53:40.380 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-18T16:53:40.380 INFO:teuthology.orchestra.run.smithi181.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-18T16:53:40.381 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-18T16:53:40.381 INFO:teuthology.orchestra.run.smithi181.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-18T16:53:40.381 INFO:teuthology.orchestra.run.smithi181.stdout:UBUNTU_CODENAME=jammy 2024-02-18T16:53:40.381 INFO:teuthology.provision.fog.smithi181:Deploy complete! 2024-02-18T16:53:40.383 DEBUG:teuthology.parallel:result is None 2024-02-18T16:53:45.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T16:53:45.656 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-18T16:53:45.656 DEBUG:teuthology.orchestra.run.smithi084:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-18T16:53:46.106 INFO:teuthology.provision.fog.smithi084:Node is ready 2024-02-18T16:53:46.106 DEBUG:teuthology.orchestra.run.smithi084:> hostname 2024-02-18T16:53:46.152 INFO:teuthology.orchestra.run.smithi084.stdout:smithi084.front.sepia.ceph.com 2024-02-18T16:53:46.153 DEBUG:teuthology.orchestra.run.smithi084:> grep smithi084.front.sepia.ceph.com /etc/hosts 2024-02-18T16:53:46.200 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84 smithi084.front.sepia.ceph.com smithi084 2024-02-18T16:53:46.200 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname smithi084 2024-02-18T16:53:46.340 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/smithi084.front.sepia.ceph.com/smithi084/g' /etc/hosts 2024-02-18T16:53:46.354 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/172.21.15.84/172.21.15.84/g' /etc/hosts 2024-02-18T16:53:46.412 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/smithi084.front.sepia.ceph.com/smithi084/g' /etc/hostname 2024-02-18T16:53:46.472 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname smithi084 2024-02-18T16:53:46.531 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2024-02-18T16:53:46.576 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-02-18T16:53:46.576 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="Ubuntu" 2024-02-18T16:53:46.576 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="22.04" 2024-02-18T16:53:46.577 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-02-18T16:53:46.577 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_CODENAME=jammy 2024-02-18T16:53:46.577 INFO:teuthology.orchestra.run.smithi084.stdout:ID=ubuntu 2024-02-18T16:53:46.577 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE=debian 2024-02-18T16:53:46.577 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-18T16:53:46.577 INFO:teuthology.orchestra.run.smithi084.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-18T16:53:46.577 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-18T16:53:46.577 INFO:teuthology.orchestra.run.smithi084.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-18T16:53:46.577 INFO:teuthology.orchestra.run.smithi084.stdout:UBUNTU_CODENAME=jammy 2024-02-18T16:53:46.577 INFO:teuthology.provision.fog.smithi084:Deploy complete! 2024-02-18T16:53:46.578 DEBUG:teuthology.parallel:result is None 2024-02-18T16:53:46.784 INFO:teuthology.lock.ops:Checking smithi084.front.sepia.ceph.com 2024-02-18T16:53:46.784 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-18T16:53:46.811 INFO:teuthology.lock.ops:Checking smithi181.front.sepia.ceph.com 2024-02-18T16:53:46.811 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-18T16:53:46.837 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: set os type and version on server 2024-02-18T16:53:46.837 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-02-18T16:53:46.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T16:53:46.919 DEBUG:teuthology.orchestra.run.smithi084:> true 2024-02-18T16:53:47.027 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-02-18T16:53:47.028 DEBUG:teuthology.orchestra.run.smithi084:> uname -m 2024-02-18T16:53:47.080 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64 2024-02-18T16:53:47.080 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2024-02-18T16:53:47.127 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-02-18T16:53:47.127 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="Ubuntu" 2024-02-18T16:53:47.127 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="22.04" 2024-02-18T16:53:47.128 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-02-18T16:53:47.128 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_CODENAME=jammy 2024-02-18T16:53:47.128 INFO:teuthology.orchestra.run.smithi084.stdout:ID=ubuntu 2024-02-18T16:53:47.128 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE=debian 2024-02-18T16:53:47.128 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-18T16:53:47.128 INFO:teuthology.orchestra.run.smithi084.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-18T16:53:47.128 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-18T16:53:47.128 INFO:teuthology.orchestra.run.smithi084.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-18T16:53:47.128 INFO:teuthology.orchestra.run.smithi084.stdout:UBUNTU_CODENAME=jammy 2024-02-18T16:53:47.129 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2024-02-18T16:53:47.153 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: set os type and version on server 2024-02-18T16:53:47.153 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-02-18T16:53:47.153 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T16:53:47.236 DEBUG:teuthology.orchestra.run.smithi181:> true 2024-02-18T16:53:47.336 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-02-18T16:53:47.336 DEBUG:teuthology.orchestra.run.smithi181:> uname -m 2024-02-18T16:53:47.382 INFO:teuthology.orchestra.run.smithi181.stdout:x86_64 2024-02-18T16:53:47.383 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release 2024-02-18T16:53:47.431 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-02-18T16:53:47.431 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="Ubuntu" 2024-02-18T16:53:47.431 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="22.04" 2024-02-18T16:53:47.431 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-02-18T16:53:47.431 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_CODENAME=jammy 2024-02-18T16:53:47.431 INFO:teuthology.orchestra.run.smithi181.stdout:ID=ubuntu 2024-02-18T16:53:47.432 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE=debian 2024-02-18T16:53:47.432 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-18T16:53:47.432 INFO:teuthology.orchestra.run.smithi181.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-18T16:53:47.432 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-18T16:53:47.432 INFO:teuthology.orchestra.run.smithi181.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-18T16:53:47.432 INFO:teuthology.orchestra.run.smithi181.stdout:UBUNTU_CODENAME=jammy 2024-02-18T16:53:47.432 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2024-02-18T16:53:47.453 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T16:53:47.542 INFO:teuthology.dispatcher.supervisor:Running job 7562822 2024-02-18T16:53:47.542 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_cbodley@teuthology --archive /home/teuthworker/archive/cbodley-2024-02-16_18:58:19-rgw-wip-cbodley-testing-distro-default-smithi/7562822 --name cbodley-2024-02-16_18:58:19-rgw-wip-cbodley-testing-distro-default-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/three-zones supported-random-distro$/{ubuntu_latest} tasks/test_multi} -- /home/teuthworker/archive/cbodley-2024-02-16_18:58:19-rgw-wip-cbodley-testing-distro-default-smithi/7562822/orig.config.yaml 2024-02-18T16:53:47.545 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/cbodley-2024-02-16_18:58:19-rgw-wip-cbodley-testing-distro-default-smithi/7562822 2024-02-18T16:53:47.545 INFO:teuthology.dispatcher.supervisor:Job PID: 3828568 2024-02-18T16:53:47.546 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-18T16:55:47.645 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T16:57:47.817 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T16:59:47.986 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T17:01:48.161 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T17:03:48.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T17:05:48.509 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T17:07:48.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T17:09:48.846 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T17:11:49.018 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T17:13:49.182 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T17:15:49.349 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T17:17:49.517 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T17:19:49.689 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T17:21:49.856 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T17:23:50.028 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T17:25:50.190 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T17:27:50.362 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T17:29:50.532 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T17:31:50.698 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T17:33:50.868 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T17:35:51.040 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T17:37:51.209 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T17:39:51.374 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T17:41:51.541 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T17:43:51.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T17:45:51.866 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T17:47:52.045 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T17:49:52.216 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T17:51:52.385 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T17:53:52.561 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T17:55:52.724 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T17:57:52.900 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T17:59:53.072 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T18:01:53.244 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T18:03:53.413 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T18:05:53.585 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T18:07:53.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T18:09:53.977 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T18:11:54.158 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T18:13:54.340 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T18:15:54.520 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T18:17:54.709 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T18:19:54.884 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T18:21:55.072 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T18:23:55.224 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T18:25:55.392 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T18:27:55.557 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T18:29:55.721 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T18:31:55.893 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T18:33:56.046 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T18:35:56.217 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T18:37:56.369 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T18:39:56.532 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T18:41:56.703 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T18:43:56.870 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T18:45:57.025 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T18:47:57.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T18:49:57.361 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T18:51:57.529 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T18:53:57.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T18:55:57.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T18:57:58.012 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T18:59:58.180 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T19:01:58.350 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T19:03:58.518 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T19:05:58.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T19:07:58.863 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T19:09:59.029 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T19:11:59.194 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T19:13:59.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T19:15:59.529 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T19:17:59.692 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T19:19:59.861 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T19:22:00.029 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T19:24:00.205 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T19:26:00.374 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T19:28:00.533 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T19:30:00.700 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T19:32:00.865 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T19:34:01.024 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T19:36:01.180 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T19:38:01.349 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T19:40:01.516 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T19:42:01.680 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T19:44:01.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T19:46:02.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T19:48:02.172 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T19:50:02.340 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T19:52:02.512 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T19:54:02.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T19:56:02.844 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T19:58:03.024 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T20:00:03.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T20:00:03.276 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1