2024-01-18T08:59:43.163 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-18T08:59:43.164 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T08:59:43.314 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4f81d72c10>, signals=[15]) 2024-01-18T08:59:43.315 INFO:teuthology.lock.ops:Start node 'smithi005.front.sepia.ceph.com' reimaging 2024-01-18T08:59:43.315 INFO:teuthology.lock.ops:Updating [smithi005.front.sepia.ceph.com]: reset os type and version on server 2024-01-18T08:59:43.316 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2024-01-18T08:59:43.333 INFO:teuthology.lock.ops:Start node 'smithi177.front.sepia.ceph.com' reimaging 2024-01-18T08:59:43.333 INFO:teuthology.lock.ops:Updating [smithi177.front.sepia.ceph.com]: reset os type and version on server 2024-01-18T08:59:43.333 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server 2024-01-18T08:59:43.450 DEBUG:teuthology.provision.fog.smithi005:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-01-18T08:59:43.465 DEBUG:teuthology.provision.fog.smithi177:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-01-18T08:59:43.496 INFO:teuthology.provision.fog.smithi005:Scheduling deploy of ubuntu 22.04 2024-01-18T08:59:43.509 INFO:teuthology.provision.fog.smithi177:Scheduling deploy of ubuntu 22.04 2024-01-18T08:59:43.758 INFO:teuthology.orchestra.console.smithi005:Power off 2024-01-18T08:59:43.758 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-18T08:59:43.770 INFO:teuthology.orchestra.console.smithi177:Power off 2024-01-18T08:59:43.771 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-18T08:59:43.779 DEBUG:teuthology.orchestra.console.smithi005:power off output: Chassis Power Control: Down/Off 2024-01-18T08:59:43.780 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T08:59:43.792 DEBUG:teuthology.orchestra.console.smithi177:power off output: Chassis Power Control: Down/Off 2024-01-18T08:59:43.792 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T08:59:43.799 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is off 2024-01-18T08:59:43.810 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off 2024-01-18T08:59:43.900 INFO:teuthology.orchestra.console.smithi005:Power off completed 2024-01-18T08:59:43.911 INFO:teuthology.orchestra.console.smithi177:Power off completed 2024-01-18T08:59:44.001 INFO:teuthology.orchestra.console.smithi005:Power on 2024-01-18T08:59:44.001 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-18T08:59:44.012 INFO:teuthology.orchestra.console.smithi177:Power on 2024-01-18T08:59:44.013 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-18T08:59:44.022 DEBUG:teuthology.orchestra.console.smithi005:power on output: Chassis Power Control: Up/On 2024-01-18T08:59:44.022 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T08:59:44.032 DEBUG:teuthology.orchestra.console.smithi177:power on output: Chassis Power Control: Up/On 2024-01-18T08:59:44.033 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T08:59:44.042 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is off 2024-01-18T08:59:44.053 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off 2024-01-18T08:59:48.047 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T08:59:48.054 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T08:59:48.156 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is off 2024-01-18T08:59:48.163 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off 2024-01-18T08:59:52.161 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T08:59:52.168 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T08:59:52.270 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on 2024-01-18T08:59:52.275 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on 2024-01-18T08:59:52.371 INFO:teuthology.orchestra.console.smithi005:Power on completed 2024-01-18T08:59:52.376 INFO:teuthology.orchestra.console.smithi177:Power on completed 2024-01-18T08:59:52.472 INFO:teuthology.provision.fog.smithi005:Waiting for deploy to finish 2024-01-18T08:59:52.476 INFO:teuthology.provision.fog.smithi177:Waiting for deploy to finish 2024-01-18T09:02:53.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T09:03:08.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T09:03:11.932 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2024-01-18T09:03:17.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T09:03:21.020 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2024-01-18T09:03:27.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T09:03:27.040 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2024-01-18T09:03:30.108 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2024-01-18T09:03:33.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T09:03:36.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T09:03:36.124 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2024-01-18T09:03:39.164 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2024-01-18T09:03:42.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T09:03:45.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T09:03:45.180 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2024-01-18T09:03:51.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T09:03:54.268 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2024-01-18T09:04:00.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T09:04:45.216 WARNING:teuthology.provision.fog.smithi005:timed out 2024-01-18T09:04:51.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T09:04:58.428 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2024-01-18T09:05:00.280 WARNING:teuthology.provision.fog.smithi177:timed out 2024-01-18T09:05:04.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T09:05:04.563 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-18T09:05:04.564 DEBUG:teuthology.orchestra.run.smithi005:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-18T09:05:04.964 INFO:teuthology.provision.fog.smithi005:Node is ready 2024-01-18T09:05:04.964 DEBUG:teuthology.orchestra.run.smithi005:> hostname 2024-01-18T09:05:05.012 INFO:teuthology.orchestra.run.smithi005.stdout:smithi005.front.sepia.ceph.com 2024-01-18T09:05:05.012 DEBUG:teuthology.orchestra.run.smithi005:> grep smithi005.front.sepia.ceph.com /etc/hosts 2024-01-18T09:05:05.060 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5 smithi005.front.sepia.ceph.com smithi005 2024-01-18T09:05:05.060 DEBUG:teuthology.orchestra.run.smithi005:> sudo hostname smithi005 2024-01-18T09:05:05.219 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i -e 's/smithi005.front.sepia.ceph.com/smithi005/g' /etc/hosts 2024-01-18T09:05:05.233 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i -e 's/172.21.15.5/172.21.15.5/g' /etc/hosts 2024-01-18T09:05:05.289 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i -e 's/smithi005.front.sepia.ceph.com/smithi005/g' /etc/hostname 2024-01-18T09:05:05.345 DEBUG:teuthology.orchestra.run.smithi005:> sudo hostname smithi005 2024-01-18T09:05:05.404 DEBUG:teuthology.orchestra.run.smithi005:> cat /etc/os-release 2024-01-18T09:05:05.452 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-01-18T09:05:05.452 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="Ubuntu" 2024-01-18T09:05:05.453 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="22.04" 2024-01-18T09:05:05.453 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-01-18T09:05:05.453 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_CODENAME=jammy 2024-01-18T09:05:05.453 INFO:teuthology.orchestra.run.smithi005.stdout:ID=ubuntu 2024-01-18T09:05:05.453 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE=debian 2024-01-18T09:05:05.453 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://www.ubuntu.com/" 2024-01-18T09:05:05.453 INFO:teuthology.orchestra.run.smithi005.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-01-18T09:05:05.453 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-01-18T09:05:05.453 INFO:teuthology.orchestra.run.smithi005.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-01-18T09:05:05.453 INFO:teuthology.orchestra.run.smithi005.stdout:UBUNTU_CODENAME=jammy 2024-01-18T09:05:05.454 INFO:teuthology.provision.fog.smithi005:Deploy complete! 2024-01-18T09:05:05.455 DEBUG:teuthology.parallel:result is None 2024-01-18T09:05:06.281 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T09:05:06.424 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-18T09:05:06.424 DEBUG:teuthology.orchestra.run.smithi177:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-18T09:05:06.959 INFO:teuthology.provision.fog.smithi177:Node is ready 2024-01-18T09:05:06.959 DEBUG:teuthology.orchestra.run.smithi177:> hostname 2024-01-18T09:05:07.006 INFO:teuthology.orchestra.run.smithi177.stdout:smithi177.front.sepia.ceph.com 2024-01-18T09:05:07.006 DEBUG:teuthology.orchestra.run.smithi177:> grep smithi177.front.sepia.ceph.com /etc/hosts 2024-01-18T09:05:07.054 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.15.177 smithi177.front.sepia.ceph.com smithi177 2024-01-18T09:05:07.055 DEBUG:teuthology.orchestra.run.smithi177:> sudo hostname smithi177 2024-01-18T09:05:07.212 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/smithi177.front.sepia.ceph.com/smithi177/g' /etc/hosts 2024-01-18T09:05:07.225 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/172.21.15.177/172.21.15.177/g' /etc/hosts 2024-01-18T09:05:07.282 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/smithi177.front.sepia.ceph.com/smithi177/g' /etc/hostname 2024-01-18T09:05:07.338 DEBUG:teuthology.orchestra.run.smithi177:> sudo hostname smithi177 2024-01-18T09:05:07.393 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release 2024-01-18T09:05:07.438 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-01-18T09:05:07.438 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="Ubuntu" 2024-01-18T09:05:07.438 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="22.04" 2024-01-18T09:05:07.438 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-01-18T09:05:07.438 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_CODENAME=jammy 2024-01-18T09:05:07.438 INFO:teuthology.orchestra.run.smithi177.stdout:ID=ubuntu 2024-01-18T09:05:07.438 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE=debian 2024-01-18T09:05:07.439 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://www.ubuntu.com/" 2024-01-18T09:05:07.439 INFO:teuthology.orchestra.run.smithi177.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-01-18T09:05:07.439 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-01-18T09:05:07.439 INFO:teuthology.orchestra.run.smithi177.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-01-18T09:05:07.439 INFO:teuthology.orchestra.run.smithi177.stdout:UBUNTU_CODENAME=jammy 2024-01-18T09:05:07.439 INFO:teuthology.provision.fog.smithi177:Deploy complete! 2024-01-18T09:05:07.439 DEBUG:teuthology.parallel:result is None 2024-01-18T09:05:07.658 INFO:teuthology.lock.ops:Checking smithi005.front.sepia.ceph.com 2024-01-18T09:05:07.658 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-18T09:05:07.685 INFO:teuthology.lock.ops:Checking smithi177.front.sepia.ceph.com 2024-01-18T09:05:07.685 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-18T09:05:07.711 INFO:teuthology.lock.ops:Updating [smithi005.front.sepia.ceph.com]: set os type and version on server 2024-01-18T09:05:07.711 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-01-18T09:05:07.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T09:05:07.789 DEBUG:teuthology.orchestra.run.smithi005:> true 2024-01-18T09:05:07.896 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-01-18T09:05:07.896 DEBUG:teuthology.orchestra.run.smithi005:> uname -m 2024-01-18T09:05:07.944 INFO:teuthology.orchestra.run.smithi005.stdout:x86_64 2024-01-18T09:05:07.944 DEBUG:teuthology.orchestra.run.smithi005:> cat /etc/os-release 2024-01-18T09:05:07.991 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-01-18T09:05:07.992 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="Ubuntu" 2024-01-18T09:05:07.992 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="22.04" 2024-01-18T09:05:07.992 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-01-18T09:05:07.992 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_CODENAME=jammy 2024-01-18T09:05:07.992 INFO:teuthology.orchestra.run.smithi005.stdout:ID=ubuntu 2024-01-18T09:05:07.992 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE=debian 2024-01-18T09:05:07.992 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://www.ubuntu.com/" 2024-01-18T09:05:07.992 INFO:teuthology.orchestra.run.smithi005.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-01-18T09:05:07.992 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-01-18T09:05:07.992 INFO:teuthology.orchestra.run.smithi005.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-01-18T09:05:07.992 INFO:teuthology.orchestra.run.smithi005.stdout:UBUNTU_CODENAME=jammy 2024-01-18T09:05:07.993 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2024-01-18T09:05:08.018 INFO:teuthology.lock.ops:Updating [smithi177.front.sepia.ceph.com]: set os type and version on server 2024-01-18T09:05:08.018 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-01-18T09:05:08.019 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T09:05:08.098 DEBUG:teuthology.orchestra.run.smithi177:> true 2024-01-18T09:05:08.196 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-01-18T09:05:08.197 DEBUG:teuthology.orchestra.run.smithi177:> uname -m 2024-01-18T09:05:08.246 INFO:teuthology.orchestra.run.smithi177.stdout:x86_64 2024-01-18T09:05:08.246 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release 2024-01-18T09:05:08.294 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-01-18T09:05:08.294 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="Ubuntu" 2024-01-18T09:05:08.294 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="22.04" 2024-01-18T09:05:08.295 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-01-18T09:05:08.295 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_CODENAME=jammy 2024-01-18T09:05:08.295 INFO:teuthology.orchestra.run.smithi177.stdout:ID=ubuntu 2024-01-18T09:05:08.295 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE=debian 2024-01-18T09:05:08.295 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://www.ubuntu.com/" 2024-01-18T09:05:08.295 INFO:teuthology.orchestra.run.smithi177.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-01-18T09:05:08.295 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-01-18T09:05:08.295 INFO:teuthology.orchestra.run.smithi177.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-01-18T09:05:08.295 INFO:teuthology.orchestra.run.smithi177.stdout:UBUNTU_CODENAME=jammy 2024-01-18T09:05:08.295 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server 2024-01-18T09:05:08.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T09:05:08.406 INFO:teuthology.dispatcher.supervisor:Running job 7519804 2024-01-18T09:05:08.406 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_cbodley@teuthology --archive /home/teuthworker/archive/cbodley-2024-01-18_00:01:30-rgw-wip-cbodley-testing-distro-default-smithi/7519804 --name cbodley-2024-01-18_00:01:30-rgw-wip-cbodley-testing-distro-default-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/three-zones supported-random-distro$/{ubuntu_latest} tasks/test_multi} -- /home/teuthworker/archive/cbodley-2024-01-18_00:01:30-rgw-wip-cbodley-testing-distro-default-smithi/7519804/orig.config.yaml 2024-01-18T09:05:08.409 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/cbodley-2024-01-18_00:01:30-rgw-wip-cbodley-testing-distro-default-smithi/7519804 2024-01-18T09:05:08.409 INFO:teuthology.dispatcher.supervisor:Job PID: 274266 2024-01-18T09:05:08.410 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-18T09:07:08.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T09:09:08.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T09:11:08.936 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T09:13:09.188 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T09:15:09.358 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T09:17:09.524 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T09:19:09.684 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T09:21:09.860 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T09:23:10.032 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T09:25:10.204 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T09:27:10.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T09:29:10.569 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T09:31:10.704 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T09:33:10.876 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T09:35:11.041 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T09:37:11.208 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T09:39:11.380 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T09:41:11.548 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T09:43:11.722 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T09:45:11.888 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T09:47:12.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T09:49:12.216 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T09:51:12.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T09:53:12.500 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T09:55:12.664 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T09:57:12.819 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T09:59:13.162 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T10:01:13.329 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T10:03:13.406 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T10:05:13.564 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T10:07:13.726 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T10:09:13.902 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T10:11:14.068 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T10:13:14.240 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T10:15:14.404 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T10:17:14.568 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T10:19:14.732 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T10:21:14.894 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T10:23:15.056 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T10:25:15.224 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T10:27:15.386 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T10:29:15.546 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T10:31:15.708 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T10:33:15.854 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T10:35:15.977 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T10:37:16.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T10:39:16.312 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T10:41:16.488 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T10:43:16.660 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T10:45:16.829 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T10:47:16.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T10:49:17.119 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T10:51:17.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T10:53:17.433 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T10:55:17.600 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T10:57:17.763 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T10:59:17.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:01:18.112 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:03:18.276 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:05:18.444 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:07:18.608 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:09:18.805 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:11:18.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:13:19.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:15:19.252 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:17:19.416 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:19:19.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:21:19.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:23:19.824 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:25:19.989 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:27:20.062 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:29:20.168 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:31:20.318 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:33:20.481 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:35:20.648 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:37:20.804 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:39:20.968 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:41:21.128 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:43:21.266 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:45:21.405 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:47:21.568 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:49:21.740 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:51:21.828 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:53:22.000 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:55:22.138 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:57:22.307 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:59:22.444 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T11:59:22.518 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-01-18T11:59:22.727 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2024-01-18T11:59:22.727 INFO:teuthology.nuke:Checking targets against current locks 2024-01-18T11:59:22.782 DEBUG:teuthology.nuke:shortname: smithi005 2024-01-18T11:59:22.782 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-18T11:59:22.802 DEBUG:teuthology.nuke:shortname: smithi177 2024-01-18T11:59:22.803 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-18T11:59:22.806 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi005.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-01-18_00:01:30-rgw-wip-cbodley-testing-distro-default-smithi/7519804', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-18 08:59:42.112904', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEJcKiKHi1Q1wmF5a1zNTcyg39hlnR1AtDNzGU929fgbDsMbVSI3erjwzSGdobet8GWGvla/Gs6hDQ0/O2HwtZ4='} 2024-01-18T11:59:22.827 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi177.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-01-18_00:01:30-rgw-wip-cbodley-testing-distro-default-smithi/7519804', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-18 08:59:42.110934', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB8aVWdcgZOF83Vn0J8ZdfLzgsvt+OU0oqcPmD1mw6gX5R/B1ZuJq7OEiZBnFOhSU5SwS1QEtteshH5IQsMS6JU='} 2024-01-18T11:59:22.861 INFO:teuthology.orchestra.console.smithi005:Power off 2024-01-18T11:59:22.861 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-18T11:59:22.883 DEBUG:teuthology.orchestra.console.smithi005:power off output: Chassis Power Control: Down/Off 2024-01-18T11:59:22.884 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T11:59:22.896 INFO:teuthology.orchestra.console.smithi177:Power off 2024-01-18T11:59:22.896 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-18T11:59:22.909 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is off 2024-01-18T11:59:22.918 DEBUG:teuthology.orchestra.console.smithi177:power off output: Chassis Power Control: Down/Off 2024-01-18T11:59:22.918 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T11:59:22.940 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off 2024-01-18T11:59:23.011 INFO:teuthology.orchestra.console.smithi005:Power off completed 2024-01-18T11:59:23.041 INFO:teuthology.orchestra.console.smithi177:Power off completed 2024-01-18T11:59:23.156 INFO:teuthology.lock.ops:unlocked: smithi005.front.sepia.ceph.com 2024-01-18T11:59:23.182 INFO:teuthology.lock.ops:unlocked: smithi177.front.sepia.ceph.com