2024-01-05T04:47:35.074 INFO:root:teuthology version: 0.0.1.dev228+g01dd171
2024-01-05T04:47:35.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T04:47:35.218 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f1b5b0fc580>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f1b5c21f940>, signals=[15])
2024-01-05T04:47:35.219 INFO:teuthology.lock.ops:Start node 'smithi131.front.sepia.ceph.com' reimaging
2024-01-05T04:47:35.219 INFO:teuthology.lock.ops:Updating [smithi131.front.sepia.ceph.com]: reset os type and version on server
2024-01-05T04:47:35.219 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server
2024-01-05T04:47:35.238 INFO:teuthology.lock.ops:Start node 'smithi179.front.sepia.ceph.com' reimaging
2024-01-05T04:47:35.238 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: reset os type and version on server
2024-01-05T04:47:35.239 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server
2024-01-05T04:47:35.363 DEBUG:teuthology.provision.fog.smithi131:Requesting image smithi_ubuntu_22.04 (ID 6)
2024-01-05T04:47:35.369 DEBUG:teuthology.provision.fog.smithi179:Requesting image smithi_ubuntu_22.04 (ID 6)
2024-01-05T04:47:35.421 INFO:teuthology.provision.fog.smithi131:Scheduling deploy of ubuntu 22.04
2024-01-05T04:47:35.434 INFO:teuthology.provision.fog.smithi179:Scheduling deploy of ubuntu 22.04
2024-01-05T04:47:35.664 INFO:teuthology.orchestra.console.smithi179:Power off
2024-01-05T04:47:35.664 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-05T04:47:35.679 INFO:teuthology.orchestra.console.smithi131:Power off
2024-01-05T04:47:35.679 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-05T04:47:35.688 DEBUG:teuthology.orchestra.console.smithi179:power off output: Chassis Power Control: Down/Off
2024-01-05T04:47:35.688 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-05T04:47:35.701 DEBUG:teuthology.orchestra.console.smithi131:power off output: Chassis Power Control: Down/Off
2024-01-05T04:47:35.701 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-05T04:47:35.712 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on
2024-01-05T04:47:35.729 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on
2024-01-05T04:47:39.717 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-05T04:47:39.730 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-05T04:47:39.827 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on
2024-01-05T04:47:39.838 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on
2024-01-05T04:47:43.832 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-05T04:47:43.839 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-05T04:47:43.941 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off
2024-01-05T04:47:43.947 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off
2024-01-05T04:47:44.042 INFO:teuthology.orchestra.console.smithi179:Power off completed
2024-01-05T04:47:44.048 INFO:teuthology.orchestra.console.smithi131:Power off completed
2024-01-05T04:47:44.144 INFO:teuthology.orchestra.console.smithi179:Power on
2024-01-05T04:47:44.144 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-05T04:47:44.151 INFO:teuthology.orchestra.console.smithi131:Power on
2024-01-05T04:47:44.151 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-05T04:47:44.165 DEBUG:teuthology.orchestra.console.smithi179:power on output: Chassis Power Control: Up/On
2024-01-05T04:47:44.166 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-05T04:47:44.173 DEBUG:teuthology.orchestra.console.smithi131:power on output: Chassis Power Control: Up/On
2024-01-05T04:47:44.174 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-05T04:47:44.187 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off
2024-01-05T04:47:44.196 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off
2024-01-05T04:47:48.192 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-05T04:47:48.199 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-05T04:47:48.301 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off
2024-01-05T04:47:48.307 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off
2024-01-05T04:47:52.304 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-05T04:47:52.310 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-05T04:47:52.412 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on
2024-01-05T04:47:52.418 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on
2024-01-05T04:47:52.513 INFO:teuthology.orchestra.console.smithi179:Power on completed
2024-01-05T04:47:52.519 INFO:teuthology.orchestra.console.smithi131:Power on completed
2024-01-05T04:47:52.614 INFO:teuthology.provision.fog.smithi179:Waiting for deploy to finish
2024-01-05T04:47:52.619 INFO:teuthology.provision.fog.smithi131:Waiting for deploy to finish
2024-01-05T04:51:09.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T04:51:09.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T04:51:12.124 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179
2024-01-05T04:51:12.124 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131
2024-01-05T04:51:18.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T04:51:18.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T04:51:21.180 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179
2024-01-05T04:51:21.180 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131
2024-01-05T04:51:27.186 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T04:51:27.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T04:51:30.236 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179
2024-01-05T04:51:30.272 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131
2024-01-05T04:51:36.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T04:51:36.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T04:51:39.324 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179
2024-01-05T04:51:39.324 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131
2024-01-05T04:51:45.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T04:51:45.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T04:51:48.412 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179
2024-01-05T04:51:48.412 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131
2024-01-05T04:51:54.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T04:51:54.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T04:51:57.472 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179
2024-01-05T04:52:03.476 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T04:52:35.009 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179
2024-01-05T04:52:41.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T04:52:41.015 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179
2024-01-05T04:52:47.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T04:52:47.022 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179
2024-01-05T04:52:53.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T04:52:53.030 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179
2024-01-05T04:52:54.420 WARNING:teuthology.provision.fog.smithi131:timed out
2024-01-05T04:52:59.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T04:52:59.038 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179
2024-01-05T04:53:00.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T04:53:00.680 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-05T04:53:00.681 DEBUG:teuthology.orchestra.run.smithi131:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-05T04:53:01.115 INFO:teuthology.provision.fog.smithi131:Node is ready
2024-01-05T04:53:01.115 DEBUG:teuthology.orchestra.run.smithi131:> hostname
2024-01-05T04:53:01.161 INFO:teuthology.orchestra.run.smithi131.stdout:smithi131.front.sepia.ceph.com
2024-01-05T04:53:01.161 DEBUG:teuthology.orchestra.run.smithi131:> grep smithi131.front.sepia.ceph.com /etc/hosts
2024-01-05T04:53:01.209 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.15.131 smithi131.front.sepia.ceph.com smithi131
2024-01-05T04:53:01.210 DEBUG:teuthology.orchestra.run.smithi131:> sudo hostname smithi131
2024-01-05T04:53:01.350 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i -e 's/smithi131.front.sepia.ceph.com/smithi131/g' /etc/hosts
2024-01-05T04:53:01.365 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i -e 's/172.21.15.131/172.21.15.131/g' /etc/hosts
2024-01-05T04:53:01.421 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i -e 's/smithi131.front.sepia.ceph.com/smithi131/g' /etc/hostname
2024-01-05T04:53:01.481 DEBUG:teuthology.orchestra.run.smithi131:> sudo hostname smithi131
2024-01-05T04:53:01.536 DEBUG:teuthology.orchestra.run.smithi131:> cat /etc/os-release
2024-01-05T04:53:01.581 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-05T04:53:01.581 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="Ubuntu"
2024-01-05T04:53:01.581 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="22.04"
2024-01-05T04:53:01.581 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-05T04:53:01.581 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_CODENAME=jammy
2024-01-05T04:53:01.581 INFO:teuthology.orchestra.run.smithi131.stdout:ID=ubuntu
2024-01-05T04:53:01.581 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE=debian
2024-01-05T04:53:01.581 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-05T04:53:01.581 INFO:teuthology.orchestra.run.smithi131.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-05T04:53:01.581 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-05T04:53:01.581 INFO:teuthology.orchestra.run.smithi131.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-05T04:53:01.581 INFO:teuthology.orchestra.run.smithi131.stdout:UBUNTU_CODENAME=jammy
2024-01-05T04:53:01.582 INFO:teuthology.provision.fog.smithi131:Deploy complete!
2024-01-05T04:53:01.583 DEBUG:teuthology.parallel:result is None
2024-01-05T04:53:05.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T04:53:05.330 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-05T04:53:05.330 DEBUG:teuthology.orchestra.run.smithi179:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-05T04:53:05.813 INFO:teuthology.provision.fog.smithi179:Node is ready
2024-01-05T04:53:05.813 DEBUG:teuthology.orchestra.run.smithi179:> hostname
2024-01-05T04:53:05.864 INFO:teuthology.orchestra.run.smithi179.stdout:smithi179.front.sepia.ceph.com
2024-01-05T04:53:05.867 DEBUG:teuthology.orchestra.run.smithi179:> grep smithi179.front.sepia.ceph.com /etc/hosts
2024-01-05T04:53:05.912 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.15.179 smithi179.front.sepia.ceph.com smithi179
2024-01-05T04:53:05.912 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname smithi179
2024-01-05T04:53:06.050 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/smithi179.front.sepia.ceph.com/smithi179/g' /etc/hosts
2024-01-05T04:53:06.063 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/172.21.15.179/172.21.15.179/g' /etc/hosts
2024-01-05T04:53:06.116 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/smithi179.front.sepia.ceph.com/smithi179/g' /etc/hostname
2024-01-05T04:53:06.175 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname smithi179
2024-01-05T04:53:06.235 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release
2024-01-05T04:53:06.280 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-05T04:53:06.280 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="Ubuntu"
2024-01-05T04:53:06.281 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="22.04"
2024-01-05T04:53:06.281 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-05T04:53:06.281 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_CODENAME=jammy
2024-01-05T04:53:06.281 INFO:teuthology.orchestra.run.smithi179.stdout:ID=ubuntu
2024-01-05T04:53:06.281 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE=debian
2024-01-05T04:53:06.281 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-05T04:53:06.281 INFO:teuthology.orchestra.run.smithi179.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-05T04:53:06.281 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-05T04:53:06.281 INFO:teuthology.orchestra.run.smithi179.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-05T04:53:06.281 INFO:teuthology.orchestra.run.smithi179.stdout:UBUNTU_CODENAME=jammy
2024-01-05T04:53:06.282 INFO:teuthology.provision.fog.smithi179:Deploy complete!
2024-01-05T04:53:06.282 DEBUG:teuthology.parallel:result is None
2024-01-05T04:53:06.462 INFO:teuthology.lock.ops:Checking smithi131.front.sepia.ceph.com
2024-01-05T04:53:06.463 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-05T04:53:06.491 INFO:teuthology.lock.ops:Checking smithi179.front.sepia.ceph.com
2024-01-05T04:53:06.491 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-05T04:53:06.509 INFO:teuthology.lock.ops:Updating [smithi131.front.sepia.ceph.com]: set os type and version on server
2024-01-05T04:53:06.509 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com'
2024-01-05T04:53:06.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T04:53:06.589 DEBUG:teuthology.orchestra.run.smithi131:> true
2024-01-05T04:53:06.687 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi131.front.sepia.ceph.com'
2024-01-05T04:53:06.687 DEBUG:teuthology.orchestra.run.smithi131:> uname -m
2024-01-05T04:53:06.732 INFO:teuthology.orchestra.run.smithi131.stdout:x86_64
2024-01-05T04:53:06.732 DEBUG:teuthology.orchestra.run.smithi131:> cat /etc/os-release
2024-01-05T04:53:06.781 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-05T04:53:06.781 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="Ubuntu"
2024-01-05T04:53:06.781 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="22.04"
2024-01-05T04:53:06.781 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-05T04:53:06.781 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_CODENAME=jammy
2024-01-05T04:53:06.782 INFO:teuthology.orchestra.run.smithi131.stdout:ID=ubuntu
2024-01-05T04:53:06.782 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE=debian
2024-01-05T04:53:06.782 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-05T04:53:06.782 INFO:teuthology.orchestra.run.smithi131.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-05T04:53:06.782 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-05T04:53:06.782 INFO:teuthology.orchestra.run.smithi131.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-05T04:53:06.782 INFO:teuthology.orchestra.run.smithi131.stdout:UBUNTU_CODENAME=jammy
2024-01-05T04:53:06.783 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server
2024-01-05T04:53:06.808 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: set os type and version on server
2024-01-05T04:53:06.808 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com'
2024-01-05T04:53:06.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T04:53:06.881 DEBUG:teuthology.orchestra.run.smithi179:> true
2024-01-05T04:53:06.984 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com'
2024-01-05T04:53:06.984 DEBUG:teuthology.orchestra.run.smithi179:> uname -m
2024-01-05T04:53:07.031 INFO:teuthology.orchestra.run.smithi179.stdout:x86_64
2024-01-05T04:53:07.031 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release
2024-01-05T04:53:07.080 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-05T04:53:07.080 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="Ubuntu"
2024-01-05T04:53:07.080 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="22.04"
2024-01-05T04:53:07.081 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-05T04:53:07.081 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_CODENAME=jammy
2024-01-05T04:53:07.081 INFO:teuthology.orchestra.run.smithi179.stdout:ID=ubuntu
2024-01-05T04:53:07.081 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE=debian
2024-01-05T04:53:07.081 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-05T04:53:07.081 INFO:teuthology.orchestra.run.smithi179.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-05T04:53:07.081 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-05T04:53:07.081 INFO:teuthology.orchestra.run.smithi179.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-05T04:53:07.081 INFO:teuthology.orchestra.run.smithi179.stdout:UBUNTU_CODENAME=jammy
2024-01-05T04:53:07.081 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server
2024-01-05T04:53:07.108 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T04:53:07.196 INFO:teuthology.dispatcher.supervisor:Running job 7507497
2024-01-05T04:53:07.196 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/virtualenv/bin/teuthology -v --owner scheduled_cbodley@teuthology --archive /home/teuthworker/archive/cbodley-2024-01-04_20:15:15-rgw-wip-cbodley-testing-distro-default-smithi/7507497 --name cbodley-2024-01-04_20:15:15-rgw-wip-cbodley-testing-distro-default-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/two-zonegroup supported-random-distro$/{ubuntu_latest} tasks/test_multi} -- /home/teuthworker/archive/cbodley-2024-01-04_20:15:15-rgw-wip-cbodley-testing-distro-default-smithi/7507497/orig.config.yaml
2024-01-05T04:53:07.199 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/cbodley-2024-01-04_20:15:15-rgw-wip-cbodley-testing-distro-default-smithi/7507497
2024-01-05T04:53:07.200 INFO:teuthology.dispatcher.supervisor:Job PID: 1317194
2024-01-05T04:53:07.200 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-01-05T04:55:07.301 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T04:57:07.477 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T04:59:07.644 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T05:01:07.808 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T05:03:07.976 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T05:05:08.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T05:07:08.325 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T05:09:08.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T05:11:08.661 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T05:13:08.830 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T05:15:08.996 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T05:17:09.160 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T05:19:09.328 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T05:21:09.497 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T05:23:09.693 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T05:25:09.861 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T05:27:10.034 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T05:29:10.208 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T05:31:10.384 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T05:33:10.561 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T05:35:10.728 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T05:37:11.192 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T05:39:11.405 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T05:41:11.561 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T05:43:11.720 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T05:45:11.889 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T05:47:12.052 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T05:49:12.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T05:51:12.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T05:53:12.569 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T05:55:12.737 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T05:57:12.900 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T05:59:13.068 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T06:01:13.236 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T06:03:13.404 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T06:05:13.571 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T06:07:13.734 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T06:09:13.989 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T06:11:14.156 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T06:13:14.329 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T06:15:14.505 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T06:17:14.677 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T06:19:14.849 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T06:21:14.968 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T06:23:15.140 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T06:25:15.309 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T06:27:15.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T06:29:15.661 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T06:31:15.828 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T06:33:15.996 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T06:35:16.165 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T06:37:16.329 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T06:39:16.501 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T06:41:16.670 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T06:43:16.846 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T06:45:17.020 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T06:47:17.200 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T06:49:17.369 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T06:51:17.536 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T06:53:17.706 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T06:55:17.877 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T06:57:18.042 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T06:59:18.221 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T07:01:18.397 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T07:03:18.565 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T07:05:18.749 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T07:07:18.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T07:09:19.080 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T07:11:19.254 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T07:13:19.424 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T07:15:19.589 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T07:17:19.756 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T07:19:19.933 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T07:21:20.106 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T07:23:20.348 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T07:25:20.516 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T07:27:20.692 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T07:29:20.883 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T07:31:21.052 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T07:33:21.221 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T07:35:21.384 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T07:37:21.561 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T07:39:21.728 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T07:41:21.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T07:43:22.076 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T07:45:22.252 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T07:47:22.424 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T07:49:22.605 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T07:51:22.784 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T07:53:22.952 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T07:55:23.117 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T07:57:23.284 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T07:59:23.448 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T08:01:23.608 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T08:03:23.768 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T08:05:23.936 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T08:07:24.096 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T08:09:24.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T08:11:24.425 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T08:11:24.487 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-01-05T08:11:24.682 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2024-01-05T08:11:24.682 INFO:teuthology.nuke:Checking targets against current locks
2024-01-05T08:11:24.727 DEBUG:teuthology.nuke:shortname: smithi131
2024-01-05T08:11:24.728 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-05T08:11:24.747 DEBUG:teuthology.nuke:shortname: smithi179
2024-01-05T08:11:24.748 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-05T08:11:24.754 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi131.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-01-04_20:15:15-rgw-wip-cbodley-testing-distro-default-smithi/7507497', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-05 04:47:34.241824', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIEyUNJUAQodi6t0XP5bgatq1tzFxnJutvbX2233dI40+lqn1FdyQZ0XxKvKNPfGPXJFqz2JwlspdXMwt0pwE2g='}
2024-01-05T08:11:24.766 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi179.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-01-04_20:15:15-rgw-wip-cbodley-testing-distro-default-smithi/7507497', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-05 04:47:34.239834', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMaM1v9uRHU9Ur+gpAL/Xs1/GMJtS0fNxXBADAVy4pkN9n6YssTwvVDzYzLaLe5BwZvWi6wGzg04Tj2fxMm+nUM='}
2024-01-05T08:11:24.807 INFO:teuthology.orchestra.console.smithi131:Power off
2024-01-05T08:11:24.808 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-05T08:11:24.823 INFO:teuthology.orchestra.console.smithi179:Power off
2024-01-05T08:11:24.824 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-05T08:11:24.835 DEBUG:teuthology.orchestra.console.smithi131:power off output: Chassis Power Control: Down/Off
2024-01-05T08:11:24.836 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-05T08:11:24.848 DEBUG:teuthology.orchestra.console.smithi179:power off output: Chassis Power Control: Down/Off
2024-01-05T08:11:24.848 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-05T08:11:24.858 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off
2024-01-05T08:11:24.872 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off
2024-01-05T08:11:24.959 INFO:teuthology.orchestra.console.smithi131:Power off completed
2024-01-05T08:11:24.973 INFO:teuthology.orchestra.console.smithi179:Power off completed
2024-01-05T08:11:25.102 INFO:teuthology.lock.ops:unlocked: smithi131.front.sepia.ceph.com
2024-01-05T08:11:25.120 INFO:teuthology.lock.ops:unlocked: smithi179.front.sepia.ceph.com