2024-01-19T16:24:56.758 INFO:root:teuthology version: 0.0.1.dev249+gcd45576
2024-01-19T16:24:56.759 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T16:24:56.898 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f373ad36f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f373bc9dc10>, signals=[15])
2024-01-19T16:24:56.898 INFO:teuthology.lock.ops:Start node 'smithi143.front.sepia.ceph.com' reimaging
2024-01-19T16:24:56.898 INFO:teuthology.lock.ops:Updating [smithi143.front.sepia.ceph.com]: reset os type and version on server
2024-01-19T16:24:56.898 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server
2024-01-19T16:24:56.922 INFO:teuthology.lock.ops:Start node 'smithi181.front.sepia.ceph.com' reimaging
2024-01-19T16:24:56.922 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: reset os type and version on server
2024-01-19T16:24:56.922 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server
2024-01-19T16:24:57.038 DEBUG:teuthology.provision.fog.smithi143:Requesting image smithi_ubuntu_22.04 (ID 6)
2024-01-19T16:24:57.061 DEBUG:teuthology.provision.fog.smithi181:Requesting image smithi_ubuntu_22.04 (ID 6)
2024-01-19T16:24:57.080 INFO:teuthology.provision.fog.smithi143:Scheduling deploy of ubuntu 22.04
2024-01-19T16:24:57.111 INFO:teuthology.provision.fog.smithi181:Scheduling deploy of ubuntu 22.04
2024-01-19T16:24:57.409 INFO:teuthology.orchestra.console.smithi143:Power off
2024-01-19T16:24:57.409 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-19T16:24:57.423 INFO:teuthology.orchestra.console.smithi181:Power off
2024-01-19T16:24:57.423 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-19T16:24:57.435 DEBUG:teuthology.orchestra.console.smithi143:power off output: Chassis Power Control: Down/Off
2024-01-19T16:24:57.435 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-19T16:24:57.445 DEBUG:teuthology.orchestra.console.smithi181:power off output: Chassis Power Control: Down/Off
2024-01-19T16:24:57.445 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-19T16:24:57.458 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on
2024-01-19T16:24:57.465 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on
2024-01-19T16:25:01.463 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-19T16:25:01.471 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-19T16:25:01.573 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on
2024-01-19T16:25:01.579 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on
2024-01-19T16:25:05.576 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-19T16:25:05.583 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-19T16:25:05.685 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on
2024-01-19T16:25:05.690 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on
2024-01-19T16:25:09.690 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-19T16:25:09.697 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-19T16:25:09.800 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off
2024-01-19T16:25:09.806 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off
2024-01-19T16:25:09.901 INFO:teuthology.orchestra.console.smithi143:Power off completed
2024-01-19T16:25:09.907 INFO:teuthology.orchestra.console.smithi181:Power off completed
2024-01-19T16:25:10.002 INFO:teuthology.orchestra.console.smithi143:Power on
2024-01-19T16:25:10.003 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-19T16:25:10.010 INFO:teuthology.orchestra.console.smithi181:Power on
2024-01-19T16:25:10.010 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-19T16:25:10.024 DEBUG:teuthology.orchestra.console.smithi143:power on output: Chassis Power Control: Up/On
2024-01-19T16:25:10.024 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-19T16:25:10.032 DEBUG:teuthology.orchestra.console.smithi181:power on output: Chassis Power Control: Up/On
2024-01-19T16:25:10.032 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-19T16:25:10.044 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off
2024-01-19T16:25:10.054 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off
2024-01-19T16:25:14.048 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-19T16:25:14.055 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-19T16:25:14.157 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on
2024-01-19T16:25:14.162 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off
2024-01-19T16:25:14.259 INFO:teuthology.orchestra.console.smithi143:Power on completed
2024-01-19T16:25:14.359 INFO:teuthology.provision.fog.smithi143:Waiting for deploy to finish
2024-01-19T16:25:18.165 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-19T16:25:18.276 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on
2024-01-19T16:25:18.377 INFO:teuthology.orchestra.console.smithi181:Power on completed
2024-01-19T16:25:18.479 INFO:teuthology.provision.fog.smithi181:Waiting for deploy to finish
2024-01-19T16:28:30.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-19T16:28:34.325 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-19T16:28:48.828 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143
2024-01-19T16:28:52.672 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181
2024-01-19T16:28:54.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-19T16:28:57.885 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143
2024-01-19T16:28:58.674 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-19T16:29:01.756 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181
2024-01-19T16:29:03.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-19T16:29:06.944 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143
2024-01-19T16:29:07.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-19T16:29:10.812 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181
2024-01-19T16:29:12.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-19T16:29:16.032 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143
2024-01-19T16:29:16.813 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-19T16:29:19.872 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181
2024-01-19T16:29:22.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-19T16:29:25.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-19T16:29:28.956 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181
2024-01-19T16:29:34.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-19T16:30:06.397 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181
2024-01-19T16:30:12.401 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-19T16:30:12.402 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181
2024-01-19T16:30:18.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-19T16:30:18.410 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181
2024-01-19T16:30:22.040 WARNING:teuthology.provision.fog.smithi143:timed out
2024-01-19T16:30:24.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-19T16:30:24.415 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181
2024-01-19T16:30:28.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-19T16:30:28.286 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-19T16:30:28.286 DEBUG:teuthology.orchestra.run.smithi143:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-19T16:30:28.739 INFO:teuthology.provision.fog.smithi143:Node is ready
2024-01-19T16:30:28.739 DEBUG:teuthology.orchestra.run.smithi143:> hostname
2024-01-19T16:30:28.786 INFO:teuthology.orchestra.run.smithi143.stdout:smithi143.front.sepia.ceph.com
2024-01-19T16:30:28.787 DEBUG:teuthology.orchestra.run.smithi143:> grep smithi143.front.sepia.ceph.com /etc/hosts
2024-01-19T16:30:28.835 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.15.143 smithi143.front.sepia.ceph.com smithi143
2024-01-19T16:30:28.835 DEBUG:teuthology.orchestra.run.smithi143:> sudo hostname smithi143
2024-01-19T16:30:28.954 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/smithi143.front.sepia.ceph.com/smithi143/g' /etc/hosts
2024-01-19T16:30:28.968 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/172.21.15.143/172.21.15.143/g' /etc/hosts
2024-01-19T16:30:29.022 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/smithi143.front.sepia.ceph.com/smithi143/g' /etc/hostname
2024-01-19T16:30:29.079 DEBUG:teuthology.orchestra.run.smithi143:> sudo hostname smithi143
2024-01-19T16:30:29.133 DEBUG:teuthology.orchestra.run.smithi143:> cat /etc/os-release
2024-01-19T16:30:29.178 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-19T16:30:29.178 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="Ubuntu"
2024-01-19T16:30:29.179 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="22.04"
2024-01-19T16:30:29.179 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-19T16:30:29.179 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_CODENAME=jammy
2024-01-19T16:30:29.179 INFO:teuthology.orchestra.run.smithi143.stdout:ID=ubuntu
2024-01-19T16:30:29.179 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE=debian
2024-01-19T16:30:29.179 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-19T16:30:29.179 INFO:teuthology.orchestra.run.smithi143.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-19T16:30:29.179 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-19T16:30:29.179 INFO:teuthology.orchestra.run.smithi143.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-19T16:30:29.179 INFO:teuthology.orchestra.run.smithi143.stdout:UBUNTU_CODENAME=jammy
2024-01-19T16:30:29.180 INFO:teuthology.provision.fog.smithi143:Deploy complete!
2024-01-19T16:30:29.181 DEBUG:teuthology.parallel:result is None
2024-01-19T16:30:30.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-19T16:30:30.661 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-19T16:30:30.662 DEBUG:teuthology.orchestra.run.smithi181:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-19T16:30:31.234 INFO:teuthology.provision.fog.smithi181:Node is ready
2024-01-19T16:30:31.234 DEBUG:teuthology.orchestra.run.smithi181:> hostname
2024-01-19T16:30:31.280 INFO:teuthology.orchestra.run.smithi181.stdout:smithi181.front.sepia.ceph.com
2024-01-19T16:30:31.280 DEBUG:teuthology.orchestra.run.smithi181:> grep smithi181.front.sepia.ceph.com /etc/hosts
2024-01-19T16:30:31.328 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.15.181 smithi181.front.sepia.ceph.com smithi181
2024-01-19T16:30:31.328 DEBUG:teuthology.orchestra.run.smithi181:> sudo hostname smithi181
2024-01-19T16:30:31.465 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/smithi181.front.sepia.ceph.com/smithi181/g' /etc/hosts
2024-01-19T16:30:31.479 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/172.21.15.181/172.21.15.181/g' /etc/hosts
2024-01-19T16:30:31.536 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/smithi181.front.sepia.ceph.com/smithi181/g' /etc/hostname
2024-01-19T16:30:31.590 DEBUG:teuthology.orchestra.run.smithi181:> sudo hostname smithi181
2024-01-19T16:30:31.646 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release
2024-01-19T16:30:31.691 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-19T16:30:31.691 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="Ubuntu"
2024-01-19T16:30:31.691 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="22.04"
2024-01-19T16:30:31.691 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-19T16:30:31.691 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_CODENAME=jammy
2024-01-19T16:30:31.691 INFO:teuthology.orchestra.run.smithi181.stdout:ID=ubuntu
2024-01-19T16:30:31.691 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE=debian
2024-01-19T16:30:31.691 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-19T16:30:31.691 INFO:teuthology.orchestra.run.smithi181.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-19T16:30:31.691 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-19T16:30:31.691 INFO:teuthology.orchestra.run.smithi181.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-19T16:30:31.692 INFO:teuthology.orchestra.run.smithi181.stdout:UBUNTU_CODENAME=jammy
2024-01-19T16:30:31.692 INFO:teuthology.provision.fog.smithi181:Deploy complete!
2024-01-19T16:30:31.692 DEBUG:teuthology.parallel:result is None
2024-01-19T16:30:31.943 INFO:teuthology.lock.ops:Checking smithi143.front.sepia.ceph.com
2024-01-19T16:30:31.943 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-19T16:30:31.973 INFO:teuthology.lock.ops:Checking smithi181.front.sepia.ceph.com
2024-01-19T16:30:31.973 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-19T16:30:31.990 INFO:teuthology.lock.ops:Updating [smithi143.front.sepia.ceph.com]: set os type and version on server
2024-01-19T16:30:31.991 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com'
2024-01-19T16:30:31.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-19T16:30:32.070 DEBUG:teuthology.orchestra.run.smithi143:> true
2024-01-19T16:30:32.180 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi143.front.sepia.ceph.com'
2024-01-19T16:30:32.180 DEBUG:teuthology.orchestra.run.smithi143:> uname -m
2024-01-19T16:30:32.226 INFO:teuthology.orchestra.run.smithi143.stdout:x86_64
2024-01-19T16:30:32.227 DEBUG:teuthology.orchestra.run.smithi143:> cat /etc/os-release
2024-01-19T16:30:32.274 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-19T16:30:32.274 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="Ubuntu"
2024-01-19T16:30:32.275 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="22.04"
2024-01-19T16:30:32.275 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-19T16:30:32.275 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_CODENAME=jammy
2024-01-19T16:30:32.275 INFO:teuthology.orchestra.run.smithi143.stdout:ID=ubuntu
2024-01-19T16:30:32.275 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE=debian
2024-01-19T16:30:32.275 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-19T16:30:32.275 INFO:teuthology.orchestra.run.smithi143.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-19T16:30:32.275 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-19T16:30:32.275 INFO:teuthology.orchestra.run.smithi143.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-19T16:30:32.275 INFO:teuthology.orchestra.run.smithi143.stdout:UBUNTU_CODENAME=jammy
2024-01-19T16:30:32.275 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server
2024-01-19T16:30:32.298 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: set os type and version on server
2024-01-19T16:30:32.298 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com'
2024-01-19T16:30:32.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-19T16:30:32.378 DEBUG:teuthology.orchestra.run.smithi181:> true
2024-01-19T16:30:32.479 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com'
2024-01-19T16:30:32.480 DEBUG:teuthology.orchestra.run.smithi181:> uname -m
2024-01-19T16:30:32.531 INFO:teuthology.orchestra.run.smithi181.stdout:x86_64
2024-01-19T16:30:32.531 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release
2024-01-19T16:30:32.579 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-19T16:30:32.579 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="Ubuntu"
2024-01-19T16:30:32.579 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="22.04"
2024-01-19T16:30:32.579 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-19T16:30:32.579 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_CODENAME=jammy
2024-01-19T16:30:32.579 INFO:teuthology.orchestra.run.smithi181.stdout:ID=ubuntu
2024-01-19T16:30:32.579 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE=debian
2024-01-19T16:30:32.579 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-19T16:30:32.579 INFO:teuthology.orchestra.run.smithi181.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-19T16:30:32.580 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-19T16:30:32.580 INFO:teuthology.orchestra.run.smithi181.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-19T16:30:32.580 INFO:teuthology.orchestra.run.smithi181.stdout:UBUNTU_CODENAME=jammy
2024-01-19T16:30:32.580 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server
2024-01-19T16:30:32.598 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T16:30:32.685 INFO:teuthology.dispatcher.supervisor:Running job 7522091
2024-01-19T16:30:32.685 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_gsalomon@teuthology --archive /home/teuthworker/archive/gsalomon-2024-01-19_11:25:24-rgw-s3select_fixes_QE_bugs-distro-default-smithi/7522091 --name gsalomon-2024-01-19_11:25:24-rgw-s3select_fixes_QE_bugs-distro-default-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/three-zones supported-random-distro$/{ubuntu_latest} tasks/test_multi} -- /home/teuthworker/archive/gsalomon-2024-01-19_11:25:24-rgw-s3select_fixes_QE_bugs-distro-default-smithi/7522091/orig.config.yaml
2024-01-19T16:30:32.688 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/gsalomon-2024-01-19_11:25:24-rgw-s3select_fixes_QE_bugs-distro-default-smithi/7522091
2024-01-19T16:30:32.688 INFO:teuthology.dispatcher.supervisor:Job PID: 2821736
2024-01-19T16:30:32.688 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-01-19T16:32:32.788 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T16:34:32.948 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T16:36:33.110 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T16:38:33.262 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T16:40:33.452 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T16:42:33.620 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T16:44:33.740 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T16:46:33.900 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T16:48:34.066 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T16:50:34.169 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T16:52:34.353 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T16:54:34.524 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T16:56:34.696 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T16:58:34.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T17:00:34.994 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T17:02:35.160 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T17:04:35.289 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T17:06:35.457 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T17:08:35.630 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T17:10:35.789 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T17:12:35.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T17:14:36.125 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T17:16:36.296 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T17:18:36.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T17:20:36.562 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T17:22:36.732 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T17:24:36.905 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T17:26:37.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T17:28:37.204 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T17:30:37.368 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T17:32:37.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T17:34:37.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T17:36:37.852 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T17:38:38.025 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T17:40:38.197 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T17:42:38.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T17:44:38.530 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T17:46:38.697 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T17:48:38.772 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T17:50:38.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T17:52:39.088 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T17:54:39.253 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T17:56:39.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T17:58:39.584 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T18:00:39.759 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T18:02:39.924 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T18:04:40.100 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T18:06:40.273 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T18:08:40.432 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T18:10:40.601 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T18:12:40.772 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T18:14:40.882 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T18:16:41.053 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T18:18:41.226 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T18:20:41.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T18:22:41.516 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T18:24:41.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T18:26:41.796 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T18:28:41.969 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T18:30:42.144 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T18:32:42.308 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T18:34:42.488 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T18:36:42.656 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T18:38:42.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T18:40:42.926 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T18:42:43.098 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T18:44:43.257 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T18:46:43.418 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T18:48:43.580 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T18:50:43.734 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T18:52:43.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T18:54:44.057 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T18:56:44.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T18:58:44.330 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T19:00:44.497 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T19:02:44.665 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T19:04:44.829 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T19:06:44.974 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T19:08:45.162 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T19:10:45.340 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-19T19:10:45.409 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-01-19T19:10:45.580 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2024-01-19T19:10:45.580 INFO:teuthology.nuke:Checking targets against current locks
2024-01-19T19:10:45.628 DEBUG:teuthology.nuke:shortname: smithi143
2024-01-19T19:10:45.629 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-19T19:10:45.651 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi143.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gsalomon-2024-01-19_11:25:24-rgw-s3select_fixes_QE_bugs-distro-default-smithi/7522091', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-19 16:24:55.767748', 'locked_by': 'scheduled_gsalomon@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOzzfTgpYjdPPkc0Q+EcfZMffEtAOPKMyu1W/fjrzJRfSrgYeEwuvtgvzna6Gu1iZXpt3gpsRZxbQT/dLHCKraU='}
2024-01-19T19:10:45.655 DEBUG:teuthology.nuke:shortname: smithi181
2024-01-19T19:10:45.655 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-19T19:10:45.679 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi181.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gsalomon-2024-01-19_11:25:24-rgw-s3select_fixes_QE_bugs-distro-default-smithi/7522091', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-19 16:24:55.769224', 'locked_by': 'scheduled_gsalomon@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBLHTQeZ6B7kY//4tBkDIZ/00Lu78LOWD0/Lb5D+9Febznl9bjOh2IxJlPmekKJZcAv+QZRoeTnwZ/uddBt+qzQ='}
2024-01-19T19:10:45.707 INFO:teuthology.orchestra.console.smithi143:Power off
2024-01-19T19:10:45.708 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-19T19:10:45.725 INFO:teuthology.orchestra.console.smithi181:Power off
2024-01-19T19:10:45.726 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-19T19:10:45.734 DEBUG:teuthology.orchestra.console.smithi143:power off output: Chassis Power Control: Down/Off
2024-01-19T19:10:45.735 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-19T19:10:45.749 DEBUG:teuthology.orchestra.console.smithi181:power off output: Chassis Power Control: Down/Off
2024-01-19T19:10:45.749 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-19T19:10:45.757 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off
2024-01-19T19:10:45.769 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off
2024-01-19T19:10:45.858 INFO:teuthology.orchestra.console.smithi143:Power off completed
2024-01-19T19:10:45.870 INFO:teuthology.orchestra.console.smithi181:Power off completed
2024-01-19T19:10:46.015 INFO:teuthology.lock.ops:unlocked: smithi143.front.sepia.ceph.com
2024-01-19T19:10:46.024 INFO:teuthology.lock.ops:unlocked: smithi181.front.sepia.ceph.com