2024-01-16T09:40:25.321 INFO:root:teuthology version: 0.0.1.dev249+gcd45576
2024-01-16T09:40:25.322 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T09:40:25.460 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f8ed30a4f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f8ed4048c10>, signals=[15])
2024-01-16T09:40:25.460 INFO:teuthology.lock.ops:Start node 'smithi046.front.sepia.ceph.com' reimaging
2024-01-16T09:40:25.460 INFO:teuthology.lock.ops:Updating [smithi046.front.sepia.ceph.com]: reset os type and version on server
2024-01-16T09:40:25.460 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server
2024-01-16T09:40:25.477 INFO:teuthology.lock.ops:Start node 'smithi088.front.sepia.ceph.com' reimaging
2024-01-16T09:40:25.477 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: reset os type and version on server
2024-01-16T09:40:25.477 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server
2024-01-16T09:40:25.595 DEBUG:teuthology.provision.fog.smithi046:Requesting image smithi_ubuntu_22.04 (ID 6)
2024-01-16T09:40:25.609 DEBUG:teuthology.provision.fog.smithi088:Requesting image smithi_ubuntu_22.04 (ID 6)
2024-01-16T09:40:25.640 INFO:teuthology.provision.fog.smithi046:Scheduling deploy of ubuntu 22.04
2024-01-16T09:40:25.655 INFO:teuthology.provision.fog.smithi088:Scheduling deploy of ubuntu 22.04
2024-01-16T09:40:25.872 INFO:teuthology.orchestra.console.smithi088:Power off
2024-01-16T09:40:25.873 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-16T09:40:25.887 INFO:teuthology.orchestra.console.smithi046:Power off
2024-01-16T09:40:25.888 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-16T09:40:25.909 DEBUG:teuthology.orchestra.console.smithi088:power off output: Chassis Power Control: Down/Off
2024-01-16T09:40:25.909 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-16T09:40:25.918 DEBUG:teuthology.orchestra.console.smithi046:power off output: Chassis Power Control: Down/Off
2024-01-16T09:40:25.919 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-16T09:40:25.933 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on
2024-01-16T09:40:25.941 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off
2024-01-16T09:40:26.042 INFO:teuthology.orchestra.console.smithi046:Power off completed
2024-01-16T09:40:26.142 INFO:teuthology.orchestra.console.smithi046:Power on
2024-01-16T09:40:26.143 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-16T09:40:26.169 DEBUG:teuthology.orchestra.console.smithi046:power on output: Chassis Power Control: Up/On
2024-01-16T09:40:26.169 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-16T09:40:26.193 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off
2024-01-16T09:40:29.937 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-16T09:40:30.046 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on
2024-01-16T09:40:30.193 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-16T09:40:30.302 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off
2024-01-16T09:40:34.048 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-16T09:40:34.156 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off
2024-01-16T09:40:34.257 INFO:teuthology.orchestra.console.smithi088:Power off completed
2024-01-16T09:40:34.302 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-16T09:40:34.358 INFO:teuthology.orchestra.console.smithi088:Power on
2024-01-16T09:40:34.358 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-16T09:40:34.380 DEBUG:teuthology.orchestra.console.smithi088:power on output: Chassis Power Control: Up/On
2024-01-16T09:40:34.381 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-16T09:40:34.403 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off
2024-01-16T09:40:34.414 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on
2024-01-16T09:40:34.515 INFO:teuthology.orchestra.console.smithi046:Power on completed
2024-01-16T09:40:34.616 INFO:teuthology.provision.fog.smithi046:Waiting for deploy to finish
2024-01-16T09:40:38.408 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-16T09:40:38.518 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on
2024-01-16T09:40:38.618 INFO:teuthology.orchestra.console.smithi088:Power on completed
2024-01-16T09:40:38.719 INFO:teuthology.provision.fog.smithi088:Waiting for deploy to finish
2024-01-16T09:43:50.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T09:43:53.660 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46
2024-01-16T09:43:59.665 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T09:44:02.720 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46
2024-01-16T09:44:08.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T09:44:09.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T09:44:11.808 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46
2024-01-16T09:44:12.768 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2024-01-16T09:44:17.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T09:44:18.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T09:44:20.892 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46
2024-01-16T09:44:21.856 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2024-01-16T09:44:26.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T09:44:27.858 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T09:44:29.948 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46
2024-01-16T09:44:30.908 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2024-01-16T09:44:35.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T09:44:36.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T09:44:39.004 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46
2024-01-16T09:44:39.964 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2024-01-16T09:44:45.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T09:44:45.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T09:44:49.024 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2024-01-16T09:44:55.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T09:44:58.108 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2024-01-16T09:45:04.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T09:45:07.164 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2024-01-16T09:45:13.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T09:45:16.252 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2024-01-16T09:45:22.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T09:45:45.033 WARNING:teuthology.provision.fog.smithi046:timed out
2024-01-16T09:45:51.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T09:45:51.278 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-16T09:45:51.279 DEBUG:teuthology.orchestra.run.smithi046:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-16T09:45:51.759 INFO:teuthology.provision.fog.smithi046:Node is ready
2024-01-16T09:45:51.759 DEBUG:teuthology.orchestra.run.smithi046:> hostname
2024-01-16T09:45:51.811 INFO:teuthology.orchestra.run.smithi046.stdout:smithi046.front.sepia.ceph.com
2024-01-16T09:45:51.811 DEBUG:teuthology.orchestra.run.smithi046:> grep smithi046.front.sepia.ceph.com /etc/hosts
2024-01-16T09:45:51.859 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046
2024-01-16T09:45:51.860 DEBUG:teuthology.orchestra.run.smithi046:> sudo hostname smithi046
2024-01-16T09:45:52.004 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/smithi046.front.sepia.ceph.com/smithi046/g' /etc/hosts
2024-01-16T09:45:52.019 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/172.21.15.46/172.21.15.46/g' /etc/hosts
2024-01-16T09:45:52.076 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/smithi046.front.sepia.ceph.com/smithi046/g' /etc/hostname
2024-01-16T09:45:52.131 DEBUG:teuthology.orchestra.run.smithi046:> sudo hostname smithi046
2024-01-16T09:45:52.186 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release
2024-01-16T09:45:52.235 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-16T09:45:52.235 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="Ubuntu"
2024-01-16T09:45:52.235 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="22.04"
2024-01-16T09:45:52.235 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-16T09:45:52.235 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_CODENAME=jammy
2024-01-16T09:45:52.235 INFO:teuthology.orchestra.run.smithi046.stdout:ID=ubuntu
2024-01-16T09:45:52.235 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE=debian
2024-01-16T09:45:52.235 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-16T09:45:52.235 INFO:teuthology.orchestra.run.smithi046.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-16T09:45:52.236 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-16T09:45:52.236 INFO:teuthology.orchestra.run.smithi046.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-16T09:45:52.236 INFO:teuthology.orchestra.run.smithi046.stdout:UBUNTU_CODENAME=jammy
2024-01-16T09:45:52.236 INFO:teuthology.provision.fog.smithi046:Deploy complete!
2024-01-16T09:45:52.239 DEBUG:teuthology.parallel:result is None
2024-01-16T09:46:22.288 WARNING:teuthology.provision.fog.smithi088:timed out
2024-01-16T09:46:28.293 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T09:46:28.485 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-16T09:46:28.485 DEBUG:teuthology.orchestra.run.smithi088:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-16T09:46:28.923 INFO:teuthology.provision.fog.smithi088:Node is ready
2024-01-16T09:46:28.924 DEBUG:teuthology.orchestra.run.smithi088:> hostname
2024-01-16T09:46:28.970 INFO:teuthology.orchestra.run.smithi088.stdout:smithi088.front.sepia.ceph.com
2024-01-16T09:46:28.970 DEBUG:teuthology.orchestra.run.smithi088:> grep smithi088.front.sepia.ceph.com /etc/hosts
2024-01-16T09:46:29.018 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88 smithi088.front.sepia.ceph.com smithi088
2024-01-16T09:46:29.018 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088
2024-01-16T09:46:29.126 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088.front.sepia.ceph.com/smithi088/g' /etc/hosts
2024-01-16T09:46:29.141 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/172.21.15.88/172.21.15.88/g' /etc/hosts
2024-01-16T09:46:29.198 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088.front.sepia.ceph.com/smithi088/g' /etc/hostname
2024-01-16T09:46:29.257 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088
2024-01-16T09:46:29.318 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release
2024-01-16T09:46:29.370 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-16T09:46:29.370 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="Ubuntu"
2024-01-16T09:46:29.370 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="22.04"
2024-01-16T09:46:29.370 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-16T09:46:29.370 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_CODENAME=jammy
2024-01-16T09:46:29.370 INFO:teuthology.orchestra.run.smithi088.stdout:ID=ubuntu
2024-01-16T09:46:29.371 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE=debian
2024-01-16T09:46:29.371 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-16T09:46:29.371 INFO:teuthology.orchestra.run.smithi088.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-16T09:46:29.371 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-16T09:46:29.371 INFO:teuthology.orchestra.run.smithi088.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-16T09:46:29.371 INFO:teuthology.orchestra.run.smithi088.stdout:UBUNTU_CODENAME=jammy
2024-01-16T09:46:29.371 INFO:teuthology.provision.fog.smithi088:Deploy complete!
2024-01-16T09:46:29.372 DEBUG:teuthology.parallel:result is None
2024-01-16T09:46:29.555 INFO:teuthology.lock.ops:Checking smithi046.front.sepia.ceph.com
2024-01-16T09:46:29.555 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-16T09:46:29.576 INFO:teuthology.lock.ops:Checking smithi088.front.sepia.ceph.com
2024-01-16T09:46:29.576 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-16T09:46:29.594 INFO:teuthology.lock.ops:Updating [smithi046.front.sepia.ceph.com]: set os type and version on server
2024-01-16T09:46:29.594 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com'
2024-01-16T09:46:29.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T09:46:29.676 DEBUG:teuthology.orchestra.run.smithi046:> true
2024-01-16T09:46:29.920 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com'
2024-01-16T09:46:29.920 DEBUG:teuthology.orchestra.run.smithi046:> uname -m
2024-01-16T09:46:29.966 INFO:teuthology.orchestra.run.smithi046.stdout:x86_64
2024-01-16T09:46:29.966 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release
2024-01-16T09:46:30.014 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-16T09:46:30.014 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="Ubuntu"
2024-01-16T09:46:30.014 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="22.04"
2024-01-16T09:46:30.014 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-16T09:46:30.014 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_CODENAME=jammy
2024-01-16T09:46:30.015 INFO:teuthology.orchestra.run.smithi046.stdout:ID=ubuntu
2024-01-16T09:46:30.015 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE=debian
2024-01-16T09:46:30.015 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-16T09:46:30.015 INFO:teuthology.orchestra.run.smithi046.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-16T09:46:30.015 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-16T09:46:30.015 INFO:teuthology.orchestra.run.smithi046.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-16T09:46:30.015 INFO:teuthology.orchestra.run.smithi046.stdout:UBUNTU_CODENAME=jammy
2024-01-16T09:46:30.015 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server
2024-01-16T09:46:30.035 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: set os type and version on server
2024-01-16T09:46:30.035 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com'
2024-01-16T09:46:30.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T09:46:30.115 DEBUG:teuthology.orchestra.run.smithi088:> true
2024-01-16T09:46:30.240 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com'
2024-01-16T09:46:30.240 DEBUG:teuthology.orchestra.run.smithi088:> uname -m
2024-01-16T09:46:30.285 INFO:teuthology.orchestra.run.smithi088.stdout:x86_64
2024-01-16T09:46:30.286 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release
2024-01-16T09:46:30.333 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-16T09:46:30.333 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="Ubuntu"
2024-01-16T09:46:30.334 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="22.04"
2024-01-16T09:46:30.334 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-16T09:46:30.334 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_CODENAME=jammy
2024-01-16T09:46:30.334 INFO:teuthology.orchestra.run.smithi088.stdout:ID=ubuntu
2024-01-16T09:46:30.334 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE=debian
2024-01-16T09:46:30.334 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-16T09:46:30.334 INFO:teuthology.orchestra.run.smithi088.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-16T09:46:30.334 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-16T09:46:30.334 INFO:teuthology.orchestra.run.smithi088.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-16T09:46:30.334 INFO:teuthology.orchestra.run.smithi088.stdout:UBUNTU_CODENAME=jammy
2024-01-16T09:46:30.335 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server
2024-01-16T09:46:30.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T09:46:30.454 INFO:teuthology.dispatcher.supervisor:Running job 7518044
2024-01-16T09:46:30.454 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_gsalomon@teuthology --archive /home/teuthworker/archive/gsalomon-2024-01-16_07:17:30-rgw:verify-s3select_fixes_QE_bugs-distro-default-smithi/7518044 --name gsalomon-2024-01-16_07:17:30-rgw:verify-s3select_fixes_QE_bugs-distro-default-smithi --description rgw:verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} -- /home/teuthworker/archive/gsalomon-2024-01-16_07:17:30-rgw:verify-s3select_fixes_QE_bugs-distro-default-smithi/7518044/orig.config.yaml
2024-01-16T09:46:30.457 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/gsalomon-2024-01-16_07:17:30-rgw:verify-s3select_fixes_QE_bugs-distro-default-smithi/7518044
2024-01-16T09:46:30.458 INFO:teuthology.dispatcher.supervisor:Job PID: 2164968
2024-01-16T09:46:30.458 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-01-16T09:48:30.557 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T09:50:30.724 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T09:52:30.896 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T09:54:31.057 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T09:56:31.228 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T09:58:31.397 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T10:00:31.554 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T10:02:31.701 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T10:04:31.877 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T10:06:31.981 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T10:08:32.147 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T10:10:32.307 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T10:12:32.473 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T10:14:32.644 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T10:16:32.800 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T10:18:32.972 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T10:20:33.106 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T10:22:33.178 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T10:24:33.308 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T10:26:33.458 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T10:28:33.621 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T10:30:33.705 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T10:32:33.844 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T10:34:33.969 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T10:36:34.148 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T10:38:34.329 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T10:40:34.468 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T10:42:34.637 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T10:44:34.761 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T10:46:34.941 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T10:48:35.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T10:50:35.183 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T10:52:35.356 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T10:54:35.565 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T10:56:35.632 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T10:58:35.728 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T11:00:35.900 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T11:02:36.080 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T11:04:36.321 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T11:06:36.484 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T11:08:36.644 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T11:10:36.816 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T11:12:36.958 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T11:14:37.124 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T11:16:37.361 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T11:18:37.529 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T11:20:37.664 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T11:22:37.835 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T11:24:38.006 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T11:26:38.133 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T11:28:38.246 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T11:30:38.398 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T11:32:38.634 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T11:34:38.734 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T11:36:38.896 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T11:38:39.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T11:38:39.148 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-01-16T11:38:39.288 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2024-01-16T11:38:39.288 INFO:teuthology.nuke:Checking targets against current locks
2024-01-16T11:38:39.337 DEBUG:teuthology.nuke:shortname: smithi046
2024-01-16T11:38:39.337 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-16T11:38:39.350 DEBUG:teuthology.nuke:shortname: smithi088
2024-01-16T11:38:39.350 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-16T11:38:39.357 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi046.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gsalomon-2024-01-16_07:17:30-rgw:verify-s3select_fixes_QE_bugs-distro-default-smithi/7518044', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-16 09:40:24.273934', 'locked_by': 'scheduled_gsalomon@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBwh/ao0NYFGrZxFXCNQ1Fxt3XYEVtk2YCvEGW1VPV6FFwkNtu6tr46ayXaN60ch/PBekbvXxggGaFM8NmtrMD8='}
2024-01-16T11:38:39.370 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gsalomon-2024-01-16_07:17:30-rgw:verify-s3select_fixes_QE_bugs-distro-default-smithi/7518044', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-16 09:40:24.275596', 'locked_by': 'scheduled_gsalomon@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNJJr9BUdBCEUDeej01WsxW1GlqqoA7UcYOPZjrzGUOV4LW8pxwCVGxKEtqLh8iqYx2W6aVVHFOSO4bFss/2snw='}
2024-01-16T11:38:39.403 INFO:teuthology.orchestra.console.smithi046:Power off
2024-01-16T11:38:39.404 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-16T11:38:39.415 INFO:teuthology.orchestra.console.smithi088:Power off
2024-01-16T11:38:39.416 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-16T11:38:39.425 DEBUG:teuthology.orchestra.console.smithi046:power off output: Chassis Power Control: Down/Off
2024-01-16T11:38:39.425 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-16T11:38:39.435 DEBUG:teuthology.orchestra.console.smithi088:power off output: Chassis Power Control: Down/Off
2024-01-16T11:38:39.435 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-16T11:38:39.446 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off
2024-01-16T11:38:39.456 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off
2024-01-16T11:38:39.547 INFO:teuthology.orchestra.console.smithi046:Power off completed
2024-01-16T11:38:39.556 INFO:teuthology.orchestra.console.smithi088:Power off completed
2024-01-16T11:38:39.722 INFO:teuthology.lock.ops:unlocked: smithi046.front.sepia.ceph.com
2024-01-16T11:38:39.730 INFO:teuthology.lock.ops:unlocked: smithi088.front.sepia.ceph.com