2024-01-14T11:49:25.628 INFO:root:teuthology version: 0.0.1.dev249+gcd45576
2024-01-14T11:49:25.628 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-14T11:49:25.784 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7facb1450f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7facb24b6c10>, signals=[15])
2024-01-14T11:49:25.784 INFO:teuthology.lock.ops:Start node 'smithi151.front.sepia.ceph.com' reimaging
2024-01-14T11:49:25.784 INFO:teuthology.lock.ops:Updating [smithi151.front.sepia.ceph.com]: reset os type and version on server
2024-01-14T11:49:25.785 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server
2024-01-14T11:49:25.811 INFO:teuthology.lock.ops:Start node 'smithi153.front.sepia.ceph.com' reimaging
2024-01-14T11:49:25.811 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: reset os type and version on server
2024-01-14T11:49:25.811 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server
2024-01-14T11:49:25.918 DEBUG:teuthology.provision.fog.smithi151:Requesting image smithi_ubuntu_22.04 (ID 6)
2024-01-14T11:49:25.926 DEBUG:teuthology.provision.fog.smithi153:Requesting image smithi_ubuntu_22.04 (ID 6)
2024-01-14T11:49:25.965 INFO:teuthology.provision.fog.smithi151:Scheduling deploy of ubuntu 22.04
2024-01-14T11:49:25.968 INFO:teuthology.provision.fog.smithi153:Scheduling deploy of ubuntu 22.04
2024-01-14T11:49:26.289 INFO:teuthology.orchestra.console.smithi151:Power off
2024-01-14T11:49:26.289 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-14T11:49:26.302 INFO:teuthology.orchestra.console.smithi153:Power off
2024-01-14T11:49:26.302 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-14T11:49:26.309 DEBUG:teuthology.orchestra.console.smithi151:power off output: Chassis Power Control: Down/Off
2024-01-14T11:49:26.309 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-14T11:49:26.323 DEBUG:teuthology.orchestra.console.smithi153:power off output: Chassis Power Control: Down/Off
2024-01-14T11:49:26.323 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-14T11:49:26.330 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on
2024-01-14T11:49:26.343 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on
2024-01-14T11:49:30.332 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-14T11:49:30.344 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-14T11:49:30.442 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on
2024-01-14T11:49:30.452 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on
2024-01-14T11:49:34.444 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-14T11:49:34.453 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-14T11:49:34.553 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on
2024-01-14T11:49:34.561 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on
2024-01-14T11:49:38.558 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-14T11:49:38.568 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-14T11:49:38.671 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off
2024-01-14T11:49:38.677 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off
2024-01-14T11:49:38.773 INFO:teuthology.orchestra.console.smithi151:Power off completed
2024-01-14T11:49:38.778 INFO:teuthology.orchestra.console.smithi153:Power off completed
2024-01-14T11:49:38.875 INFO:teuthology.orchestra.console.smithi151:Power on
2024-01-14T11:49:38.875 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-14T11:49:38.884 INFO:teuthology.orchestra.console.smithi153:Power on
2024-01-14T11:49:38.884 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-14T11:49:38.899 DEBUG:teuthology.orchestra.console.smithi151:power on output: Chassis Power Control: Up/On
2024-01-14T11:49:38.900 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-14T11:49:38.908 DEBUG:teuthology.orchestra.console.smithi153:power on output: Chassis Power Control: Up/On
2024-01-14T11:49:38.908 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-14T11:49:38.922 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off
2024-01-14T11:49:38.929 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off
2024-01-14T11:49:42.927 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-14T11:49:42.933 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-14T11:49:43.035 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on
2024-01-14T11:49:43.040 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on
2024-01-14T11:49:43.136 INFO:teuthology.orchestra.console.smithi151:Power on completed
2024-01-14T11:49:43.141 INFO:teuthology.orchestra.console.smithi153:Power on completed
2024-01-14T11:49:43.237 INFO:teuthology.provision.fog.smithi151:Waiting for deploy to finish
2024-01-14T11:49:43.242 INFO:teuthology.provision.fog.smithi153:Waiting for deploy to finish
2024-01-14T11:54:15.565 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T11:54:33.916 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2024-01-14T11:54:39.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T11:54:43.004 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2024-01-14T11:54:45.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T11:54:49.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T11:54:52.060 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2024-01-14T11:54:58.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T11:55:01.148 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2024-01-14T11:55:04.128 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2024-01-14T11:55:07.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T11:55:10.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T11:55:10.204 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2024-01-14T11:55:13.212 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2024-01-14T11:55:16.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T11:55:19.216 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T11:55:19.260 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2024-01-14T11:55:22.268 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2024-01-14T11:55:25.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T11:55:28.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T11:55:31.324 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2024-01-14T11:55:37.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T11:55:40.412 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2024-01-14T11:55:46.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T11:56:25.274 WARNING:teuthology.provision.fog.smithi153:timed out
2024-01-14T11:56:31.281 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T11:56:31.558 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-14T11:56:31.559 DEBUG:teuthology.orchestra.run.smithi153:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-14T11:56:32.018 INFO:teuthology.provision.fog.smithi153:Node is ready
2024-01-14T11:56:32.018 DEBUG:teuthology.orchestra.run.smithi153:> hostname
2024-01-14T11:56:32.067 INFO:teuthology.orchestra.run.smithi153.stdout:smithi153.front.sepia.ceph.com
2024-01-14T11:56:32.067 DEBUG:teuthology.orchestra.run.smithi153:> grep smithi153.front.sepia.ceph.com /etc/hosts
2024-01-14T11:56:32.115 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.15.153 smithi153.front.sepia.ceph.com smithi153
2024-01-14T11:56:32.115 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname smithi153
2024-01-14T11:56:32.218 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/smithi153.front.sepia.ceph.com/smithi153/g' /etc/hosts
2024-01-14T11:56:32.232 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/172.21.15.153/172.21.15.153/g' /etc/hosts
2024-01-14T11:56:32.290 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/smithi153.front.sepia.ceph.com/smithi153/g' /etc/hostname
2024-01-14T11:56:32.347 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname smithi153
2024-01-14T11:56:32.401 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release
2024-01-14T11:56:32.450 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-14T11:56:32.450 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="Ubuntu"
2024-01-14T11:56:32.450 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="22.04"
2024-01-14T11:56:32.450 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-14T11:56:32.450 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_CODENAME=jammy
2024-01-14T11:56:32.450 INFO:teuthology.orchestra.run.smithi153.stdout:ID=ubuntu
2024-01-14T11:56:32.450 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE=debian
2024-01-14T11:56:32.451 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-14T11:56:32.451 INFO:teuthology.orchestra.run.smithi153.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-14T11:56:32.451 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-14T11:56:32.451 INFO:teuthology.orchestra.run.smithi153.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-14T11:56:32.451 INFO:teuthology.orchestra.run.smithi153.stdout:UBUNTU_CODENAME=jammy
2024-01-14T11:56:32.451 INFO:teuthology.provision.fog.smithi153:Deploy complete!
2024-01-14T11:56:32.453 DEBUG:teuthology.parallel:result is None
2024-01-14T11:56:46.426 WARNING:teuthology.provision.fog.smithi151:timed out
2024-01-14T11:56:52.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T11:56:52.750 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-14T11:56:52.750 DEBUG:teuthology.orchestra.run.smithi151:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-14T11:56:53.167 INFO:teuthology.provision.fog.smithi151:Node is ready
2024-01-14T11:56:53.167 DEBUG:teuthology.orchestra.run.smithi151:> hostname
2024-01-14T11:56:53.216 INFO:teuthology.orchestra.run.smithi151.stdout:smithi151.front.sepia.ceph.com
2024-01-14T11:56:53.216 DEBUG:teuthology.orchestra.run.smithi151:> grep smithi151.front.sepia.ceph.com /etc/hosts
2024-01-14T11:56:53.264 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151 smithi151.front.sepia.ceph.com smithi151
2024-01-14T11:56:53.264 DEBUG:teuthology.orchestra.run.smithi151:> sudo hostname smithi151
2024-01-14T11:56:53.406 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/smithi151.front.sepia.ceph.com/smithi151/g' /etc/hosts
2024-01-14T11:56:53.420 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/172.21.15.151/172.21.15.151/g' /etc/hosts
2024-01-14T11:56:53.475 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/smithi151.front.sepia.ceph.com/smithi151/g' /etc/hostname
2024-01-14T11:56:53.531 DEBUG:teuthology.orchestra.run.smithi151:> sudo hostname smithi151
2024-01-14T11:56:53.590 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release
2024-01-14T11:56:53.644 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-14T11:56:53.644 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="Ubuntu"
2024-01-14T11:56:53.644 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="22.04"
2024-01-14T11:56:53.644 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-14T11:56:53.644 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_CODENAME=jammy
2024-01-14T11:56:53.644 INFO:teuthology.orchestra.run.smithi151.stdout:ID=ubuntu
2024-01-14T11:56:53.644 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE=debian
2024-01-14T11:56:53.644 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-14T11:56:53.644 INFO:teuthology.orchestra.run.smithi151.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-14T11:56:53.644 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-14T11:56:53.644 INFO:teuthology.orchestra.run.smithi151.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-14T11:56:53.644 INFO:teuthology.orchestra.run.smithi151.stdout:UBUNTU_CODENAME=jammy
2024-01-14T11:56:53.645 INFO:teuthology.provision.fog.smithi151:Deploy complete!
2024-01-14T11:56:53.645 DEBUG:teuthology.parallel:result is None
2024-01-14T11:56:53.830 INFO:teuthology.lock.ops:Checking smithi151.front.sepia.ceph.com
2024-01-14T11:56:53.830 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-14T11:56:53.857 INFO:teuthology.lock.ops:Checking smithi153.front.sepia.ceph.com
2024-01-14T11:56:53.858 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-14T11:56:53.875 INFO:teuthology.lock.ops:Updating [smithi151.front.sepia.ceph.com]: set os type and version on server
2024-01-14T11:56:53.875 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com'
2024-01-14T11:56:53.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T11:56:53.951 DEBUG:teuthology.orchestra.run.smithi151:> true
2024-01-14T11:56:54.064 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com'
2024-01-14T11:56:54.064 DEBUG:teuthology.orchestra.run.smithi151:> uname -m
2024-01-14T11:56:54.111 INFO:teuthology.orchestra.run.smithi151.stdout:x86_64
2024-01-14T11:56:54.111 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release
2024-01-14T11:56:54.159 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-14T11:56:54.159 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="Ubuntu"
2024-01-14T11:56:54.159 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="22.04"
2024-01-14T11:56:54.159 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-14T11:56:54.159 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_CODENAME=jammy
2024-01-14T11:56:54.159 INFO:teuthology.orchestra.run.smithi151.stdout:ID=ubuntu
2024-01-14T11:56:54.160 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE=debian
2024-01-14T11:56:54.160 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-14T11:56:54.160 INFO:teuthology.orchestra.run.smithi151.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-14T11:56:54.160 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-14T11:56:54.160 INFO:teuthology.orchestra.run.smithi151.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-14T11:56:54.160 INFO:teuthology.orchestra.run.smithi151.stdout:UBUNTU_CODENAME=jammy
2024-01-14T11:56:54.160 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server
2024-01-14T11:56:54.200 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: set os type and version on server
2024-01-14T11:56:54.200 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com'
2024-01-14T11:56:54.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T11:56:54.275 DEBUG:teuthology.orchestra.run.smithi153:> true
2024-01-14T11:56:54.504 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com'
2024-01-14T11:56:54.504 DEBUG:teuthology.orchestra.run.smithi153:> uname -m
2024-01-14T11:56:54.549 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64
2024-01-14T11:56:54.550 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release
2024-01-14T11:56:54.598 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-14T11:56:54.598 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="Ubuntu"
2024-01-14T11:56:54.598 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="22.04"
2024-01-14T11:56:54.598 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-14T11:56:54.598 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_CODENAME=jammy
2024-01-14T11:56:54.598 INFO:teuthology.orchestra.run.smithi153.stdout:ID=ubuntu
2024-01-14T11:56:54.598 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE=debian
2024-01-14T11:56:54.598 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-14T11:56:54.598 INFO:teuthology.orchestra.run.smithi153.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-14T11:56:54.598 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-14T11:56:54.598 INFO:teuthology.orchestra.run.smithi153.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-14T11:56:54.598 INFO:teuthology.orchestra.run.smithi153.stdout:UBUNTU_CODENAME=jammy
2024-01-14T11:56:54.599 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server
2024-01-14T11:56:54.624 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-14T11:56:54.703 INFO:teuthology.dispatcher.supervisor:Running job 7516444
2024-01-14T11:56:54.703 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_rfriedma@teuthology --archive /home/teuthworker/archive/rfriedma-2024-01-14_11:48:13-rados:thrash-wip-rf-reserver-distro-default-smithi/7516444 --name rfriedma-2024-01-14_11:48:13-rados:thrash-wip-rf-reserver-distro-default-smithi --description rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-agent-big} -- /home/teuthworker/archive/rfriedma-2024-01-14_11:48:13-rados:thrash-wip-rf-reserver-distro-default-smithi/7516444/orig.config.yaml
2024-01-14T11:56:54.706 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rfriedma-2024-01-14_11:48:13-rados:thrash-wip-rf-reserver-distro-default-smithi/7516444
2024-01-14T11:56:54.706 INFO:teuthology.dispatcher.supervisor:Job PID: 3234897
2024-01-14T11:56:54.706 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-01-14T11:58:54.804 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-14T12:00:54.984 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-14T12:02:55.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-14T12:04:55.234 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-14T12:06:55.398 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-14T12:08:55.524 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-14T12:08:55.594 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-01-14T12:08:55.690 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2024-01-14T12:08:55.691 INFO:teuthology.nuke:Checking targets against current locks
2024-01-14T12:08:55.736 DEBUG:teuthology.nuke:shortname: smithi151
2024-01-14T12:08:55.736 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-14T12:08:55.754 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi151.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rfriedma-2024-01-14_11:48:13-rados:thrash-wip-rf-reserver-distro-default-smithi/7516444', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-14 11:49:24.636039', 'locked_by': 'scheduled_rfriedma@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAmjtW0tM9oCsI7WRe8+Cj/LEbwvkptewqNgwrWKGPqIQZ3rHjTa186rFjvexCgJWgkMs11dUnQYKM/6nulOAL8='}
2024-01-14T12:08:55.760 DEBUG:teuthology.nuke:shortname: smithi153
2024-01-14T12:08:55.760 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-14T12:08:55.778 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rfriedma-2024-01-14_11:48:13-rados:thrash-wip-rf-reserver-distro-default-smithi/7516444', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-14 11:49:24.637103', 'locked_by': 'scheduled_rfriedma@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDwfSjHL1HlAGNXA0s2WieVppGQYobKxgCkvic3fjcbqx8Ysk8E/AlYOI3ZjcO9rLBjqHGiUVkikzrFsxolYbbc='}
2024-01-14T12:08:55.804 INFO:teuthology.orchestra.console.smithi151:Power off
2024-01-14T12:08:55.804 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-14T12:08:55.824 DEBUG:teuthology.orchestra.console.smithi151:power off output: Chassis Power Control: Down/Off
2024-01-14T12:08:55.825 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-14T12:08:55.836 INFO:teuthology.orchestra.console.smithi153:Power off
2024-01-14T12:08:55.836 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-14T12:08:55.846 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off
2024-01-14T12:08:55.855 DEBUG:teuthology.orchestra.console.smithi153:power off output: Chassis Power Control: Down/Off
2024-01-14T12:08:55.855 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-14T12:08:55.875 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off
2024-01-14T12:08:55.947 INFO:teuthology.orchestra.console.smithi151:Power off completed
2024-01-14T12:08:55.975 INFO:teuthology.orchestra.console.smithi153:Power off completed
2024-01-14T12:08:56.100 INFO:teuthology.lock.ops:unlocked: smithi151.front.sepia.ceph.com
2024-01-14T12:08:56.127 INFO:teuthology.lock.ops:unlocked: smithi153.front.sepia.ceph.com