2024-01-17T20:25:15.503 INFO:root:teuthology version: 0.0.1.dev249+gcd45576
2024-01-17T20:25:15.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T20:25:15.630 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f16b4485f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f16b54ebc10>, signals=[15])
2024-01-17T20:25:15.631 INFO:teuthology.lock.ops:Start node 'smithi100.front.sepia.ceph.com' reimaging
2024-01-17T20:25:15.631 INFO:teuthology.lock.ops:Updating [smithi100.front.sepia.ceph.com]: reset os type and version on server
2024-01-17T20:25:15.631 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server
2024-01-17T20:25:15.647 INFO:teuthology.lock.ops:Start node 'smithi154.front.sepia.ceph.com' reimaging
2024-01-17T20:25:15.648 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: reset os type and version on server
2024-01-17T20:25:15.648 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server
2024-01-17T20:25:15.766 DEBUG:teuthology.provision.fog.smithi100:Requesting image smithi_ubuntu_22.04 (ID 6)
2024-01-17T20:25:15.773 DEBUG:teuthology.provision.fog.smithi154:Requesting image smithi_ubuntu_22.04 (ID 6)
2024-01-17T20:25:15.811 INFO:teuthology.provision.fog.smithi154:Scheduling deploy of ubuntu 22.04
2024-01-17T20:25:15.818 INFO:teuthology.provision.fog.smithi100:Scheduling deploy of ubuntu 22.04
2024-01-17T20:25:16.096 INFO:teuthology.orchestra.console.smithi154:Power off
2024-01-17T20:25:16.097 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-17T20:25:16.113 INFO:teuthology.orchestra.console.smithi100:Power off
2024-01-17T20:25:16.113 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-17T20:25:16.121 DEBUG:teuthology.orchestra.console.smithi154:power off output: Chassis Power Control: Down/Off
2024-01-17T20:25:16.122 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T20:25:16.135 DEBUG:teuthology.orchestra.console.smithi100:power off output: Chassis Power Control: Down/Off
2024-01-17T20:25:16.135 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T20:25:16.146 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on
2024-01-17T20:25:16.156 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on
2024-01-17T20:25:20.151 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T20:25:20.158 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T20:25:20.260 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on
2024-01-17T20:25:20.266 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on
2024-01-17T20:25:24.265 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T20:25:24.273 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T20:25:24.375 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off
2024-01-17T20:25:24.381 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on
2024-01-17T20:25:24.477 INFO:teuthology.orchestra.console.smithi154:Power off completed
2024-01-17T20:25:24.577 INFO:teuthology.orchestra.console.smithi154:Power on
2024-01-17T20:25:24.577 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-17T20:25:24.599 DEBUG:teuthology.orchestra.console.smithi154:power on output: Chassis Power Control: Up/On
2024-01-17T20:25:24.599 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T20:25:24.618 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off
2024-01-17T20:25:28.384 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T20:25:28.492 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off
2024-01-17T20:25:28.592 INFO:teuthology.orchestra.console.smithi100:Power off completed
2024-01-17T20:25:28.620 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T20:25:28.693 INFO:teuthology.orchestra.console.smithi100:Power on
2024-01-17T20:25:28.693 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-17T20:25:28.714 DEBUG:teuthology.orchestra.console.smithi100:power on output: Chassis Power Control: Up/On
2024-01-17T20:25:28.715 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T20:25:28.728 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off
2024-01-17T20:25:28.734 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off
2024-01-17T20:25:32.732 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T20:25:32.739 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T20:25:32.841 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on
2024-01-17T20:25:32.847 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on
2024-01-17T20:25:32.943 INFO:teuthology.orchestra.console.smithi154:Power on completed
2024-01-17T20:25:32.948 INFO:teuthology.orchestra.console.smithi100:Power on completed
2024-01-17T20:25:33.044 INFO:teuthology.provision.fog.smithi154:Waiting for deploy to finish
2024-01-17T20:25:33.049 INFO:teuthology.provision.fog.smithi100:Waiting for deploy to finish
2024-01-17T20:28:49.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T20:28:49.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T20:29:07.772 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2024-01-17T20:29:07.772 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2024-01-17T20:29:13.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T20:29:13.778 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T20:29:16.828 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2024-01-17T20:29:16.828 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2024-01-17T20:29:22.835 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T20:29:22.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T20:29:25.920 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2024-01-17T20:29:25.920 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2024-01-17T20:29:31.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T20:29:31.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T20:29:35.004 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2024-01-17T20:29:35.004 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2024-01-17T20:29:41.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T20:29:41.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T20:29:44.064 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2024-01-17T20:29:44.092 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2024-01-17T20:29:50.068 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T20:29:50.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T20:29:53.151 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2024-01-17T20:29:59.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T20:30:50.122 WARNING:teuthology.provision.fog.smithi100:timed out
2024-01-17T20:30:56.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T20:30:56.347 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-17T20:30:56.347 DEBUG:teuthology.orchestra.run.smithi100:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-17T20:30:56.747 INFO:teuthology.provision.fog.smithi100:Node is ready
2024-01-17T20:30:56.747 DEBUG:teuthology.orchestra.run.smithi100:> hostname
2024-01-17T20:30:56.796 INFO:teuthology.orchestra.run.smithi100.stdout:smithi100.front.sepia.ceph.com
2024-01-17T20:30:56.796 DEBUG:teuthology.orchestra.run.smithi100:> grep smithi100.front.sepia.ceph.com /etc/hosts
2024-01-17T20:30:56.843 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100 smithi100.front.sepia.ceph.com smithi100
2024-01-17T20:30:56.844 DEBUG:teuthology.orchestra.run.smithi100:> sudo hostname smithi100
2024-01-17T20:30:56.981 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/smithi100.front.sepia.ceph.com/smithi100/g' /etc/hosts
2024-01-17T20:30:56.995 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/172.21.15.100/172.21.15.100/g' /etc/hosts
2024-01-17T20:30:57.055 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/smithi100.front.sepia.ceph.com/smithi100/g' /etc/hostname
2024-01-17T20:30:57.112 DEBUG:teuthology.orchestra.run.smithi100:> sudo hostname smithi100
2024-01-17T20:30:57.166 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release
2024-01-17T20:30:57.214 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-17T20:30:57.215 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="Ubuntu"
2024-01-17T20:30:57.215 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="22.04"
2024-01-17T20:30:57.215 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-17T20:30:57.215 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_CODENAME=jammy
2024-01-17T20:30:57.215 INFO:teuthology.orchestra.run.smithi100.stdout:ID=ubuntu
2024-01-17T20:30:57.215 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE=debian
2024-01-17T20:30:57.215 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-17T20:30:57.215 INFO:teuthology.orchestra.run.smithi100.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-17T20:30:57.215 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-17T20:30:57.215 INFO:teuthology.orchestra.run.smithi100.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-17T20:30:57.215 INFO:teuthology.orchestra.run.smithi100.stdout:UBUNTU_CODENAME=jammy
2024-01-17T20:30:57.216 INFO:teuthology.provision.fog.smithi100:Deploy complete!
2024-01-17T20:30:57.217 DEBUG:teuthology.parallel:result is None
2024-01-17T20:30:59.160 WARNING:teuthology.provision.fog.smithi154:timed out
2024-01-17T20:31:05.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T20:31:05.622 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-17T20:31:05.622 DEBUG:teuthology.orchestra.run.smithi154:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-17T20:31:06.168 INFO:teuthology.provision.fog.smithi154:Node is ready
2024-01-17T20:31:06.168 DEBUG:teuthology.orchestra.run.smithi154:> hostname
2024-01-17T20:31:06.215 INFO:teuthology.orchestra.run.smithi154.stdout:smithi154.front.sepia.ceph.com
2024-01-17T20:31:06.215 DEBUG:teuthology.orchestra.run.smithi154:> grep smithi154.front.sepia.ceph.com /etc/hosts
2024-01-17T20:31:06.263 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154 smithi154.front.sepia.ceph.com smithi154
2024-01-17T20:31:06.264 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname smithi154
2024-01-17T20:31:06.411 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/smithi154.front.sepia.ceph.com/smithi154/g' /etc/hosts
2024-01-17T20:31:06.424 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/172.21.15.154/172.21.15.154/g' /etc/hosts
2024-01-17T20:31:06.480 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/smithi154.front.sepia.ceph.com/smithi154/g' /etc/hostname
2024-01-17T20:31:06.534 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname smithi154
2024-01-17T20:31:06.591 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release
2024-01-17T20:31:06.640 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-17T20:31:06.640 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="Ubuntu"
2024-01-17T20:31:06.640 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="22.04"
2024-01-17T20:31:06.640 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-17T20:31:06.640 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_CODENAME=jammy
2024-01-17T20:31:06.640 INFO:teuthology.orchestra.run.smithi154.stdout:ID=ubuntu
2024-01-17T20:31:06.640 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE=debian
2024-01-17T20:31:06.640 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-17T20:31:06.640 INFO:teuthology.orchestra.run.smithi154.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-17T20:31:06.640 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-17T20:31:06.641 INFO:teuthology.orchestra.run.smithi154.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-17T20:31:06.641 INFO:teuthology.orchestra.run.smithi154.stdout:UBUNTU_CODENAME=jammy
2024-01-17T20:31:06.641 INFO:teuthology.provision.fog.smithi154:Deploy complete!
2024-01-17T20:31:06.641 DEBUG:teuthology.parallel:result is None
2024-01-17T20:31:06.850 INFO:teuthology.lock.ops:Checking smithi100.front.sepia.ceph.com
2024-01-17T20:31:06.850 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-17T20:31:06.874 INFO:teuthology.lock.ops:Checking smithi154.front.sepia.ceph.com
2024-01-17T20:31:06.874 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-17T20:31:06.899 INFO:teuthology.lock.ops:Updating [smithi100.front.sepia.ceph.com]: set os type and version on server
2024-01-17T20:31:06.900 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com'
2024-01-17T20:31:06.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T20:31:06.978 DEBUG:teuthology.orchestra.run.smithi100:> true
2024-01-17T20:31:07.068 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com'
2024-01-17T20:31:07.068 DEBUG:teuthology.orchestra.run.smithi100:> uname -m
2024-01-17T20:31:07.114 INFO:teuthology.orchestra.run.smithi100.stdout:x86_64
2024-01-17T20:31:07.115 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release
2024-01-17T20:31:07.162 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-17T20:31:07.163 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="Ubuntu"
2024-01-17T20:31:07.163 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="22.04"
2024-01-17T20:31:07.163 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-17T20:31:07.163 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_CODENAME=jammy
2024-01-17T20:31:07.163 INFO:teuthology.orchestra.run.smithi100.stdout:ID=ubuntu
2024-01-17T20:31:07.163 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE=debian
2024-01-17T20:31:07.163 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-17T20:31:07.163 INFO:teuthology.orchestra.run.smithi100.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-17T20:31:07.163 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-17T20:31:07.163 INFO:teuthology.orchestra.run.smithi100.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-17T20:31:07.163 INFO:teuthology.orchestra.run.smithi100.stdout:UBUNTU_CODENAME=jammy
2024-01-17T20:31:07.164 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server
2024-01-17T20:31:07.182 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: set os type and version on server
2024-01-17T20:31:07.182 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com'
2024-01-17T20:31:07.182 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T20:31:07.257 DEBUG:teuthology.orchestra.run.smithi154:> true
2024-01-17T20:31:07.364 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com'
2024-01-17T20:31:07.364 DEBUG:teuthology.orchestra.run.smithi154:> uname -m
2024-01-17T20:31:07.411 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64
2024-01-17T20:31:07.411 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release
2024-01-17T20:31:07.459 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-17T20:31:07.459 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="Ubuntu"
2024-01-17T20:31:07.459 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="22.04"
2024-01-17T20:31:07.459 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-17T20:31:07.459 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_CODENAME=jammy
2024-01-17T20:31:07.459 INFO:teuthology.orchestra.run.smithi154.stdout:ID=ubuntu
2024-01-17T20:31:07.459 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE=debian
2024-01-17T20:31:07.459 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-17T20:31:07.459 INFO:teuthology.orchestra.run.smithi154.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-17T20:31:07.459 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-17T20:31:07.460 INFO:teuthology.orchestra.run.smithi154.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-17T20:31:07.460 INFO:teuthology.orchestra.run.smithi154.stdout:UBUNTU_CODENAME=jammy
2024-01-17T20:31:07.460 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server
2024-01-17T20:31:07.482 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T20:31:07.562 INFO:teuthology.dispatcher.supervisor:Running job 7519246
2024-01-17T20:31:07.562 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_leonidus@teuthology --archive /home/teuthworker/archive/leonidus-2024-01-17_20:20:37-fs-main-distro-default-smithi/7519246 --name leonidus-2024-01-17_20:20:37-fs-main-distro-default-smithi --description fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/3 tasks/fsstress validater/valgrind} -- /home/teuthworker/archive/leonidus-2024-01-17_20:20:37-fs-main-distro-default-smithi/7519246/orig.config.yaml
2024-01-17T20:31:07.565 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/leonidus-2024-01-17_20:20:37-fs-main-distro-default-smithi/7519246
2024-01-17T20:31:07.565 INFO:teuthology.dispatcher.supervisor:Job PID: 2042851
2024-01-17T20:31:07.565 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-01-17T20:33:07.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T20:35:07.786 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T20:37:07.905 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T20:39:08.077 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T20:41:08.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T20:43:08.413 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T20:45:08.577 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T20:47:08.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T20:49:08.852 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T20:51:09.017 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T20:53:09.169 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T20:55:09.330 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T20:57:09.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T20:59:09.568 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:01:09.732 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:03:09.898 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:05:10.050 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:07:10.213 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:09:10.397 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:11:10.564 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:13:10.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:15:10.873 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:17:11.040 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:19:11.224 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:21:11.361 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:23:11.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:25:11.794 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:27:11.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:29:12.109 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:31:12.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:33:12.414 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:35:12.525 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:37:12.673 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:39:12.832 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:41:13.002 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:43:13.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:45:13.426 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:47:13.573 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:49:13.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:51:13.897 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:53:14.074 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:55:14.225 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:57:14.405 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T21:59:14.564 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:01:14.697 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:03:14.858 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:05:15.022 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:07:15.237 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:09:15.404 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:11:15.573 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:13:15.682 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:15:15.784 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:17:15.938 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:19:16.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:21:16.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:23:16.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:25:16.517 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:27:16.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:29:16.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:31:17.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:33:17.217 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:35:17.384 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:37:17.548 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:39:17.709 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:41:17.881 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:43:18.041 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:45:18.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:47:18.384 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:49:18.545 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:51:18.689 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:53:18.860 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:55:18.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:57:19.156 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T22:59:19.316 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:01:19.429 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:03:19.581 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:05:19.745 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:07:19.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:09:20.174 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:11:20.348 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:13:20.556 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:15:20.714 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:17:20.874 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:19:21.043 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:21:21.217 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:23:21.380 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:25:21.526 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:27:21.689 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:29:21.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:31:21.998 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:33:22.146 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:35:22.303 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:37:22.468 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:39:22.618 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:41:22.769 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:43:22.941 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:45:23.182 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:47:23.349 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:49:23.514 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T23:49:23.592 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-01-17T23:49:23.787 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2024-01-17T23:49:23.787 INFO:teuthology.nuke:Checking targets against current locks
2024-01-17T23:49:23.829 DEBUG:teuthology.nuke:shortname: smithi100
2024-01-17T23:49:23.829 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-17T23:49:23.854 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi100.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-01-17_20:20:37-fs-main-distro-default-smithi/7519246', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-17 20:25:14.522197', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBYqxmL28k+lokwvCP7FnzGRsd6oEFs3c9cfn8qT1t/rrB9OjQQtCqlamm+xFzO7ZR2px8K/bUQ5PVwvnsznppQ='}
2024-01-17T23:49:23.857 DEBUG:teuthology.nuke:shortname: smithi154
2024-01-17T23:49:23.857 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-17T23:49:23.881 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-01-17_20:20:37-fs-main-distro-default-smithi/7519246', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-17 20:25:14.524153', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDXiKudgKDEjFFoPp63ZzhuAPBIKWBvFYP4m572cG0rTcqI27/YmIt5PCMKsxml8nj49G9HnLgr9lBS+lVzW5gE='}
2024-01-17T23:49:23.905 INFO:teuthology.orchestra.console.smithi100:Power off
2024-01-17T23:49:23.905 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-17T23:49:23.924 DEBUG:teuthology.orchestra.console.smithi100:power off output: Chassis Power Control: Down/Off
2024-01-17T23:49:23.924 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T23:49:23.937 INFO:teuthology.orchestra.console.smithi154:Power off
2024-01-17T23:49:23.937 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-17T23:49:23.946 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off
2024-01-17T23:49:23.957 DEBUG:teuthology.orchestra.console.smithi154:power off output: Chassis Power Control: Down/Off
2024-01-17T23:49:23.957 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T23:49:23.978 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off
2024-01-17T23:49:24.047 INFO:teuthology.orchestra.console.smithi100:Power off completed
2024-01-17T23:49:24.079 INFO:teuthology.orchestra.console.smithi154:Power off completed
2024-01-17T23:49:24.199 INFO:teuthology.lock.ops:unlocked: smithi100.front.sepia.ceph.com
2024-01-17T23:49:24.223 INFO:teuthology.lock.ops:unlocked: smithi154.front.sepia.ceph.com