2024-01-05T16:44:55.912 INFO:root:teuthology version: 0.0.1.dev228+g01dd171
2024-01-05T16:44:55.913 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T16:44:56.104 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f8e7c76d280>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f8e7d6c6940>, signals=[15])
2024-01-05T16:44:56.105 INFO:teuthology.lock.ops:Start node 'smithi001.front.sepia.ceph.com' reimaging
2024-01-05T16:44:56.105 INFO:teuthology.lock.ops:Updating [smithi001.front.sepia.ceph.com]: reset os type and version on server
2024-01-05T16:44:56.105 INFO:teuthology.lock.ops:Updating smithi001.front.sepia.ceph.com on lock server
2024-01-05T16:44:56.131 INFO:teuthology.lock.ops:Start node 'smithi149.front.sepia.ceph.com' reimaging
2024-01-05T16:44:56.132 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: reset os type and version on server
2024-01-05T16:44:56.132 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server
2024-01-05T16:44:56.157 INFO:teuthology.lock.ops:Start node 'smithi153.front.sepia.ceph.com' reimaging
2024-01-05T16:44:56.157 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: reset os type and version on server
2024-01-05T16:44:56.157 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server
2024-01-05T16:44:56.262 DEBUG:teuthology.provision.fog.smithi001:Requesting image smithi_centos_8.stream (ID 3)
2024-01-05T16:44:56.294 DEBUG:teuthology.provision.fog.smithi149:Requesting image smithi_centos_8.stream (ID 3)
2024-01-05T16:44:56.297 DEBUG:teuthology.provision.fog.smithi153:Requesting image smithi_centos_8.stream (ID 3)
2024-01-05T16:44:56.316 INFO:teuthology.provision.fog.smithi001:Scheduling deploy of centos 8.stream
2024-01-05T16:44:56.336 INFO:teuthology.provision.fog.smithi149:Scheduling deploy of centos 8.stream
2024-01-05T16:44:56.343 INFO:teuthology.provision.fog.smithi153:Scheduling deploy of centos 8.stream
2024-01-05T16:44:56.398 DEBUG:teuthology.provision.fog.smithi001:Canceling deploy task with ID 699999
2024-01-05T16:44:56.410 DEBUG:teuthology.provision.fog.smithi153:Canceling deploy task with ID 700000
2024-01-05T16:44:56.421 DEBUG:teuthology.provision.fog.smithi149:Canceling deploy task with ID 700001
2024-01-05T16:44:56.698 INFO:teuthology.orchestra.console.smithi001:Power off
2024-01-05T16:44:56.698 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-05T16:44:56.719 DEBUG:teuthology.orchestra.console.smithi001:power off output: Chassis Power Control: Down/Off
2024-01-05T16:44:56.719 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-05T16:44:56.737 INFO:teuthology.orchestra.console.smithi149:Power off
2024-01-05T16:44:56.737 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-05T16:44:56.750 INFO:teuthology.orchestra.console.smithi153:Power off
2024-01-05T16:44:56.750 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-05T16:44:56.757 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is off
2024-01-05T16:44:56.758 DEBUG:teuthology.orchestra.console.smithi149:power off output: Chassis Power Control: Down/Off
2024-01-05T16:44:56.758 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-05T16:44:56.770 DEBUG:teuthology.orchestra.console.smithi153:power off output: Chassis Power Control: Down/Off
2024-01-05T16:44:56.770 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-05T16:44:56.778 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off
2024-01-05T16:44:56.792 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off
2024-01-05T16:44:56.858 INFO:teuthology.orchestra.console.smithi001:Power off completed
2024-01-05T16:44:56.879 INFO:teuthology.orchestra.console.smithi149:Power off completed
2024-01-05T16:44:56.892 INFO:teuthology.orchestra.console.smithi153:Power off completed
2024-01-05T16:44:56.959 INFO:teuthology.orchestra.console.smithi001:Power on
2024-01-05T16:44:56.960 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-05T16:44:56.980 DEBUG:teuthology.orchestra.console.smithi001:power on output: Chassis Power Control: Up/On
2024-01-05T16:44:56.980 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-05T16:44:56.987 INFO:teuthology.orchestra.console.smithi149:Power on
2024-01-05T16:44:56.987 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-05T16:44:56.993 INFO:teuthology.orchestra.console.smithi153:Power on
2024-01-05T16:44:56.993 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-05T16:44:57.004 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is off
2024-01-05T16:44:57.007 DEBUG:teuthology.orchestra.console.smithi149:power on output: Chassis Power Control: Up/On
2024-01-05T16:44:57.008 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-05T16:44:57.016 DEBUG:teuthology.orchestra.console.smithi153:power on output: Chassis Power Control: Up/On
2024-01-05T16:44:57.017 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-05T16:44:57.028 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off
2024-01-05T16:44:57.037 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off
2024-01-05T16:45:01.008 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-05T16:45:01.029 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-05T16:45:01.038 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-05T16:45:01.116 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is off
2024-01-05T16:45:01.138 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on
2024-01-05T16:45:01.146 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off
2024-01-05T16:45:01.239 INFO:teuthology.orchestra.console.smithi149:Power on completed
2024-01-05T16:45:01.339 INFO:teuthology.provision.fog.smithi149:Waiting for deploy to finish
2024-01-05T16:45:05.120 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-05T16:45:05.147 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-05T16:45:05.230 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is on
2024-01-05T16:45:05.255 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on
2024-01-05T16:45:05.331 INFO:teuthology.orchestra.console.smithi001:Power on completed
2024-01-05T16:45:05.356 INFO:teuthology.orchestra.console.smithi153:Power on completed
2024-01-05T16:45:05.432 INFO:teuthology.provision.fog.smithi001:Waiting for deploy to finish
2024-01-05T16:45:05.457 INFO:teuthology.provision.fog.smithi153:Waiting for deploy to finish
2024-01-05T16:47:36.455 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:47:47.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:47:51.500 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:48:10.652 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1
2024-01-05T16:48:16.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:48:19.712 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1
2024-01-05T16:48:20.540 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149
2024-01-05T16:48:25.713 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:48:26.172 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2024-01-05T16:48:26.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:48:29.596 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149
2024-01-05T16:48:32.173 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:48:35.228 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2024-01-05T16:48:35.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:48:35.740 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149
2024-01-05T16:48:41.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:48:41.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:48:44.284 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2024-01-05T16:48:44.796 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149
2024-01-05T16:48:50.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:48:50.797 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:48:53.852 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149
2024-01-05T16:48:59.858 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:49:25.741 WARNING:teuthology.provision.fog.smithi001:timed out
2024-01-05T16:49:31.748 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:49:31.818 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-05T16:49:31.818 DEBUG:teuthology.orchestra.run.smithi001:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-05T16:49:31.894 INFO:teuthology.provision.fog.smithi001:Node is ready
2024-01-05T16:49:31.894 DEBUG:teuthology.orchestra.run.smithi001:> hostname
2024-01-05T16:49:31.956 INFO:teuthology.orchestra.run.smithi001.stdout:smithi001
2024-01-05T16:49:31.956 DEBUG:teuthology.orchestra.run.smithi001:> grep smithi001 /etc/hosts
2024-01-05T16:49:32.018 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1 smithi001 smithi001
2024-01-05T16:49:32.019 DEBUG:teuthology.orchestra.run.smithi001:> sudo hostname smithi001
2024-01-05T16:49:32.091 DEBUG:teuthology.orchestra.run.smithi001:> sudo sed -i -e 's/smithi001/smithi001/g' /etc/hosts
2024-01-05T16:49:32.162 DEBUG:teuthology.orchestra.run.smithi001:> sudo sed -i -e 's/172.21.15.1/172.21.15.1/g' /etc/hosts
2024-01-05T16:49:32.233 DEBUG:teuthology.orchestra.run.smithi001:> sudo sed -i -e 's/smithi001/smithi001/g' /etc/hostname
2024-01-05T16:49:32.304 DEBUG:teuthology.orchestra.run.smithi001:> sudo hostname smithi001
2024-01-05T16:49:32.374 DEBUG:teuthology.orchestra.run.smithi001:> cat /etc/os-release
2024-01-05T16:49:32.435 INFO:teuthology.orchestra.run.smithi001.stdout:NAME="CentOS Stream"
2024-01-05T16:49:32.435 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION="8"
2024-01-05T16:49:32.435 INFO:teuthology.orchestra.run.smithi001.stdout:ID="centos"
2024-01-05T16:49:32.435 INFO:teuthology.orchestra.run.smithi001.stdout:ID_LIKE="rhel fedora"
2024-01-05T16:49:32.435 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION_ID="8"
2024-01-05T16:49:32.435 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM_ID="platform:el8"
2024-01-05T16:49:32.435 INFO:teuthology.orchestra.run.smithi001.stdout:PRETTY_NAME="CentOS Stream 8"
2024-01-05T16:49:32.435 INFO:teuthology.orchestra.run.smithi001.stdout:ANSI_COLOR="0;31"
2024-01-05T16:49:32.435 INFO:teuthology.orchestra.run.smithi001.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-01-05T16:49:32.435 INFO:teuthology.orchestra.run.smithi001.stdout:HOME_URL="https://centos.org/"
2024-01-05T16:49:32.436 INFO:teuthology.orchestra.run.smithi001.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-05T16:49:32.436 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-05T16:49:32.436 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-05T16:49:32.436 INFO:teuthology.provision.fog.smithi001:Deploy complete!
2024-01-05T16:49:32.438 DEBUG:teuthology.parallel:result is None
2024-01-05T16:49:50.308 WARNING:teuthology.provision.fog.smithi153:timed out
2024-01-05T16:49:56.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:49:56.542 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-05T16:49:56.542 DEBUG:teuthology.orchestra.run.smithi153:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-05T16:49:56.811 INFO:teuthology.provision.fog.smithi153:Node is ready
2024-01-05T16:49:56.812 DEBUG:teuthology.orchestra.run.smithi153:> hostname
2024-01-05T16:49:56.831 INFO:teuthology.orchestra.run.smithi153.stdout:smithi153.front.sepia.ceph.com
2024-01-05T16:49:56.831 DEBUG:teuthology.orchestra.run.smithi153:> grep smithi153.front.sepia.ceph.com /etc/hosts
2024-01-05T16:49:56.890 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.15.153 smithi153.front.sepia.ceph.com smithi153
2024-01-05T16:49:56.891 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname smithi153
2024-01-05T16:49:57.013 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/smithi153.front.sepia.ceph.com/smithi153/g' /etc/hosts
2024-01-05T16:49:57.043 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/172.21.15.153/172.21.15.153/g' /etc/hosts
2024-01-05T16:49:57.112 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/smithi153.front.sepia.ceph.com/smithi153/g' /etc/hostname
2024-01-05T16:49:57.182 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname smithi153
2024-01-05T16:49:57.249 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release
2024-01-05T16:49:57.307 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="CentOS Stream"
2024-01-05T16:49:57.308 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="8"
2024-01-05T16:49:57.308 INFO:teuthology.orchestra.run.smithi153.stdout:ID="centos"
2024-01-05T16:49:57.308 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="rhel fedora"
2024-01-05T16:49:57.308 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="8"
2024-01-05T16:49:57.308 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el8"
2024-01-05T16:49:57.308 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="CentOS Stream 8"
2024-01-05T16:49:57.308 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31"
2024-01-05T16:49:57.308 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-01-05T16:49:57.308 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://centos.org/"
2024-01-05T16:49:57.308 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-05T16:49:57.308 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-05T16:49:57.308 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-05T16:49:57.309 INFO:teuthology.provision.fog.smithi153:Deploy complete!
2024-01-05T16:49:57.309 DEBUG:teuthology.parallel:result is None
2024-01-05T16:49:59.862 WARNING:teuthology.provision.fog.smithi149:timed out
2024-01-05T16:50:05.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:50:06.105 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-05T16:50:06.105 DEBUG:teuthology.orchestra.run.smithi149:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-05T16:50:06.364 INFO:teuthology.provision.fog.smithi149:Node is ready
2024-01-05T16:50:06.365 DEBUG:teuthology.orchestra.run.smithi149:> hostname
2024-01-05T16:50:06.383 INFO:teuthology.orchestra.run.smithi149.stdout:smithi149.front.sepia.ceph.com
2024-01-05T16:50:06.383 DEBUG:teuthology.orchestra.run.smithi149:> grep smithi149.front.sepia.ceph.com /etc/hosts
2024-01-05T16:50:06.442 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.15.149 smithi149.front.sepia.ceph.com smithi149
2024-01-05T16:50:06.442 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname smithi149
2024-01-05T16:50:06.575 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/smithi149.front.sepia.ceph.com/smithi149/g' /etc/hosts
2024-01-05T16:50:06.604 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/172.21.15.149/172.21.15.149/g' /etc/hosts
2024-01-05T16:50:06.672 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/smithi149.front.sepia.ceph.com/smithi149/g' /etc/hostname
2024-01-05T16:50:06.740 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname smithi149
2024-01-05T16:50:06.807 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release
2024-01-05T16:50:06.865 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="CentOS Stream"
2024-01-05T16:50:06.865 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="8"
2024-01-05T16:50:06.865 INFO:teuthology.orchestra.run.smithi149.stdout:ID="centos"
2024-01-05T16:50:06.866 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="rhel fedora"
2024-01-05T16:50:06.866 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="8"
2024-01-05T16:50:06.866 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el8"
2024-01-05T16:50:06.866 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="CentOS Stream 8"
2024-01-05T16:50:06.866 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31"
2024-01-05T16:50:06.866 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-01-05T16:50:06.866 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://centos.org/"
2024-01-05T16:50:06.866 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-05T16:50:06.866 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-05T16:50:06.866 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-05T16:50:06.866 INFO:teuthology.provision.fog.smithi149:Deploy complete!
2024-01-05T16:50:06.867 DEBUG:teuthology.parallel:result is None
2024-01-05T16:50:07.054 INFO:teuthology.lock.ops:Checking smithi001.front.sepia.ceph.com
2024-01-05T16:50:07.055 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-05T16:50:07.079 INFO:teuthology.lock.ops:Checking smithi149.front.sepia.ceph.com
2024-01-05T16:50:07.079 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-05T16:50:07.095 INFO:teuthology.lock.ops:Checking smithi153.front.sepia.ceph.com
2024-01-05T16:50:07.095 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-05T16:50:07.113 INFO:teuthology.lock.ops:Updating [smithi001.front.sepia.ceph.com]: set os type and version on server
2024-01-05T16:50:07.113 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com'
2024-01-05T16:50:07.113 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:50:07.182 DEBUG:teuthology.orchestra.run.smithi001:> true
2024-01-05T16:50:07.319 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi001.front.sepia.ceph.com'
2024-01-05T16:50:07.320 DEBUG:teuthology.orchestra.run.smithi001:> uname -m
2024-01-05T16:50:07.378 INFO:teuthology.orchestra.run.smithi001.stdout:x86_64
2024-01-05T16:50:07.379 DEBUG:teuthology.orchestra.run.smithi001:> cat /etc/os-release
2024-01-05T16:50:07.437 INFO:teuthology.orchestra.run.smithi001.stdout:NAME="CentOS Stream"
2024-01-05T16:50:07.437 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION="8"
2024-01-05T16:50:07.437 INFO:teuthology.orchestra.run.smithi001.stdout:ID="centos"
2024-01-05T16:50:07.437 INFO:teuthology.orchestra.run.smithi001.stdout:ID_LIKE="rhel fedora"
2024-01-05T16:50:07.437 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION_ID="8"
2024-01-05T16:50:07.437 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM_ID="platform:el8"
2024-01-05T16:50:07.438 INFO:teuthology.orchestra.run.smithi001.stdout:PRETTY_NAME="CentOS Stream 8"
2024-01-05T16:50:07.438 INFO:teuthology.orchestra.run.smithi001.stdout:ANSI_COLOR="0;31"
2024-01-05T16:50:07.438 INFO:teuthology.orchestra.run.smithi001.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-01-05T16:50:07.438 INFO:teuthology.orchestra.run.smithi001.stdout:HOME_URL="https://centos.org/"
2024-01-05T16:50:07.438 INFO:teuthology.orchestra.run.smithi001.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-05T16:50:07.438 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-05T16:50:07.438 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-05T16:50:07.438 INFO:teuthology.lock.ops:Updating smithi001.front.sepia.ceph.com on lock server
2024-01-05T16:50:07.462 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: set os type and version on server
2024-01-05T16:50:07.462 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com'
2024-01-05T16:50:07.463 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:50:07.529 DEBUG:teuthology.orchestra.run.smithi149:> true
2024-01-05T16:50:07.599 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com'
2024-01-05T16:50:07.599 DEBUG:teuthology.orchestra.run.smithi149:> uname -m
2024-01-05T16:50:07.657 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64
2024-01-05T16:50:07.657 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release
2024-01-05T16:50:07.715 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="CentOS Stream"
2024-01-05T16:50:07.715 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="8"
2024-01-05T16:50:07.715 INFO:teuthology.orchestra.run.smithi149.stdout:ID="centos"
2024-01-05T16:50:07.715 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="rhel fedora"
2024-01-05T16:50:07.715 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="8"
2024-01-05T16:50:07.715 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el8"
2024-01-05T16:50:07.715 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="CentOS Stream 8"
2024-01-05T16:50:07.715 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31"
2024-01-05T16:50:07.715 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-01-05T16:50:07.715 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://centos.org/"
2024-01-05T16:50:07.715 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-05T16:50:07.715 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-05T16:50:07.716 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-05T16:50:07.716 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server
2024-01-05T16:50:07.737 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: set os type and version on server
2024-01-05T16:50:07.737 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com'
2024-01-05T16:50:07.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-05T16:50:07.805 DEBUG:teuthology.orchestra.run.smithi153:> true
2024-01-05T16:50:07.941 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com'
2024-01-05T16:50:07.941 DEBUG:teuthology.orchestra.run.smithi153:> uname -m
2024-01-05T16:50:08.001 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64
2024-01-05T16:50:08.001 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release
2024-01-05T16:50:08.060 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="CentOS Stream"
2024-01-05T16:50:08.060 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="8"
2024-01-05T16:50:08.060 INFO:teuthology.orchestra.run.smithi153.stdout:ID="centos"
2024-01-05T16:50:08.060 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="rhel fedora"
2024-01-05T16:50:08.060 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="8"
2024-01-05T16:50:08.060 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el8"
2024-01-05T16:50:08.060 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="CentOS Stream 8"
2024-01-05T16:50:08.060 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31"
2024-01-05T16:50:08.060 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-01-05T16:50:08.060 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://centos.org/"
2024-01-05T16:50:08.060 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-05T16:50:08.061 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-05T16:50:08.061 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-05T16:50:08.061 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server
2024-01-05T16:50:08.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T16:50:08.168 INFO:teuthology.dispatcher.supervisor:Running job 7508229
2024-01-05T16:50:08.169 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/virtualenv/bin/teuthology -v --owner scheduled_lflores@teuthology --archive /home/teuthworker/archive/lflores-2024-01-05_16:44:37-rados:thrash-old-clients-wip-read-balancer-mgr-module-distro-default-smithi/7508229 --name lflores-2024-01-05_16:44:37-rados:thrash-old-clients-wip-read-balancer-mgr-module-distro-default-smithi --description rados:thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/radosbench} -- /home/teuthworker/archive/lflores-2024-01-05_16:44:37-rados:thrash-old-clients-wip-read-balancer-mgr-module-distro-default-smithi/7508229/orig.config.yaml
2024-01-05T16:50:08.171 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/lflores-2024-01-05_16:44:37-rados:thrash-old-clients-wip-read-balancer-mgr-module-distro-default-smithi/7508229
2024-01-05T16:50:08.172 INFO:teuthology.dispatcher.supervisor:Job PID: 2137610
2024-01-05T16:50:08.172 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-01-05T16:52:08.272 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-05T16:52:08.335 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-01-05T16:52:08.458 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2024-01-05T16:52:08.459 INFO:teuthology.nuke:Checking targets against current locks
2024-01-05T16:52:08.502 DEBUG:teuthology.nuke:shortname: smithi001
2024-01-05T16:52:08.502 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-05T16:52:08.526 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi001.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2024-01-05_16:44:37-rados:thrash-old-clients-wip-read-balancer-mgr-module-distro-default-smithi/7508229', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-05 16:44:55.066130', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKTG6qFELsIORSEk+0zQ55pUJX3c/AKBMfDDbSMslrqhDjfS+DnOOhRNMRUenuWpy+zkZW5YNK1MaVetApWgyok='}
2024-01-05T16:52:08.529 DEBUG:teuthology.nuke:shortname: smithi149
2024-01-05T16:52:08.529 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-05T16:52:08.557 DEBUG:teuthology.nuke:shortname: smithi153
2024-01-05T16:52:08.558 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-05T16:52:08.559 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi149.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2024-01-05_16:44:37-rados:thrash-old-clients-wip-read-balancer-mgr-module-distro-default-smithi/7508229', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-05 16:44:55.067782', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKVolyxagtZF2pDaErxhu+6fEqet9Fkph6iqNobc/vU2pjlS+Fvxc4gje8bXzxdSHA571kROE6SlYb8bZBB9qd0='}
2024-01-05T16:52:08.571 INFO:teuthology.orchestra.console.smithi001:Power off
2024-01-05T16:52:08.571 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-05T16:52:08.584 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2024-01-05_16:44:37-rados:thrash-old-clients-wip-read-balancer-mgr-module-distro-default-smithi/7508229', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-05 16:44:55.069129', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBClH2RiyJVJPoxsFCe2kVqI3FT0nqNsGxIHlVidyshZYctx2XyI5LH70kBZIjfVnKP8DGneSHnRRO0I5X7MPUVs='}
2024-01-05T16:52:08.593 DEBUG:teuthology.orchestra.console.smithi001:power off output: Chassis Power Control: Down/Off
2024-01-05T16:52:08.594 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-05T16:52:08.609 INFO:teuthology.orchestra.console.smithi149:Power off
2024-01-05T16:52:08.609 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-05T16:52:08.620 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is off
2024-01-05T16:52:08.629 DEBUG:teuthology.orchestra.console.smithi149:power off output: Chassis Power Control: Down/Off
2024-01-05T16:52:08.629 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-05T16:52:08.646 INFO:teuthology.orchestra.console.smithi153:Power off
2024-01-05T16:52:08.646 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-05T16:52:08.654 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off
2024-01-05T16:52:08.667 DEBUG:teuthology.orchestra.console.smithi153:power off output: Chassis Power Control: Down/Off
2024-01-05T16:52:08.667 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-05T16:52:08.692 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off
2024-01-05T16:52:08.721 INFO:teuthology.orchestra.console.smithi001:Power off completed
2024-01-05T16:52:08.755 INFO:teuthology.orchestra.console.smithi149:Power off completed
2024-01-05T16:52:08.793 INFO:teuthology.orchestra.console.smithi153:Power off completed
2024-01-05T16:52:08.859 INFO:teuthology.lock.ops:unlocked: smithi001.front.sepia.ceph.com
2024-01-05T16:52:08.901 INFO:teuthology.lock.ops:unlocked: smithi149.front.sepia.ceph.com
2024-01-05T16:52:08.934 INFO:teuthology.lock.ops:unlocked: smithi153.front.sepia.ceph.com