2023-12-14T18:00:43.176 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e
2023-12-14T18:00:43.177 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:00:43.383 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f6995dbc370>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f6996d02940>, signals=[15])
2023-12-14T18:00:43.383 INFO:teuthology.lock.ops:Start node 'smithi070.front.sepia.ceph.com' reimaging
2023-12-14T18:00:43.383 INFO:teuthology.lock.ops:Updating [smithi070.front.sepia.ceph.com]: reset os type and version on server
2023-12-14T18:00:43.384 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server
2023-12-14T18:00:45.275 INFO:teuthology.lock.ops:Start node 'smithi081.front.sepia.ceph.com' reimaging
2023-12-14T18:00:45.276 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: reset os type and version on server
2023-12-14T18:00:45.276 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server
2023-12-14T18:00:45.291 INFO:teuthology.lock.ops:Start node 'smithi114.front.sepia.ceph.com' reimaging
2023-12-14T18:00:45.291 INFO:teuthology.lock.ops:Updating [smithi114.front.sepia.ceph.com]: reset os type and version on server
2023-12-14T18:00:45.291 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server
2023-12-14T18:00:45.396 DEBUG:teuthology.provision.fog.smithi081:Requesting image smithi_rhel_8.6 (ID 5)
2023-12-14T18:00:45.402 DEBUG:teuthology.provision.fog.smithi114:Requesting image smithi_rhel_8.6 (ID 5)
2023-12-14T18:00:45.405 DEBUG:teuthology.provision.fog.smithi070:Requesting image smithi_rhel_8.6 (ID 5)
2023-12-14T18:00:45.430 INFO:teuthology.provision.fog.smithi081:Scheduling deploy of rhel 8.6
2023-12-14T18:00:45.440 INFO:teuthology.provision.fog.smithi114:Scheduling deploy of rhel 8.6
2023-12-14T18:00:45.449 INFO:teuthology.provision.fog.smithi070:Scheduling deploy of rhel 8.6
2023-12-14T18:00:45.718 INFO:teuthology.orchestra.console.smithi081:Power off
2023-12-14T18:00:45.718 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-14T18:00:45.731 INFO:teuthology.orchestra.console.smithi070:Power off
2023-12-14T18:00:45.731 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-14T18:00:45.741 INFO:teuthology.orchestra.console.smithi114:Power off
2023-12-14T18:00:45.741 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-14T18:00:45.749 DEBUG:teuthology.orchestra.console.smithi081:power off output: Chassis Power Control: Down/Off
2023-12-14T18:00:45.749 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T18:00:45.756 DEBUG:teuthology.orchestra.console.smithi070:power off output: Chassis Power Control: Down/Off
2023-12-14T18:00:45.757 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T18:00:45.763 DEBUG:teuthology.orchestra.console.smithi114:power off output: Chassis Power Control: Down/Off
2023-12-14T18:00:45.764 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T18:00:45.771 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off
2023-12-14T18:00:45.779 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is on
2023-12-14T18:00:45.790 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is off
2023-12-14T18:00:45.872 INFO:teuthology.orchestra.console.smithi081:Power off completed
2023-12-14T18:00:45.891 INFO:teuthology.orchestra.console.smithi114:Power off completed
2023-12-14T18:00:45.973 INFO:teuthology.orchestra.console.smithi081:Power on
2023-12-14T18:00:45.974 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-14T18:00:45.992 INFO:teuthology.orchestra.console.smithi114:Power on
2023-12-14T18:00:45.992 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-14T18:00:45.999 DEBUG:teuthology.orchestra.console.smithi081:power on output: Chassis Power Control: Up/On
2023-12-14T18:00:46.000 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T18:00:46.012 DEBUG:teuthology.orchestra.console.smithi114:power on output: Chassis Power Control: Up/On
2023-12-14T18:00:46.012 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T18:00:46.020 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off
2023-12-14T18:00:46.033 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is off
2023-12-14T18:00:49.783 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T18:00:49.891 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is on
2023-12-14T18:00:50.022 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T18:00:50.034 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T18:00:50.130 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off
2023-12-14T18:00:50.142 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is on
2023-12-14T18:00:50.242 INFO:teuthology.orchestra.console.smithi114:Power on completed
2023-12-14T18:00:50.343 INFO:teuthology.provision.fog.smithi114:Waiting for deploy to finish
2023-12-14T18:00:53.896 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T18:00:54.005 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is off
2023-12-14T18:00:54.105 INFO:teuthology.orchestra.console.smithi070:Power off completed
2023-12-14T18:00:54.131 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T18:00:54.206 INFO:teuthology.orchestra.console.smithi070:Power on
2023-12-14T18:00:54.206 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-14T18:00:54.226 DEBUG:teuthology.orchestra.console.smithi070:power on output: Chassis Power Control: Up/On
2023-12-14T18:00:54.227 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T18:00:54.239 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on
2023-12-14T18:00:54.246 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is off
2023-12-14T18:00:54.340 INFO:teuthology.orchestra.console.smithi081:Power on completed
2023-12-14T18:00:54.440 INFO:teuthology.provision.fog.smithi081:Waiting for deploy to finish
2023-12-14T18:00:58.251 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T18:00:58.360 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is off
2023-12-14T18:01:02.365 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T18:01:02.474 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is on
2023-12-14T18:01:02.574 INFO:teuthology.orchestra.console.smithi070:Power on completed
2023-12-14T18:01:02.675 INFO:teuthology.provision.fog.smithi070:Waiting for deploy to finish
2023-12-14T18:03:33.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:03:36.882 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70
2023-12-14T18:03:42.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:03:45.937 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70
2023-12-14T18:03:51.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:03:51.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:03:54.642 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114
2023-12-14T18:03:54.994 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70
2023-12-14T18:04:00.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:04:00.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:04:03.729 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114
2023-12-14T18:04:04.049 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70
2023-12-14T18:04:09.737 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:04:10.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:04:12.818 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114
2023-12-14T18:04:13.105 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70
2023-12-14T18:04:18.825 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:04:19.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:04:21.905 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114
2023-12-14T18:04:22.161 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70
2023-12-14T18:04:25.852 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:04:27.909 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:04:28.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:04:28.914 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2023-12-14T18:04:30.961 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114
2023-12-14T18:04:34.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:04:36.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:04:38.002 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2023-12-14T18:04:40.018 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114
2023-12-14T18:04:44.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:04:46.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:04:47.090 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2023-12-14T18:04:53.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:04:56.145 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2023-12-14T18:05:02.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:05:05.202 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2023-12-14T18:05:11.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:05:14.290 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2023-12-14T18:05:20.297 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:05:23.377 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2023-12-14T18:05:28.171 WARNING:teuthology.provision.fog.smithi070:timed out
2023-12-14T18:05:29.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:05:34.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:05:34.441 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-14T18:05:34.442 DEBUG:teuthology.orchestra.run.smithi070:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-14T18:05:34.720 INFO:teuthology.provision.fog.smithi070:Node is ready
2023-12-14T18:05:34.720 DEBUG:teuthology.orchestra.run.smithi070:> hostname
2023-12-14T18:05:34.777 INFO:teuthology.orchestra.run.smithi070.stdout:smithi070.front.sepia.ceph.com
2023-12-14T18:05:34.777 DEBUG:teuthology.orchestra.run.smithi070:> grep smithi070.front.sepia.ceph.com /etc/hosts
2023-12-14T18:05:34.835 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70 smithi070.front.sepia.ceph.com smithi070
2023-12-14T18:05:34.835 DEBUG:teuthology.orchestra.run.smithi070:> sudo hostname smithi070
2023-12-14T18:05:34.959 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i -e 's/smithi070.front.sepia.ceph.com/smithi070/g' /etc/hosts
2023-12-14T18:05:34.987 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i -e 's/172.21.15.70/172.21.15.70/g' /etc/hosts
2023-12-14T18:05:35.054 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i -e 's/smithi070.front.sepia.ceph.com/smithi070/g' /etc/hostname
2023-12-14T18:05:35.123 DEBUG:teuthology.orchestra.run.smithi070:> sudo hostname smithi070
2023-12-14T18:05:35.189 DEBUG:teuthology.orchestra.run.smithi070:> cat /etc/os-release
2023-12-14T18:05:35.245 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="Red Hat Enterprise Linux"
2023-12-14T18:05:35.245 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="8.6 (Ootpa)"
2023-12-14T18:05:35.245 INFO:teuthology.orchestra.run.smithi070.stdout:ID="rhel"
2023-12-14T18:05:35.245 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE="fedora"
2023-12-14T18:05:35.246 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="8.6"
2023-12-14T18:05:35.246 INFO:teuthology.orchestra.run.smithi070.stdout:PLATFORM_ID="platform:el8"
2023-12-14T18:05:35.246 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-14T18:05:35.246 INFO:teuthology.orchestra.run.smithi070.stdout:ANSI_COLOR="0;31"
2023-12-14T18:05:35.246 INFO:teuthology.orchestra.run.smithi070.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-14T18:05:35.246 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://www.redhat.com/"
2023-12-14T18:05:35.246 INFO:teuthology.orchestra.run.smithi070.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-14T18:05:35.246 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-14T18:05:35.246 INFO:teuthology.orchestra.run.smithi070.stdout:
2023-12-14T18:05:35.247 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-14T18:05:35.247 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-14T18:05:35.247 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-14T18:05:35.247 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-14T18:05:35.248 INFO:teuthology.provision.fog.smithi070:Deploy complete!
2023-12-14T18:05:35.249 DEBUG:teuthology.parallel:result is None
2023-12-14T18:05:46.035 WARNING:teuthology.provision.fog.smithi114:timed out
2023-12-14T18:05:52.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:05:52.465 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-14T18:05:52.465 DEBUG:teuthology.orchestra.run.smithi114:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-14T18:05:52.802 INFO:teuthology.provision.fog.smithi114:Node is ready
2023-12-14T18:05:52.802 DEBUG:teuthology.orchestra.run.smithi114:> hostname
2023-12-14T18:05:52.821 INFO:teuthology.orchestra.run.smithi114.stdout:smithi114
2023-12-14T18:05:52.821 DEBUG:teuthology.orchestra.run.smithi114:> grep smithi114 /etc/hosts
2023-12-14T18:05:52.880 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114 smithi114.front.sepia.ceph.com smithi114
2023-12-14T18:05:52.880 DEBUG:teuthology.orchestra.run.smithi114:> sudo hostname smithi114
2023-12-14T18:05:53.005 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/smithi114/smithi114/g' /etc/hosts
2023-12-14T18:05:53.035 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/172.21.15.114/172.21.15.114/g' /etc/hosts
2023-12-14T18:05:53.102 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/smithi114/smithi114/g' /etc/hostname
2023-12-14T18:05:53.170 DEBUG:teuthology.orchestra.run.smithi114:> sudo hostname smithi114
2023-12-14T18:05:53.237 DEBUG:teuthology.orchestra.run.smithi114:> cat /etc/os-release
2023-12-14T18:05:53.294 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="Red Hat Enterprise Linux"
2023-12-14T18:05:53.295 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="8.6 (Ootpa)"
2023-12-14T18:05:53.295 INFO:teuthology.orchestra.run.smithi114.stdout:ID="rhel"
2023-12-14T18:05:53.295 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE="fedora"
2023-12-14T18:05:53.295 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="8.6"
2023-12-14T18:05:53.295 INFO:teuthology.orchestra.run.smithi114.stdout:PLATFORM_ID="platform:el8"
2023-12-14T18:05:53.295 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-14T18:05:53.295 INFO:teuthology.orchestra.run.smithi114.stdout:ANSI_COLOR="0;31"
2023-12-14T18:05:53.295 INFO:teuthology.orchestra.run.smithi114.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-14T18:05:53.296 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://www.redhat.com/"
2023-12-14T18:05:53.296 INFO:teuthology.orchestra.run.smithi114.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-14T18:05:53.296 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-14T18:05:53.296 INFO:teuthology.orchestra.run.smithi114.stdout:
2023-12-14T18:05:53.296 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-14T18:05:53.296 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-14T18:05:53.296 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-14T18:05:53.296 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-14T18:05:53.297 INFO:teuthology.provision.fog.smithi114:Deploy complete!
2023-12-14T18:05:53.297 DEBUG:teuthology.parallel:result is None
2023-12-14T18:06:29.399 WARNING:teuthology.provision.fog.smithi081:timed out
2023-12-14T18:06:35.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:06:35.679 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-14T18:06:35.679 DEBUG:teuthology.orchestra.run.smithi081:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-14T18:06:35.970 INFO:teuthology.provision.fog.smithi081:Node is ready
2023-12-14T18:06:35.970 DEBUG:teuthology.orchestra.run.smithi081:> hostname
2023-12-14T18:06:35.988 INFO:teuthology.orchestra.run.smithi081.stdout:smithi081.front.sepia.ceph.com
2023-12-14T18:06:35.988 DEBUG:teuthology.orchestra.run.smithi081:> grep smithi081.front.sepia.ceph.com /etc/hosts
2023-12-14T18:06:36.046 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81 smithi081.front.sepia.ceph.com smithi081
2023-12-14T18:06:36.046 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname smithi081
2023-12-14T18:06:36.163 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/smithi081.front.sepia.ceph.com/smithi081/g' /etc/hosts
2023-12-14T18:06:36.191 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/172.21.15.81/172.21.15.81/g' /etc/hosts
2023-12-14T18:06:36.258 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/smithi081.front.sepia.ceph.com/smithi081/g' /etc/hostname
2023-12-14T18:06:36.325 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname smithi081
2023-12-14T18:06:36.392 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release
2023-12-14T18:06:36.452 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="Red Hat Enterprise Linux"
2023-12-14T18:06:36.453 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="8.6 (Ootpa)"
2023-12-14T18:06:36.453 INFO:teuthology.orchestra.run.smithi081.stdout:ID="rhel"
2023-12-14T18:06:36.453 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="fedora"
2023-12-14T18:06:36.453 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="8.6"
2023-12-14T18:06:36.453 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el8"
2023-12-14T18:06:36.453 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-14T18:06:36.453 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31"
2023-12-14T18:06:36.453 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-14T18:06:36.453 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://www.redhat.com/"
2023-12-14T18:06:36.453 INFO:teuthology.orchestra.run.smithi081.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-14T18:06:36.453 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-14T18:06:36.453 INFO:teuthology.orchestra.run.smithi081.stdout:
2023-12-14T18:06:36.454 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-14T18:06:36.454 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-14T18:06:36.454 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-14T18:06:36.454 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-14T18:06:36.454 INFO:teuthology.provision.fog.smithi081:Deploy complete!
2023-12-14T18:06:36.455 DEBUG:teuthology.parallel:result is None
2023-12-14T18:06:36.640 INFO:teuthology.lock.ops:Checking smithi070.front.sepia.ceph.com
2023-12-14T18:06:36.641 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-14T18:06:36.668 INFO:teuthology.lock.ops:Checking smithi081.front.sepia.ceph.com
2023-12-14T18:06:36.668 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-14T18:06:36.684 INFO:teuthology.lock.ops:Checking smithi114.front.sepia.ceph.com
2023-12-14T18:06:36.684 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-14T18:06:36.702 INFO:teuthology.lock.ops:Updating [smithi070.front.sepia.ceph.com]: set os type and version on server
2023-12-14T18:06:36.703 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com'
2023-12-14T18:06:36.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:06:36.772 DEBUG:teuthology.orchestra.run.smithi070:> true
2023-12-14T18:06:36.911 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com'
2023-12-14T18:06:36.911 DEBUG:teuthology.orchestra.run.smithi070:> uname -m
2023-12-14T18:06:36.968 INFO:teuthology.orchestra.run.smithi070.stdout:x86_64
2023-12-14T18:06:36.969 DEBUG:teuthology.orchestra.run.smithi070:> cat /etc/os-release
2023-12-14T18:06:37.025 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="Red Hat Enterprise Linux"
2023-12-14T18:06:37.025 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="8.6 (Ootpa)"
2023-12-14T18:06:37.025 INFO:teuthology.orchestra.run.smithi070.stdout:ID="rhel"
2023-12-14T18:06:37.026 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE="fedora"
2023-12-14T18:06:37.026 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="8.6"
2023-12-14T18:06:37.026 INFO:teuthology.orchestra.run.smithi070.stdout:PLATFORM_ID="platform:el8"
2023-12-14T18:06:37.026 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-14T18:06:37.026 INFO:teuthology.orchestra.run.smithi070.stdout:ANSI_COLOR="0;31"
2023-12-14T18:06:37.026 INFO:teuthology.orchestra.run.smithi070.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-14T18:06:37.026 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://www.redhat.com/"
2023-12-14T18:06:37.026 INFO:teuthology.orchestra.run.smithi070.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-14T18:06:37.026 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-14T18:06:37.026 INFO:teuthology.orchestra.run.smithi070.stdout:
2023-12-14T18:06:37.026 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-14T18:06:37.026 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-14T18:06:37.026 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-14T18:06:37.027 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-14T18:06:37.027 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server
2023-12-14T18:06:37.052 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: set os type and version on server
2023-12-14T18:06:37.052 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com'
2023-12-14T18:06:37.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:06:37.123 DEBUG:teuthology.orchestra.run.smithi081:> true
2023-12-14T18:06:37.191 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com'
2023-12-14T18:06:37.191 DEBUG:teuthology.orchestra.run.smithi081:> uname -m
2023-12-14T18:06:37.250 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64
2023-12-14T18:06:37.251 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release
2023-12-14T18:06:37.310 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="Red Hat Enterprise Linux"
2023-12-14T18:06:37.310 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="8.6 (Ootpa)"
2023-12-14T18:06:37.311 INFO:teuthology.orchestra.run.smithi081.stdout:ID="rhel"
2023-12-14T18:06:37.311 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="fedora"
2023-12-14T18:06:37.311 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="8.6"
2023-12-14T18:06:37.311 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el8"
2023-12-14T18:06:37.311 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-14T18:06:37.311 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31"
2023-12-14T18:06:37.311 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-14T18:06:37.311 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://www.redhat.com/"
2023-12-14T18:06:37.311 INFO:teuthology.orchestra.run.smithi081.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-14T18:06:37.311 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-14T18:06:37.311 INFO:teuthology.orchestra.run.smithi081.stdout:
2023-12-14T18:06:37.312 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-14T18:06:37.312 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-14T18:06:37.312 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-14T18:06:37.312 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-14T18:06:37.312 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server
2023-12-14T18:06:37.334 INFO:teuthology.lock.ops:Updating [smithi114.front.sepia.ceph.com]: set os type and version on server
2023-12-14T18:06:37.335 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com'
2023-12-14T18:06:37.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:06:37.405 DEBUG:teuthology.orchestra.run.smithi114:> true
2023-12-14T18:06:37.497 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi114.front.sepia.ceph.com'
2023-12-14T18:06:37.498 DEBUG:teuthology.orchestra.run.smithi114:> uname -m
2023-12-14T18:06:37.557 INFO:teuthology.orchestra.run.smithi114.stdout:x86_64
2023-12-14T18:06:37.557 DEBUG:teuthology.orchestra.run.smithi114:> cat /etc/os-release
2023-12-14T18:06:37.615 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="Red Hat Enterprise Linux"
2023-12-14T18:06:37.615 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="8.6 (Ootpa)"
2023-12-14T18:06:37.615 INFO:teuthology.orchestra.run.smithi114.stdout:ID="rhel"
2023-12-14T18:06:37.615 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE="fedora"
2023-12-14T18:06:37.615 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="8.6"
2023-12-14T18:06:37.615 INFO:teuthology.orchestra.run.smithi114.stdout:PLATFORM_ID="platform:el8"
2023-12-14T18:06:37.615 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-14T18:06:37.615 INFO:teuthology.orchestra.run.smithi114.stdout:ANSI_COLOR="0;31"
2023-12-14T18:06:37.615 INFO:teuthology.orchestra.run.smithi114.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-14T18:06:37.615 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://www.redhat.com/"
2023-12-14T18:06:37.615 INFO:teuthology.orchestra.run.smithi114.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-14T18:06:37.616 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-14T18:06:37.616 INFO:teuthology.orchestra.run.smithi114.stdout:
2023-12-14T18:06:37.616 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-14T18:06:37.616 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-14T18:06:37.616 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-14T18:06:37.616 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-14T18:06:37.616 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server
2023-12-14T18:06:37.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:06:37.730 INFO:teuthology.dispatcher.supervisor:Running job 7491437
2023-12-14T18:06:37.730 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_choffman@teuthology --archive /home/teuthworker/archive/choffman-2023-12-14_17:59:30-fs-wip-choffman-62793-distro-default-smithi/7491437 --name choffman-2023-12-14_17:59:30-fs-wip-choffman-62793-distro-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/fs/misc}} -- /home/teuthworker/archive/choffman-2023-12-14_17:59:30-fs-wip-choffman-62793-distro-default-smithi/7491437/orig.config.yaml
2023-12-14T18:06:37.733 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/choffman-2023-12-14_17:59:30-fs-wip-choffman-62793-distro-default-smithi/7491437
2023-12-14T18:06:37.733 INFO:teuthology.dispatcher.supervisor:Job PID: 1293087
2023-12-14T18:06:37.733 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-12-14T18:08:37.834 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:10:37.910 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:12:38.082 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:14:38.221 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:16:38.322 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:18:38.571 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:20:38.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:22:38.888 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:24:39.020 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:26:39.093 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:28:39.188 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:30:39.468 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:32:39.602 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:34:39.770 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:36:39.909 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:38:40.058 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:40:40.226 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:40:40.301 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-12-14T18:40:40.442 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-12-14T18:40:40.443 INFO:teuthology.nuke:Checking targets against current locks
2023-12-14T18:40:40.497 DEBUG:teuthology.nuke:shortname: smithi070
2023-12-14T18:40:40.498 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-14T18:40:40.519 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi070.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-12-14_17:59:30-fs-wip-choffman-62793-distro-default-smithi/7491437', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-14 18:00:33.253912', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNYMhxNSB6oDz1u3RlpIDyuM7Wuef1FCp4Va4vplfM0dQCmSlbEVX/JSvF95m2i3n2K2j6Uv7N00c3svBhNeBd0='}
2023-12-14T18:40:40.520 DEBUG:teuthology.nuke:shortname: smithi081
2023-12-14T18:40:40.521 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-14T18:40:40.538 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-12-14_17:59:30-fs-wip-choffman-62793-distro-default-smithi/7491437', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-14 18:00:33.252338', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHpWYWl65oqDu4VVJh3FKTf5G8mB4LloLG+Zu8BDISBT441NPuox3u8HDXSEYvOaMVETScWPcAHl6YA2sJd7sTs='}
2023-12-14T18:40:40.542 DEBUG:teuthology.nuke:shortname: smithi114
2023-12-14T18:40:40.542 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-14T18:40:40.568 INFO:teuthology.orchestra.console.smithi070:Power off
2023-12-14T18:40:40.569 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-14T18:40:40.579 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi114.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-12-14_17:59:30-fs-wip-choffman-62793-distro-default-smithi/7491437', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-14 18:00:33.255137', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI3pXBZiwl7g34lgQh6Poed1Dzs++mO1ypY4uzElQ39PupFSXSpHo47uxp0/g1vbAY3B4pWgi1WgwZPg7SvY6f8='}
2023-12-14T18:40:40.590 DEBUG:teuthology.orchestra.console.smithi070:power off output: Chassis Power Control: Down/Off
2023-12-14T18:40:40.590 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T18:40:40.607 INFO:teuthology.orchestra.console.smithi081:Power off
2023-12-14T18:40:40.607 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-14T18:40:40.618 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is off
2023-12-14T18:40:40.627 DEBUG:teuthology.orchestra.console.smithi081:power off output: Chassis Power Control: Down/Off
2023-12-14T18:40:40.627 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T18:40:40.643 INFO:teuthology.orchestra.console.smithi114:Power off
2023-12-14T18:40:40.643 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-14T18:40:40.651 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off
2023-12-14T18:40:40.664 DEBUG:teuthology.orchestra.console.smithi114:power off output: Chassis Power Control: Down/Off
2023-12-14T18:40:40.665 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T18:40:40.685 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is off
2023-12-14T18:40:40.719 INFO:teuthology.orchestra.console.smithi070:Power off completed
2023-12-14T18:40:40.752 INFO:teuthology.orchestra.console.smithi081:Power off completed
2023-12-14T18:40:40.786 INFO:teuthology.orchestra.console.smithi114:Power off completed
2023-12-14T18:40:40.873 INFO:teuthology.lock.ops:unlocked: smithi070.front.sepia.ceph.com
2023-12-14T18:40:40.900 INFO:teuthology.lock.ops:unlocked: smithi081.front.sepia.ceph.com
2023-12-14T18:40:40.933 INFO:teuthology.lock.ops:unlocked: smithi114.front.sepia.ceph.com