2023-12-14T18:00:43.178 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e
2023-12-14T18:00:43.179 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:00:43.483 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f3cb680f310>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f3cb7765940>, signals=[15])
2023-12-14T18:00:43.484 INFO:teuthology.lock.ops:Start node 'smithi007.front.sepia.ceph.com' reimaging
2023-12-14T18:00:43.484 INFO:teuthology.lock.ops:Updating [smithi007.front.sepia.ceph.com]: reset os type and version on server
2023-12-14T18:00:43.484 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server
2023-12-14T18:00:43.500 INFO:teuthology.lock.ops:Start node 'smithi043.front.sepia.ceph.com' reimaging
2023-12-14T18:00:43.500 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: reset os type and version on server
2023-12-14T18:00:43.500 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server
2023-12-14T18:00:43.525 INFO:teuthology.lock.ops:Start node 'smithi111.front.sepia.ceph.com' reimaging
2023-12-14T18:00:43.525 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: reset os type and version on server
2023-12-14T18:00:43.525 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server
2023-12-14T18:00:43.780 DEBUG:teuthology.provision.fog.smithi111:Requesting image smithi_rhel_8.6 (ID 5)
2023-12-14T18:00:43.784 DEBUG:teuthology.provision.fog.smithi007:Requesting image smithi_rhel_8.6 (ID 5)
2023-12-14T18:00:43.806 DEBUG:teuthology.provision.fog.smithi043:Requesting image smithi_rhel_8.6 (ID 5)
2023-12-14T18:00:43.901 INFO:teuthology.provision.fog.smithi007:Scheduling deploy of rhel 8.6
2023-12-14T18:00:43.906 INFO:teuthology.provision.fog.smithi111:Scheduling deploy of rhel 8.6
2023-12-14T18:00:43.943 INFO:teuthology.provision.fog.smithi043:Scheduling deploy of rhel 8.6
2023-12-14T18:00:44.533 INFO:teuthology.orchestra.console.smithi007:Power off
2023-12-14T18:00:44.533 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-14T18:00:44.554 DEBUG:teuthology.orchestra.console.smithi007:power off output: Chassis Power Control: Down/Off
2023-12-14T18:00:44.555 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T18:00:44.580 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is on
2023-12-14T18:00:44.667 INFO:teuthology.orchestra.console.smithi043:Power off
2023-12-14T18:00:44.667 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-14T18:00:44.680 INFO:teuthology.orchestra.console.smithi111:Power off
2023-12-14T18:00:44.680 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-14T18:00:44.690 DEBUG:teuthology.orchestra.console.smithi043:power off output: Chassis Power Control: Down/Off
2023-12-14T18:00:44.691 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T18:00:44.701 DEBUG:teuthology.orchestra.console.smithi111:power off output: Chassis Power Control: Down/Off
2023-12-14T18:00:44.701 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T18:00:44.711 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off
2023-12-14T18:00:44.720 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off
2023-12-14T18:00:44.812 INFO:teuthology.orchestra.console.smithi043:Power off completed
2023-12-14T18:00:44.821 INFO:teuthology.orchestra.console.smithi111:Power off completed
2023-12-14T18:00:44.913 INFO:teuthology.orchestra.console.smithi043:Power on
2023-12-14T18:00:44.914 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-14T18:00:44.922 INFO:teuthology.orchestra.console.smithi111:Power on
2023-12-14T18:00:44.923 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-14T18:00:44.934 DEBUG:teuthology.orchestra.console.smithi043:power on output: Chassis Power Control: Up/On
2023-12-14T18:00:44.935 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T18:00:44.944 DEBUG:teuthology.orchestra.console.smithi111:power on output: Chassis Power Control: Up/On
2023-12-14T18:00:44.945 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T18:00:44.956 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off
2023-12-14T18:00:44.964 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off
2023-12-14T18:00:48.581 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T18:00:48.690 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is on
2023-12-14T18:00:48.957 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T18:00:48.964 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T18:00:49.065 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is on
2023-12-14T18:00:49.072 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on
2023-12-14T18:00:49.167 INFO:teuthology.orchestra.console.smithi043:Power on completed
2023-12-14T18:00:49.173 INFO:teuthology.orchestra.console.smithi111:Power on completed
2023-12-14T18:00:49.267 INFO:teuthology.provision.fog.smithi043:Waiting for deploy to finish
2023-12-14T18:00:49.274 INFO:teuthology.provision.fog.smithi111:Waiting for deploy to finish
2023-12-14T18:00:52.695 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T18:00:52.803 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is off
2023-12-14T18:00:52.903 INFO:teuthology.orchestra.console.smithi007:Power off completed
2023-12-14T18:00:53.004 INFO:teuthology.orchestra.console.smithi007:Power on
2023-12-14T18:00:53.004 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-14T18:00:53.024 DEBUG:teuthology.orchestra.console.smithi007:power on output: Chassis Power Control: Up/On
2023-12-14T18:00:53.024 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T18:00:53.044 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is off
2023-12-14T18:00:57.047 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T18:00:57.156 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is off
2023-12-14T18:01:01.160 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T18:01:01.270 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is on
2023-12-14T18:01:01.371 INFO:teuthology.orchestra.console.smithi007:Power on completed
2023-12-14T18:01:01.471 INFO:teuthology.provision.fog.smithi007:Waiting for deploy to finish
2023-12-14T18:03:32.875 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:03:35.501 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:03:35.955 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7
2023-12-14T18:03:38.578 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2023-12-14T18:03:41.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:03:44.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:03:45.042 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7
2023-12-14T18:03:47.634 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2023-12-14T18:03:51.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:03:53.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:03:54.098 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7
2023-12-14T18:03:56.690 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2023-12-14T18:04:00.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:04:02.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:04:03.154 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7
2023-12-14T18:04:05.745 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2023-12-14T18:04:09.159 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:04:11.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:04:12.209 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7
2023-12-14T18:04:14.802 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2023-12-14T18:04:18.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:04:20.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:04:20.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:04:21.208 ERROR:teuthology.orchestra.connection:Error authenticating with smithi111.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-14T18:05:18.217 WARNING:teuthology.provision.fog.smithi007:timed out
2023-12-14T18:05:20.804 WARNING:teuthology.provision.fog.smithi043:timed out
2023-12-14T18:05:24.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:05:24.570 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-14T18:05:24.571 DEBUG:teuthology.orchestra.run.smithi007:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-14T18:05:24.877 INFO:teuthology.provision.fog.smithi007:Node is ready
2023-12-14T18:05:24.878 DEBUG:teuthology.orchestra.run.smithi007:> hostname
2023-12-14T18:05:24.900 INFO:teuthology.orchestra.run.smithi007.stdout:smithi007.front.sepia.ceph.com
2023-12-14T18:05:24.900 DEBUG:teuthology.orchestra.run.smithi007:> grep smithi007.front.sepia.ceph.com /etc/hosts
2023-12-14T18:05:24.961 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7 smithi007.front.sepia.ceph.com smithi007
2023-12-14T18:05:24.961 DEBUG:teuthology.orchestra.run.smithi007:> sudo hostname smithi007
2023-12-14T18:05:25.109 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i -e 's/smithi007.front.sepia.ceph.com/smithi007/g' /etc/hosts
2023-12-14T18:05:25.144 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i -e 's/172.21.15.7/172.21.15.7/g' /etc/hosts
2023-12-14T18:05:25.212 WARNING:teuthology.provision.fog.smithi111:timed out
2023-12-14T18:05:25.218 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i -e 's/smithi007.front.sepia.ceph.com/smithi007/g' /etc/hostname
2023-12-14T18:05:25.293 DEBUG:teuthology.orchestra.run.smithi007:> sudo hostname smithi007
2023-12-14T18:05:25.368 DEBUG:teuthology.orchestra.run.smithi007:> cat /etc/os-release
2023-12-14T18:05:25.429 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="Red Hat Enterprise Linux"
2023-12-14T18:05:25.429 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="8.6 (Ootpa)"
2023-12-14T18:05:25.429 INFO:teuthology.orchestra.run.smithi007.stdout:ID="rhel"
2023-12-14T18:05:25.429 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE="fedora"
2023-12-14T18:05:25.429 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="8.6"
2023-12-14T18:05:25.429 INFO:teuthology.orchestra.run.smithi007.stdout:PLATFORM_ID="platform:el8"
2023-12-14T18:05:25.429 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-14T18:05:25.429 INFO:teuthology.orchestra.run.smithi007.stdout:ANSI_COLOR="0;31"
2023-12-14T18:05:25.429 INFO:teuthology.orchestra.run.smithi007.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-14T18:05:25.429 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://www.redhat.com/"
2023-12-14T18:05:25.430 INFO:teuthology.orchestra.run.smithi007.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-14T18:05:25.430 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-14T18:05:25.430 INFO:teuthology.orchestra.run.smithi007.stdout:
2023-12-14T18:05:25.430 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-14T18:05:25.430 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-14T18:05:25.430 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-14T18:05:25.430 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-14T18:05:25.432 INFO:teuthology.provision.fog.smithi007:Deploy complete!
2023-12-14T18:05:25.433 DEBUG:teuthology.parallel:result is None
2023-12-14T18:05:26.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:05:27.155 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-14T18:05:27.156 DEBUG:teuthology.orchestra.run.smithi043:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-14T18:05:27.493 INFO:teuthology.provision.fog.smithi043:Node is ready
2023-12-14T18:05:27.493 DEBUG:teuthology.orchestra.run.smithi043:> hostname
2023-12-14T18:05:27.514 INFO:teuthology.orchestra.run.smithi043.stdout:smithi043.front.sepia.ceph.com
2023-12-14T18:05:27.514 DEBUG:teuthology.orchestra.run.smithi043:> grep smithi043.front.sepia.ceph.com /etc/hosts
2023-12-14T18:05:27.575 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43 smithi043.front.sepia.ceph.com smithi043
2023-12-14T18:05:27.576 DEBUG:teuthology.orchestra.run.smithi043:> sudo hostname smithi043
2023-12-14T18:05:27.710 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/smithi043.front.sepia.ceph.com/smithi043/g' /etc/hosts
2023-12-14T18:05:27.744 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/172.21.15.43/172.21.15.43/g' /etc/hosts
2023-12-14T18:05:27.820 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/smithi043.front.sepia.ceph.com/smithi043/g' /etc/hostname
2023-12-14T18:05:27.894 DEBUG:teuthology.orchestra.run.smithi043:> sudo hostname smithi043
2023-12-14T18:05:27.969 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release
2023-12-14T18:05:28.030 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="Red Hat Enterprise Linux"
2023-12-14T18:05:28.030 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="8.6 (Ootpa)"
2023-12-14T18:05:28.030 INFO:teuthology.orchestra.run.smithi043.stdout:ID="rhel"
2023-12-14T18:05:28.030 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="fedora"
2023-12-14T18:05:28.031 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="8.6"
2023-12-14T18:05:28.031 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el8"
2023-12-14T18:05:28.031 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-14T18:05:28.031 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31"
2023-12-14T18:05:28.031 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-14T18:05:28.031 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://www.redhat.com/"
2023-12-14T18:05:28.031 INFO:teuthology.orchestra.run.smithi043.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-14T18:05:28.031 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-14T18:05:28.032 INFO:teuthology.orchestra.run.smithi043.stdout:
2023-12-14T18:05:28.032 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-14T18:05:28.032 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-14T18:05:28.032 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-14T18:05:28.032 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-14T18:05:28.032 INFO:teuthology.provision.fog.smithi043:Deploy complete!
2023-12-14T18:05:28.033 DEBUG:teuthology.parallel:result is None
2023-12-14T18:05:31.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:05:34.290 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-12-14T18:05:40.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:05:58.674 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-12-14T18:06:04.675 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:06:07.729 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-12-14T18:06:13.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:06:16.786 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-12-14T18:06:22.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:06:23.143 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-14T18:06:23.144 DEBUG:teuthology.orchestra.run.smithi111:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-14T18:06:43.470 INFO:teuthology.provision.fog.smithi111:Node is ready
2023-12-14T18:06:43.470 DEBUG:teuthology.orchestra.run.smithi111:> hostname
2023-12-14T18:06:43.491 INFO:teuthology.orchestra.run.smithi111.stdout:smithi111.front.sepia.ceph.com
2023-12-14T18:06:43.491 DEBUG:teuthology.orchestra.run.smithi111:> grep smithi111.front.sepia.ceph.com /etc/hosts
2023-12-14T18:06:43.552 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111 smithi111.front.sepia.ceph.com smithi111
2023-12-14T18:06:43.552 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111
2023-12-14T18:06:43.684 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hosts
2023-12-14T18:06:43.715 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/172.21.15.111/172.21.15.111/g' /etc/hosts
2023-12-14T18:06:43.783 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hostname
2023-12-14T18:06:43.853 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111
2023-12-14T18:06:43.921 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release
2023-12-14T18:06:43.978 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="Red Hat Enterprise Linux"
2023-12-14T18:06:43.978 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="8.6 (Ootpa)"
2023-12-14T18:06:43.978 INFO:teuthology.orchestra.run.smithi111.stdout:ID="rhel"
2023-12-14T18:06:43.978 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="fedora"
2023-12-14T18:06:43.978 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="8.6"
2023-12-14T18:06:43.978 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el8"
2023-12-14T18:06:43.978 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-14T18:06:43.978 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31"
2023-12-14T18:06:43.978 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-14T18:06:43.978 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://www.redhat.com/"
2023-12-14T18:06:43.978 INFO:teuthology.orchestra.run.smithi111.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-14T18:06:43.979 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-14T18:06:43.979 INFO:teuthology.orchestra.run.smithi111.stdout:
2023-12-14T18:06:43.979 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-14T18:06:43.979 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-14T18:06:43.979 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-14T18:06:43.979 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-14T18:06:43.979 INFO:teuthology.provision.fog.smithi111:Deploy complete!
2023-12-14T18:06:43.980 DEBUG:teuthology.parallel:result is None
2023-12-14T18:06:44.171 INFO:teuthology.lock.ops:Checking smithi007.front.sepia.ceph.com
2023-12-14T18:06:44.171 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-14T18:06:44.201 INFO:teuthology.lock.ops:Checking smithi043.front.sepia.ceph.com
2023-12-14T18:06:44.201 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-14T18:06:44.217 INFO:teuthology.lock.ops:Checking smithi111.front.sepia.ceph.com
2023-12-14T18:06:44.217 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-14T18:06:44.235 INFO:teuthology.lock.ops:Updating [smithi007.front.sepia.ceph.com]: set os type and version on server
2023-12-14T18:06:44.235 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com'
2023-12-14T18:06:44.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:06:44.304 DEBUG:teuthology.orchestra.run.smithi007:> true
2023-12-14T18:06:44.445 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi007.front.sepia.ceph.com'
2023-12-14T18:06:44.445 DEBUG:teuthology.orchestra.run.smithi007:> uname -m
2023-12-14T18:06:44.507 INFO:teuthology.orchestra.run.smithi007.stdout:x86_64
2023-12-14T18:06:44.507 DEBUG:teuthology.orchestra.run.smithi007:> cat /etc/os-release
2023-12-14T18:06:44.568 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="Red Hat Enterprise Linux"
2023-12-14T18:06:44.568 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="8.6 (Ootpa)"
2023-12-14T18:06:44.568 INFO:teuthology.orchestra.run.smithi007.stdout:ID="rhel"
2023-12-14T18:06:44.568 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE="fedora"
2023-12-14T18:06:44.568 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="8.6"
2023-12-14T18:06:44.568 INFO:teuthology.orchestra.run.smithi007.stdout:PLATFORM_ID="platform:el8"
2023-12-14T18:06:44.568 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-14T18:06:44.569 INFO:teuthology.orchestra.run.smithi007.stdout:ANSI_COLOR="0;31"
2023-12-14T18:06:44.569 INFO:teuthology.orchestra.run.smithi007.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-14T18:06:44.569 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://www.redhat.com/"
2023-12-14T18:06:44.569 INFO:teuthology.orchestra.run.smithi007.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-14T18:06:44.569 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-14T18:06:44.569 INFO:teuthology.orchestra.run.smithi007.stdout:
2023-12-14T18:06:44.569 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-14T18:06:44.569 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-14T18:06:44.569 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-14T18:06:44.569 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-14T18:06:44.570 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server
2023-12-14T18:06:44.592 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: set os type and version on server
2023-12-14T18:06:44.592 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com'
2023-12-14T18:06:44.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:06:44.664 DEBUG:teuthology.orchestra.run.smithi043:> true
2023-12-14T18:06:44.809 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi043.front.sepia.ceph.com'
2023-12-14T18:06:44.810 DEBUG:teuthology.orchestra.run.smithi043:> uname -m
2023-12-14T18:06:44.870 INFO:teuthology.orchestra.run.smithi043.stdout:x86_64
2023-12-14T18:06:44.871 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release
2023-12-14T18:06:44.932 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="Red Hat Enterprise Linux"
2023-12-14T18:06:44.932 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="8.6 (Ootpa)"
2023-12-14T18:06:44.932 INFO:teuthology.orchestra.run.smithi043.stdout:ID="rhel"
2023-12-14T18:06:44.932 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="fedora"
2023-12-14T18:06:44.932 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="8.6"
2023-12-14T18:06:44.932 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el8"
2023-12-14T18:06:44.932 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-14T18:06:44.932 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31"
2023-12-14T18:06:44.932 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-14T18:06:44.932 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://www.redhat.com/"
2023-12-14T18:06:44.932 INFO:teuthology.orchestra.run.smithi043.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-14T18:06:44.933 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-14T18:06:44.933 INFO:teuthology.orchestra.run.smithi043.stdout:
2023-12-14T18:06:44.933 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-14T18:06:44.933 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-14T18:06:44.933 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-14T18:06:44.933 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-14T18:06:44.933 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server
2023-12-14T18:06:44.950 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: set os type and version on server
2023-12-14T18:06:44.950 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com'
2023-12-14T18:06:44.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T18:06:45.019 DEBUG:teuthology.orchestra.run.smithi111:> true
2023-12-14T18:06:45.090 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com'
2023-12-14T18:06:45.090 DEBUG:teuthology.orchestra.run.smithi111:> uname -m
2023-12-14T18:06:45.150 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64
2023-12-14T18:06:45.150 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release
2023-12-14T18:06:45.210 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="Red Hat Enterprise Linux"
2023-12-14T18:06:45.210 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="8.6 (Ootpa)"
2023-12-14T18:06:45.211 INFO:teuthology.orchestra.run.smithi111.stdout:ID="rhel"
2023-12-14T18:06:45.211 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="fedora"
2023-12-14T18:06:45.211 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="8.6"
2023-12-14T18:06:45.211 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el8"
2023-12-14T18:06:45.212 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-14T18:06:45.212 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31"
2023-12-14T18:06:45.212 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-14T18:06:45.212 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://www.redhat.com/"
2023-12-14T18:06:45.213 INFO:teuthology.orchestra.run.smithi111.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-14T18:06:45.213 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-14T18:06:45.213 INFO:teuthology.orchestra.run.smithi111.stdout:
2023-12-14T18:06:45.213 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-14T18:06:45.214 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-14T18:06:45.214 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-14T18:06:45.214 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-14T18:06:45.215 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server
2023-12-14T18:06:45.234 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:06:45.318 INFO:teuthology.dispatcher.supervisor:Running job 7491439
2023-12-14T18:06:45.319 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_choffman@teuthology --archive /home/teuthworker/archive/choffman-2023-12-14_17:59:30-fs-wip-choffman-62793-distro-default-smithi/7491439 --name choffman-2023-12-14_17:59:30-fs-wip-choffman-62793-distro-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/fs/misc}} -- /home/teuthworker/archive/choffman-2023-12-14_17:59:30-fs-wip-choffman-62793-distro-default-smithi/7491439/orig.config.yaml
2023-12-14T18:06:45.321 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/choffman-2023-12-14_17:59:30-fs-wip-choffman-62793-distro-default-smithi/7491439
2023-12-14T18:06:45.322 INFO:teuthology.dispatcher.supervisor:Job PID: 1294241
2023-12-14T18:06:45.322 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-12-14T18:08:45.324 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:10:45.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:12:45.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:14:45.540 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:16:45.601 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:18:45.758 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:20:45.890 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:22:45.958 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:24:46.030 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:26:46.102 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:28:46.174 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:30:46.245 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:32:46.368 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:34:46.441 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:36:46.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:38:46.589 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:40:46.872 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:42:46.936 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:44:46.997 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:46:47.060 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:48:47.129 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:50:47.196 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T18:50:47.256 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-12-14T18:50:47.398 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-12-14T18:50:47.398 INFO:teuthology.nuke:Checking targets against current locks
2023-12-14T18:50:47.446 DEBUG:teuthology.nuke:shortname: smithi007
2023-12-14T18:50:47.446 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-14T18:50:47.465 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi007.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-12-14_17:59:30-fs-wip-choffman-62793-distro-default-smithi/7491439', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-14 18:00:34.051766', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLWJOBB8Oxl4d/bNRA0g7KVj6R1+4BuUUpd/HMQsQTihgNA//Zv6koTyhTpqBFhyAvofdDv41xgbZxHm0hmGNRU='}
2023-12-14T18:50:47.476 DEBUG:teuthology.nuke:shortname: smithi043
2023-12-14T18:50:47.476 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-14T18:50:47.495 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi043.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-12-14_17:59:30-fs-wip-choffman-62793-distro-default-smithi/7491439', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-14 18:00:34.055354', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIiQsGkb+OlCa9g5cgIOSBENVeC+9PR1TzbuS9p16M4Ka2MfUV1u2mphf0dp9dA0OhfK8SWb3lFkhAIf28RsJq8='}
2023-12-14T18:50:47.499 DEBUG:teuthology.nuke:shortname: smithi111
2023-12-14T18:50:47.499 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-14T18:50:47.508 INFO:teuthology.orchestra.console.smithi007:Power off
2023-12-14T18:50:47.508 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-14T18:50:47.519 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi111.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-12-14_17:59:30-fs-wip-choffman-62793-distro-default-smithi/7491439', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-14 18:00:34.053668', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNNgpGyC7dS5XtAC4K/l+RfsMiTkdCIZDMjHK8qpqHg6d6V+ubqR77IcRXFbAuLoTA7VGjd8oa9+apmq8UgOZdE='}
2023-12-14T18:50:47.528 DEBUG:teuthology.orchestra.console.smithi007:power off output: Chassis Power Control: Down/Off
2023-12-14T18:50:47.529 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T18:50:47.545 INFO:teuthology.orchestra.console.smithi043:Power off
2023-12-14T18:50:47.545 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-14T18:50:47.552 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is off
2023-12-14T18:50:47.564 DEBUG:teuthology.orchestra.console.smithi043:power off output: Chassis Power Control: Down/Off
2023-12-14T18:50:47.564 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T18:50:47.576 INFO:teuthology.orchestra.console.smithi111:Power off
2023-12-14T18:50:47.577 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-14T18:50:47.584 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off
2023-12-14T18:50:47.596 DEBUG:teuthology.orchestra.console.smithi111:power off output: Chassis Power Control: Down/Off
2023-12-14T18:50:47.597 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T18:50:47.616 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off
2023-12-14T18:50:47.654 INFO:teuthology.orchestra.console.smithi007:Power off completed
2023-12-14T18:50:47.685 INFO:teuthology.orchestra.console.smithi043:Power off completed
2023-12-14T18:50:47.717 INFO:teuthology.orchestra.console.smithi111:Power off completed
2023-12-14T18:50:47.805 INFO:teuthology.lock.ops:unlocked: smithi007.front.sepia.ceph.com
2023-12-14T18:50:47.830 INFO:teuthology.lock.ops:unlocked: smithi043.front.sepia.ceph.com
2023-12-14T18:50:47.863 INFO:teuthology.lock.ops:unlocked: smithi111.front.sepia.ceph.com