2023-12-12T17:17:22.019 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e
2023-12-12T17:17:22.020 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-12T17:17:22.250 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f43d8328550>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f43d926c940>, signals=[15])
2023-12-12T17:17:22.251 INFO:teuthology.lock.ops:Start node 'smithi063.front.sepia.ceph.com' reimaging
2023-12-12T17:17:22.251 INFO:teuthology.lock.ops:Updating [smithi063.front.sepia.ceph.com]: reset os type and version on server
2023-12-12T17:17:22.252 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server
2023-12-12T17:17:22.268 INFO:teuthology.lock.ops:Start node 'smithi111.front.sepia.ceph.com' reimaging
2023-12-12T17:17:22.269 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: reset os type and version on server
2023-12-12T17:17:22.269 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server
2023-12-12T17:17:22.284 INFO:teuthology.lock.ops:Start node 'smithi183.front.sepia.ceph.com' reimaging
2023-12-12T17:17:22.285 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: reset os type and version on server
2023-12-12T17:17:22.285 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server
2023-12-12T17:17:22.415 DEBUG:teuthology.provision.fog.smithi183:Requesting image smithi_centos_9.stream (ID 10)
2023-12-12T17:17:22.418 DEBUG:teuthology.provision.fog.smithi111:Requesting image smithi_centos_9.stream (ID 10)
2023-12-12T17:17:22.422 DEBUG:teuthology.provision.fog.smithi063:Requesting image smithi_centos_9.stream (ID 10)
2023-12-12T17:17:22.458 INFO:teuthology.provision.fog.smithi111:Scheduling deploy of centos 9.stream
2023-12-12T17:17:22.472 INFO:teuthology.provision.fog.smithi183:Scheduling deploy of centos 9.stream
2023-12-12T17:17:22.480 INFO:teuthology.provision.fog.smithi063:Scheduling deploy of centos 9.stream
2023-12-12T17:17:22.753 INFO:teuthology.orchestra.console.smithi111:Power off
2023-12-12T17:17:22.754 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-12T17:17:22.787 DEBUG:teuthology.orchestra.console.smithi111:power off output: Chassis Power Control: Down/Off
2023-12-12T17:17:22.787 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-12T17:17:22.807 INFO:teuthology.orchestra.console.smithi183:Power off
2023-12-12T17:17:22.808 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-12T17:17:22.820 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off
2023-12-12T17:17:22.831 DEBUG:teuthology.orchestra.console.smithi183:power off output: Chassis Power Control: Down/Off
2023-12-12T17:17:22.831 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-12T17:17:22.846 INFO:teuthology.orchestra.console.smithi063:Power off
2023-12-12T17:17:22.846 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-12T17:17:22.854 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on
2023-12-12T17:17:22.870 DEBUG:teuthology.orchestra.console.smithi063:power off output: Chassis Power Control: Down/Off
2023-12-12T17:17:22.870 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-12T17:17:22.893 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is on
2023-12-12T17:17:22.921 INFO:teuthology.orchestra.console.smithi111:Power off completed
2023-12-12T17:17:23.021 INFO:teuthology.orchestra.console.smithi111:Power on
2023-12-12T17:17:23.022 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-12T17:17:23.054 DEBUG:teuthology.orchestra.console.smithi111:power on output: Chassis Power Control: Up/On
2023-12-12T17:17:23.055 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-12T17:17:23.103 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off
2023-12-12T17:17:26.858 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-12T17:17:26.894 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-12T17:17:26.969 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on
2023-12-12T17:17:27.005 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is on
2023-12-12T17:17:27.104 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-12T17:17:27.213 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off
2023-12-12T17:17:30.974 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-12T17:17:31.006 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-12T17:17:31.086 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off
2023-12-12T17:17:31.118 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is on
2023-12-12T17:17:31.187 INFO:teuthology.orchestra.console.smithi183:Power off completed
2023-12-12T17:17:31.215 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-12T17:17:31.288 INFO:teuthology.orchestra.console.smithi183:Power on
2023-12-12T17:17:31.289 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-12T17:17:31.313 DEBUG:teuthology.orchestra.console.smithi183:power on output: Chassis Power Control: Up/On
2023-12-12T17:17:31.313 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-12T17:17:31.326 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on
2023-12-12T17:17:31.342 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off
2023-12-12T17:17:31.426 INFO:teuthology.orchestra.console.smithi111:Power on completed
2023-12-12T17:17:31.527 INFO:teuthology.provision.fog.smithi111:Waiting for deploy to finish
2023-12-12T17:17:35.122 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-12T17:17:35.233 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is off
2023-12-12T17:17:35.334 INFO:teuthology.orchestra.console.smithi063:Power off completed
2023-12-12T17:17:35.343 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-12T17:17:35.435 INFO:teuthology.orchestra.console.smithi063:Power on
2023-12-12T17:17:35.435 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-12T17:17:35.452 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off
2023-12-12T17:17:35.461 DEBUG:teuthology.orchestra.console.smithi063:power on output: Chassis Power Control: Up/On
2023-12-12T17:17:35.461 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-12T17:17:35.484 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is off
2023-12-12T17:17:39.455 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-12T17:17:39.486 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-12T17:17:39.566 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on
2023-12-12T17:17:39.595 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is on
2023-12-12T17:17:39.668 INFO:teuthology.orchestra.console.smithi183:Power on completed
2023-12-12T17:17:39.696 INFO:teuthology.orchestra.console.smithi063:Power on completed
2023-12-12T17:17:39.769 INFO:teuthology.provision.fog.smithi183:Waiting for deploy to finish
2023-12-12T17:17:39.797 INFO:teuthology.provision.fog.smithi063:Waiting for deploy to finish
2023-12-12T17:20:10.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T17:20:13.666 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183
2023-12-12T17:20:17.373 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T17:20:19.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T17:20:20.457 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-12-12T17:20:22.722 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183
2023-12-12T17:20:25.673 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T17:20:26.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T17:20:28.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T17:20:28.742 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63
2023-12-12T17:20:29.542 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-12-12T17:20:31.778 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183
2023-12-12T17:20:34.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T17:20:35.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T17:20:37.781 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T17:20:37.826 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63
2023-12-12T17:20:38.626 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-12-12T17:20:40.838 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183
2023-12-12T17:20:43.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T17:20:44.628 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T17:20:46.842 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T17:20:46.886 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63
2023-12-12T17:20:47.682 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-12-12T17:20:49.925 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183
2023-12-12T17:20:52.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T17:20:53.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T17:20:55.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T17:20:55.938 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63
2023-12-12T17:20:56.738 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-12-12T17:20:59.014 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183
2023-12-12T17:21:01.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T17:21:02.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T17:21:04.998 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63
2023-12-12T17:21:05.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T17:21:05.798 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-12-12T17:21:11.002 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T17:21:11.800 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T17:21:14.082 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63
2023-12-12T17:21:14.850 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-12-12T17:21:20.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T17:21:20.852 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T17:21:23.906 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-12-12T17:21:29.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T17:22:05.052 WARNING:teuthology.provision.fog.smithi183:timed out
2023-12-12T17:22:11.059 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T17:22:11.282 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-12T17:22:11.283 DEBUG:teuthology.orchestra.run.smithi183:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-12T17:22:11.607 INFO:teuthology.provision.fog.smithi183:Node is ready
2023-12-12T17:22:11.607 DEBUG:teuthology.orchestra.run.smithi183:> hostname
2023-12-12T17:22:11.622 INFO:teuthology.orchestra.run.smithi183.stdout:smithi183.front.sepia.ceph.com
2023-12-12T17:22:11.623 DEBUG:teuthology.orchestra.run.smithi183:> grep smithi183.front.sepia.ceph.com /etc/hosts
2023-12-12T17:22:11.677 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.15.183 smithi183.front.sepia.ceph.com smithi183
2023-12-12T17:22:11.678 DEBUG:teuthology.orchestra.run.smithi183:> sudo hostname smithi183
2023-12-12T17:22:11.774 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/smithi183.front.sepia.ceph.com/smithi183/g' /etc/hosts
2023-12-12T17:22:11.802 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/172.21.15.183/172.21.15.183/g' /etc/hosts
2023-12-12T17:22:11.869 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/smithi183.front.sepia.ceph.com/smithi183/g' /etc/hostname
2023-12-12T17:22:11.936 DEBUG:teuthology.orchestra.run.smithi183:> sudo hostname smithi183
2023-12-12T17:22:12.003 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release
2023-12-12T17:22:12.058 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="CentOS Stream"
2023-12-12T17:22:12.058 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="9"
2023-12-12T17:22:12.058 INFO:teuthology.orchestra.run.smithi183.stdout:ID="centos"
2023-12-12T17:22:12.058 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="rhel fedora"
2023-12-12T17:22:12.058 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="9"
2023-12-12T17:22:12.058 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el9"
2023-12-12T17:22:12.058 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="CentOS Stream 9"
2023-12-12T17:22:12.058 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31"
2023-12-12T17:22:12.058 INFO:teuthology.orchestra.run.smithi183.stdout:LOGO="fedora-logo-icon"
2023-12-12T17:22:12.058 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-12-12T17:22:12.058 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://centos.org/"
2023-12-12T17:22:12.059 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-12T17:22:12.059 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-12-12T17:22:12.059 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-12T17:22:12.059 INFO:teuthology.provision.fog.smithi183:Deploy complete!
2023-12-12T17:22:12.061 DEBUG:teuthology.parallel:result is None
2023-12-12T17:22:20.096 WARNING:teuthology.provision.fog.smithi063:timed out
2023-12-12T17:22:26.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T17:22:26.350 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-12T17:22:26.351 DEBUG:teuthology.orchestra.run.smithi063:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-12T17:22:26.679 INFO:teuthology.provision.fog.smithi063:Node is ready
2023-12-12T17:22:26.679 DEBUG:teuthology.orchestra.run.smithi063:> hostname
2023-12-12T17:22:26.695 INFO:teuthology.orchestra.run.smithi063.stdout:smithi063.front.sepia.ceph.com
2023-12-12T17:22:26.695 DEBUG:teuthology.orchestra.run.smithi063:> grep smithi063.front.sepia.ceph.com /etc/hosts
2023-12-12T17:22:26.751 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63 smithi063.front.sepia.ceph.com smithi063
2023-12-12T17:22:26.751 DEBUG:teuthology.orchestra.run.smithi063:> sudo hostname smithi063
2023-12-12T17:22:26.875 DEBUG:teuthology.orchestra.run.smithi063:> sudo sed -i -e 's/smithi063.front.sepia.ceph.com/smithi063/g' /etc/hosts
2023-12-12T17:22:26.907 DEBUG:teuthology.orchestra.run.smithi063:> sudo sed -i -e 's/172.21.15.63/172.21.15.63/g' /etc/hosts
2023-12-12T17:22:26.978 DEBUG:teuthology.orchestra.run.smithi063:> sudo sed -i -e 's/smithi063.front.sepia.ceph.com/smithi063/g' /etc/hostname
2023-12-12T17:22:27.049 DEBUG:teuthology.orchestra.run.smithi063:> sudo hostname smithi063
2023-12-12T17:22:27.119 DEBUG:teuthology.orchestra.run.smithi063:> cat /etc/os-release
2023-12-12T17:22:27.174 INFO:teuthology.orchestra.run.smithi063.stdout:NAME="CentOS Stream"
2023-12-12T17:22:27.175 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION="9"
2023-12-12T17:22:27.175 INFO:teuthology.orchestra.run.smithi063.stdout:ID="centos"
2023-12-12T17:22:27.175 INFO:teuthology.orchestra.run.smithi063.stdout:ID_LIKE="rhel fedora"
2023-12-12T17:22:27.175 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_ID="9"
2023-12-12T17:22:27.176 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM_ID="platform:el9"
2023-12-12T17:22:27.176 INFO:teuthology.orchestra.run.smithi063.stdout:PRETTY_NAME="CentOS Stream 9"
2023-12-12T17:22:27.176 INFO:teuthology.orchestra.run.smithi063.stdout:ANSI_COLOR="0;31"
2023-12-12T17:22:27.177 INFO:teuthology.orchestra.run.smithi063.stdout:LOGO="fedora-logo-icon"
2023-12-12T17:22:27.177 INFO:teuthology.orchestra.run.smithi063.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-12-12T17:22:27.177 INFO:teuthology.orchestra.run.smithi063.stdout:HOME_URL="https://centos.org/"
2023-12-12T17:22:27.177 INFO:teuthology.orchestra.run.smithi063.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-12T17:22:27.178 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-12-12T17:22:27.178 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-12T17:22:27.179 INFO:teuthology.provision.fog.smithi063:Deploy complete!
2023-12-12T17:22:27.179 DEBUG:teuthology.parallel:result is None
2023-12-12T17:22:29.914 WARNING:teuthology.provision.fog.smithi111:timed out
2023-12-12T17:22:35.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T17:22:36.206 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-12T17:22:36.207 DEBUG:teuthology.orchestra.run.smithi111:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-12T17:22:36.533 INFO:teuthology.provision.fog.smithi111:Node is ready
2023-12-12T17:22:36.534 DEBUG:teuthology.orchestra.run.smithi111:> hostname
2023-12-12T17:22:36.548 INFO:teuthology.orchestra.run.smithi111.stdout:smithi111.front.sepia.ceph.com
2023-12-12T17:22:36.549 DEBUG:teuthology.orchestra.run.smithi111:> grep smithi111.front.sepia.ceph.com /etc/hosts
2023-12-12T17:22:36.604 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111 smithi111.front.sepia.ceph.com smithi111
2023-12-12T17:22:36.604 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111
2023-12-12T17:22:36.705 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hosts
2023-12-12T17:22:36.734 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/172.21.15.111/172.21.15.111/g' /etc/hosts
2023-12-12T17:22:36.802 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hostname
2023-12-12T17:22:36.869 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111
2023-12-12T17:22:36.936 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release
2023-12-12T17:22:36.990 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="CentOS Stream"
2023-12-12T17:22:36.990 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="9"
2023-12-12T17:22:36.990 INFO:teuthology.orchestra.run.smithi111.stdout:ID="centos"
2023-12-12T17:22:36.990 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="rhel fedora"
2023-12-12T17:22:36.990 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="9"
2023-12-12T17:22:36.990 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el9"
2023-12-12T17:22:36.990 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="CentOS Stream 9"
2023-12-12T17:22:36.991 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31"
2023-12-12T17:22:36.991 INFO:teuthology.orchestra.run.smithi111.stdout:LOGO="fedora-logo-icon"
2023-12-12T17:22:36.991 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-12-12T17:22:36.991 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://centos.org/"
2023-12-12T17:22:36.991 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-12T17:22:36.991 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-12-12T17:22:36.991 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-12T17:22:36.991 INFO:teuthology.provision.fog.smithi111:Deploy complete!
2023-12-12T17:22:36.992 DEBUG:teuthology.parallel:result is None
2023-12-12T17:22:37.209 INFO:teuthology.lock.ops:Checking smithi063.front.sepia.ceph.com
2023-12-12T17:22:37.209 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-12T17:22:37.234 INFO:teuthology.lock.ops:Checking smithi111.front.sepia.ceph.com
2023-12-12T17:22:37.234 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-12T17:22:37.251 INFO:teuthology.lock.ops:Checking smithi183.front.sepia.ceph.com
2023-12-12T17:22:37.251 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-12T17:22:37.269 INFO:teuthology.lock.ops:Updating [smithi063.front.sepia.ceph.com]: set os type and version on server
2023-12-12T17:22:37.269 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com'
2023-12-12T17:22:37.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T17:22:37.366 DEBUG:teuthology.orchestra.run.smithi063:> true
2023-12-12T17:22:37.548 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi063.front.sepia.ceph.com'
2023-12-12T17:22:37.548 DEBUG:teuthology.orchestra.run.smithi063:> uname -m
2023-12-12T17:22:37.603 INFO:teuthology.orchestra.run.smithi063.stdout:x86_64
2023-12-12T17:22:37.603 DEBUG:teuthology.orchestra.run.smithi063:> cat /etc/os-release
2023-12-12T17:22:37.658 INFO:teuthology.orchestra.run.smithi063.stdout:NAME="CentOS Stream"
2023-12-12T17:22:37.658 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION="9"
2023-12-12T17:22:37.658 INFO:teuthology.orchestra.run.smithi063.stdout:ID="centos"
2023-12-12T17:22:37.658 INFO:teuthology.orchestra.run.smithi063.stdout:ID_LIKE="rhel fedora"
2023-12-12T17:22:37.658 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_ID="9"
2023-12-12T17:22:37.658 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM_ID="platform:el9"
2023-12-12T17:22:37.659 INFO:teuthology.orchestra.run.smithi063.stdout:PRETTY_NAME="CentOS Stream 9"
2023-12-12T17:22:37.659 INFO:teuthology.orchestra.run.smithi063.stdout:ANSI_COLOR="0;31"
2023-12-12T17:22:37.659 INFO:teuthology.orchestra.run.smithi063.stdout:LOGO="fedora-logo-icon"
2023-12-12T17:22:37.659 INFO:teuthology.orchestra.run.smithi063.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-12-12T17:22:37.659 INFO:teuthology.orchestra.run.smithi063.stdout:HOME_URL="https://centos.org/"
2023-12-12T17:22:37.659 INFO:teuthology.orchestra.run.smithi063.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-12T17:22:37.659 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-12-12T17:22:37.659 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-12T17:22:37.660 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server
2023-12-12T17:22:37.710 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: set os type and version on server
2023-12-12T17:22:37.711 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com'
2023-12-12T17:22:37.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T17:22:37.792 DEBUG:teuthology.orchestra.run.smithi111:> true
2023-12-12T17:22:37.857 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com'
2023-12-12T17:22:37.857 DEBUG:teuthology.orchestra.run.smithi111:> uname -m
2023-12-12T17:22:37.911 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64
2023-12-12T17:22:37.912 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release
2023-12-12T17:22:37.966 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="CentOS Stream"
2023-12-12T17:22:37.967 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="9"
2023-12-12T17:22:37.967 INFO:teuthology.orchestra.run.smithi111.stdout:ID="centos"
2023-12-12T17:22:37.967 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="rhel fedora"
2023-12-12T17:22:37.968 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="9"
2023-12-12T17:22:37.968 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el9"
2023-12-12T17:22:37.968 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="CentOS Stream 9"
2023-12-12T17:22:37.968 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31"
2023-12-12T17:22:37.968 INFO:teuthology.orchestra.run.smithi111.stdout:LOGO="fedora-logo-icon"
2023-12-12T17:22:37.968 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-12-12T17:22:37.968 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://centos.org/"
2023-12-12T17:22:37.968 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-12T17:22:37.968 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-12-12T17:22:37.968 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-12T17:22:37.969 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server
2023-12-12T17:22:38.001 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: set os type and version on server
2023-12-12T17:22:38.001 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com'
2023-12-12T17:22:38.002 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T17:22:38.084 DEBUG:teuthology.orchestra.run.smithi183:> true
2023-12-12T17:22:38.252 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi183.front.sepia.ceph.com'
2023-12-12T17:22:38.253 DEBUG:teuthology.orchestra.run.smithi183:> uname -m
2023-12-12T17:22:38.307 INFO:teuthology.orchestra.run.smithi183.stdout:x86_64
2023-12-12T17:22:38.308 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release
2023-12-12T17:22:38.363 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="CentOS Stream"
2023-12-12T17:22:38.363 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="9"
2023-12-12T17:22:38.363 INFO:teuthology.orchestra.run.smithi183.stdout:ID="centos"
2023-12-12T17:22:38.363 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="rhel fedora"
2023-12-12T17:22:38.363 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="9"
2023-12-12T17:22:38.363 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el9"
2023-12-12T17:22:38.363 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="CentOS Stream 9"
2023-12-12T17:22:38.363 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31"
2023-12-12T17:22:38.363 INFO:teuthology.orchestra.run.smithi183.stdout:LOGO="fedora-logo-icon"
2023-12-12T17:22:38.364 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-12-12T17:22:38.364 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://centos.org/"
2023-12-12T17:22:38.364 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-12T17:22:38.364 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-12-12T17:22:38.364 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-12T17:22:38.364 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server
2023-12-12T17:22:38.384 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-12T17:22:38.477 INFO:teuthology.dispatcher.supervisor:Running job 7488770
2023-12-12T17:22:38.477 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-12_16:18:21-rados-wip-yuri-testing-2023-12-11-1524-distro-default-smithi/7488770 --name yuriw-2023-12-12_16:18:21-rados-wip-yuri-testing-2023-12-11-1524-distro-default-smithi --description rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} -- /home/teuthworker/archive/yuriw-2023-12-12_16:18:21-rados-wip-yuri-testing-2023-12-11-1524-distro-default-smithi/7488770/orig.config.yaml
2023-12-12T17:22:38.481 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-12_16:18:21-rados-wip-yuri-testing-2023-12-11-1524-distro-default-smithi/7488770
2023-12-12T17:22:38.482 INFO:teuthology.dispatcher.supervisor:Job PID: 3930881
2023-12-12T17:22:38.482 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-12-12T17:24:38.583 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-12T17:26:38.765 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-12T17:28:38.947 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-12T17:30:39.130 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-12T17:32:39.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-12T17:34:39.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-12T17:36:39.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-12T17:38:39.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-12T17:40:39.974 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-12T17:42:40.142 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-12T17:44:40.311 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-12T17:44:40.383 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-12-12T17:44:40.510 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-12-12T17:44:40.511 INFO:teuthology.nuke:Checking targets against current locks
2023-12-12T17:44:40.559 DEBUG:teuthology.nuke:shortname: smithi063
2023-12-12T17:44:40.560 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-12T17:44:40.592 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi063.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-12_16:18:21-rados-wip-yuri-testing-2023-12-11-1524-distro-default-smithi/7488770', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-12 17:17:21.134939', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAfUy9w8f8VedsmkLvWfOFqh3FoqQkcA1iaHCO34MnNwjkolreIU5WxrdzsDVTiV8y/XdXRL8aehSjSPLI8Rdc4='}
2023-12-12T17:44:40.599 DEBUG:teuthology.nuke:shortname: smithi111
2023-12-12T17:44:40.599 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-12T17:44:40.635 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi111.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-12_16:18:21-rados-wip-yuri-testing-2023-12-11-1524-distro-default-smithi/7488770', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-12 17:17:21.136003', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCeySmOJRv4UduUthn9Ia6SFOPkpqWZVlFTXOhh5H3tlhYJQWpp+kZhdM82hmLPoAc7XNnTlKrGhpi0PLzKil/4='}
2023-12-12T17:44:40.638 DEBUG:teuthology.nuke:shortname: smithi183
2023-12-12T17:44:40.639 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-12T17:44:40.668 INFO:teuthology.orchestra.console.smithi063:Power off
2023-12-12T17:44:40.668 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-12T17:44:40.681 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi183.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-12_16:18:21-rados-wip-yuri-testing-2023-12-11-1524-distro-default-smithi/7488770', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-12 17:17:21.133559', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ+b08BR7Qj3QojM4m23wGSW6kTM7oa6ufQZlarsZMpKzFrNKN6Lk2tXJmQtbh4V9teuUVAfKl//uLTm+NPLfkY='}
2023-12-12T17:44:40.694 DEBUG:teuthology.orchestra.console.smithi063:power off output: Chassis Power Control: Down/Off
2023-12-12T17:44:40.694 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-12T17:44:40.715 INFO:teuthology.orchestra.console.smithi111:Power off
2023-12-12T17:44:40.716 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-12T17:44:40.725 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is off
2023-12-12T17:44:40.737 DEBUG:teuthology.orchestra.console.smithi111:power off output: Chassis Power Control: Down/Off
2023-12-12T17:44:40.737 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-12T17:44:40.753 INFO:teuthology.orchestra.console.smithi183:Power off
2023-12-12T17:44:40.754 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-12T17:44:40.765 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off
2023-12-12T17:44:40.779 DEBUG:teuthology.orchestra.console.smithi183:power off output: Chassis Power Control: Down/Off
2023-12-12T17:44:40.779 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-12T17:44:40.802 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off
2023-12-12T17:44:40.827 INFO:teuthology.orchestra.console.smithi063:Power off completed
2023-12-12T17:44:40.866 INFO:teuthology.orchestra.console.smithi111:Power off completed
2023-12-12T17:44:40.903 INFO:teuthology.orchestra.console.smithi183:Power off completed
2023-12-12T17:44:40.981 INFO:teuthology.lock.ops:unlocked: smithi063.front.sepia.ceph.com
2023-12-12T17:44:41.014 INFO:teuthology.lock.ops:unlocked: smithi111.front.sepia.ceph.com
2023-12-12T17:44:41.056 INFO:teuthology.lock.ops:unlocked: smithi183.front.sepia.ceph.com