2023-11-28T09:24:32.434 INFO:root:teuthology version: 0.0.1.dev209+g5ae09a5 2023-11-28T09:24:32.434 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T09:24:32.614 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2668c73dc0>, signals=[15]) 2023-11-28T09:24:32.615 INFO:teuthology.lock.ops:Start node 'smithi097.front.sepia.ceph.com' reimaging 2023-11-28T09:24:32.615 INFO:teuthology.lock.ops:Updating [smithi097.front.sepia.ceph.com]: reset os type and version on server 2023-11-28T09:24:32.615 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server 2023-11-28T09:24:32.634 INFO:teuthology.lock.ops:Start node 'smithi137.front.sepia.ceph.com' reimaging 2023-11-28T09:24:32.635 INFO:teuthology.lock.ops:Updating [smithi137.front.sepia.ceph.com]: reset os type and version on server 2023-11-28T09:24:32.635 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server 2023-11-28T09:24:32.659 INFO:teuthology.lock.ops:Start node 'smithi172.front.sepia.ceph.com' reimaging 2023-11-28T09:24:32.659 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: reset os type and version on server 2023-11-28T09:24:32.659 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2023-11-28T09:24:32.750 DEBUG:teuthology.provision.fog.smithi097:Requesting image smithi_rhel_8.6 (ID 5) 2023-11-28T09:24:32.783 DEBUG:teuthology.provision.fog.smithi137:Requesting image smithi_rhel_8.6 (ID 5) 2023-11-28T09:24:32.794 INFO:teuthology.provision.fog.smithi097:Scheduling deploy of rhel 8.6 2023-11-28T09:24:32.799 DEBUG:teuthology.provision.fog.smithi172:Requesting image smithi_rhel_8.6 (ID 5) 2023-11-28T09:24:32.827 INFO:teuthology.provision.fog.smithi137:Scheduling deploy of rhel 8.6 2023-11-28T09:24:32.842 INFO:teuthology.provision.fog.smithi172:Scheduling deploy of rhel 8.6 2023-11-28T09:24:33.042 INFO:teuthology.orchestra.console.smithi097:Power off 2023-11-28T09:24:33.042 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T09:24:33.059 INFO:teuthology.orchestra.console.smithi172:Power off 2023-11-28T09:24:33.059 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T09:24:33.072 INFO:teuthology.orchestra.console.smithi137:Power off 2023-11-28T09:24:33.072 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T09:24:33.080 DEBUG:teuthology.orchestra.console.smithi097:power off output: Chassis Power Control: Down/Off 2023-11-28T09:24:33.080 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T09:24:33.090 DEBUG:teuthology.orchestra.console.smithi172:power off output: Chassis Power Control: Down/Off 2023-11-28T09:24:33.090 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T09:24:33.099 DEBUG:teuthology.orchestra.console.smithi137:power off output: Chassis Power Control: Down/Off 2023-11-28T09:24:33.099 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T09:24:33.108 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off 2023-11-28T09:24:33.113 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2023-11-28T09:24:33.120 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is off 2023-11-28T09:24:33.209 INFO:teuthology.orchestra.console.smithi097:Power off completed 2023-11-28T09:24:33.214 INFO:teuthology.orchestra.console.smithi172:Power off completed 2023-11-28T09:24:33.221 INFO:teuthology.orchestra.console.smithi137:Power off completed 2023-11-28T09:24:33.311 INFO:teuthology.orchestra.console.smithi097:Power on 2023-11-28T09:24:33.311 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-28T09:24:33.319 INFO:teuthology.orchestra.console.smithi172:Power on 2023-11-28T09:24:33.319 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-28T09:24:33.327 INFO:teuthology.orchestra.console.smithi137:Power on 2023-11-28T09:24:33.327 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-28T09:24:33.336 DEBUG:teuthology.orchestra.console.smithi097:power on output: Chassis Power Control: Up/On 2023-11-28T09:24:33.336 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T09:24:33.345 DEBUG:teuthology.orchestra.console.smithi172:power on output: Chassis Power Control: Up/On 2023-11-28T09:24:33.345 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T09:24:33.353 DEBUG:teuthology.orchestra.console.smithi137:power on output: Chassis Power Control: Up/On 2023-11-28T09:24:33.353 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T09:24:33.361 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off 2023-11-28T09:24:33.365 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2023-11-28T09:24:33.373 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is off 2023-11-28T09:24:37.366 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T09:24:37.375 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T09:24:37.381 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T09:24:37.477 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is on 2023-11-28T09:24:37.483 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2023-11-28T09:24:37.491 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is off 2023-11-28T09:24:37.578 INFO:teuthology.orchestra.console.smithi097:Power on completed 2023-11-28T09:24:37.584 INFO:teuthology.orchestra.console.smithi172:Power on completed 2023-11-28T09:24:37.679 INFO:teuthology.provision.fog.smithi097:Waiting for deploy to finish 2023-11-28T09:24:37.684 INFO:teuthology.provision.fog.smithi172:Waiting for deploy to finish 2023-11-28T09:24:41.495 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T09:24:41.704 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is on 2023-11-28T09:24:41.805 INFO:teuthology.orchestra.console.smithi137:Power on completed 2023-11-28T09:24:41.906 INFO:teuthology.provision.fog.smithi137:Waiting for deploy to finish 2023-11-28T09:27:12.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T09:27:15.622 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2023-11-28T09:27:21.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T09:27:23.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T09:27:23.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T09:27:24.706 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2023-11-28T09:27:26.594 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-11-28T09:27:26.594 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-11-28T09:27:30.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T09:27:32.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T09:27:32.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T09:27:33.894 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2023-11-28T09:27:35.650 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-11-28T09:27:35.650 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-11-28T09:27:39.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T09:27:41.653 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T09:27:41.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T09:27:42.978 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2023-11-28T09:27:44.706 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-11-28T09:27:44.706 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-11-28T09:27:48.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T09:27:50.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T09:27:50.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T09:27:52.038 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2023-11-28T09:27:53.762 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-11-28T09:27:53.762 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-11-28T09:27:58.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T09:27:59.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T09:27:59.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T09:28:01.122 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2023-11-28T09:28:02.818 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-11-28T09:28:02.818 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-11-28T09:28:07.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T09:28:08.821 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T09:28:08.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T09:28:10.210 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2023-11-28T09:28:11.874 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-11-28T09:28:16.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T09:28:17.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T09:28:20.934 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-11-28T09:28:26.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T09:28:48.055 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-28T09:28:48.056 DEBUG:teuthology.orchestra.run.smithi137:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-28T09:28:48.335 INFO:teuthology.provision.fog.smithi137:Node is ready 2023-11-28T09:28:48.336 DEBUG:teuthology.orchestra.run.smithi137:> hostname 2023-11-28T09:28:48.392 INFO:teuthology.orchestra.run.smithi137.stdout:smithi022 2023-11-28T09:28:48.392 DEBUG:teuthology.orchestra.run.smithi137:> grep smithi022 /etc/hosts 2023-11-28T09:28:48.448 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-11-28T09:28:48.448 DEBUG:teuthology.orchestra.run.smithi137:> sudo hostname smithi137 2023-11-28T09:28:48.574 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i -e 's/smithi022/smithi137/g' /etc/hosts 2023-11-28T09:28:48.600 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i -e 's/172.21.15.22/172.21.15.137/g' /etc/hosts 2023-11-28T09:28:48.667 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i -e 's/smithi022/smithi137/g' /etc/hostname 2023-11-28T09:28:48.733 DEBUG:teuthology.orchestra.run.smithi137:> sudo hostname smithi137 2023-11-28T09:28:48.799 DEBUG:teuthology.orchestra.run.smithi137:> cat /etc/os-release 2023-11-28T09:28:48.855 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="Red Hat Enterprise Linux" 2023-11-28T09:28:48.856 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="8.6 (Ootpa)" 2023-11-28T09:28:48.856 INFO:teuthology.orchestra.run.smithi137.stdout:ID="rhel" 2023-11-28T09:28:48.856 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE="fedora" 2023-11-28T09:28:48.856 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="8.6" 2023-11-28T09:28:48.856 INFO:teuthology.orchestra.run.smithi137.stdout:PLATFORM_ID="platform:el8" 2023-11-28T09:28:48.856 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-28T09:28:48.856 INFO:teuthology.orchestra.run.smithi137.stdout:ANSI_COLOR="0;31" 2023-11-28T09:28:48.856 INFO:teuthology.orchestra.run.smithi137.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-28T09:28:48.856 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://www.redhat.com/" 2023-11-28T09:28:48.856 INFO:teuthology.orchestra.run.smithi137.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-28T09:28:48.857 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-28T09:28:48.857 INFO:teuthology.orchestra.run.smithi137.stdout: 2023-11-28T09:28:48.857 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-28T09:28:48.857 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-28T09:28:48.857 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-28T09:28:48.857 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-28T09:28:48.858 INFO:teuthology.provision.fog.smithi137:Deploy complete! 2023-11-28T09:28:48.859 DEBUG:teuthology.parallel:result is None 2023-11-28T09:29:08.843 WARNING:teuthology.provision.fog.smithi097:timed out 2023-11-28T09:29:14.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T09:29:15.187 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-28T09:29:15.187 DEBUG:teuthology.orchestra.run.smithi097:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-28T09:29:15.488 INFO:teuthology.provision.fog.smithi097:Node is ready 2023-11-28T09:29:15.489 DEBUG:teuthology.orchestra.run.smithi097:> hostname 2023-11-28T09:29:15.508 INFO:teuthology.orchestra.run.smithi097.stdout:smithi097.front.sepia.ceph.com 2023-11-28T09:29:15.508 DEBUG:teuthology.orchestra.run.smithi097:> grep smithi097.front.sepia.ceph.com /etc/hosts 2023-11-28T09:29:15.567 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.15.97 smithi097.front.sepia.ceph.com smithi097 2023-11-28T09:29:15.568 DEBUG:teuthology.orchestra.run.smithi097:> sudo hostname smithi097 2023-11-28T09:29:15.674 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/smithi097.front.sepia.ceph.com/smithi097/g' /etc/hosts 2023-11-28T09:29:15.703 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/172.21.15.97/172.21.15.97/g' /etc/hosts 2023-11-28T09:29:15.771 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/smithi097.front.sepia.ceph.com/smithi097/g' /etc/hostname 2023-11-28T09:29:15.838 DEBUG:teuthology.orchestra.run.smithi097:> sudo hostname smithi097 2023-11-28T09:29:15.904 DEBUG:teuthology.orchestra.run.smithi097:> cat /etc/os-release 2023-11-28T09:29:15.961 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="Red Hat Enterprise Linux" 2023-11-28T09:29:15.961 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="8.6 (Ootpa)" 2023-11-28T09:29:15.961 INFO:teuthology.orchestra.run.smithi097.stdout:ID="rhel" 2023-11-28T09:29:15.961 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE="fedora" 2023-11-28T09:29:15.961 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="8.6" 2023-11-28T09:29:15.961 INFO:teuthology.orchestra.run.smithi097.stdout:PLATFORM_ID="platform:el8" 2023-11-28T09:29:15.961 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-28T09:29:15.962 INFO:teuthology.orchestra.run.smithi097.stdout:ANSI_COLOR="0;31" 2023-11-28T09:29:15.962 INFO:teuthology.orchestra.run.smithi097.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-28T09:29:15.962 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://www.redhat.com/" 2023-11-28T09:29:15.962 INFO:teuthology.orchestra.run.smithi097.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-28T09:29:15.962 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-28T09:29:15.962 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-28T09:29:15.962 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-28T09:29:15.962 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-28T09:29:15.963 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-28T09:29:15.963 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-28T09:29:15.963 INFO:teuthology.provision.fog.smithi097:Deploy complete! 2023-11-28T09:29:15.964 DEBUG:teuthology.parallel:result is None 2023-11-28T09:29:26.950 WARNING:teuthology.provision.fog.smithi172:timed out 2023-11-28T09:29:32.957 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T09:29:33.327 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-28T09:29:33.327 DEBUG:teuthology.orchestra.run.smithi172:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-28T09:29:33.619 INFO:teuthology.provision.fog.smithi172:Node is ready 2023-11-28T09:29:33.620 DEBUG:teuthology.orchestra.run.smithi172:> hostname 2023-11-28T09:29:33.639 INFO:teuthology.orchestra.run.smithi172.stdout:smithi172 2023-11-28T09:29:33.640 DEBUG:teuthology.orchestra.run.smithi172:> grep smithi172 /etc/hosts 2023-11-28T09:29:33.705 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.15.172 smithi172.front.sepia.ceph.com smithi172 2023-11-28T09:29:33.706 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname smithi172 2023-11-28T09:29:33.856 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/smithi172/smithi172/g' /etc/hosts 2023-11-28T09:29:33.884 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/172.21.15.172/172.21.15.172/g' /etc/hosts 2023-11-28T09:29:33.956 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/smithi172/smithi172/g' /etc/hostname 2023-11-28T09:29:34.027 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname smithi172 2023-11-28T09:29:34.095 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2023-11-28T09:29:34.156 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="Red Hat Enterprise Linux" 2023-11-28T09:29:34.156 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="8.6 (Ootpa)" 2023-11-28T09:29:34.156 INFO:teuthology.orchestra.run.smithi172.stdout:ID="rhel" 2023-11-28T09:29:34.156 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="fedora" 2023-11-28T09:29:34.156 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="8.6" 2023-11-28T09:29:34.156 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el8" 2023-11-28T09:29:34.156 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-28T09:29:34.156 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2023-11-28T09:29:34.156 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-28T09:29:34.157 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://www.redhat.com/" 2023-11-28T09:29:34.157 INFO:teuthology.orchestra.run.smithi172.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-28T09:29:34.157 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-28T09:29:34.157 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-11-28T09:29:34.157 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-28T09:29:34.157 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-28T09:29:34.157 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-28T09:29:34.157 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-28T09:29:34.157 INFO:teuthology.provision.fog.smithi172:Deploy complete! 2023-11-28T09:29:34.158 DEBUG:teuthology.parallel:result is None 2023-11-28T09:29:34.356 INFO:teuthology.lock.ops:Checking smithi097.front.sepia.ceph.com 2023-11-28T09:29:34.356 INFO:teuthology.lock.ops:Checking smithi137.front.sepia.ceph.com 2023-11-28T09:29:34.356 INFO:teuthology.lock.ops:Checking smithi172.front.sepia.ceph.com 2023-11-28T09:29:34.358 INFO:teuthology.lock.ops:Updating [smithi097.front.sepia.ceph.com]: set os type and version on server 2023-11-28T09:29:34.358 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2023-11-28T09:29:34.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T09:29:34.426 DEBUG:teuthology.orchestra.run.smithi097:> true 2023-11-28T09:29:34.556 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi097.front.sepia.ceph.com' 2023-11-28T09:29:34.556 DEBUG:teuthology.orchestra.run.smithi097:> uname -m 2023-11-28T09:29:34.613 INFO:teuthology.orchestra.run.smithi097.stdout:x86_64 2023-11-28T09:29:34.613 DEBUG:teuthology.orchestra.run.smithi097:> cat /etc/os-release 2023-11-28T09:29:34.670 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="Red Hat Enterprise Linux" 2023-11-28T09:29:34.670 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="8.6 (Ootpa)" 2023-11-28T09:29:34.670 INFO:teuthology.orchestra.run.smithi097.stdout:ID="rhel" 2023-11-28T09:29:34.670 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE="fedora" 2023-11-28T09:29:34.671 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="8.6" 2023-11-28T09:29:34.671 INFO:teuthology.orchestra.run.smithi097.stdout:PLATFORM_ID="platform:el8" 2023-11-28T09:29:34.671 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-28T09:29:34.671 INFO:teuthology.orchestra.run.smithi097.stdout:ANSI_COLOR="0;31" 2023-11-28T09:29:34.671 INFO:teuthology.orchestra.run.smithi097.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-28T09:29:34.671 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://www.redhat.com/" 2023-11-28T09:29:34.671 INFO:teuthology.orchestra.run.smithi097.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-28T09:29:34.671 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-28T09:29:34.671 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-28T09:29:34.671 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-28T09:29:34.671 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-28T09:29:34.671 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-28T09:29:34.672 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-28T09:29:34.672 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server 2023-11-28T09:29:34.698 INFO:teuthology.lock.ops:Updating [smithi137.front.sepia.ceph.com]: set os type and version on server 2023-11-28T09:29:34.699 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2023-11-28T09:29:34.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T09:29:34.766 DEBUG:teuthology.orchestra.run.smithi137:> true 2023-11-28T09:29:34.904 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi137.front.sepia.ceph.com' 2023-11-28T09:29:34.905 DEBUG:teuthology.orchestra.run.smithi137:> uname -m 2023-11-28T09:29:34.962 INFO:teuthology.orchestra.run.smithi137.stdout:x86_64 2023-11-28T09:29:34.963 DEBUG:teuthology.orchestra.run.smithi137:> cat /etc/os-release 2023-11-28T09:29:35.021 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="Red Hat Enterprise Linux" 2023-11-28T09:29:35.021 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="8.6 (Ootpa)" 2023-11-28T09:29:35.021 INFO:teuthology.orchestra.run.smithi137.stdout:ID="rhel" 2023-11-28T09:29:35.021 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE="fedora" 2023-11-28T09:29:35.021 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="8.6" 2023-11-28T09:29:35.021 INFO:teuthology.orchestra.run.smithi137.stdout:PLATFORM_ID="platform:el8" 2023-11-28T09:29:35.021 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-28T09:29:35.021 INFO:teuthology.orchestra.run.smithi137.stdout:ANSI_COLOR="0;31" 2023-11-28T09:29:35.021 INFO:teuthology.orchestra.run.smithi137.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-28T09:29:35.021 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://www.redhat.com/" 2023-11-28T09:29:35.022 INFO:teuthology.orchestra.run.smithi137.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-28T09:29:35.022 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-28T09:29:35.022 INFO:teuthology.orchestra.run.smithi137.stdout: 2023-11-28T09:29:35.022 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-28T09:29:35.022 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-28T09:29:35.022 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-28T09:29:35.022 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-28T09:29:35.022 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server 2023-11-28T09:29:35.041 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: set os type and version on server 2023-11-28T09:29:35.041 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-11-28T09:29:35.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T09:29:35.113 DEBUG:teuthology.orchestra.run.smithi172:> true 2023-11-28T09:29:35.179 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-11-28T09:29:35.180 DEBUG:teuthology.orchestra.run.smithi172:> uname -m 2023-11-28T09:29:35.241 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64 2023-11-28T09:29:35.241 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2023-11-28T09:29:35.301 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="Red Hat Enterprise Linux" 2023-11-28T09:29:35.301 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="8.6 (Ootpa)" 2023-11-28T09:29:35.301 INFO:teuthology.orchestra.run.smithi172.stdout:ID="rhel" 2023-11-28T09:29:35.302 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="fedora" 2023-11-28T09:29:35.302 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="8.6" 2023-11-28T09:29:35.302 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el8" 2023-11-28T09:29:35.302 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-28T09:29:35.302 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2023-11-28T09:29:35.302 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-28T09:29:35.302 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://www.redhat.com/" 2023-11-28T09:29:35.302 INFO:teuthology.orchestra.run.smithi172.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-28T09:29:35.302 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-28T09:29:35.302 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-11-28T09:29:35.302 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-28T09:29:35.303 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-28T09:29:35.303 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-28T09:29:35.303 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-28T09:29:35.304 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2023-11-28T09:29:35.324 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T09:29:35.438 INFO:teuthology.dispatcher.supervisor:Running job 7469900 2023-11-28T09:29:35.438 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-11-28_06:34:49-fs-rishabh-2023nov26-testing-default-smithi/7469900 --name rishabh-2023-11-28_06:34:49-fs-rishabh-2023nov26-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/suites/dbench}} -- /home/teuthworker/archive/rishabh-2023-11-28_06:34:49-fs-rishabh-2023nov26-testing-default-smithi/7469900/orig.config.yaml 2023-11-28T09:29:35.444 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-11-28_06:34:49-fs-rishabh-2023nov26-testing-default-smithi/7469900 2023-11-28T09:29:35.445 INFO:teuthology.dispatcher.supervisor:Job PID: 654891 2023-11-28T09:29:35.445 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-28T09:31:35.544 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T09:33:35.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T09:35:35.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T09:37:36.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T09:39:36.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T09:41:36.407 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T09:43:36.571 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T09:45:36.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T09:47:36.904 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T09:47:36.961 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-11-28T09:47:37.119 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-28T09:47:37.120 INFO:teuthology.nuke:Checking targets against current locks 2023-11-28T09:47:37.173 DEBUG:teuthology.nuke:shortname: smithi097 2023-11-28T09:47:37.173 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T09:47:37.195 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi097.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-28_06:34:49-fs-rishabh-2023nov26-testing-default-smithi/7469900', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 09:24:31.560052', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-28T09:47:37.198 DEBUG:teuthology.nuke:shortname: smithi137 2023-11-28T09:47:37.199 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T09:47:37.219 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi137.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-28_06:34:49-fs-rishabh-2023nov26-testing-default-smithi/7469900', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 09:24:31.557145', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-28T09:47:37.222 DEBUG:teuthology.nuke:shortname: smithi172 2023-11-28T09:47:37.222 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T09:47:37.245 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-28_06:34:49-fs-rishabh-2023nov26-testing-default-smithi/7469900', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 09:24:31.558970', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-28T09:47:37.253 INFO:teuthology.orchestra.console.smithi097:Power off 2023-11-28T09:47:37.254 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T09:47:37.274 DEBUG:teuthology.orchestra.console.smithi097:power off output: Chassis Power Control: Down/Off 2023-11-28T09:47:37.274 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T09:47:37.290 INFO:teuthology.orchestra.console.smithi137:Power off 2023-11-28T09:47:37.290 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T09:47:37.300 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off 2023-11-28T09:47:37.310 DEBUG:teuthology.orchestra.console.smithi137:power off output: Chassis Power Control: Down/Off 2023-11-28T09:47:37.310 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T09:47:37.325 INFO:teuthology.orchestra.console.smithi172:Power off 2023-11-28T09:47:37.325 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T09:47:37.334 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is off 2023-11-28T09:47:37.345 DEBUG:teuthology.orchestra.console.smithi172:power off output: Chassis Power Control: Down/Off 2023-11-28T09:47:37.345 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T09:47:37.367 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2023-11-28T09:47:37.401 INFO:teuthology.orchestra.console.smithi097:Power off completed 2023-11-28T09:47:37.435 INFO:teuthology.orchestra.console.smithi137:Power off completed 2023-11-28T09:47:37.469 INFO:teuthology.orchestra.console.smithi172:Power off completed 2023-11-28T09:47:37.552 INFO:teuthology.lock.ops:unlocked: smithi097.front.sepia.ceph.com 2023-11-28T09:47:37.577 INFO:teuthology.lock.ops:unlocked: smithi137.front.sepia.ceph.com 2023-11-28T09:47:37.610 INFO:teuthology.lock.ops:unlocked: smithi172.front.sepia.ceph.com