2023-12-19T08:04:21.840 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-19T08:04:21.840 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T08:04:22.022 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f58cd97a940>, signals=[15]) 2023-12-19T08:04:22.022 INFO:teuthology.lock.ops:Start node 'smithi099.front.sepia.ceph.com' reimaging 2023-12-19T08:04:22.023 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: reset os type and version on server 2023-12-19T08:04:22.023 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2023-12-19T08:04:22.057 INFO:teuthology.lock.ops:Start node 'smithi100.front.sepia.ceph.com' reimaging 2023-12-19T08:04:22.057 INFO:teuthology.lock.ops:Updating [smithi100.front.sepia.ceph.com]: reset os type and version on server 2023-12-19T08:04:22.057 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server 2023-12-19T08:04:22.082 INFO:teuthology.lock.ops:Start node 'smithi138.front.sepia.ceph.com' reimaging 2023-12-19T08:04:22.082 INFO:teuthology.lock.ops:Updating [smithi138.front.sepia.ceph.com]: reset os type and version on server 2023-12-19T08:04:22.082 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2023-12-19T08:04:22.167 DEBUG:teuthology.provision.fog.smithi099:Requesting image smithi_rhel_8.4 (ID 7) 2023-12-19T08:04:22.208 DEBUG:teuthology.provision.fog.smithi100:Requesting image smithi_rhel_8.4 (ID 7) 2023-12-19T08:04:22.211 INFO:teuthology.provision.fog.smithi099:Scheduling deploy of rhel 8.4 2023-12-19T08:04:22.221 DEBUG:teuthology.provision.fog.smithi138:Requesting image smithi_rhel_8.4 (ID 7) 2023-12-19T08:04:22.251 INFO:teuthology.provision.fog.smithi100:Scheduling deploy of rhel 8.4 2023-12-19T08:04:22.271 INFO:teuthology.provision.fog.smithi138:Scheduling deploy of rhel 8.4 2023-12-19T08:04:22.440 INFO:teuthology.orchestra.console.smithi099:Power off 2023-12-19T08:04:22.440 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T08:04:22.463 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off 2023-12-19T08:04:22.463 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T08:04:22.486 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2023-12-19T08:04:22.512 INFO:teuthology.orchestra.console.smithi138:Power off 2023-12-19T08:04:22.513 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T08:04:22.529 INFO:teuthology.orchestra.console.smithi100:Power off 2023-12-19T08:04:22.529 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T08:04:22.537 DEBUG:teuthology.orchestra.console.smithi138:power off output: Chassis Power Control: Down/Off 2023-12-19T08:04:22.537 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T08:04:22.550 DEBUG:teuthology.orchestra.console.smithi100:power off output: Chassis Power Control: Down/Off 2023-12-19T08:04:22.551 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T08:04:22.559 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on 2023-12-19T08:04:22.572 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on 2023-12-19T08:04:22.587 INFO:teuthology.orchestra.console.smithi099:Power off completed 2023-12-19T08:04:22.688 INFO:teuthology.orchestra.console.smithi099:Power on 2023-12-19T08:04:22.688 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-19T08:04:22.712 DEBUG:teuthology.orchestra.console.smithi099:power on output: Chassis Power Control: Up/On 2023-12-19T08:04:22.713 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T08:04:22.735 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2023-12-19T08:04:26.563 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T08:04:26.573 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T08:04:26.673 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on 2023-12-19T08:04:26.682 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on 2023-12-19T08:04:26.736 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T08:04:26.845 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2023-12-19T08:04:26.946 INFO:teuthology.orchestra.console.smithi099:Power on completed 2023-12-19T08:04:27.047 INFO:teuthology.provision.fog.smithi099:Waiting for deploy to finish 2023-12-19T08:04:30.675 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T08:04:30.683 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T08:04:30.785 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off 2023-12-19T08:04:30.793 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on 2023-12-19T08:04:30.887 INFO:teuthology.orchestra.console.smithi138:Power off completed 2023-12-19T08:04:30.987 INFO:teuthology.orchestra.console.smithi138:Power on 2023-12-19T08:04:30.988 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-19T08:04:31.010 DEBUG:teuthology.orchestra.console.smithi138:power on output: Chassis Power Control: Up/On 2023-12-19T08:04:31.010 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T08:04:31.033 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off 2023-12-19T08:04:34.798 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T08:04:34.907 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off 2023-12-19T08:04:35.008 INFO:teuthology.orchestra.console.smithi100:Power off completed 2023-12-19T08:04:35.034 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T08:04:35.109 INFO:teuthology.orchestra.console.smithi100:Power on 2023-12-19T08:04:35.109 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-19T08:04:35.132 DEBUG:teuthology.orchestra.console.smithi100:power on output: Chassis Power Control: Up/On 2023-12-19T08:04:35.132 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T08:04:35.143 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off 2023-12-19T08:04:35.161 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off 2023-12-19T08:04:39.148 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T08:04:39.162 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T08:04:39.272 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on 2023-12-19T08:04:39.311 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on 2023-12-19T08:04:39.372 INFO:teuthology.orchestra.console.smithi100:Power on completed 2023-12-19T08:04:39.412 INFO:teuthology.orchestra.console.smithi138:Power on completed 2023-12-19T08:04:39.474 INFO:teuthology.provision.fog.smithi100:Waiting for deploy to finish 2023-12-19T08:04:39.513 INFO:teuthology.provision.fog.smithi138:Waiting for deploy to finish 2023-12-19T08:07:13.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T08:07:16.114 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-12-19T08:07:22.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T08:07:25.169 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-12-19T08:07:25.573 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T08:07:25.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T08:07:28.626 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-12-19T08:07:28.657 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2023-12-19T08:07:31.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T08:07:34.225 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-12-19T08:07:34.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T08:07:34.659 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T08:07:37.681 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-12-19T08:07:37.717 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2023-12-19T08:07:40.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T08:07:43.281 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-12-19T08:07:43.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T08:07:43.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T08:07:46.737 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-12-19T08:07:46.769 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2023-12-19T08:07:49.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T08:07:52.342 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-12-19T08:07:52.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T08:07:52.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T08:07:55.793 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-12-19T08:07:55.829 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2023-12-19T08:07:58.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T08:08:01.425 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-12-19T08:08:01.795 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T08:08:01.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T08:08:04.853 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-12-19T08:08:04.881 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2023-12-19T08:08:07.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T08:08:10.858 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T08:08:10.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T08:08:13.937 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2023-12-19T08:08:13.938 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-12-19T08:08:19.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T08:08:19.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T08:08:22.993 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2023-12-19T08:08:28.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T08:09:07.470 WARNING:teuthology.provision.fog.smithi099:timed out 2023-12-19T08:09:13.476 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T08:09:13.762 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-19T08:09:13.763 DEBUG:teuthology.orchestra.run.smithi099:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-19T08:09:14.042 INFO:teuthology.provision.fog.smithi099:Node is ready 2023-12-19T08:09:14.043 DEBUG:teuthology.orchestra.run.smithi099:> hostname 2023-12-19T08:09:14.102 INFO:teuthology.orchestra.run.smithi099.stdout:smithi099.front.sepia.ceph.com 2023-12-19T08:09:14.103 DEBUG:teuthology.orchestra.run.smithi099:> grep smithi099.front.sepia.ceph.com /etc/hosts 2023-12-19T08:09:14.161 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99 smithi099.front.sepia.ceph.com smithi099 2023-12-19T08:09:14.162 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099 2023-12-19T08:09:14.284 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hosts 2023-12-19T08:09:14.309 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/172.21.15.99/172.21.15.99/g' /etc/hosts 2023-12-19T08:09:14.378 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hostname 2023-12-19T08:09:14.446 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099 2023-12-19T08:09:14.513 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2023-12-19T08:09:14.570 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T08:09:14.570 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="8.4 (Ootpa)" 2023-12-19T08:09:14.570 INFO:teuthology.orchestra.run.smithi099.stdout:ID="rhel" 2023-12-19T08:09:14.570 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="fedora" 2023-12-19T08:09:14.570 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="8.4" 2023-12-19T08:09:14.570 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el8" 2023-12-19T08:09:14.571 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-19T08:09:14.571 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2023-12-19T08:09:14.571 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-19T08:09:14.571 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T08:09:14.571 INFO:teuthology.orchestra.run.smithi099.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T08:09:14.571 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T08:09:14.571 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T08:09:14.571 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T08:09:14.571 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-19T08:09:14.571 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T08:09:14.571 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-19T08:09:14.572 INFO:teuthology.provision.fog.smithi099:Deploy complete! 2023-12-19T08:09:14.573 DEBUG:teuthology.parallel:result is None 2023-12-19T08:09:19.949 WARNING:teuthology.provision.fog.smithi138:timed out 2023-12-19T08:09:25.957 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T08:09:26.338 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-19T08:09:26.338 DEBUG:teuthology.orchestra.run.smithi138:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-19T08:09:26.608 INFO:teuthology.provision.fog.smithi138:Node is ready 2023-12-19T08:09:26.608 DEBUG:teuthology.orchestra.run.smithi138:> hostname 2023-12-19T08:09:26.624 INFO:teuthology.orchestra.run.smithi138.stdout:smithi138.front.sepia.ceph.com 2023-12-19T08:09:26.625 DEBUG:teuthology.orchestra.run.smithi138:> grep smithi138.front.sepia.ceph.com /etc/hosts 2023-12-19T08:09:26.681 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138 smithi138.front.sepia.ceph.com smithi138 2023-12-19T08:09:26.681 DEBUG:teuthology.orchestra.run.smithi138:> sudo hostname smithi138 2023-12-19T08:09:26.797 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/smithi138.front.sepia.ceph.com/smithi138/g' /etc/hosts 2023-12-19T08:09:26.823 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/172.21.15.138/172.21.15.138/g' /etc/hosts 2023-12-19T08:09:26.888 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/smithi138.front.sepia.ceph.com/smithi138/g' /etc/hostname 2023-12-19T08:09:26.954 DEBUG:teuthology.orchestra.run.smithi138:> sudo hostname smithi138 2023-12-19T08:09:27.016 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release 2023-12-19T08:09:27.070 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T08:09:27.071 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="8.4 (Ootpa)" 2023-12-19T08:09:27.071 INFO:teuthology.orchestra.run.smithi138.stdout:ID="rhel" 2023-12-19T08:09:27.071 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE="fedora" 2023-12-19T08:09:27.071 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="8.4" 2023-12-19T08:09:27.071 INFO:teuthology.orchestra.run.smithi138.stdout:PLATFORM_ID="platform:el8" 2023-12-19T08:09:27.071 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-19T08:09:27.071 INFO:teuthology.orchestra.run.smithi138.stdout:ANSI_COLOR="0;31" 2023-12-19T08:09:27.071 INFO:teuthology.orchestra.run.smithi138.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-19T08:09:27.071 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T08:09:27.071 INFO:teuthology.orchestra.run.smithi138.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T08:09:27.071 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T08:09:27.071 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-12-19T08:09:27.072 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T08:09:27.072 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-19T08:09:27.072 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T08:09:27.072 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-19T08:09:27.072 INFO:teuthology.provision.fog.smithi138:Deploy complete! 2023-12-19T08:09:27.073 DEBUG:teuthology.parallel:result is None 2023-12-19T08:09:29.001 WARNING:teuthology.provision.fog.smithi100:timed out 2023-12-19T08:09:35.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T08:09:35.377 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-19T08:09:35.378 DEBUG:teuthology.orchestra.run.smithi100:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-19T08:09:35.661 INFO:teuthology.provision.fog.smithi100:Node is ready 2023-12-19T08:09:35.661 DEBUG:teuthology.orchestra.run.smithi100:> hostname 2023-12-19T08:09:35.718 INFO:teuthology.orchestra.run.smithi100.stdout:smithi100.front.sepia.ceph.com 2023-12-19T08:09:35.718 DEBUG:teuthology.orchestra.run.smithi100:> grep smithi100.front.sepia.ceph.com /etc/hosts 2023-12-19T08:09:35.774 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100 smithi100.front.sepia.ceph.com smithi100 2023-12-19T08:09:35.774 DEBUG:teuthology.orchestra.run.smithi100:> sudo hostname smithi100 2023-12-19T08:09:35.883 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/smithi100.front.sepia.ceph.com/smithi100/g' /etc/hosts 2023-12-19T08:09:35.909 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/172.21.15.100/172.21.15.100/g' /etc/hosts 2023-12-19T08:09:35.974 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/smithi100.front.sepia.ceph.com/smithi100/g' /etc/hostname 2023-12-19T08:09:36.040 DEBUG:teuthology.orchestra.run.smithi100:> sudo hostname smithi100 2023-12-19T08:09:36.104 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release 2023-12-19T08:09:36.158 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T08:09:36.159 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="8.4 (Ootpa)" 2023-12-19T08:09:36.159 INFO:teuthology.orchestra.run.smithi100.stdout:ID="rhel" 2023-12-19T08:09:36.159 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE="fedora" 2023-12-19T08:09:36.159 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="8.4" 2023-12-19T08:09:36.159 INFO:teuthology.orchestra.run.smithi100.stdout:PLATFORM_ID="platform:el8" 2023-12-19T08:09:36.159 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-19T08:09:36.159 INFO:teuthology.orchestra.run.smithi100.stdout:ANSI_COLOR="0;31" 2023-12-19T08:09:36.159 INFO:teuthology.orchestra.run.smithi100.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-19T08:09:36.159 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T08:09:36.159 INFO:teuthology.orchestra.run.smithi100.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T08:09:36.159 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T08:09:36.159 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-19T08:09:36.159 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T08:09:36.159 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-19T08:09:36.160 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T08:09:36.160 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-19T08:09:36.160 INFO:teuthology.provision.fog.smithi100:Deploy complete! 2023-12-19T08:09:36.160 DEBUG:teuthology.parallel:result is None 2023-12-19T08:09:36.344 INFO:teuthology.lock.ops:Checking smithi099.front.sepia.ceph.com 2023-12-19T08:09:36.345 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-19T08:09:36.374 INFO:teuthology.lock.ops:Checking smithi100.front.sepia.ceph.com 2023-12-19T08:09:36.375 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-19T08:09:36.399 INFO:teuthology.lock.ops:Checking smithi138.front.sepia.ceph.com 2023-12-19T08:09:36.399 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-19T08:09:36.425 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: set os type and version on server 2023-12-19T08:09:36.425 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2023-12-19T08:09:36.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T08:09:36.494 DEBUG:teuthology.orchestra.run.smithi099:> true 2023-12-19T08:09:36.612 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2023-12-19T08:09:36.612 DEBUG:teuthology.orchestra.run.smithi099:> uname -m 2023-12-19T08:09:36.666 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64 2023-12-19T08:09:36.667 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2023-12-19T08:09:36.721 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T08:09:36.721 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="8.4 (Ootpa)" 2023-12-19T08:09:36.721 INFO:teuthology.orchestra.run.smithi099.stdout:ID="rhel" 2023-12-19T08:09:36.721 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="fedora" 2023-12-19T08:09:36.721 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="8.4" 2023-12-19T08:09:36.721 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el8" 2023-12-19T08:09:36.721 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-19T08:09:36.721 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2023-12-19T08:09:36.722 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-19T08:09:36.722 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T08:09:36.722 INFO:teuthology.orchestra.run.smithi099.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T08:09:36.722 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T08:09:36.722 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T08:09:36.722 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T08:09:36.722 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-19T08:09:36.722 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T08:09:36.722 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-19T08:09:36.723 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2023-12-19T08:09:36.741 INFO:teuthology.lock.ops:Updating [smithi100.front.sepia.ceph.com]: set os type and version on server 2023-12-19T08:09:36.741 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2023-12-19T08:09:36.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T08:09:36.808 DEBUG:teuthology.orchestra.run.smithi100:> true 2023-12-19T08:09:36.877 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com' 2023-12-19T08:09:36.877 DEBUG:teuthology.orchestra.run.smithi100:> uname -m 2023-12-19T08:09:36.932 INFO:teuthology.orchestra.run.smithi100.stdout:x86_64 2023-12-19T08:09:36.932 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release 2023-12-19T08:09:36.988 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T08:09:36.988 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="8.4 (Ootpa)" 2023-12-19T08:09:36.988 INFO:teuthology.orchestra.run.smithi100.stdout:ID="rhel" 2023-12-19T08:09:36.988 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE="fedora" 2023-12-19T08:09:36.988 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="8.4" 2023-12-19T08:09:36.988 INFO:teuthology.orchestra.run.smithi100.stdout:PLATFORM_ID="platform:el8" 2023-12-19T08:09:36.988 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-19T08:09:36.988 INFO:teuthology.orchestra.run.smithi100.stdout:ANSI_COLOR="0;31" 2023-12-19T08:09:36.988 INFO:teuthology.orchestra.run.smithi100.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-19T08:09:36.988 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T08:09:36.988 INFO:teuthology.orchestra.run.smithi100.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T08:09:36.989 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T08:09:36.989 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-19T08:09:36.989 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T08:09:36.989 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-19T08:09:36.989 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T08:09:36.989 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-19T08:09:36.989 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server 2023-12-19T08:09:37.008 INFO:teuthology.lock.ops:Updating [smithi138.front.sepia.ceph.com]: set os type and version on server 2023-12-19T08:09:37.008 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2023-12-19T08:09:37.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T08:09:37.075 DEBUG:teuthology.orchestra.run.smithi138:> true 2023-12-19T08:09:37.142 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com' 2023-12-19T08:09:37.143 DEBUG:teuthology.orchestra.run.smithi138:> uname -m 2023-12-19T08:09:37.198 INFO:teuthology.orchestra.run.smithi138.stdout:x86_64 2023-12-19T08:09:37.199 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release 2023-12-19T08:09:37.254 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T08:09:37.254 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="8.4 (Ootpa)" 2023-12-19T08:09:37.254 INFO:teuthology.orchestra.run.smithi138.stdout:ID="rhel" 2023-12-19T08:09:37.254 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE="fedora" 2023-12-19T08:09:37.254 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="8.4" 2023-12-19T08:09:37.255 INFO:teuthology.orchestra.run.smithi138.stdout:PLATFORM_ID="platform:el8" 2023-12-19T08:09:37.255 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-19T08:09:37.255 INFO:teuthology.orchestra.run.smithi138.stdout:ANSI_COLOR="0;31" 2023-12-19T08:09:37.255 INFO:teuthology.orchestra.run.smithi138.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-19T08:09:37.255 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T08:09:37.255 INFO:teuthology.orchestra.run.smithi138.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T08:09:37.255 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T08:09:37.255 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-12-19T08:09:37.255 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T08:09:37.255 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-19T08:09:37.255 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T08:09:37.255 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-19T08:09:37.256 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2023-12-19T08:09:37.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T08:09:37.374 INFO:teuthology.dispatcher.supervisor:Running job 7495948 2023-12-19T08:09:37.374 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-12-19_05:14:21-fs-rishabh-mdscap-pacific-testing-default-smithi/7495948 --name rishabh-2023-12-19_05:14:21-fs-rishabh-mdscap-pacific-testing-default-smithi --description fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/3 scrub/yes standby-replay subvolume/{with-quota} tasks/{0-check-counter workunit/suites/iogen} wsync/{yes}} -- /home/teuthworker/archive/rishabh-2023-12-19_05:14:21-fs-rishabh-mdscap-pacific-testing-default-smithi/7495948/orig.config.yaml 2023-12-19T08:09:37.377 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-12-19_05:14:21-fs-rishabh-mdscap-pacific-testing-default-smithi/7495948 2023-12-19T08:09:37.377 INFO:teuthology.dispatcher.supervisor:Job PID: 356796 2023-12-19T08:09:37.378 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-19T08:11:37.478 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T08:13:37.638 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T08:15:37.822 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T08:17:38.006 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T08:17:38.082 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-19T08:17:38.226 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-19T08:17:38.227 INFO:teuthology.nuke:Checking targets against current locks 2023-12-19T08:17:38.275 DEBUG:teuthology.nuke:shortname: smithi099 2023-12-19T08:17:38.276 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T08:17:38.299 DEBUG:teuthology.nuke:shortname: smithi100 2023-12-19T08:17:38.300 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T08:17:38.305 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_05:14:21-fs-rishabh-mdscap-pacific-testing-default-smithi/7495948', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 08:04:20.956199', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGkXTaI/24JqdD/bQOpJO5v5rKopJiAH5xr/umqQdwDiRCDOJnCvEUavtN4MN262b+YixFfN4wbG0uNbvlfhSpA='} 2023-12-19T08:17:38.333 DEBUG:teuthology.nuke:shortname: smithi138 2023-12-19T08:17:38.333 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T08:17:38.334 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi100.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_05:14:21-fs-rishabh-mdscap-pacific-testing-default-smithi/7495948', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 08:04:20.953107', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHZ5eI0OfGaOq12BQmqDqWVVEBR1TaH0s16fXeWGmzlX1g0j550vu6mpBnjiicfJ8eZfozUeb6foG+GusukE3wI='} 2023-12-19T08:17:38.355 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi138.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_05:14:21-fs-rishabh-mdscap-pacific-testing-default-smithi/7495948', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 08:04:20.954665', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFhoaS+Uin4PVS12kABjXnpIwlM5G/NkIHfrHCsDT2XYXXuY0ZyKG1FW+yk0ceq+x8mxEGuYBY27lcelikV8GuI='} 2023-12-19T08:17:38.363 INFO:teuthology.orchestra.console.smithi099:Power off 2023-12-19T08:17:38.364 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T08:17:38.384 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off 2023-12-19T08:17:38.385 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T08:17:38.404 INFO:teuthology.orchestra.console.smithi100:Power off 2023-12-19T08:17:38.405 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T08:17:38.413 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2023-12-19T08:17:38.426 DEBUG:teuthology.orchestra.console.smithi100:power off output: Chassis Power Control: Down/Off 2023-12-19T08:17:38.427 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T08:17:38.444 INFO:teuthology.orchestra.console.smithi138:Power off 2023-12-19T08:17:38.444 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T08:17:38.454 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off 2023-12-19T08:17:38.466 DEBUG:teuthology.orchestra.console.smithi138:power off output: Chassis Power Control: Down/Off 2023-12-19T08:17:38.466 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T08:17:38.487 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off 2023-12-19T08:17:38.515 INFO:teuthology.orchestra.console.smithi099:Power off completed 2023-12-19T08:17:38.555 INFO:teuthology.orchestra.console.smithi100:Power off completed 2023-12-19T08:17:38.588 INFO:teuthology.orchestra.console.smithi138:Power off completed 2023-12-19T08:17:38.672 INFO:teuthology.lock.ops:unlocked: smithi099.front.sepia.ceph.com 2023-12-19T08:17:38.706 INFO:teuthology.lock.ops:unlocked: smithi100.front.sepia.ceph.com 2023-12-19T08:17:38.732 INFO:teuthology.lock.ops:unlocked: smithi138.front.sepia.ceph.com