2023-12-19T10:14:06.935 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-19T10:14:06.936 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T10:14:07.113 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fac2dc3b940>, signals=[15]) 2023-12-19T10:14:07.113 INFO:teuthology.lock.ops:Start node 'smithi053.front.sepia.ceph.com' reimaging 2023-12-19T10:14:07.114 INFO:teuthology.lock.ops:Updating [smithi053.front.sepia.ceph.com]: reset os type and version on server 2023-12-19T10:14:07.114 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server 2023-12-19T10:14:07.134 INFO:teuthology.lock.ops:Start node 'smithi111.front.sepia.ceph.com' reimaging 2023-12-19T10:14:07.135 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: reset os type and version on server 2023-12-19T10:14:07.135 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server 2023-12-19T10:14:07.158 INFO:teuthology.lock.ops:Start node 'smithi143.front.sepia.ceph.com' reimaging 2023-12-19T10:14:07.159 INFO:teuthology.lock.ops:Updating [smithi143.front.sepia.ceph.com]: reset os type and version on server 2023-12-19T10:14:07.159 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2023-12-19T10:14:07.243 DEBUG:teuthology.provision.fog.smithi053:Requesting image smithi_rhel_8.4 (ID 7) 2023-12-19T10:14:07.271 DEBUG:teuthology.provision.fog.smithi111:Requesting image smithi_rhel_8.4 (ID 7) 2023-12-19T10:14:07.276 DEBUG:teuthology.provision.fog.smithi143:Requesting image smithi_rhel_8.4 (ID 7) 2023-12-19T10:14:07.283 INFO:teuthology.provision.fog.smithi053:Scheduling deploy of rhel 8.4 2023-12-19T10:14:07.318 INFO:teuthology.provision.fog.smithi143:Scheduling deploy of rhel 8.4 2023-12-19T10:14:07.327 INFO:teuthology.provision.fog.smithi111:Scheduling deploy of rhel 8.4 2023-12-19T10:14:07.576 INFO:teuthology.orchestra.console.smithi053:Power off 2023-12-19T10:14:07.576 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T10:14:07.589 INFO:teuthology.orchestra.console.smithi143:Power off 2023-12-19T10:14:07.590 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T10:14:07.601 INFO:teuthology.orchestra.console.smithi111:Power off 2023-12-19T10:14:07.601 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T10:14:07.609 DEBUG:teuthology.orchestra.console.smithi053:power off output: Chassis Power Control: Down/Off 2023-12-19T10:14:07.609 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T10:14:07.617 DEBUG:teuthology.orchestra.console.smithi143:power off output: Chassis Power Control: Down/Off 2023-12-19T10:14:07.617 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T10:14:07.625 DEBUG:teuthology.orchestra.console.smithi111:power off output: Chassis Power Control: Down/Off 2023-12-19T10:14:07.625 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T10:14:07.632 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is on 2023-12-19T10:14:07.637 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off 2023-12-19T10:14:07.644 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off 2023-12-19T10:14:07.738 INFO:teuthology.orchestra.console.smithi143:Power off completed 2023-12-19T10:14:07.745 INFO:teuthology.orchestra.console.smithi111:Power off completed 2023-12-19T10:14:07.839 INFO:teuthology.orchestra.console.smithi143:Power on 2023-12-19T10:14:07.839 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-19T10:14:07.847 INFO:teuthology.orchestra.console.smithi111:Power on 2023-12-19T10:14:07.847 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-19T10:14:07.861 DEBUG:teuthology.orchestra.console.smithi143:power on output: Chassis Power Control: Up/On 2023-12-19T10:14:07.861 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T10:14:07.870 DEBUG:teuthology.orchestra.console.smithi111:power on output: Chassis Power Control: Up/On 2023-12-19T10:14:07.870 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T10:14:07.884 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off 2023-12-19T10:14:07.894 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off 2023-12-19T10:14:11.637 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T10:14:11.747 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is on 2023-12-19T10:14:11.886 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T10:14:11.895 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T10:14:11.994 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on 2023-12-19T10:14:12.004 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off 2023-12-19T10:14:12.095 INFO:teuthology.orchestra.console.smithi143:Power on completed 2023-12-19T10:14:12.196 INFO:teuthology.provision.fog.smithi143:Waiting for deploy to finish 2023-12-19T10:14:15.749 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T10:14:15.858 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is on 2023-12-19T10:14:16.005 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T10:14:16.113 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2023-12-19T10:14:16.214 INFO:teuthology.orchestra.console.smithi111:Power on completed 2023-12-19T10:14:16.314 INFO:teuthology.provision.fog.smithi111:Waiting for deploy to finish 2023-12-19T10:14:19.862 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T10:14:19.971 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off 2023-12-19T10:14:20.071 INFO:teuthology.orchestra.console.smithi053:Power off completed 2023-12-19T10:14:20.172 INFO:teuthology.orchestra.console.smithi053:Power on 2023-12-19T10:14:20.172 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-19T10:14:20.195 DEBUG:teuthology.orchestra.console.smithi053:power on output: Chassis Power Control: Up/On 2023-12-19T10:14:20.195 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T10:14:20.217 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off 2023-12-19T10:14:24.222 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T10:14:24.331 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off 2023-12-19T10:14:28.333 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T10:14:28.443 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is on 2023-12-19T10:14:28.544 INFO:teuthology.orchestra.console.smithi053:Power on completed 2023-12-19T10:14:28.644 INFO:teuthology.provision.fog.smithi053:Waiting for deploy to finish 2023-12-19T10:16:58.341 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T10:16:59.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T10:17:01.398 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-12-19T10:17:02.769 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53 2023-12-19T10:17:07.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T10:17:08.772 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T10:17:10.485 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-12-19T10:17:11.825 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53 2023-12-19T10:17:16.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T10:17:17.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T10:17:19.573 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-12-19T10:17:20.881 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53 2023-12-19T10:17:25.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T10:17:26.884 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T10:17:28.657 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-12-19T10:17:29.937 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53 2023-12-19T10:17:32.565 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T10:17:34.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T10:17:35.634 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-12-19T10:17:35.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T10:17:37.714 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-12-19T10:17:41.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T10:17:43.717 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T10:17:44.693 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-12-19T10:17:46.770 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-12-19T10:17:50.698 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T10:17:52.772 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T10:17:53.777 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-12-19T10:17:59.782 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T10:18:02.838 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-12-19T10:18:08.842 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T10:18:11.925 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-12-19T10:18:17.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T10:18:21.016 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-12-19T10:18:27.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T10:18:30.101 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-12-19T10:18:35.945 WARNING:teuthology.provision.fog.smithi053:timed out 2023-12-19T10:18:36.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T10:18:39.157 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-12-19T10:18:41.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T10:18:42.231 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-19T10:18:42.232 DEBUG:teuthology.orchestra.run.smithi053:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-19T10:18:42.514 INFO:teuthology.provision.fog.smithi053:Node is ready 2023-12-19T10:18:42.515 DEBUG:teuthology.orchestra.run.smithi053:> hostname 2023-12-19T10:18:42.531 INFO:teuthology.orchestra.run.smithi053.stdout:smithi053.front.sepia.ceph.com 2023-12-19T10:18:42.531 DEBUG:teuthology.orchestra.run.smithi053:> grep smithi053.front.sepia.ceph.com /etc/hosts 2023-12-19T10:18:42.589 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53 smithi053.front.sepia.ceph.com smithi053 2023-12-19T10:18:42.589 DEBUG:teuthology.orchestra.run.smithi053:> sudo hostname smithi053 2023-12-19T10:18:42.706 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i -e 's/smithi053.front.sepia.ceph.com/smithi053/g' /etc/hosts 2023-12-19T10:18:42.734 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i -e 's/172.21.15.53/172.21.15.53/g' /etc/hosts 2023-12-19T10:18:42.802 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i -e 's/smithi053.front.sepia.ceph.com/smithi053/g' /etc/hostname 2023-12-19T10:18:42.868 DEBUG:teuthology.orchestra.run.smithi053:> sudo hostname smithi053 2023-12-19T10:18:42.934 DEBUG:teuthology.orchestra.run.smithi053:> cat /etc/os-release 2023-12-19T10:18:42.990 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T10:18:42.990 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="8.4 (Ootpa)" 2023-12-19T10:18:42.990 INFO:teuthology.orchestra.run.smithi053.stdout:ID="rhel" 2023-12-19T10:18:42.990 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE="fedora" 2023-12-19T10:18:42.990 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="8.4" 2023-12-19T10:18:42.990 INFO:teuthology.orchestra.run.smithi053.stdout:PLATFORM_ID="platform:el8" 2023-12-19T10:18:42.990 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-19T10:18:42.990 INFO:teuthology.orchestra.run.smithi053.stdout:ANSI_COLOR="0;31" 2023-12-19T10:18:42.990 INFO:teuthology.orchestra.run.smithi053.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-19T10:18:42.991 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T10:18:42.991 INFO:teuthology.orchestra.run.smithi053.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T10:18:42.991 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T10:18:42.991 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-19T10:18:42.991 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T10:18:42.991 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-19T10:18:42.991 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T10:18:42.991 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-19T10:18:42.992 INFO:teuthology.provision.fog.smithi053:Deploy complete! 2023-12-19T10:18:42.993 DEBUG:teuthology.parallel:result is None 2023-12-19T10:18:45.161 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T10:18:48.242 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-12-19T10:18:52.780 WARNING:teuthology.provision.fog.smithi143:timed out 2023-12-19T10:18:54.244 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T10:18:58.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T10:18:59.198 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-19T10:18:59.198 DEBUG:teuthology.orchestra.run.smithi143:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-19T10:18:59.435 INFO:teuthology.provision.fog.smithi143:Node is ready 2023-12-19T10:18:59.435 DEBUG:teuthology.orchestra.run.smithi143:> hostname 2023-12-19T10:18:59.488 INFO:teuthology.orchestra.run.smithi143.stdout:smithi143.front.sepia.ceph.com 2023-12-19T10:18:59.488 DEBUG:teuthology.orchestra.run.smithi143:> grep smithi143.front.sepia.ceph.com /etc/hosts 2023-12-19T10:18:59.542 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.15.143 smithi143.front.sepia.ceph.com smithi143 2023-12-19T10:18:59.542 DEBUG:teuthology.orchestra.run.smithi143:> sudo hostname smithi143 2023-12-19T10:18:59.650 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/smithi143.front.sepia.ceph.com/smithi143/g' /etc/hosts 2023-12-19T10:18:59.674 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/172.21.15.143/172.21.15.143/g' /etc/hosts 2023-12-19T10:18:59.738 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/smithi143.front.sepia.ceph.com/smithi143/g' /etc/hostname 2023-12-19T10:18:59.802 DEBUG:teuthology.orchestra.run.smithi143:> sudo hostname smithi143 2023-12-19T10:18:59.865 DEBUG:teuthology.orchestra.run.smithi143:> cat /etc/os-release 2023-12-19T10:18:59.916 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T10:18:59.916 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="8.4 (Ootpa)" 2023-12-19T10:18:59.916 INFO:teuthology.orchestra.run.smithi143.stdout:ID="rhel" 2023-12-19T10:18:59.916 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE="fedora" 2023-12-19T10:18:59.916 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="8.4" 2023-12-19T10:18:59.917 INFO:teuthology.orchestra.run.smithi143.stdout:PLATFORM_ID="platform:el8" 2023-12-19T10:18:59.917 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-19T10:18:59.917 INFO:teuthology.orchestra.run.smithi143.stdout:ANSI_COLOR="0;31" 2023-12-19T10:18:59.917 INFO:teuthology.orchestra.run.smithi143.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-19T10:18:59.917 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T10:18:59.917 INFO:teuthology.orchestra.run.smithi143.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T10:18:59.917 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T10:18:59.917 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-19T10:18:59.917 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T10:18:59.917 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-19T10:18:59.917 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T10:18:59.917 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-19T10:18:59.918 INFO:teuthology.provision.fog.smithi143:Deploy complete! 2023-12-19T10:18:59.918 DEBUG:teuthology.parallel:result is None 2023-12-19T10:19:12.786 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-12-19T10:19:18.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T10:19:21.841 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-12-19T10:19:27.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T10:19:30.901 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-12-19T10:19:36.909 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T10:19:37.384 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-19T10:19:37.384 DEBUG:teuthology.orchestra.run.smithi111:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-19T10:19:53.512 INFO:teuthology.provision.fog.smithi111:Node is ready 2023-12-19T10:19:53.512 DEBUG:teuthology.orchestra.run.smithi111:> hostname 2023-12-19T10:19:53.528 INFO:teuthology.orchestra.run.smithi111.stdout:smithi111.front.sepia.ceph.com 2023-12-19T10:19:53.529 DEBUG:teuthology.orchestra.run.smithi111:> grep smithi111.front.sepia.ceph.com /etc/hosts 2023-12-19T10:19:53.582 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111 smithi111.front.sepia.ceph.com smithi111 2023-12-19T10:19:53.583 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111 2023-12-19T10:19:53.799 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hosts 2023-12-19T10:19:53.824 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/172.21.15.111/172.21.15.111/g' /etc/hosts 2023-12-19T10:19:53.889 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hostname 2023-12-19T10:19:53.953 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111 2023-12-19T10:19:54.017 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release 2023-12-19T10:19:54.073 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T10:19:54.074 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="8.4 (Ootpa)" 2023-12-19T10:19:54.074 INFO:teuthology.orchestra.run.smithi111.stdout:ID="rhel" 2023-12-19T10:19:54.074 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="fedora" 2023-12-19T10:19:54.074 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="8.4" 2023-12-19T10:19:54.074 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el8" 2023-12-19T10:19:54.074 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-19T10:19:54.074 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31" 2023-12-19T10:19:54.074 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-19T10:19:54.074 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T10:19:54.075 INFO:teuthology.orchestra.run.smithi111.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T10:19:54.075 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T10:19:54.075 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-19T10:19:54.075 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T10:19:54.075 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-19T10:19:54.076 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T10:19:54.077 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-19T10:19:54.077 INFO:teuthology.provision.fog.smithi111:Deploy complete! 2023-12-19T10:19:54.077 DEBUG:teuthology.parallel:result is None 2023-12-19T10:19:54.278 INFO:teuthology.lock.ops:Checking smithi053.front.sepia.ceph.com 2023-12-19T10:19:54.279 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-19T10:19:54.304 INFO:teuthology.lock.ops:Checking smithi111.front.sepia.ceph.com 2023-12-19T10:19:54.304 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-19T10:19:54.329 INFO:teuthology.lock.ops:Checking smithi143.front.sepia.ceph.com 2023-12-19T10:19:54.329 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-19T10:19:54.355 INFO:teuthology.lock.ops:Updating [smithi053.front.sepia.ceph.com]: set os type and version on server 2023-12-19T10:19:54.355 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2023-12-19T10:19:54.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T10:19:54.426 DEBUG:teuthology.orchestra.run.smithi053:> true 2023-12-19T10:19:54.550 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi053.front.sepia.ceph.com' 2023-12-19T10:19:54.550 DEBUG:teuthology.orchestra.run.smithi053:> uname -m 2023-12-19T10:19:54.606 INFO:teuthology.orchestra.run.smithi053.stdout:x86_64 2023-12-19T10:19:54.606 DEBUG:teuthology.orchestra.run.smithi053:> cat /etc/os-release 2023-12-19T10:19:54.662 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T10:19:54.662 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="8.4 (Ootpa)" 2023-12-19T10:19:54.662 INFO:teuthology.orchestra.run.smithi053.stdout:ID="rhel" 2023-12-19T10:19:54.662 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE="fedora" 2023-12-19T10:19:54.662 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="8.4" 2023-12-19T10:19:54.662 INFO:teuthology.orchestra.run.smithi053.stdout:PLATFORM_ID="platform:el8" 2023-12-19T10:19:54.663 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-19T10:19:54.663 INFO:teuthology.orchestra.run.smithi053.stdout:ANSI_COLOR="0;31" 2023-12-19T10:19:54.663 INFO:teuthology.orchestra.run.smithi053.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-19T10:19:54.663 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T10:19:54.663 INFO:teuthology.orchestra.run.smithi053.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T10:19:54.663 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T10:19:54.663 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-19T10:19:54.663 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T10:19:54.663 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-19T10:19:54.664 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T10:19:54.664 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-19T10:19:54.664 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server 2023-12-19T10:19:54.688 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: set os type and version on server 2023-12-19T10:19:54.688 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2023-12-19T10:19:54.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T10:19:54.756 DEBUG:teuthology.orchestra.run.smithi111:> true 2023-12-19T10:19:54.823 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com' 2023-12-19T10:19:54.824 DEBUG:teuthology.orchestra.run.smithi111:> uname -m 2023-12-19T10:19:54.878 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64 2023-12-19T10:19:54.878 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release 2023-12-19T10:19:54.932 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T10:19:54.933 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="8.4 (Ootpa)" 2023-12-19T10:19:54.933 INFO:teuthology.orchestra.run.smithi111.stdout:ID="rhel" 2023-12-19T10:19:54.933 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="fedora" 2023-12-19T10:19:54.933 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="8.4" 2023-12-19T10:19:54.933 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el8" 2023-12-19T10:19:54.933 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-19T10:19:54.933 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31" 2023-12-19T10:19:54.933 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-19T10:19:54.933 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T10:19:54.933 INFO:teuthology.orchestra.run.smithi111.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T10:19:54.933 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T10:19:54.933 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-19T10:19:54.933 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T10:19:54.933 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-19T10:19:54.934 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T10:19:54.934 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-19T10:19:54.934 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server 2023-12-19T10:19:54.962 INFO:teuthology.lock.ops:Updating [smithi143.front.sepia.ceph.com]: set os type and version on server 2023-12-19T10:19:54.962 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2023-12-19T10:19:54.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T10:19:55.029 DEBUG:teuthology.orchestra.run.smithi143:> true 2023-12-19T10:19:55.152 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi143.front.sepia.ceph.com' 2023-12-19T10:19:55.152 DEBUG:teuthology.orchestra.run.smithi143:> uname -m 2023-12-19T10:19:55.207 INFO:teuthology.orchestra.run.smithi143.stdout:x86_64 2023-12-19T10:19:55.208 DEBUG:teuthology.orchestra.run.smithi143:> cat /etc/os-release 2023-12-19T10:19:55.262 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T10:19:55.262 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="8.4 (Ootpa)" 2023-12-19T10:19:55.262 INFO:teuthology.orchestra.run.smithi143.stdout:ID="rhel" 2023-12-19T10:19:55.262 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE="fedora" 2023-12-19T10:19:55.263 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="8.4" 2023-12-19T10:19:55.263 INFO:teuthology.orchestra.run.smithi143.stdout:PLATFORM_ID="platform:el8" 2023-12-19T10:19:55.263 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-19T10:19:55.263 INFO:teuthology.orchestra.run.smithi143.stdout:ANSI_COLOR="0;31" 2023-12-19T10:19:55.263 INFO:teuthology.orchestra.run.smithi143.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-19T10:19:55.263 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T10:19:55.263 INFO:teuthology.orchestra.run.smithi143.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T10:19:55.263 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T10:19:55.263 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-19T10:19:55.263 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T10:19:55.263 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-19T10:19:55.263 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T10:19:55.263 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-19T10:19:55.264 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2023-12-19T10:19:55.287 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T10:19:55.367 INFO:teuthology.dispatcher.supervisor:Running job 7496127 2023-12-19T10:19:55.367 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-12-19_05:13:44-fs-rishabh-mdscap-quincy-testing-default-smithi/7496127 --name rishabh-2023-12-19_05:13:44-fs-rishabh-mdscap-quincy-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse ms_mode/{secure} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/ffsb} wsync/{no}} -- /home/teuthworker/archive/rishabh-2023-12-19_05:13:44-fs-rishabh-mdscap-quincy-testing-default-smithi/7496127/orig.config.yaml 2023-12-19T10:19:55.374 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-12-19_05:13:44-fs-rishabh-mdscap-quincy-testing-default-smithi/7496127 2023-12-19T10:19:55.374 INFO:teuthology.dispatcher.supervisor:Job PID: 2395813 2023-12-19T10:19:55.374 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-19T10:21:55.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T10:23:55.642 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T10:25:55.806 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T10:27:55.974 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T10:29:56.142 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T10:31:56.309 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T10:33:56.482 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T10:33:56.547 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-19T10:33:56.683 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-19T10:33:56.684 INFO:teuthology.nuke:Checking targets against current locks 2023-12-19T10:33:56.735 DEBUG:teuthology.nuke:shortname: smithi053 2023-12-19T10:33:56.735 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T10:33:56.769 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi053.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_05:13:44-fs-rishabh-mdscap-quincy-testing-default-smithi/7496127', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 10:14:06.092101', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAszA1zuFFOJvKdJ+DpWwOside3Owo0CSovNU+Q/m557bNtQ8fm6KT88rdSilyAEVHRh+5KpS9OlrTCgmxB1/vg='} 2023-12-19T10:33:56.770 DEBUG:teuthology.nuke:shortname: smithi111 2023-12-19T10:33:56.770 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T10:33:56.792 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi111.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_05:13:44-fs-rishabh-mdscap-quincy-testing-default-smithi/7496127', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 10:14:06.088397', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLvJwPJ9neQa8FqMOnokJ49CZB1lMRn+Xpux9qdh+gqRcGKKwGYXLimum7TvgYGhJyz6/PGdHAM9l70qaroG+uE='} 2023-12-19T10:33:56.796 DEBUG:teuthology.nuke:shortname: smithi143 2023-12-19T10:33:56.796 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T10:33:56.823 INFO:teuthology.orchestra.console.smithi053:Power off 2023-12-19T10:33:56.823 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T10:33:56.834 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi143.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_05:13:44-fs-rishabh-mdscap-quincy-testing-default-smithi/7496127', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 10:14:06.090403', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFNhhM0k+PawriFPKHje+NHG5NuyJnwIGN7rK1iKUNK1qmwg9rw+0Ltn+A5zON6MlW0FQcfCnRWD1q7JdeX29ug='} 2023-12-19T10:33:56.846 DEBUG:teuthology.orchestra.console.smithi053:power off output: Chassis Power Control: Down/Off 2023-12-19T10:33:56.847 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T10:33:56.867 INFO:teuthology.orchestra.console.smithi111:Power off 2023-12-19T10:33:56.867 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T10:33:56.875 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off 2023-12-19T10:33:56.889 DEBUG:teuthology.orchestra.console.smithi111:power off output: Chassis Power Control: Down/Off 2023-12-19T10:33:56.889 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T10:33:56.904 INFO:teuthology.orchestra.console.smithi143:Power off 2023-12-19T10:33:56.905 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T10:33:56.913 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off 2023-12-19T10:33:56.927 DEBUG:teuthology.orchestra.console.smithi143:power off output: Chassis Power Control: Down/Off 2023-12-19T10:33:56.928 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T10:33:56.952 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off 2023-12-19T10:33:56.976 INFO:teuthology.orchestra.console.smithi053:Power off completed 2023-12-19T10:33:57.014 INFO:teuthology.orchestra.console.smithi111:Power off completed 2023-12-19T10:33:57.053 INFO:teuthology.orchestra.console.smithi143:Power off completed 2023-12-19T10:33:57.129 INFO:teuthology.lock.ops:unlocked: smithi053.front.sepia.ceph.com 2023-12-19T10:33:57.163 INFO:teuthology.lock.ops:unlocked: smithi111.front.sepia.ceph.com 2023-12-19T10:33:57.195 INFO:teuthology.lock.ops:unlocked: smithi143.front.sepia.ceph.com