2024-01-03T10:38:13.558 INFO:root:teuthology version: 0.0.1.dev228+g01dd171 2024-01-03T10:38:13.558 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-03T10:38:13.754 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fbaebc57940>, signals=[15]) 2024-01-03T10:38:13.755 INFO:teuthology.lock.ops:Start node 'smithi002.front.sepia.ceph.com' reimaging 2024-01-03T10:38:13.755 INFO:teuthology.lock.ops:Updating [smithi002.front.sepia.ceph.com]: reset os type and version on server 2024-01-03T10:38:13.755 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server 2024-01-03T10:38:13.790 INFO:teuthology.lock.ops:Start node 'smithi027.front.sepia.ceph.com' reimaging 2024-01-03T10:38:13.790 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: reset os type and version on server 2024-01-03T10:38:13.790 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server 2024-01-03T10:38:13.813 INFO:teuthology.lock.ops:Start node 'smithi133.front.sepia.ceph.com' reimaging 2024-01-03T10:38:13.814 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: reset os type and version on server 2024-01-03T10:38:13.814 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2024-01-03T10:38:13.910 DEBUG:teuthology.provision.fog.smithi002:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-03T10:38:13.931 DEBUG:teuthology.provision.fog.smithi027:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-03T10:38:13.962 INFO:teuthology.provision.fog.smithi002:Scheduling deploy of rhel 8.6 2024-01-03T10:38:13.966 DEBUG:teuthology.provision.fog.smithi133:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-03T10:38:13.970 INFO:teuthology.provision.fog.smithi027:Scheduling deploy of rhel 8.6 2024-01-03T10:38:14.011 INFO:teuthology.provision.fog.smithi133:Scheduling deploy of rhel 8.6 2024-01-03T10:38:14.184 INFO:teuthology.orchestra.console.smithi002:Power off 2024-01-03T10:38:14.184 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-03T10:38:14.220 INFO:teuthology.orchestra.console.smithi027:Power off 2024-01-03T10:38:14.220 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-03T10:38:14.230 DEBUG:teuthology.orchestra.console.smithi002:power off output: Chassis Power Control: Down/Off 2024-01-03T10:38:14.230 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-03T10:38:14.247 DEBUG:teuthology.orchestra.console.smithi027:power off output: Chassis Power Control: Down/Off 2024-01-03T10:38:14.247 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-03T10:38:14.255 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off 2024-01-03T10:38:14.267 INFO:teuthology.orchestra.console.smithi133:Power off 2024-01-03T10:38:14.267 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-03T10:38:14.279 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off 2024-01-03T10:38:14.292 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off 2024-01-03T10:38:14.292 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-03T10:38:14.319 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2024-01-03T10:38:14.356 INFO:teuthology.orchestra.console.smithi002:Power off completed 2024-01-03T10:38:14.380 INFO:teuthology.orchestra.console.smithi027:Power off completed 2024-01-03T10:38:14.419 INFO:teuthology.orchestra.console.smithi133:Power off completed 2024-01-03T10:38:14.457 INFO:teuthology.orchestra.console.smithi002:Power on 2024-01-03T10:38:14.457 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-03T10:38:14.481 INFO:teuthology.orchestra.console.smithi027:Power on 2024-01-03T10:38:14.481 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-03T10:38:14.490 DEBUG:teuthology.orchestra.console.smithi002:power on output: Chassis Power Control: Up/On 2024-01-03T10:38:14.490 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-03T10:38:14.509 DEBUG:teuthology.orchestra.console.smithi027:power on output: Chassis Power Control: Up/On 2024-01-03T10:38:14.509 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-03T10:38:14.520 INFO:teuthology.orchestra.console.smithi133:Power on 2024-01-03T10:38:14.521 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-03T10:38:14.539 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off 2024-01-03T10:38:14.542 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off 2024-01-03T10:38:14.555 DEBUG:teuthology.orchestra.console.smithi133:power on output: Chassis Power Control: Up/On 2024-01-03T10:38:14.555 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-03T10:38:14.589 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2024-01-03T10:38:18.545 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-03T10:38:18.552 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-03T10:38:18.591 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-03T10:38:18.654 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off 2024-01-03T10:38:18.661 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off 2024-01-03T10:38:18.701 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2024-01-03T10:38:22.659 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-03T10:38:22.667 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-03T10:38:22.703 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-03T10:38:22.769 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is on 2024-01-03T10:38:22.776 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on 2024-01-03T10:38:22.813 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2024-01-03T10:38:22.870 INFO:teuthology.orchestra.console.smithi002:Power on completed 2024-01-03T10:38:22.877 INFO:teuthology.orchestra.console.smithi027:Power on completed 2024-01-03T10:38:22.913 INFO:teuthology.orchestra.console.smithi133:Power on completed 2024-01-03T10:38:22.971 INFO:teuthology.provision.fog.smithi002:Waiting for deploy to finish 2024-01-03T10:38:22.978 INFO:teuthology.provision.fog.smithi027:Waiting for deploy to finish 2024-01-03T10:38:23.014 INFO:teuthology.provision.fog.smithi133:Waiting for deploy to finish 2024-01-03T10:40:53.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-03T10:40:56.924 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2024-01-03T10:41:02.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-03T10:41:05.984 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2024-01-03T10:41:08.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-03T10:41:11.989 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-03T10:41:12.000 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-01-03T10:41:15.072 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2024-01-03T10:41:18.003 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-03T10:41:21.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-03T10:41:21.088 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-01-03T10:41:23.981 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-03T10:41:24.156 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2024-01-03T10:41:27.036 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-03T10:41:27.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-03T10:41:30.144 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-01-03T10:41:30.157 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-03T10:41:33.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-03T10:41:33.212 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2024-01-03T10:41:36.096 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-03T10:41:36.145 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-03T10:41:39.196 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-01-03T10:41:39.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-03T10:41:42.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-03T10:41:42.272 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2024-01-03T10:41:45.184 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-03T10:41:45.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-03T10:41:48.259 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-01-03T10:41:48.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-03T10:41:51.189 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-03T10:41:54.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-03T10:41:54.272 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-03T10:41:57.344 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-01-03T10:42:00.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-03T10:42:03.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-03T10:42:03.356 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-03T10:42:09.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-03T10:42:12.412 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-03T10:42:18.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-03T10:42:21.468 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-03T10:42:27.473 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-03T10:42:30.524 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-03T10:42:36.529 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-03T10:42:48.284 WARNING:teuthology.provision.fog.smithi002:timed out 2024-01-03T10:42:54.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-03T10:42:54.617 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-03T10:42:54.618 DEBUG:teuthology.orchestra.run.smithi002:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-03T10:42:54.867 INFO:teuthology.provision.fog.smithi002:Node is ready 2024-01-03T10:42:54.867 DEBUG:teuthology.orchestra.run.smithi002:> hostname 2024-01-03T10:42:54.888 INFO:teuthology.orchestra.run.smithi002.stdout:smithi002.front.sepia.ceph.com 2024-01-03T10:42:54.888 DEBUG:teuthology.orchestra.run.smithi002:> grep smithi002.front.sepia.ceph.com /etc/hosts 2024-01-03T10:42:54.913 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-03T10:42:54.949 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2 smithi002.front.sepia.ceph.com smithi002 2024-01-03T10:42:54.950 DEBUG:teuthology.orchestra.run.smithi002:> sudo hostname smithi002 2024-01-03T10:42:55.081 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i -e 's/smithi002.front.sepia.ceph.com/smithi002/g' /etc/hosts 2024-01-03T10:42:55.114 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i -e 's/172.21.15.2/172.21.15.2/g' /etc/hosts 2024-01-03T10:42:55.190 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i -e 's/smithi002.front.sepia.ceph.com/smithi002/g' /etc/hostname 2024-01-03T10:42:55.265 DEBUG:teuthology.orchestra.run.smithi002:> sudo hostname smithi002 2024-01-03T10:42:55.339 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release 2024-01-03T10:42:55.401 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="Red Hat Enterprise Linux" 2024-01-03T10:42:55.401 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="8.6 (Ootpa)" 2024-01-03T10:42:55.401 INFO:teuthology.orchestra.run.smithi002.stdout:ID="rhel" 2024-01-03T10:42:55.402 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="fedora" 2024-01-03T10:42:55.402 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="8.6" 2024-01-03T10:42:55.402 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el8" 2024-01-03T10:42:55.402 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-03T10:42:55.402 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31" 2024-01-03T10:42:55.402 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-03T10:42:55.402 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://www.redhat.com/" 2024-01-03T10:42:55.402 INFO:teuthology.orchestra.run.smithi002.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-03T10:42:55.402 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-03T10:42:55.402 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-01-03T10:42:55.402 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-03T10:42:55.402 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-03T10:42:55.402 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-03T10:42:55.402 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-03T10:42:55.403 INFO:teuthology.provision.fog.smithi002:Deploy complete! 2024-01-03T10:42:55.404 DEBUG:teuthology.parallel:result is None 2024-01-03T10:43:00.917 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-03T10:43:03.348 WARNING:teuthology.provision.fog.smithi133:timed out 2024-01-03T10:43:04.000 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-03T10:43:09.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-03T10:43:09.557 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-03T10:43:09.557 DEBUG:teuthology.orchestra.run.smithi133:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-03T10:43:09.849 INFO:teuthology.provision.fog.smithi133:Node is ready 2024-01-03T10:43:09.850 DEBUG:teuthology.orchestra.run.smithi133:> hostname 2024-01-03T10:43:09.869 INFO:teuthology.orchestra.run.smithi133.stdout:smithi133.front.sepia.ceph.com 2024-01-03T10:43:09.870 DEBUG:teuthology.orchestra.run.smithi133:> grep smithi133.front.sepia.ceph.com /etc/hosts 2024-01-03T10:43:09.929 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.15.133 smithi133.front.sepia.ceph.com smithi133 2024-01-03T10:43:09.929 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname smithi133 2024-01-03T10:43:10.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-03T10:43:10.036 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi133.front.sepia.ceph.com/smithi133/g' /etc/hosts 2024-01-03T10:43:10.066 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/172.21.15.133/172.21.15.133/g' /etc/hosts 2024-01-03T10:43:10.136 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi133.front.sepia.ceph.com/smithi133/g' /etc/hostname 2024-01-03T10:43:10.204 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname smithi133 2024-01-03T10:43:10.271 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2024-01-03T10:43:10.328 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="Red Hat Enterprise Linux" 2024-01-03T10:43:10.328 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="8.6 (Ootpa)" 2024-01-03T10:43:10.328 INFO:teuthology.orchestra.run.smithi133.stdout:ID="rhel" 2024-01-03T10:43:10.328 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="fedora" 2024-01-03T10:43:10.328 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="8.6" 2024-01-03T10:43:10.328 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el8" 2024-01-03T10:43:10.329 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-03T10:43:10.329 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31" 2024-01-03T10:43:10.329 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-03T10:43:10.329 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://www.redhat.com/" 2024-01-03T10:43:10.329 INFO:teuthology.orchestra.run.smithi133.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-03T10:43:10.329 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-03T10:43:10.329 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-03T10:43:10.329 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-03T10:43:10.329 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-03T10:43:10.329 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-03T10:43:10.329 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-03T10:43:10.330 INFO:teuthology.provision.fog.smithi133:Deploy complete! 2024-01-03T10:43:10.331 DEBUG:teuthology.parallel:result is None 2024-01-03T10:43:13.053 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-03T10:43:19.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-03T10:43:19.315 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-03T10:43:19.315 DEBUG:teuthology.orchestra.run.smithi027:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-03T10:43:34.640 INFO:teuthology.provision.fog.smithi027:Node is ready 2024-01-03T10:43:34.640 DEBUG:teuthology.orchestra.run.smithi027:> hostname 2024-01-03T10:43:34.662 INFO:teuthology.orchestra.run.smithi027.stdout:smithi027.front.sepia.ceph.com 2024-01-03T10:43:34.663 DEBUG:teuthology.orchestra.run.smithi027:> grep smithi027.front.sepia.ceph.com /etc/hosts 2024-01-03T10:43:34.723 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27 smithi027.front.sepia.ceph.com smithi027 2024-01-03T10:43:34.724 DEBUG:teuthology.orchestra.run.smithi027:> sudo hostname smithi027 2024-01-03T10:43:34.856 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/smithi027.front.sepia.ceph.com/smithi027/g' /etc/hosts 2024-01-03T10:43:34.888 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/172.21.15.27/172.21.15.27/g' /etc/hosts 2024-01-03T10:43:34.959 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/smithi027.front.sepia.ceph.com/smithi027/g' /etc/hostname 2024-01-03T10:43:35.030 DEBUG:teuthology.orchestra.run.smithi027:> sudo hostname smithi027 2024-01-03T10:43:35.099 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release 2024-01-03T10:43:35.157 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="Red Hat Enterprise Linux" 2024-01-03T10:43:35.157 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="8.6 (Ootpa)" 2024-01-03T10:43:35.157 INFO:teuthology.orchestra.run.smithi027.stdout:ID="rhel" 2024-01-03T10:43:35.157 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="fedora" 2024-01-03T10:43:35.157 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="8.6" 2024-01-03T10:43:35.158 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el8" 2024-01-03T10:43:35.158 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-03T10:43:35.158 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31" 2024-01-03T10:43:35.158 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-03T10:43:35.158 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://www.redhat.com/" 2024-01-03T10:43:35.158 INFO:teuthology.orchestra.run.smithi027.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-03T10:43:35.158 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-03T10:43:35.158 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-03T10:43:35.158 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-03T10:43:35.158 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-03T10:43:35.158 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-03T10:43:35.158 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-03T10:43:35.158 INFO:teuthology.provision.fog.smithi027:Deploy complete! 2024-01-03T10:43:35.159 DEBUG:teuthology.parallel:result is None 2024-01-03T10:43:35.358 INFO:teuthology.lock.ops:Checking smithi002.front.sepia.ceph.com 2024-01-03T10:43:35.359 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-03T10:43:35.386 INFO:teuthology.lock.ops:Checking smithi027.front.sepia.ceph.com 2024-01-03T10:43:35.386 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-03T10:43:35.403 INFO:teuthology.lock.ops:Checking smithi133.front.sepia.ceph.com 2024-01-03T10:43:35.403 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-03T10:43:35.420 INFO:teuthology.lock.ops:Updating [smithi002.front.sepia.ceph.com]: set os type and version on server 2024-01-03T10:43:35.421 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-01-03T10:43:35.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-03T10:43:35.489 DEBUG:teuthology.orchestra.run.smithi002:> true 2024-01-03T10:43:35.591 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-01-03T10:43:35.591 DEBUG:teuthology.orchestra.run.smithi002:> uname -m 2024-01-03T10:43:35.652 INFO:teuthology.orchestra.run.smithi002.stdout:x86_64 2024-01-03T10:43:35.652 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release 2024-01-03T10:43:35.713 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="Red Hat Enterprise Linux" 2024-01-03T10:43:35.713 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="8.6 (Ootpa)" 2024-01-03T10:43:35.713 INFO:teuthology.orchestra.run.smithi002.stdout:ID="rhel" 2024-01-03T10:43:35.713 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="fedora" 2024-01-03T10:43:35.713 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="8.6" 2024-01-03T10:43:35.713 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el8" 2024-01-03T10:43:35.713 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-03T10:43:35.713 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31" 2024-01-03T10:43:35.713 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-03T10:43:35.713 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://www.redhat.com/" 2024-01-03T10:43:35.714 INFO:teuthology.orchestra.run.smithi002.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-03T10:43:35.714 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-03T10:43:35.714 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-01-03T10:43:35.714 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-03T10:43:35.714 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-03T10:43:35.714 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-03T10:43:35.714 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-03T10:43:35.714 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server 2024-01-03T10:43:35.737 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: set os type and version on server 2024-01-03T10:43:35.737 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-03T10:43:35.737 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-03T10:43:35.808 DEBUG:teuthology.orchestra.run.smithi027:> true 2024-01-03T10:43:35.885 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-03T10:43:35.885 DEBUG:teuthology.orchestra.run.smithi027:> uname -m 2024-01-03T10:43:35.945 INFO:teuthology.orchestra.run.smithi027.stdout:x86_64 2024-01-03T10:43:35.946 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release 2024-01-03T10:43:36.007 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="Red Hat Enterprise Linux" 2024-01-03T10:43:36.007 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="8.6 (Ootpa)" 2024-01-03T10:43:36.007 INFO:teuthology.orchestra.run.smithi027.stdout:ID="rhel" 2024-01-03T10:43:36.007 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="fedora" 2024-01-03T10:43:36.007 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="8.6" 2024-01-03T10:43:36.007 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el8" 2024-01-03T10:43:36.007 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-03T10:43:36.007 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31" 2024-01-03T10:43:36.007 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-03T10:43:36.007 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://www.redhat.com/" 2024-01-03T10:43:36.007 INFO:teuthology.orchestra.run.smithi027.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-03T10:43:36.007 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-03T10:43:36.008 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-03T10:43:36.008 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-03T10:43:36.008 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-03T10:43:36.008 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-03T10:43:36.008 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-03T10:43:36.008 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server 2024-01-03T10:43:36.028 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: set os type and version on server 2024-01-03T10:43:36.028 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-01-03T10:43:36.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-03T10:43:36.100 DEBUG:teuthology.orchestra.run.smithi133:> true 2024-01-03T10:43:36.234 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-01-03T10:43:36.235 DEBUG:teuthology.orchestra.run.smithi133:> uname -m 2024-01-03T10:43:36.293 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64 2024-01-03T10:43:36.294 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2024-01-03T10:43:36.356 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="Red Hat Enterprise Linux" 2024-01-03T10:43:36.356 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="8.6 (Ootpa)" 2024-01-03T10:43:36.356 INFO:teuthology.orchestra.run.smithi133.stdout:ID="rhel" 2024-01-03T10:43:36.356 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="fedora" 2024-01-03T10:43:36.356 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="8.6" 2024-01-03T10:43:36.356 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el8" 2024-01-03T10:43:36.357 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-03T10:43:36.357 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31" 2024-01-03T10:43:36.357 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-03T10:43:36.357 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://www.redhat.com/" 2024-01-03T10:43:36.357 INFO:teuthology.orchestra.run.smithi133.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-03T10:43:36.357 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-03T10:43:36.357 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-03T10:43:36.357 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-03T10:43:36.357 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-03T10:43:36.357 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-03T10:43:36.357 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-03T10:43:36.358 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2024-01-03T10:43:36.378 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-03T10:43:36.472 INFO:teuthology.dispatcher.supervisor:Running job 7504940 2024-01-03T10:43:36.473 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-01-03_10:00:50-fs-wip-vshankar-testing-20240103.072409-testing-default-smithi/7504940 --name vshankar-2024-01-03_10:00:50-fs-wip-vshankar-testing-20240103.072409-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-workunit/fs/norstats}} -- /home/teuthworker/archive/vshankar-2024-01-03_10:00:50-fs-wip-vshankar-testing-20240103.072409-testing-default-smithi/7504940/orig.config.yaml 2024-01-03T10:43:36.475 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-01-03_10:00:50-fs-wip-vshankar-testing-20240103.072409-testing-default-smithi/7504940 2024-01-03T10:43:36.476 INFO:teuthology.dispatcher.supervisor:Job PID: 1560071 2024-01-03T10:43:36.476 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-03T10:45:36.554 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-03T10:47:36.724 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-03T10:49:36.897 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-03T10:51:37.056 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-03T10:53:37.208 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-03T10:55:37.388 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-03T10:57:37.552 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-03T10:59:37.720 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-03T11:01:37.896 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-03T11:01:37.964 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-01-03T11:01:38.114 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2024-01-03T11:01:38.115 INFO:teuthology.nuke:Checking targets against current locks 2024-01-03T11:01:38.170 DEBUG:teuthology.nuke:shortname: smithi002 2024-01-03T11:01:38.171 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-03T11:01:38.195 DEBUG:teuthology.nuke:shortname: smithi027 2024-01-03T11:01:38.195 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-03T11:01:38.199 DEBUG:teuthology.nuke:shortname: smithi133 2024-01-03T11:01:38.199 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-03T11:01:38.200 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi002.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-03_10:00:50-fs-wip-vshankar-testing-20240103.072409-testing-default-smithi/7504940', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-03 10:38:12.635709', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPJszS+ecm3/mF/IOjDuy4Scnv9IXvglvcKMfE7xTDbt+X1lT+tO15VlVsfRSXpl/yGShJ1FmFG9KtLXRuTjLeo='} 2024-01-03T11:01:38.225 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi133.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-03_10:00:50-fs-wip-vshankar-testing-20240103.072409-testing-default-smithi/7504940', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-03 10:38:12.638709', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHyPh2K2TEYUYxJC3/m68JpQOX4c3dT/8uU/pq/0dsHBjoN0rg05AqQyNrNoznXI5/7Z5cdd/MWITWefzQJXuAw='} 2024-01-03T11:01:38.233 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi027.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-03_10:00:50-fs-wip-vshankar-testing-20240103.072409-testing-default-smithi/7504940', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-03 10:38:12.637314', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHCrXkEeB5a0fL6tvY4Y71xyXKhiG1yX7MpcIVeuk2zVy+PHmMS1n5moAH2HlJ2cxcJPWRhX1pb7exzsht598Nw='} 2024-01-03T11:01:38.264 INFO:teuthology.orchestra.console.smithi002:Power off 2024-01-03T11:01:38.265 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-03T11:01:38.294 DEBUG:teuthology.orchestra.console.smithi002:power off output: Chassis Power Control: Down/Off 2024-01-03T11:01:38.294 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-03T11:01:38.314 INFO:teuthology.orchestra.console.smithi133:Power off 2024-01-03T11:01:38.314 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-03T11:01:38.329 INFO:teuthology.orchestra.console.smithi027:Power off 2024-01-03T11:01:38.330 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-03T11:01:38.337 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off 2024-01-03T11:01:38.337 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-03T11:01:38.345 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off 2024-01-03T11:01:38.351 DEBUG:teuthology.orchestra.console.smithi027:power off output: Chassis Power Control: Down/Off 2024-01-03T11:01:38.351 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-03T11:01:38.361 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2024-01-03T11:01:38.374 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off 2024-01-03T11:01:38.446 INFO:teuthology.orchestra.console.smithi002:Power off completed 2024-01-03T11:01:38.462 INFO:teuthology.orchestra.console.smithi133:Power off completed 2024-01-03T11:01:38.475 INFO:teuthology.orchestra.console.smithi027:Power off completed 2024-01-03T11:01:38.599 INFO:teuthology.lock.ops:unlocked: smithi002.front.sepia.ceph.com 2024-01-03T11:01:38.604 INFO:teuthology.lock.ops:unlocked: smithi133.front.sepia.ceph.com 2024-01-03T11:01:38.614 INFO:teuthology.lock.ops:unlocked: smithi027.front.sepia.ceph.com