2023-12-19T15:12:54.464 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-19T15:12:54.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T15:12:54.657 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9ec1f12940>, signals=[15]) 2023-12-19T15:12:54.657 INFO:teuthology.lock.ops:Start node 'smithi071.front.sepia.ceph.com' reimaging 2023-12-19T15:12:54.658 INFO:teuthology.lock.ops:Updating [smithi071.front.sepia.ceph.com]: reset os type and version on server 2023-12-19T15:12:54.658 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2023-12-19T15:12:54.690 INFO:teuthology.lock.ops:Start node 'smithi097.front.sepia.ceph.com' reimaging 2023-12-19T15:12:54.690 INFO:teuthology.lock.ops:Updating [smithi097.front.sepia.ceph.com]: reset os type and version on server 2023-12-19T15:12:54.690 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server 2023-12-19T15:12:54.715 INFO:teuthology.lock.ops:Start node 'smithi173.front.sepia.ceph.com' reimaging 2023-12-19T15:12:54.715 INFO:teuthology.lock.ops:Updating [smithi173.front.sepia.ceph.com]: reset os type and version on server 2023-12-19T15:12:54.715 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2023-12-19T15:12:54.803 DEBUG:teuthology.provision.fog.smithi071:Requesting image smithi_rhel_8.4 (ID 7) 2023-12-19T15:12:54.830 DEBUG:teuthology.provision.fog.smithi097:Requesting image smithi_rhel_8.4 (ID 7) 2023-12-19T15:12:54.842 DEBUG:teuthology.provision.fog.smithi173:Requesting image smithi_rhel_8.4 (ID 7) 2023-12-19T15:12:54.869 INFO:teuthology.provision.fog.smithi071:Scheduling deploy of rhel 8.4 2023-12-19T15:12:54.884 INFO:teuthology.provision.fog.smithi173:Scheduling deploy of rhel 8.4 2023-12-19T15:12:54.888 INFO:teuthology.provision.fog.smithi097:Scheduling deploy of rhel 8.4 2023-12-19T15:12:55.148 INFO:teuthology.orchestra.console.smithi071:Power off 2023-12-19T15:12:55.148 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T15:12:55.163 INFO:teuthology.orchestra.console.smithi097:Power off 2023-12-19T15:12:55.164 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T15:12:55.176 INFO:teuthology.orchestra.console.smithi173:Power off 2023-12-19T15:12:55.177 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T15:12:55.186 DEBUG:teuthology.orchestra.console.smithi097:power off output: Chassis Power Control: Down/Off 2023-12-19T15:12:55.187 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T15:12:55.195 DEBUG:teuthology.orchestra.console.smithi071:power off output: Chassis Power Control: Down/Off 2023-12-19T15:12:55.195 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T15:12:55.203 DEBUG:teuthology.orchestra.console.smithi173:power off output: Chassis Power Control: Down/Off 2023-12-19T15:12:55.204 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T15:12:55.213 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off 2023-12-19T15:12:55.217 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is off 2023-12-19T15:12:55.229 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off 2023-12-19T15:12:55.315 INFO:teuthology.orchestra.console.smithi097:Power off completed 2023-12-19T15:12:55.318 INFO:teuthology.orchestra.console.smithi071:Power off completed 2023-12-19T15:12:55.330 INFO:teuthology.orchestra.console.smithi173:Power off completed 2023-12-19T15:12:55.415 INFO:teuthology.orchestra.console.smithi097:Power on 2023-12-19T15:12:55.416 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-19T15:12:55.425 INFO:teuthology.orchestra.console.smithi071:Power on 2023-12-19T15:12:55.425 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-19T15:12:55.432 INFO:teuthology.orchestra.console.smithi173:Power on 2023-12-19T15:12:55.433 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-19T15:12:55.442 DEBUG:teuthology.orchestra.console.smithi097:power on output: Chassis Power Control: Up/On 2023-12-19T15:12:55.442 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T15:12:55.450 DEBUG:teuthology.orchestra.console.smithi071:power on output: Chassis Power Control: Up/On 2023-12-19T15:12:55.451 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T15:12:55.460 DEBUG:teuthology.orchestra.console.smithi173:power on output: Chassis Power Control: Up/On 2023-12-19T15:12:55.461 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T15:12:55.470 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off 2023-12-19T15:12:55.473 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is off 2023-12-19T15:12:55.482 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off 2023-12-19T15:12:59.473 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T15:12:59.484 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T15:12:59.490 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T15:12:59.586 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off 2023-12-19T15:12:59.592 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is off 2023-12-19T15:12:59.599 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off 2023-12-19T15:13:03.589 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T15:13:03.597 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T15:13:03.604 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T15:13:03.699 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is on 2023-12-19T15:13:03.706 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is on 2023-12-19T15:13:03.713 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on 2023-12-19T15:13:03.800 INFO:teuthology.orchestra.console.smithi097:Power on completed 2023-12-19T15:13:03.807 INFO:teuthology.orchestra.console.smithi071:Power on completed 2023-12-19T15:13:03.813 INFO:teuthology.orchestra.console.smithi173:Power on completed 2023-12-19T15:13:03.902 INFO:teuthology.provision.fog.smithi097:Waiting for deploy to finish 2023-12-19T15:13:03.907 INFO:teuthology.provision.fog.smithi071:Waiting for deploy to finish 2023-12-19T15:13:03.914 INFO:teuthology.provision.fog.smithi173:Waiting for deploy to finish 2023-12-19T15:15:35.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:15:38.066 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-12-19T15:15:44.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:15:47.125 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-12-19T15:15:50.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:15:50.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:15:53.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:15:53.173 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-12-19T15:15:53.174 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2023-12-19T15:15:56.209 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-12-19T15:15:59.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:15:59.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:16:02.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:16:02.257 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-12-19T15:16:02.258 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2023-12-19T15:16:05.269 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-12-19T15:16:08.261 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:16:08.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:16:11.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:16:11.317 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-12-19T15:16:11.318 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2023-12-19T15:16:14.353 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-12-19T15:16:17.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:16:17.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:16:20.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:16:20.401 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-12-19T15:16:20.402 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2023-12-19T15:16:23.409 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-12-19T15:16:26.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:16:26.405 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:16:29.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:16:29.460 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-12-19T15:16:29.461 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2023-12-19T15:16:32.470 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-12-19T15:16:35.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:16:35.463 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:16:38.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:16:38.517 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-12-19T15:16:44.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:17:02.866 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-12-19T15:17:08.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:17:11.925 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-12-19T15:17:17.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:17:21.014 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-12-19T15:17:27.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:17:27.428 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-19T15:17:27.429 DEBUG:teuthology.orchestra.run.smithi097:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-19T15:17:35.465 WARNING:teuthology.provision.fog.smithi071:timed out 2023-12-19T15:17:38.476 WARNING:teuthology.provision.fog.smithi173:timed out 2023-12-19T15:17:41.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:17:41.743 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-19T15:17:41.744 DEBUG:teuthology.orchestra.run.smithi071:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-19T15:17:42.000 INFO:teuthology.provision.fog.smithi071:Node is ready 2023-12-19T15:17:42.001 DEBUG:teuthology.orchestra.run.smithi071:> hostname 2023-12-19T15:17:42.059 INFO:teuthology.orchestra.run.smithi071.stdout:smithi071.front.sepia.ceph.com 2023-12-19T15:17:42.059 DEBUG:teuthology.orchestra.run.smithi071:> grep smithi071.front.sepia.ceph.com /etc/hosts 2023-12-19T15:17:42.117 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71 smithi071.front.sepia.ceph.com smithi071 2023-12-19T15:17:42.117 DEBUG:teuthology.orchestra.run.smithi071:> sudo hostname smithi071 2023-12-19T15:17:42.250 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i -e 's/smithi071.front.sepia.ceph.com/smithi071/g' /etc/hosts 2023-12-19T15:17:42.274 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i -e 's/172.21.15.71/172.21.15.71/g' /etc/hosts 2023-12-19T15:17:42.341 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i -e 's/smithi071.front.sepia.ceph.com/smithi071/g' /etc/hostname 2023-12-19T15:17:42.408 DEBUG:teuthology.orchestra.run.smithi071:> sudo hostname smithi071 2023-12-19T15:17:42.474 DEBUG:teuthology.orchestra.run.smithi071:> cat /etc/os-release 2023-12-19T15:17:42.531 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T15:17:42.531 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="8.4 (Ootpa)" 2023-12-19T15:17:42.531 INFO:teuthology.orchestra.run.smithi071.stdout:ID="rhel" 2023-12-19T15:17:42.532 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE="fedora" 2023-12-19T15:17:42.532 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="8.4" 2023-12-19T15:17:42.532 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM_ID="platform:el8" 2023-12-19T15:17:42.532 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-19T15:17:42.532 INFO:teuthology.orchestra.run.smithi071.stdout:ANSI_COLOR="0;31" 2023-12-19T15:17:42.532 INFO:teuthology.orchestra.run.smithi071.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-19T15:17:42.532 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T15:17:42.532 INFO:teuthology.orchestra.run.smithi071.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T15:17:42.532 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T15:17:42.532 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-12-19T15:17:42.532 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T15:17:42.532 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-19T15:17:42.532 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T15:17:42.532 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-19T15:17:42.533 INFO:teuthology.provision.fog.smithi071:Deploy complete! 2023-12-19T15:17:42.534 DEBUG:teuthology.parallel:result is None 2023-12-19T15:17:42.862 INFO:teuthology.provision.fog.smithi097:Node is ready 2023-12-19T15:17:42.862 DEBUG:teuthology.orchestra.run.smithi097:> hostname 2023-12-19T15:17:42.880 INFO:teuthology.orchestra.run.smithi097.stdout:smithi036 2023-12-19T15:17:42.880 DEBUG:teuthology.orchestra.run.smithi097:> grep smithi036 /etc/hosts 2023-12-19T15:17:42.936 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.15.36 smithi036.front.sepia.ceph.com smithi036 2023-12-19T15:17:42.936 DEBUG:teuthology.orchestra.run.smithi097:> sudo hostname smithi097 2023-12-19T15:17:43.089 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/smithi036/smithi097/g' /etc/hosts 2023-12-19T15:17:43.116 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/172.21.15.36/172.21.15.97/g' /etc/hosts 2023-12-19T15:17:43.182 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/smithi036/smithi097/g' /etc/hostname 2023-12-19T15:17:43.248 DEBUG:teuthology.orchestra.run.smithi097:> sudo hostname smithi097 2023-12-19T15:17:43.312 DEBUG:teuthology.orchestra.run.smithi097:> cat /etc/os-release 2023-12-19T15:17:43.366 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T15:17:43.367 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="8.4 (Ootpa)" 2023-12-19T15:17:43.367 INFO:teuthology.orchestra.run.smithi097.stdout:ID="rhel" 2023-12-19T15:17:43.367 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE="fedora" 2023-12-19T15:17:43.367 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="8.4" 2023-12-19T15:17:43.367 INFO:teuthology.orchestra.run.smithi097.stdout:PLATFORM_ID="platform:el8" 2023-12-19T15:17:43.367 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-19T15:17:43.367 INFO:teuthology.orchestra.run.smithi097.stdout:ANSI_COLOR="0;31" 2023-12-19T15:17:43.367 INFO:teuthology.orchestra.run.smithi097.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-19T15:17:43.367 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T15:17:43.368 INFO:teuthology.orchestra.run.smithi097.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T15:17:43.368 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T15:17:43.368 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-19T15:17:43.368 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T15:17:43.368 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-19T15:17:43.368 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T15:17:43.368 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-19T15:17:43.368 INFO:teuthology.provision.fog.smithi097:Deploy complete! 2023-12-19T15:17:43.369 DEBUG:teuthology.parallel:result is None 2023-12-19T15:17:44.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:17:44.813 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-19T15:17:44.814 DEBUG:teuthology.orchestra.run.smithi173:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-19T15:17:45.073 INFO:teuthology.provision.fog.smithi173:Node is ready 2023-12-19T15:17:45.073 DEBUG:teuthology.orchestra.run.smithi173:> hostname 2023-12-19T15:17:45.129 INFO:teuthology.orchestra.run.smithi173.stdout:smithi173.front.sepia.ceph.com 2023-12-19T15:17:45.129 DEBUG:teuthology.orchestra.run.smithi173:> grep smithi173.front.sepia.ceph.com /etc/hosts 2023-12-19T15:17:45.185 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.15.173 smithi173.front.sepia.ceph.com smithi173 2023-12-19T15:17:45.185 DEBUG:teuthology.orchestra.run.smithi173:> sudo hostname smithi173 2023-12-19T15:17:45.285 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i -e 's/smithi173.front.sepia.ceph.com/smithi173/g' /etc/hosts 2023-12-19T15:17:45.310 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i -e 's/172.21.15.173/172.21.15.173/g' /etc/hosts 2023-12-19T15:17:45.375 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i -e 's/smithi173.front.sepia.ceph.com/smithi173/g' /etc/hostname 2023-12-19T15:17:45.439 DEBUG:teuthology.orchestra.run.smithi173:> sudo hostname smithi173 2023-12-19T15:17:45.502 DEBUG:teuthology.orchestra.run.smithi173:> cat /etc/os-release 2023-12-19T15:17:45.556 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T15:17:45.557 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="8.4 (Ootpa)" 2023-12-19T15:17:45.557 INFO:teuthology.orchestra.run.smithi173.stdout:ID="rhel" 2023-12-19T15:17:45.557 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE="fedora" 2023-12-19T15:17:45.557 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="8.4" 2023-12-19T15:17:45.557 INFO:teuthology.orchestra.run.smithi173.stdout:PLATFORM_ID="platform:el8" 2023-12-19T15:17:45.557 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-19T15:17:45.557 INFO:teuthology.orchestra.run.smithi173.stdout:ANSI_COLOR="0;31" 2023-12-19T15:17:45.557 INFO:teuthology.orchestra.run.smithi173.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-19T15:17:45.558 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T15:17:45.558 INFO:teuthology.orchestra.run.smithi173.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T15:17:45.558 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T15:17:45.558 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-12-19T15:17:45.558 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T15:17:45.558 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-19T15:17:45.559 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T15:17:45.559 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-19T15:17:45.559 INFO:teuthology.provision.fog.smithi173:Deploy complete! 2023-12-19T15:17:45.560 DEBUG:teuthology.parallel:result is None 2023-12-19T15:17:45.750 INFO:teuthology.lock.ops:Checking smithi071.front.sepia.ceph.com 2023-12-19T15:17:45.750 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-19T15:17:45.777 INFO:teuthology.lock.ops:Checking smithi097.front.sepia.ceph.com 2023-12-19T15:17:45.777 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-19T15:17:45.794 INFO:teuthology.lock.ops:Checking smithi173.front.sepia.ceph.com 2023-12-19T15:17:45.794 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-19T15:17:45.815 INFO:teuthology.lock.ops:Updating [smithi071.front.sepia.ceph.com]: set os type and version on server 2023-12-19T15:17:45.815 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2023-12-19T15:17:45.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:17:45.884 DEBUG:teuthology.orchestra.run.smithi071:> true 2023-12-19T15:17:45.909 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi071.front.sepia.ceph.com' 2023-12-19T15:17:45.909 DEBUG:teuthology.orchestra.run.smithi071:> uname -m 2023-12-19T15:17:45.965 INFO:teuthology.orchestra.run.smithi071.stdout:x86_64 2023-12-19T15:17:45.965 DEBUG:teuthology.orchestra.run.smithi071:> cat /etc/os-release 2023-12-19T15:17:46.020 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T15:17:46.020 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="8.4 (Ootpa)" 2023-12-19T15:17:46.020 INFO:teuthology.orchestra.run.smithi071.stdout:ID="rhel" 2023-12-19T15:17:46.020 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE="fedora" 2023-12-19T15:17:46.021 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="8.4" 2023-12-19T15:17:46.021 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM_ID="platform:el8" 2023-12-19T15:17:46.021 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-19T15:17:46.021 INFO:teuthology.orchestra.run.smithi071.stdout:ANSI_COLOR="0;31" 2023-12-19T15:17:46.021 INFO:teuthology.orchestra.run.smithi071.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-19T15:17:46.021 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T15:17:46.021 INFO:teuthology.orchestra.run.smithi071.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T15:17:46.021 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T15:17:46.021 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-12-19T15:17:46.021 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T15:17:46.021 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-19T15:17:46.021 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T15:17:46.021 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-19T15:17:46.022 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2023-12-19T15:17:46.044 INFO:teuthology.lock.ops:Updating [smithi097.front.sepia.ceph.com]: set os type and version on server 2023-12-19T15:17:46.044 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2023-12-19T15:17:46.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:17:46.111 DEBUG:teuthology.orchestra.run.smithi097:> true 2023-12-19T15:17:46.181 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi097.front.sepia.ceph.com' 2023-12-19T15:17:46.181 DEBUG:teuthology.orchestra.run.smithi097:> uname -m 2023-12-19T15:17:46.235 INFO:teuthology.orchestra.run.smithi097.stdout:x86_64 2023-12-19T15:17:46.236 DEBUG:teuthology.orchestra.run.smithi097:> cat /etc/os-release 2023-12-19T15:17:46.290 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T15:17:46.291 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="8.4 (Ootpa)" 2023-12-19T15:17:46.291 INFO:teuthology.orchestra.run.smithi097.stdout:ID="rhel" 2023-12-19T15:17:46.291 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE="fedora" 2023-12-19T15:17:46.291 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="8.4" 2023-12-19T15:17:46.291 INFO:teuthology.orchestra.run.smithi097.stdout:PLATFORM_ID="platform:el8" 2023-12-19T15:17:46.291 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-19T15:17:46.291 INFO:teuthology.orchestra.run.smithi097.stdout:ANSI_COLOR="0;31" 2023-12-19T15:17:46.291 INFO:teuthology.orchestra.run.smithi097.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-19T15:17:46.291 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T15:17:46.292 INFO:teuthology.orchestra.run.smithi097.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T15:17:46.292 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T15:17:46.292 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-19T15:17:46.292 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T15:17:46.292 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-19T15:17:46.292 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T15:17:46.292 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-19T15:17:46.293 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server 2023-12-19T15:17:46.319 INFO:teuthology.lock.ops:Updating [smithi173.front.sepia.ceph.com]: set os type and version on server 2023-12-19T15:17:46.319 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2023-12-19T15:17:46.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:17:46.384 DEBUG:teuthology.orchestra.run.smithi173:> true 2023-12-19T15:17:46.448 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi173.front.sepia.ceph.com' 2023-12-19T15:17:46.448 DEBUG:teuthology.orchestra.run.smithi173:> uname -m 2023-12-19T15:17:46.503 INFO:teuthology.orchestra.run.smithi173.stdout:x86_64 2023-12-19T15:17:46.503 DEBUG:teuthology.orchestra.run.smithi173:> cat /etc/os-release 2023-12-19T15:17:46.558 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T15:17:46.558 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="8.4 (Ootpa)" 2023-12-19T15:17:46.558 INFO:teuthology.orchestra.run.smithi173.stdout:ID="rhel" 2023-12-19T15:17:46.559 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE="fedora" 2023-12-19T15:17:46.559 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="8.4" 2023-12-19T15:17:46.559 INFO:teuthology.orchestra.run.smithi173.stdout:PLATFORM_ID="platform:el8" 2023-12-19T15:17:46.559 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-19T15:17:46.559 INFO:teuthology.orchestra.run.smithi173.stdout:ANSI_COLOR="0;31" 2023-12-19T15:17:46.559 INFO:teuthology.orchestra.run.smithi173.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-19T15:17:46.559 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T15:17:46.559 INFO:teuthology.orchestra.run.smithi173.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T15:17:46.559 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T15:17:46.559 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-12-19T15:17:46.559 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T15:17:46.560 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-19T15:17:46.560 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T15:17:46.560 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-19T15:17:46.560 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2023-12-19T15:17:46.586 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T15:17:46.685 INFO:teuthology.dispatcher.supervisor:Running job 7496987 2023-12-19T15:17:46.686 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-12-19_12:42:58-fs-rishabh-mdscap-pacific-testing-default-smithi/7496987 --name rishabh-2023-12-19_12:42:58-fs-rishabh-mdscap-pacific-testing-default-smithi --description fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/3 scrub/yes standby-replay subvolume/{with-quota} tasks/{0-check-counter workunit/suites/iogen} wsync/{yes}} -- /home/teuthworker/archive/rishabh-2023-12-19_12:42:58-fs-rishabh-mdscap-pacific-testing-default-smithi/7496987/orig.config.yaml 2023-12-19T15:17:46.689 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-12-19_12:42:58-fs-rishabh-mdscap-pacific-testing-default-smithi/7496987 2023-12-19T15:17:46.690 INFO:teuthology.dispatcher.supervisor:Job PID: 2832715 2023-12-19T15:17:46.690 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-19T15:19:46.790 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T15:21:47.194 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T15:23:47.366 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T15:25:47.674 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T15:27:47.848 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T15:27:47.911 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-19T15:27:48.060 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-19T15:27:48.061 INFO:teuthology.nuke:Checking targets against current locks 2023-12-19T15:27:48.108 DEBUG:teuthology.nuke:shortname: smithi071 2023-12-19T15:27:48.109 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T15:27:48.135 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi071.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_12:42:58-fs-rishabh-mdscap-pacific-testing-default-smithi/7496987', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 15:12:53.548117', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDRQrwYtLBBNN8UfhU5TKtt7cQYqJNcEvTDdfIO52jfzqmo7iXwhbcyOcabkNSxiaBN/IT5mIT2qQZMG8TBRn1c='} 2023-12-19T15:27:48.140 DEBUG:teuthology.nuke:shortname: smithi097 2023-12-19T15:27:48.140 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T15:27:48.164 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi097.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_12:42:58-fs-rishabh-mdscap-pacific-testing-default-smithi/7496987', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 15:12:53.546407', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBITwX6lY2Ri8rfr969j9BAdA/Bk14FQt6tJA++T9IeoK5US7xbODK1LhvKmqbF7O5MQucBi0sOLlkB8g2eehyjk='} 2023-12-19T15:27:48.168 DEBUG:teuthology.nuke:shortname: smithi173 2023-12-19T15:27:48.168 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T15:27:48.193 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi173.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_12:42:58-fs-rishabh-mdscap-pacific-testing-default-smithi/7496987', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 15:12:53.549789', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNE8BGXiwjivLxu4S6uS/7wqBPR/i3jKh+Zje55x3Tr6FDrY8HiKzjTkOmTkFkK4W8qEOdqLwXHRD2P1pTnS1/4='} 2023-12-19T15:27:48.202 INFO:teuthology.orchestra.console.smithi071:Power off 2023-12-19T15:27:48.203 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T15:27:48.229 DEBUG:teuthology.orchestra.console.smithi071:power off output: Chassis Power Control: Down/Off 2023-12-19T15:27:48.230 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T15:27:48.255 INFO:teuthology.orchestra.console.smithi097:Power off 2023-12-19T15:27:48.255 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T15:27:48.270 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is off 2023-12-19T15:27:48.280 DEBUG:teuthology.orchestra.console.smithi097:power off output: Chassis Power Control: Down/Off 2023-12-19T15:27:48.280 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T15:27:48.298 INFO:teuthology.orchestra.console.smithi173:Power off 2023-12-19T15:27:48.299 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T15:27:48.311 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off 2023-12-19T15:27:48.323 DEBUG:teuthology.orchestra.console.smithi173:power off output: Chassis Power Control: Down/Off 2023-12-19T15:27:48.324 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T15:27:48.353 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off 2023-12-19T15:27:48.370 INFO:teuthology.orchestra.console.smithi071:Power off completed 2023-12-19T15:27:48.412 INFO:teuthology.orchestra.console.smithi097:Power off completed 2023-12-19T15:27:48.453 INFO:teuthology.orchestra.console.smithi173:Power off completed 2023-12-19T15:27:48.522 INFO:teuthology.lock.ops:unlocked: smithi071.front.sepia.ceph.com 2023-12-19T15:27:48.570 INFO:teuthology.lock.ops:unlocked: smithi097.front.sepia.ceph.com 2023-12-19T15:27:48.611 INFO:teuthology.lock.ops:unlocked: smithi173.front.sepia.ceph.com