2023-12-19T13:40:09.326 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-19T13:40:09.326 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T13:40:09.505 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f96281d5940>, signals=[15]) 2023-12-19T13:40:09.505 INFO:teuthology.lock.ops:Start node 'smithi142.front.sepia.ceph.com' reimaging 2023-12-19T13:40:09.505 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: reset os type and version on server 2023-12-19T13:40:09.505 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2023-12-19T13:40:09.531 INFO:teuthology.lock.ops:Start node 'smithi154.front.sepia.ceph.com' reimaging 2023-12-19T13:40:09.531 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: reset os type and version on server 2023-12-19T13:40:09.531 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2023-12-19T13:40:09.555 INFO:teuthology.lock.ops:Start node 'smithi170.front.sepia.ceph.com' reimaging 2023-12-19T13:40:09.556 INFO:teuthology.lock.ops:Updating [smithi170.front.sepia.ceph.com]: reset os type and version on server 2023-12-19T13:40:09.556 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2023-12-19T13:40:09.645 DEBUG:teuthology.provision.fog.smithi142:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-19T13:40:09.672 DEBUG:teuthology.provision.fog.smithi154:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-19T13:40:09.673 DEBUG:teuthology.provision.fog.smithi170:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-19T13:40:09.692 INFO:teuthology.provision.fog.smithi142:Scheduling deploy of rhel 8.6 2023-12-19T13:40:09.729 INFO:teuthology.provision.fog.smithi154:Scheduling deploy of rhel 8.6 2023-12-19T13:40:09.732 INFO:teuthology.provision.fog.smithi170:Scheduling deploy of rhel 8.6 2023-12-19T13:40:09.815 DEBUG:teuthology.provision.fog.smithi170:Canceling deploy task with ID 678654 2023-12-19T13:40:10.071 INFO:teuthology.orchestra.console.smithi142:Power off 2023-12-19T13:40:10.071 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T13:40:10.097 DEBUG:teuthology.orchestra.console.smithi142:power off output: Chassis Power Control: Down/Off 2023-12-19T13:40:10.097 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:40:10.113 INFO:teuthology.orchestra.console.smithi154:Power off 2023-12-19T13:40:10.113 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T13:40:10.130 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2023-12-19T13:40:10.147 DEBUG:teuthology.orchestra.console.smithi154:power off output: Chassis Power Control: Down/Off 2023-12-19T13:40:10.147 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:40:10.172 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on 2023-12-19T13:40:10.212 INFO:teuthology.orchestra.console.smithi170:Power off 2023-12-19T13:40:10.212 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T13:40:10.237 DEBUG:teuthology.orchestra.console.smithi170:power off output: Chassis Power Control: Down/Off 2023-12-19T13:40:10.237 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:40:10.259 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off 2023-12-19T13:40:10.360 INFO:teuthology.orchestra.console.smithi170:Power off completed 2023-12-19T13:40:10.461 INFO:teuthology.orchestra.console.smithi170:Power on 2023-12-19T13:40:10.461 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-19T13:40:10.482 DEBUG:teuthology.orchestra.console.smithi170:power on output: Chassis Power Control: Up/On 2023-12-19T13:40:10.483 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:40:10.505 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off 2023-12-19T13:40:14.133 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:40:14.174 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:40:14.242 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2023-12-19T13:40:14.283 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on 2023-12-19T13:40:14.506 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:40:14.615 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is on 2023-12-19T13:40:14.716 INFO:teuthology.orchestra.console.smithi170:Power on completed 2023-12-19T13:40:14.816 INFO:teuthology.provision.fog.smithi170:Waiting for deploy to finish 2023-12-19T13:40:18.245 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:40:18.284 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:40:18.355 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2023-12-19T13:40:18.393 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off 2023-12-19T13:40:18.493 INFO:teuthology.orchestra.console.smithi154:Power off completed 2023-12-19T13:40:18.594 INFO:teuthology.orchestra.console.smithi154:Power on 2023-12-19T13:40:18.594 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-19T13:40:18.616 DEBUG:teuthology.orchestra.console.smithi154:power on output: Chassis Power Control: Up/On 2023-12-19T13:40:18.616 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:40:18.639 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off 2023-12-19T13:40:22.357 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:40:22.467 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2023-12-19T13:40:22.568 INFO:teuthology.orchestra.console.smithi142:Power off completed 2023-12-19T13:40:22.640 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:40:22.669 INFO:teuthology.orchestra.console.smithi142:Power on 2023-12-19T13:40:22.669 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-19T13:40:22.690 DEBUG:teuthology.orchestra.console.smithi142:power on output: Chassis Power Control: Up/On 2023-12-19T13:40:22.690 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:40:22.712 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2023-12-19T13:40:22.748 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off 2023-12-19T13:40:26.717 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:40:26.749 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:40:26.827 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2023-12-19T13:40:26.858 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on 2023-12-19T13:40:26.958 INFO:teuthology.orchestra.console.smithi154:Power on completed 2023-12-19T13:40:27.059 INFO:teuthology.provision.fog.smithi154:Waiting for deploy to finish 2023-12-19T13:40:30.829 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:40:30.939 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2023-12-19T13:40:31.040 INFO:teuthology.orchestra.console.smithi142:Power on completed 2023-12-19T13:40:31.140 INFO:teuthology.provision.fog.smithi142:Waiting for deploy to finish 2023-12-19T13:43:01.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:43:13.182 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:43:16.242 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-12-19T13:43:17.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:43:20.305 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-12-19T13:43:22.245 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:43:25.297 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-12-19T13:43:26.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:43:29.365 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-12-19T13:43:31.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:43:32.721 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2023-12-19T13:43:34.353 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-12-19T13:43:35.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:43:38.453 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-12-19T13:43:38.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:43:40.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:43:41.777 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2023-12-19T13:43:43.413 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-12-19T13:43:44.455 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:43:47.505 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-12-19T13:43:47.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:43:49.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:43:52.501 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-12-19T13:43:53.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:43:56.561 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-12-19T13:43:58.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:44:01.585 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-12-19T13:44:02.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:44:05.617 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-12-19T13:44:06.165 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2023-12-19T13:44:07.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:44:10.645 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-12-19T13:44:11.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:44:12.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:44:13.201 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2023-12-19T13:44:16.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:44:19.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:44:22.257 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2023-12-19T13:44:28.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:44:28.334 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-19T13:44:28.334 DEBUG:teuthology.orchestra.run.smithi170:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-19T13:44:48.407 INFO:teuthology.provision.fog.smithi170:Node is ready 2023-12-19T13:44:48.408 DEBUG:teuthology.orchestra.run.smithi170:> hostname 2023-12-19T13:44:48.428 INFO:teuthology.orchestra.run.smithi170.stdout:smithi170 2023-12-19T13:44:48.428 DEBUG:teuthology.orchestra.run.smithi170:> grep smithi170 /etc/hosts 2023-12-19T13:44:48.488 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170 smithi170 smithi170 2023-12-19T13:44:48.488 DEBUG:teuthology.orchestra.run.smithi170:> sudo hostname smithi170 2023-12-19T13:44:48.558 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i -e 's/smithi170/smithi170/g' /etc/hosts 2023-12-19T13:44:48.628 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i -e 's/172.21.15.170/172.21.15.170/g' /etc/hosts 2023-12-19T13:44:48.697 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i -e 's/smithi170/smithi170/g' /etc/hostname 2023-12-19T13:44:48.766 DEBUG:teuthology.orchestra.run.smithi170:> sudo hostname smithi170 2023-12-19T13:44:48.833 DEBUG:teuthology.orchestra.run.smithi170:> cat /etc/os-release 2023-12-19T13:44:48.889 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T13:44:48.890 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="8.6 (Ootpa)" 2023-12-19T13:44:48.890 INFO:teuthology.orchestra.run.smithi170.stdout:ID="rhel" 2023-12-19T13:44:48.890 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="fedora" 2023-12-19T13:44:48.890 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="8.6" 2023-12-19T13:44:48.890 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el8" 2023-12-19T13:44:48.890 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-19T13:44:48.890 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31" 2023-12-19T13:44:48.890 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-19T13:44:48.890 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T13:44:48.890 INFO:teuthology.orchestra.run.smithi170.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T13:44:48.890 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T13:44:48.890 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-12-19T13:44:48.890 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T13:44:48.891 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-19T13:44:48.891 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T13:44:48.891 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-19T13:44:48.891 INFO:teuthology.provision.fog.smithi170:Deploy complete! 2023-12-19T13:44:48.893 DEBUG:teuthology.parallel:result is None 2023-12-19T13:45:11.641 WARNING:teuthology.provision.fog.smithi142:timed out 2023-12-19T13:45:16.656 WARNING:teuthology.provision.fog.smithi154:timed out 2023-12-19T13:45:17.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:45:17.843 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-19T13:45:17.843 DEBUG:teuthology.orchestra.run.smithi142:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-19T13:45:18.085 INFO:teuthology.provision.fog.smithi142:Node is ready 2023-12-19T13:45:18.086 DEBUG:teuthology.orchestra.run.smithi142:> hostname 2023-12-19T13:45:18.103 INFO:teuthology.orchestra.run.smithi142.stdout:smithi142.front.sepia.ceph.com 2023-12-19T13:45:18.103 DEBUG:teuthology.orchestra.run.smithi142:> grep smithi142.front.sepia.ceph.com /etc/hosts 2023-12-19T13:45:18.162 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142 smithi142.front.sepia.ceph.com smithi142 2023-12-19T13:45:18.162 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname smithi142 2023-12-19T13:45:18.264 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142.front.sepia.ceph.com/smithi142/g' /etc/hosts 2023-12-19T13:45:18.293 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/172.21.15.142/172.21.15.142/g' /etc/hosts 2023-12-19T13:45:18.361 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142.front.sepia.ceph.com/smithi142/g' /etc/hostname 2023-12-19T13:45:18.429 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname smithi142 2023-12-19T13:45:18.496 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2023-12-19T13:45:18.553 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T13:45:18.553 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="8.6 (Ootpa)" 2023-12-19T13:45:18.553 INFO:teuthology.orchestra.run.smithi142.stdout:ID="rhel" 2023-12-19T13:45:18.553 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="fedora" 2023-12-19T13:45:18.554 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="8.6" 2023-12-19T13:45:18.554 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el8" 2023-12-19T13:45:18.554 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-19T13:45:18.554 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2023-12-19T13:45:18.554 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-19T13:45:18.554 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T13:45:18.554 INFO:teuthology.orchestra.run.smithi142.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T13:45:18.554 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T13:45:18.554 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-19T13:45:18.554 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T13:45:18.554 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-19T13:45:18.554 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T13:45:18.554 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-19T13:45:18.555 INFO:teuthology.provision.fog.smithi142:Deploy complete! 2023-12-19T13:45:18.555 DEBUG:teuthology.parallel:result is None 2023-12-19T13:45:22.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:45:22.909 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-19T13:45:22.909 DEBUG:teuthology.orchestra.run.smithi154:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-19T13:45:23.187 INFO:teuthology.provision.fog.smithi154:Node is ready 2023-12-19T13:45:23.187 DEBUG:teuthology.orchestra.run.smithi154:> hostname 2023-12-19T13:45:23.205 INFO:teuthology.orchestra.run.smithi154.stdout:smithi154 2023-12-19T13:45:23.205 DEBUG:teuthology.orchestra.run.smithi154:> grep smithi154 /etc/hosts 2023-12-19T13:45:23.263 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154 smithi154.front.sepia.ceph.com smithi154 2023-12-19T13:45:23.263 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname smithi154 2023-12-19T13:45:23.372 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/smithi154/smithi154/g' /etc/hosts 2023-12-19T13:45:23.401 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/172.21.15.154/172.21.15.154/g' /etc/hosts 2023-12-19T13:45:23.470 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/smithi154/smithi154/g' /etc/hostname 2023-12-19T13:45:23.538 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname smithi154 2023-12-19T13:45:23.606 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2023-12-19T13:45:23.662 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T13:45:23.662 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="8.6 (Ootpa)" 2023-12-19T13:45:23.662 INFO:teuthology.orchestra.run.smithi154.stdout:ID="rhel" 2023-12-19T13:45:23.662 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="fedora" 2023-12-19T13:45:23.662 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="8.6" 2023-12-19T13:45:23.662 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el8" 2023-12-19T13:45:23.662 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-19T13:45:23.662 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31" 2023-12-19T13:45:23.662 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-19T13:45:23.662 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T13:45:23.663 INFO:teuthology.orchestra.run.smithi154.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T13:45:23.663 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T13:45:23.663 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-12-19T13:45:23.663 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T13:45:23.663 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-19T13:45:23.663 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T13:45:23.663 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-19T13:45:23.663 INFO:teuthology.provision.fog.smithi154:Deploy complete! 2023-12-19T13:45:23.664 DEBUG:teuthology.parallel:result is None 2023-12-19T13:45:23.862 INFO:teuthology.lock.ops:Checking smithi142.front.sepia.ceph.com 2023-12-19T13:45:23.863 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-19T13:45:23.888 INFO:teuthology.lock.ops:Checking smithi154.front.sepia.ceph.com 2023-12-19T13:45:23.888 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-19T13:45:23.912 INFO:teuthology.lock.ops:Checking smithi170.front.sepia.ceph.com 2023-12-19T13:45:23.913 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: set os type and version on server 2023-12-19T13:45:23.913 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-12-19T13:45:23.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:45:23.981 DEBUG:teuthology.orchestra.run.smithi142:> true 2023-12-19T13:45:24.055 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-12-19T13:45:24.055 DEBUG:teuthology.orchestra.run.smithi142:> uname -m 2023-12-19T13:45:24.115 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2023-12-19T13:45:24.115 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2023-12-19T13:45:24.174 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T13:45:24.174 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="8.6 (Ootpa)" 2023-12-19T13:45:24.175 INFO:teuthology.orchestra.run.smithi142.stdout:ID="rhel" 2023-12-19T13:45:24.175 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="fedora" 2023-12-19T13:45:24.175 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="8.6" 2023-12-19T13:45:24.175 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el8" 2023-12-19T13:45:24.175 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-19T13:45:24.175 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2023-12-19T13:45:24.175 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-19T13:45:24.175 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T13:45:24.175 INFO:teuthology.orchestra.run.smithi142.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T13:45:24.175 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T13:45:24.175 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-19T13:45:24.175 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T13:45:24.175 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-19T13:45:24.175 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T13:45:24.176 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-19T13:45:24.176 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2023-12-19T13:45:24.212 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: set os type and version on server 2023-12-19T13:45:24.212 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-12-19T13:45:24.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:45:24.281 DEBUG:teuthology.orchestra.run.smithi154:> true 2023-12-19T13:45:24.346 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-12-19T13:45:24.346 DEBUG:teuthology.orchestra.run.smithi154:> uname -m 2023-12-19T13:45:24.403 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64 2023-12-19T13:45:24.403 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2023-12-19T13:45:24.460 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T13:45:24.460 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="8.6 (Ootpa)" 2023-12-19T13:45:24.460 INFO:teuthology.orchestra.run.smithi154.stdout:ID="rhel" 2023-12-19T13:45:24.460 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="fedora" 2023-12-19T13:45:24.460 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="8.6" 2023-12-19T13:45:24.460 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el8" 2023-12-19T13:45:24.460 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-19T13:45:24.460 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31" 2023-12-19T13:45:24.460 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-19T13:45:24.460 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T13:45:24.461 INFO:teuthology.orchestra.run.smithi154.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T13:45:24.461 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T13:45:24.461 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-12-19T13:45:24.461 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T13:45:24.461 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-19T13:45:24.461 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T13:45:24.461 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-19T13:45:24.461 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2023-12-19T13:45:24.496 INFO:teuthology.lock.ops:Updating [smithi170.front.sepia.ceph.com]: set os type and version on server 2023-12-19T13:45:24.496 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2023-12-19T13:45:24.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:45:24.566 DEBUG:teuthology.orchestra.run.smithi170:> true 2023-12-19T13:45:24.636 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi170.front.sepia.ceph.com' 2023-12-19T13:45:24.636 DEBUG:teuthology.orchestra.run.smithi170:> uname -m 2023-12-19T13:45:24.696 INFO:teuthology.orchestra.run.smithi170.stdout:x86_64 2023-12-19T13:45:24.697 DEBUG:teuthology.orchestra.run.smithi170:> cat /etc/os-release 2023-12-19T13:45:24.755 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T13:45:24.755 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="8.6 (Ootpa)" 2023-12-19T13:45:24.755 INFO:teuthology.orchestra.run.smithi170.stdout:ID="rhel" 2023-12-19T13:45:24.756 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="fedora" 2023-12-19T13:45:24.756 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="8.6" 2023-12-19T13:45:24.756 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el8" 2023-12-19T13:45:24.756 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-19T13:45:24.756 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31" 2023-12-19T13:45:24.756 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-19T13:45:24.757 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T13:45:24.757 INFO:teuthology.orchestra.run.smithi170.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T13:45:24.757 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T13:45:24.757 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-12-19T13:45:24.757 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T13:45:24.757 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-19T13:45:24.757 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T13:45:24.757 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-19T13:45:24.758 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2023-12-19T13:45:24.779 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T13:45:24.871 INFO:teuthology.dispatcher.supervisor:Running job 7496803 2023-12-19T13:45:24.871 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496803 --name rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/fs/norstats}} -- /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496803/orig.config.yaml 2023-12-19T13:45:24.876 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496803 2023-12-19T13:45:24.876 INFO:teuthology.dispatcher.supervisor:Job PID: 1362426 2023-12-19T13:45:24.876 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-19T13:47:24.974 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T13:49:25.140 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T13:51:25.314 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T13:53:25.480 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T13:55:25.646 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T13:57:25.810 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T13:59:25.974 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T14:01:26.138 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T14:03:26.302 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T14:05:26.470 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T14:05:26.529 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-19T14:05:26.691 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi170 but it was locked by another job: /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496848 2023-12-19T14:05:26.691 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-19T14:05:26.692 INFO:teuthology.nuke:Checking targets against current locks 2023-12-19T14:05:26.730 DEBUG:teuthology.nuke:shortname: smithi142 2023-12-19T14:05:26.731 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T14:05:26.758 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496803', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 13:40:08.412507', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMbteLmc0v2pF2ekPrPQcV0uymaV9yihCctnIw8N1VNV9pGU9VE1MNjEHHjsygd+M+KMk2ha3KVqJvW/1iqOIEg='} 2023-12-19T14:05:26.759 DEBUG:teuthology.nuke:shortname: smithi154 2023-12-19T14:05:26.760 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T14:05:26.786 DEBUG:teuthology.nuke:shortname: smithi170 2023-12-19T14:05:26.786 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T14:05:26.787 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496803', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 13:40:08.411610', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK1P+E72dJbM8PXiA32tSX/6DcdUb3dfMtHV4XIthqzOjzSra3xpQFsgd2BH77eMt+ZXeL9iV1EEoItf9zZMiwI='} 2023-12-19T14:05:26.807 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi170.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496848', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 14:03:29.238674', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMgDep2/mPvIy4YUPdD63x39XTidC1cKAOTCXbVREvZRIa++mHzI6D3Mkolhi4l3Kf1zFenNwKFCqgAuyPPbDnA='} 2023-12-19T14:05:26.818 INFO:teuthology.orchestra.console.smithi142:Power off 2023-12-19T14:05:26.818 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T14:05:26.841 DEBUG:teuthology.orchestra.console.smithi142:power off output: Chassis Power Control: Down/Off 2023-12-19T14:05:26.841 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T14:05:26.864 INFO:teuthology.orchestra.console.smithi154:Power off 2023-12-19T14:05:26.864 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T14:05:26.874 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2023-12-19T14:05:26.885 DEBUG:teuthology.orchestra.console.smithi154:power off output: Chassis Power Control: Down/Off 2023-12-19T14:05:26.885 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T14:05:26.904 INFO:teuthology.orchestra.console.smithi170:Power off 2023-12-19T14:05:26.905 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T14:05:26.915 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off 2023-12-19T14:05:26.928 DEBUG:teuthology.orchestra.console.smithi170:power off output: Chassis Power Control: Down/Off 2023-12-19T14:05:26.928 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T14:05:26.950 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is on 2023-12-19T14:05:26.975 INFO:teuthology.orchestra.console.smithi142:Power off completed 2023-12-19T14:05:27.016 INFO:teuthology.orchestra.console.smithi154:Power off completed 2023-12-19T14:05:27.121 INFO:teuthology.lock.ops:unlocked: smithi142.front.sepia.ceph.com 2023-12-19T14:05:27.170 INFO:teuthology.lock.ops:unlocked: smithi154.front.sepia.ceph.com 2023-12-19T14:05:30.953 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T14:05:31.063 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is on 2023-12-19T14:05:35.067 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T14:05:35.175 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is on 2023-12-19T14:05:39.177 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T14:05:39.286 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off 2023-12-19T14:05:39.387 INFO:teuthology.orchestra.console.smithi170:Power off completed 2023-12-19T14:05:39.543 INFO:teuthology.lock.ops:unlocked: smithi170.front.sepia.ceph.com