2023-11-28T13:30:43.612 INFO:root:teuthology version: 0.0.1.dev209+g5ae09a5 2023-11-28T13:30:43.613 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T13:30:43.809 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f36a09e4dc0>, signals=[15]) 2023-11-28T13:30:43.809 INFO:teuthology.lock.ops:Start node 'smithi083.front.sepia.ceph.com' reimaging 2023-11-28T13:30:43.810 INFO:teuthology.lock.ops:Updating [smithi083.front.sepia.ceph.com]: reset os type and version on server 2023-11-28T13:30:43.810 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server 2023-11-28T13:30:43.828 INFO:teuthology.lock.ops:Start node 'smithi090.front.sepia.ceph.com' reimaging 2023-11-28T13:30:43.829 INFO:teuthology.lock.ops:Updating [smithi090.front.sepia.ceph.com]: reset os type and version on server 2023-11-28T13:30:43.829 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server 2023-11-28T13:30:43.853 INFO:teuthology.lock.ops:Start node 'smithi193.front.sepia.ceph.com' reimaging 2023-11-28T13:30:43.853 INFO:teuthology.lock.ops:Updating [smithi193.front.sepia.ceph.com]: reset os type and version on server 2023-11-28T13:30:43.853 INFO:teuthology.lock.ops:Updating smithi193.front.sepia.ceph.com on lock server 2023-11-28T13:30:43.947 DEBUG:teuthology.provision.fog.smithi083:Requesting image smithi_rhel_8.6 (ID 5) 2023-11-28T13:30:43.971 DEBUG:teuthology.provision.fog.smithi090:Requesting image smithi_rhel_8.6 (ID 5) 2023-11-28T13:30:43.988 DEBUG:teuthology.provision.fog.smithi193:Requesting image smithi_rhel_8.6 (ID 5) 2023-11-28T13:30:43.998 INFO:teuthology.provision.fog.smithi083:Scheduling deploy of rhel 8.6 2023-11-28T13:30:44.021 INFO:teuthology.provision.fog.smithi090:Scheduling deploy of rhel 8.6 2023-11-28T13:30:44.029 INFO:teuthology.provision.fog.smithi193:Scheduling deploy of rhel 8.6 2023-11-28T13:30:44.289 INFO:teuthology.orchestra.console.smithi083:Power off 2023-11-28T13:30:44.289 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T13:30:44.306 INFO:teuthology.orchestra.console.smithi193:Power off 2023-11-28T13:30:44.306 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T13:30:44.319 INFO:teuthology.orchestra.console.smithi090:Power off 2023-11-28T13:30:44.319 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T13:30:44.326 DEBUG:teuthology.orchestra.console.smithi193:power off output: Chassis Power Control: Down/Off 2023-11-28T13:30:44.327 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T13:30:44.336 DEBUG:teuthology.orchestra.console.smithi083:power off output: Chassis Power Control: Down/Off 2023-11-28T13:30:44.336 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T13:30:44.347 DEBUG:teuthology.orchestra.console.smithi090:power off output: Chassis Power Control: Down/Off 2023-11-28T13:30:44.347 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T13:30:44.356 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is off 2023-11-28T13:30:44.357 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is off 2023-11-28T13:30:44.372 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is off 2023-11-28T13:30:44.457 INFO:teuthology.orchestra.console.smithi193:Power off completed 2023-11-28T13:30:44.457 INFO:teuthology.orchestra.console.smithi083:Power off completed 2023-11-28T13:30:44.474 INFO:teuthology.orchestra.console.smithi090:Power off completed 2023-11-28T13:30:44.558 INFO:teuthology.orchestra.console.smithi193:Power on 2023-11-28T13:30:44.559 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-28T13:30:44.566 INFO:teuthology.orchestra.console.smithi083:Power on 2023-11-28T13:30:44.567 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-28T13:30:44.575 INFO:teuthology.orchestra.console.smithi090:Power on 2023-11-28T13:30:44.576 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-28T13:30:44.590 DEBUG:teuthology.orchestra.console.smithi193:power on output: Chassis Power Control: Up/On 2023-11-28T13:30:44.590 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T13:30:44.601 DEBUG:teuthology.orchestra.console.smithi083:power on output: Chassis Power Control: Up/On 2023-11-28T13:30:44.602 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T13:30:44.610 DEBUG:teuthology.orchestra.console.smithi090:power on output: Chassis Power Control: Up/On 2023-11-28T13:30:44.610 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T13:30:44.618 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is off 2023-11-28T13:30:44.626 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is off 2023-11-28T13:30:44.639 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is off 2023-11-28T13:30:48.622 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T13:30:48.629 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T13:30:48.640 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T13:30:48.731 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is on 2023-11-28T13:30:48.737 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is off 2023-11-28T13:30:48.752 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is off 2023-11-28T13:30:48.833 INFO:teuthology.orchestra.console.smithi193:Power on completed 2023-11-28T13:30:48.934 INFO:teuthology.provision.fog.smithi193:Waiting for deploy to finish 2023-11-28T13:30:52.742 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T13:30:52.753 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T13:30:52.852 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is on 2023-11-28T13:30:52.863 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is on 2023-11-28T13:30:52.953 INFO:teuthology.orchestra.console.smithi083:Power on completed 2023-11-28T13:30:52.964 INFO:teuthology.orchestra.console.smithi090:Power on completed 2023-11-28T13:30:53.054 INFO:teuthology.provision.fog.smithi083:Waiting for deploy to finish 2023-11-28T13:30:53.065 INFO:teuthology.provision.fog.smithi090:Waiting for deploy to finish 2023-11-28T13:33:34.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:33:37.894 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-11-28T13:33:38.884 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:33:41.954 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-11-28T13:33:43.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:33:46.978 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-11-28T13:33:47.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:33:51.014 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-11-28T13:33:52.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:33:56.038 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-11-28T13:33:57.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:34:00.066 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-11-28T13:34:02.041 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:34:05.126 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-11-28T13:34:06.068 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:34:09.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:34:09.122 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-11-28T13:34:11.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:34:12.070 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-11-28T13:34:14.210 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-11-28T13:34:15.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:34:18.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:34:18.182 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-11-28T13:34:20.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:34:21.158 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-11-28T13:34:23.270 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-11-28T13:34:24.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:34:27.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:34:27.234 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-11-28T13:34:29.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:34:30.246 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-11-28T13:34:33.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:34:35.394 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-11-28T13:34:36.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:34:39.330 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-11-28T13:34:41.397 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:34:44.450 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-11-28T13:34:45.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:34:48.386 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-11-28T13:34:50.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:34:53.507 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-11-28T13:34:54.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:34:57.442 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-11-28T13:34:59.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:35:01.576 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-28T13:35:01.577 DEBUG:teuthology.orchestra.run.smithi193:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-28T13:35:01.871 INFO:teuthology.provision.fog.smithi193:Node is ready 2023-11-28T13:35:01.871 DEBUG:teuthology.orchestra.run.smithi193:> hostname 2023-11-28T13:35:01.887 INFO:teuthology.orchestra.run.smithi193.stdout:smithi022 2023-11-28T13:35:01.888 DEBUG:teuthology.orchestra.run.smithi193:> grep smithi022 /etc/hosts 2023-11-28T13:35:01.944 INFO:teuthology.orchestra.run.smithi193.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-11-28T13:35:01.944 DEBUG:teuthology.orchestra.run.smithi193:> sudo hostname smithi193 2023-11-28T13:35:02.058 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/smithi022/smithi193/g' /etc/hosts 2023-11-28T13:35:02.085 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/172.21.15.22/172.21.15.193/g' /etc/hosts 2023-11-28T13:35:02.151 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/smithi022/smithi193/g' /etc/hostname 2023-11-28T13:35:02.218 DEBUG:teuthology.orchestra.run.smithi193:> sudo hostname smithi193 2023-11-28T13:35:02.283 DEBUG:teuthology.orchestra.run.smithi193:> cat /etc/os-release 2023-11-28T13:35:02.340 INFO:teuthology.orchestra.run.smithi193.stdout:NAME="Red Hat Enterprise Linux" 2023-11-28T13:35:02.340 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION="8.6 (Ootpa)" 2023-11-28T13:35:02.340 INFO:teuthology.orchestra.run.smithi193.stdout:ID="rhel" 2023-11-28T13:35:02.340 INFO:teuthology.orchestra.run.smithi193.stdout:ID_LIKE="fedora" 2023-11-28T13:35:02.341 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_ID="8.6" 2023-11-28T13:35:02.341 INFO:teuthology.orchestra.run.smithi193.stdout:PLATFORM_ID="platform:el8" 2023-11-28T13:35:02.341 INFO:teuthology.orchestra.run.smithi193.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-28T13:35:02.341 INFO:teuthology.orchestra.run.smithi193.stdout:ANSI_COLOR="0;31" 2023-11-28T13:35:02.341 INFO:teuthology.orchestra.run.smithi193.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-28T13:35:02.341 INFO:teuthology.orchestra.run.smithi193.stdout:HOME_URL="https://www.redhat.com/" 2023-11-28T13:35:02.341 INFO:teuthology.orchestra.run.smithi193.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-28T13:35:02.341 INFO:teuthology.orchestra.run.smithi193.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-28T13:35:02.341 INFO:teuthology.orchestra.run.smithi193.stdout: 2023-11-28T13:35:02.341 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-28T13:35:02.341 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-28T13:35:02.341 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-28T13:35:02.342 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-28T13:35:02.342 INFO:teuthology.provision.fog.smithi193:Deploy complete! 2023-11-28T13:35:02.344 DEBUG:teuthology.parallel:result is None 2023-11-28T13:35:03.445 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:35:06.502 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-11-28T13:35:12.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:35:15.586 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-11-28T13:35:21.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:35:33.250 WARNING:teuthology.provision.fog.smithi083:timed out 2023-11-28T13:35:39.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:35:39.597 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-28T13:35:39.597 DEBUG:teuthology.orchestra.run.smithi083:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-28T13:35:39.902 INFO:teuthology.provision.fog.smithi083:Node is ready 2023-11-28T13:35:39.902 DEBUG:teuthology.orchestra.run.smithi083:> hostname 2023-11-28T13:35:39.919 INFO:teuthology.orchestra.run.smithi083.stdout:smithi083.front.sepia.ceph.com 2023-11-28T13:35:39.919 DEBUG:teuthology.orchestra.run.smithi083:> grep smithi083.front.sepia.ceph.com /etc/hosts 2023-11-28T13:35:39.977 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83 smithi083.front.sepia.ceph.com smithi083 2023-11-28T13:35:39.977 DEBUG:teuthology.orchestra.run.smithi083:> sudo hostname smithi083 2023-11-28T13:35:40.104 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i -e 's/smithi083.front.sepia.ceph.com/smithi083/g' /etc/hosts 2023-11-28T13:35:40.132 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i -e 's/172.21.15.83/172.21.15.83/g' /etc/hosts 2023-11-28T13:35:40.199 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i -e 's/smithi083.front.sepia.ceph.com/smithi083/g' /etc/hostname 2023-11-28T13:35:40.265 DEBUG:teuthology.orchestra.run.smithi083:> sudo hostname smithi083 2023-11-28T13:35:40.332 DEBUG:teuthology.orchestra.run.smithi083:> cat /etc/os-release 2023-11-28T13:35:40.388 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="Red Hat Enterprise Linux" 2023-11-28T13:35:40.388 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="8.6 (Ootpa)" 2023-11-28T13:35:40.388 INFO:teuthology.orchestra.run.smithi083.stdout:ID="rhel" 2023-11-28T13:35:40.388 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE="fedora" 2023-11-28T13:35:40.389 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="8.6" 2023-11-28T13:35:40.389 INFO:teuthology.orchestra.run.smithi083.stdout:PLATFORM_ID="platform:el8" 2023-11-28T13:35:40.389 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-28T13:35:40.389 INFO:teuthology.orchestra.run.smithi083.stdout:ANSI_COLOR="0;31" 2023-11-28T13:35:40.389 INFO:teuthology.orchestra.run.smithi083.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-28T13:35:40.389 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://www.redhat.com/" 2023-11-28T13:35:40.389 INFO:teuthology.orchestra.run.smithi083.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-28T13:35:40.389 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-28T13:35:40.389 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-11-28T13:35:40.389 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-28T13:35:40.389 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-28T13:35:40.389 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-28T13:35:40.389 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-28T13:35:40.390 INFO:teuthology.provision.fog.smithi083:Deploy complete! 2023-11-28T13:35:40.390 DEBUG:teuthology.parallel:result is None 2023-11-28T13:36:21.635 WARNING:teuthology.provision.fog.smithi090:timed out 2023-11-28T13:36:27.639 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:36:27.867 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-28T13:36:27.868 DEBUG:teuthology.orchestra.run.smithi090:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-28T13:36:28.181 INFO:teuthology.provision.fog.smithi090:Node is ready 2023-11-28T13:36:28.181 DEBUG:teuthology.orchestra.run.smithi090:> hostname 2023-11-28T13:36:28.198 INFO:teuthology.orchestra.run.smithi090.stdout:smithi090.front.sepia.ceph.com 2023-11-28T13:36:28.198 DEBUG:teuthology.orchestra.run.smithi090:> grep smithi090.front.sepia.ceph.com /etc/hosts 2023-11-28T13:36:28.257 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90 smithi090.front.sepia.ceph.com smithi090 2023-11-28T13:36:28.258 DEBUG:teuthology.orchestra.run.smithi090:> sudo hostname smithi090 2023-11-28T13:36:28.398 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/smithi090.front.sepia.ceph.com/smithi090/g' /etc/hosts 2023-11-28T13:36:28.425 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/172.21.15.90/172.21.15.90/g' /etc/hosts 2023-11-28T13:36:28.493 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/smithi090.front.sepia.ceph.com/smithi090/g' /etc/hostname 2023-11-28T13:36:28.559 DEBUG:teuthology.orchestra.run.smithi090:> sudo hostname smithi090 2023-11-28T13:36:28.625 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release 2023-11-28T13:36:28.682 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="Red Hat Enterprise Linux" 2023-11-28T13:36:28.682 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="8.6 (Ootpa)" 2023-11-28T13:36:28.682 INFO:teuthology.orchestra.run.smithi090.stdout:ID="rhel" 2023-11-28T13:36:28.682 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE="fedora" 2023-11-28T13:36:28.682 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="8.6" 2023-11-28T13:36:28.683 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM_ID="platform:el8" 2023-11-28T13:36:28.683 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-28T13:36:28.683 INFO:teuthology.orchestra.run.smithi090.stdout:ANSI_COLOR="0;31" 2023-11-28T13:36:28.683 INFO:teuthology.orchestra.run.smithi090.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-28T13:36:28.683 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://www.redhat.com/" 2023-11-28T13:36:28.683 INFO:teuthology.orchestra.run.smithi090.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-28T13:36:28.683 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-28T13:36:28.683 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-28T13:36:28.683 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-28T13:36:28.683 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-28T13:36:28.683 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-28T13:36:28.683 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-28T13:36:28.684 INFO:teuthology.provision.fog.smithi090:Deploy complete! 2023-11-28T13:36:28.684 DEBUG:teuthology.parallel:result is None 2023-11-28T13:36:28.870 INFO:teuthology.lock.ops:Checking smithi083.front.sepia.ceph.com 2023-11-28T13:36:28.871 INFO:teuthology.lock.ops:Checking smithi090.front.sepia.ceph.com 2023-11-28T13:36:28.871 INFO:teuthology.lock.ops:Checking smithi193.front.sepia.ceph.com 2023-11-28T13:36:28.872 INFO:teuthology.lock.ops:Updating [smithi083.front.sepia.ceph.com]: set os type and version on server 2023-11-28T13:36:28.873 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2023-11-28T13:36:28.873 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:36:28.941 DEBUG:teuthology.orchestra.run.smithi083:> true 2023-11-28T13:36:29.072 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi083.front.sepia.ceph.com' 2023-11-28T13:36:29.072 DEBUG:teuthology.orchestra.run.smithi083:> uname -m 2023-11-28T13:36:29.130 INFO:teuthology.orchestra.run.smithi083.stdout:x86_64 2023-11-28T13:36:29.130 DEBUG:teuthology.orchestra.run.smithi083:> cat /etc/os-release 2023-11-28T13:36:29.186 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="Red Hat Enterprise Linux" 2023-11-28T13:36:29.187 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="8.6 (Ootpa)" 2023-11-28T13:36:29.187 INFO:teuthology.orchestra.run.smithi083.stdout:ID="rhel" 2023-11-28T13:36:29.187 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE="fedora" 2023-11-28T13:36:29.187 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="8.6" 2023-11-28T13:36:29.187 INFO:teuthology.orchestra.run.smithi083.stdout:PLATFORM_ID="platform:el8" 2023-11-28T13:36:29.187 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-28T13:36:29.187 INFO:teuthology.orchestra.run.smithi083.stdout:ANSI_COLOR="0;31" 2023-11-28T13:36:29.187 INFO:teuthology.orchestra.run.smithi083.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-28T13:36:29.187 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://www.redhat.com/" 2023-11-28T13:36:29.187 INFO:teuthology.orchestra.run.smithi083.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-28T13:36:29.187 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-28T13:36:29.188 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-11-28T13:36:29.188 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-28T13:36:29.188 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-28T13:36:29.188 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-28T13:36:29.188 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-28T13:36:29.188 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server 2023-11-28T13:36:29.214 INFO:teuthology.lock.ops:Updating [smithi090.front.sepia.ceph.com]: set os type and version on server 2023-11-28T13:36:29.214 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2023-11-28T13:36:29.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:36:29.281 DEBUG:teuthology.orchestra.run.smithi090:> true 2023-11-28T13:36:29.347 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi090.front.sepia.ceph.com' 2023-11-28T13:36:29.347 DEBUG:teuthology.orchestra.run.smithi090:> uname -m 2023-11-28T13:36:29.404 INFO:teuthology.orchestra.run.smithi090.stdout:x86_64 2023-11-28T13:36:29.404 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release 2023-11-28T13:36:29.460 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="Red Hat Enterprise Linux" 2023-11-28T13:36:29.460 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="8.6 (Ootpa)" 2023-11-28T13:36:29.460 INFO:teuthology.orchestra.run.smithi090.stdout:ID="rhel" 2023-11-28T13:36:29.460 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE="fedora" 2023-11-28T13:36:29.461 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="8.6" 2023-11-28T13:36:29.461 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM_ID="platform:el8" 2023-11-28T13:36:29.461 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-28T13:36:29.461 INFO:teuthology.orchestra.run.smithi090.stdout:ANSI_COLOR="0;31" 2023-11-28T13:36:29.461 INFO:teuthology.orchestra.run.smithi090.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-28T13:36:29.461 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://www.redhat.com/" 2023-11-28T13:36:29.461 INFO:teuthology.orchestra.run.smithi090.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-28T13:36:29.461 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-28T13:36:29.461 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-28T13:36:29.461 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-28T13:36:29.461 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-28T13:36:29.461 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-28T13:36:29.462 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-28T13:36:29.462 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server 2023-11-28T13:36:29.480 INFO:teuthology.lock.ops:Updating [smithi193.front.sepia.ceph.com]: set os type and version on server 2023-11-28T13:36:29.480 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com' 2023-11-28T13:36:29.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T13:36:29.547 DEBUG:teuthology.orchestra.run.smithi193:> true 2023-11-28T13:36:29.639 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi193.front.sepia.ceph.com' 2023-11-28T13:36:29.639 DEBUG:teuthology.orchestra.run.smithi193:> uname -m 2023-11-28T13:36:29.699 INFO:teuthology.orchestra.run.smithi193.stdout:x86_64 2023-11-28T13:36:29.699 DEBUG:teuthology.orchestra.run.smithi193:> cat /etc/os-release 2023-11-28T13:36:29.756 INFO:teuthology.orchestra.run.smithi193.stdout:NAME="Red Hat Enterprise Linux" 2023-11-28T13:36:29.756 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION="8.6 (Ootpa)" 2023-11-28T13:36:29.756 INFO:teuthology.orchestra.run.smithi193.stdout:ID="rhel" 2023-11-28T13:36:29.756 INFO:teuthology.orchestra.run.smithi193.stdout:ID_LIKE="fedora" 2023-11-28T13:36:29.757 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_ID="8.6" 2023-11-28T13:36:29.757 INFO:teuthology.orchestra.run.smithi193.stdout:PLATFORM_ID="platform:el8" 2023-11-28T13:36:29.757 INFO:teuthology.orchestra.run.smithi193.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-28T13:36:29.757 INFO:teuthology.orchestra.run.smithi193.stdout:ANSI_COLOR="0;31" 2023-11-28T13:36:29.757 INFO:teuthology.orchestra.run.smithi193.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-28T13:36:29.757 INFO:teuthology.orchestra.run.smithi193.stdout:HOME_URL="https://www.redhat.com/" 2023-11-28T13:36:29.757 INFO:teuthology.orchestra.run.smithi193.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-28T13:36:29.757 INFO:teuthology.orchestra.run.smithi193.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-28T13:36:29.757 INFO:teuthology.orchestra.run.smithi193.stdout: 2023-11-28T13:36:29.757 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-28T13:36:29.757 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-28T13:36:29.757 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-28T13:36:29.757 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-28T13:36:29.758 INFO:teuthology.lock.ops:Updating smithi193.front.sepia.ceph.com on lock server 2023-11-28T13:36:29.780 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T13:36:29.873 INFO:teuthology.dispatcher.supervisor:Running job 7470032 2023-11-28T13:36:29.873 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-11-28_13:00:50-fs-rishabh-2023nov26-testing-default-smithi/7470032 --name rishabh-2023-11-28_13:00:50-fs-rishabh-2023nov26-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/suites/fsync-tester}} -- /home/teuthworker/archive/rishabh-2023-11-28_13:00:50-fs-rishabh-2023nov26-testing-default-smithi/7470032/orig.config.yaml 2023-11-28T13:36:29.876 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-11-28_13:00:50-fs-rishabh-2023nov26-testing-default-smithi/7470032 2023-11-28T13:36:29.876 INFO:teuthology.dispatcher.supervisor:Job PID: 3998637 2023-11-28T13:36:29.876 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-28T13:38:29.974 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T13:40:30.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T13:42:30.307 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T13:44:30.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T13:46:30.643 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T13:48:30.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T13:50:30.977 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T13:52:31.136 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T13:54:31.307 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T13:56:31.482 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T13:56:31.552 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-11-28T13:56:31.688 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-28T13:56:31.689 INFO:teuthology.nuke:Checking targets against current locks 2023-11-28T13:56:31.739 DEBUG:teuthology.nuke:shortname: smithi083 2023-11-28T13:56:31.740 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T13:56:31.769 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi083.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-28_13:00:50-fs-rishabh-2023nov26-testing-default-smithi/7470032', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 13:30:42.705549', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-28T13:56:31.771 DEBUG:teuthology.nuke:shortname: smithi090 2023-11-28T13:56:31.771 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T13:56:31.796 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi090.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-28_13:00:50-fs-rishabh-2023nov26-testing-default-smithi/7470032', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 13:30:42.707237', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-28T13:56:31.801 DEBUG:teuthology.nuke:shortname: smithi193 2023-11-28T13:56:31.801 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T13:56:31.832 INFO:teuthology.orchestra.console.smithi083:Power off 2023-11-28T13:56:31.832 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T13:56:31.843 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi193.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-28_13:00:50-fs-rishabh-2023nov26-testing-default-smithi/7470032', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 13:30:42.703599', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-28T13:56:31.853 DEBUG:teuthology.orchestra.console.smithi083:power off output: Chassis Power Control: Down/Off 2023-11-28T13:56:31.853 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T13:56:31.878 INFO:teuthology.orchestra.console.smithi090:Power off 2023-11-28T13:56:31.878 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T13:56:31.889 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is off 2023-11-28T13:56:31.900 DEBUG:teuthology.orchestra.console.smithi090:power off output: Chassis Power Control: Down/Off 2023-11-28T13:56:31.900 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T13:56:31.916 INFO:teuthology.orchestra.console.smithi193:Power off 2023-11-28T13:56:31.916 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T13:56:31.925 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is off 2023-11-28T13:56:31.937 DEBUG:teuthology.orchestra.console.smithi193:power off output: Chassis Power Control: Down/Off 2023-11-28T13:56:31.937 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T13:56:31.961 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is off 2023-11-28T13:56:31.990 INFO:teuthology.orchestra.console.smithi083:Power off completed 2023-11-28T13:56:32.026 INFO:teuthology.orchestra.console.smithi090:Power off completed 2023-11-28T13:56:32.061 INFO:teuthology.orchestra.console.smithi193:Power off completed 2023-11-28T13:56:32.144 INFO:teuthology.lock.ops:unlocked: smithi083.front.sepia.ceph.com 2023-11-28T13:56:32.167 INFO:teuthology.lock.ops:unlocked: smithi090.front.sepia.ceph.com 2023-11-28T13:56:32.211 INFO:teuthology.lock.ops:unlocked: smithi193.front.sepia.ceph.com