2023-12-05T09:34:24.336 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-05T09:34:24.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T09:34:24.519 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1a26557e50>, signals=[15]) 2023-12-05T09:34:24.519 INFO:teuthology.lock.ops:Start node 'smithi063.front.sepia.ceph.com' reimaging 2023-12-05T09:34:24.520 INFO:teuthology.lock.ops:Updating [smithi063.front.sepia.ceph.com]: reset os type and version on server 2023-12-05T09:34:24.520 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server 2023-12-05T09:34:24.543 INFO:teuthology.lock.ops:Start node 'smithi097.front.sepia.ceph.com' reimaging 2023-12-05T09:34:24.543 INFO:teuthology.lock.ops:Updating [smithi097.front.sepia.ceph.com]: reset os type and version on server 2023-12-05T09:34:24.543 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server 2023-12-05T09:34:24.570 INFO:teuthology.lock.ops:Start node 'smithi179.front.sepia.ceph.com' reimaging 2023-12-05T09:34:24.571 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: reset os type and version on server 2023-12-05T09:34:24.571 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2023-12-05T09:34:24.667 DEBUG:teuthology.provision.fog.smithi063:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-05T09:34:24.682 DEBUG:teuthology.provision.fog.smithi097:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-05T09:34:24.699 DEBUG:teuthology.provision.fog.smithi179:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-05T09:34:24.718 INFO:teuthology.provision.fog.smithi063:Scheduling deploy of rhel 8.6 2023-12-05T09:34:24.736 INFO:teuthology.provision.fog.smithi097:Scheduling deploy of rhel 8.6 2023-12-05T09:34:24.742 INFO:teuthology.provision.fog.smithi179:Scheduling deploy of rhel 8.6 2023-12-05T09:34:24.985 INFO:teuthology.orchestra.console.smithi179:Power off 2023-12-05T09:34:24.986 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-05T09:34:25.006 INFO:teuthology.orchestra.console.smithi097:Power off 2023-12-05T09:34:25.006 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-05T09:34:25.020 INFO:teuthology.orchestra.console.smithi063:Power off 2023-12-05T09:34:25.021 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-05T09:34:25.030 DEBUG:teuthology.orchestra.console.smithi179:power off output: Chassis Power Control: Down/Off 2023-12-05T09:34:25.030 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T09:34:25.039 DEBUG:teuthology.orchestra.console.smithi097:power off output: Chassis Power Control: Down/Off 2023-12-05T09:34:25.039 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T09:34:25.047 DEBUG:teuthology.orchestra.console.smithi063:power off output: Chassis Power Control: Down/Off 2023-12-05T09:34:25.048 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T09:34:25.056 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2023-12-05T09:34:25.063 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is on 2023-12-05T09:34:25.072 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is on 2023-12-05T09:34:25.158 INFO:teuthology.orchestra.console.smithi179:Power off completed 2023-12-05T09:34:25.259 INFO:teuthology.orchestra.console.smithi179:Power on 2023-12-05T09:34:25.259 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-05T09:34:25.283 DEBUG:teuthology.orchestra.console.smithi179:power on output: Chassis Power Control: Up/On 2023-12-05T09:34:25.284 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T09:34:25.307 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2023-12-05T09:34:29.067 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T09:34:29.076 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T09:34:29.178 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is on 2023-12-05T09:34:29.185 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is on 2023-12-05T09:34:29.308 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T09:34:29.419 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2023-12-05T09:34:29.520 INFO:teuthology.orchestra.console.smithi179:Power on completed 2023-12-05T09:34:29.620 INFO:teuthology.provision.fog.smithi179:Waiting for deploy to finish 2023-12-05T09:34:33.182 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T09:34:33.190 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T09:34:33.292 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off 2023-12-05T09:34:33.301 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is off 2023-12-05T09:34:33.394 INFO:teuthology.orchestra.console.smithi097:Power off completed 2023-12-05T09:34:33.403 INFO:teuthology.orchestra.console.smithi063:Power off completed 2023-12-05T09:34:33.496 INFO:teuthology.orchestra.console.smithi097:Power on 2023-12-05T09:34:33.496 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-05T09:34:33.507 INFO:teuthology.orchestra.console.smithi063:Power on 2023-12-05T09:34:33.507 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-05T09:34:33.524 DEBUG:teuthology.orchestra.console.smithi097:power on output: Chassis Power Control: Up/On 2023-12-05T09:34:33.524 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T09:34:33.536 DEBUG:teuthology.orchestra.console.smithi063:power on output: Chassis Power Control: Up/On 2023-12-05T09:34:33.536 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T09:34:33.557 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off 2023-12-05T09:34:33.562 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is off 2023-12-05T09:34:37.559 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T09:34:37.566 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T09:34:37.668 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is on 2023-12-05T09:34:37.681 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is off 2023-12-05T09:34:37.769 INFO:teuthology.orchestra.console.smithi097:Power on completed 2023-12-05T09:34:37.870 INFO:teuthology.provision.fog.smithi097:Waiting for deploy to finish 2023-12-05T09:34:41.683 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T09:34:41.793 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is on 2023-12-05T09:34:41.894 INFO:teuthology.orchestra.console.smithi063:Power on completed 2023-12-05T09:34:41.995 INFO:teuthology.provision.fog.smithi063:Waiting for deploy to finish 2023-12-05T09:37:15.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T09:37:18.534 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-12-05T09:37:23.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T09:37:24.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T09:37:26.791 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-12-05T09:37:27.622 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-12-05T09:37:27.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T09:37:30.914 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2023-12-05T09:37:32.797 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T09:37:33.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T09:37:35.874 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-12-05T09:37:36.674 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-12-05T09:37:36.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T09:37:39.970 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2023-12-05T09:37:41.877 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T09:37:42.677 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T09:37:44.930 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-12-05T09:37:45.730 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-12-05T09:37:45.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T09:37:49.026 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2023-12-05T09:37:50.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T09:37:51.733 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T09:37:53.986 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-12-05T09:37:54.790 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-12-05T09:37:55.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T09:37:58.082 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2023-12-05T09:37:59.989 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T09:38:00.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T09:38:03.046 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-12-05T09:38:03.874 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-12-05T09:38:04.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T09:38:07.138 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2023-12-05T09:38:09.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T09:38:09.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T09:38:12.134 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-12-05T09:38:12.930 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-12-05T09:38:13.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T09:38:16.198 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2023-12-05T09:38:18.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T09:38:18.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T09:38:22.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T09:38:25.282 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2023-12-05T09:38:31.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T09:39:18.182 WARNING:teuthology.provision.fog.smithi097:timed out 2023-12-05T09:39:18.936 WARNING:teuthology.provision.fog.smithi179:timed out 2023-12-05T09:39:24.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T09:39:24.541 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-05T09:39:24.541 DEBUG:teuthology.orchestra.run.smithi097:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-05T09:39:24.827 INFO:teuthology.provision.fog.smithi097:Node is ready 2023-12-05T09:39:24.828 DEBUG:teuthology.orchestra.run.smithi097:> hostname 2023-12-05T09:39:24.846 INFO:teuthology.orchestra.run.smithi097.stdout:smithi097 2023-12-05T09:39:24.847 DEBUG:teuthology.orchestra.run.smithi097:> grep smithi097 /etc/hosts 2023-12-05T09:39:24.906 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.15.97 smithi097.front.sepia.ceph.com smithi097 2023-12-05T09:39:24.906 DEBUG:teuthology.orchestra.run.smithi097:> sudo hostname smithi097 2023-12-05T09:39:24.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T09:39:25.008 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/smithi097/smithi097/g' /etc/hosts 2023-12-05T09:39:25.038 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/172.21.15.97/172.21.15.97/g' /etc/hosts 2023-12-05T09:39:25.106 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/smithi097/smithi097/g' /etc/hostname 2023-12-05T09:39:25.175 DEBUG:teuthology.orchestra.run.smithi097:> sudo hostname smithi097 2023-12-05T09:39:25.246 DEBUG:teuthology.orchestra.run.smithi097:> cat /etc/os-release 2023-12-05T09:39:25.258 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-05T09:39:25.258 DEBUG:teuthology.orchestra.run.smithi179:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-05T09:39:25.303 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="Red Hat Enterprise Linux" 2023-12-05T09:39:25.303 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="8.6 (Ootpa)" 2023-12-05T09:39:25.303 INFO:teuthology.orchestra.run.smithi097.stdout:ID="rhel" 2023-12-05T09:39:25.304 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE="fedora" 2023-12-05T09:39:25.304 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="8.6" 2023-12-05T09:39:25.304 INFO:teuthology.orchestra.run.smithi097.stdout:PLATFORM_ID="platform:el8" 2023-12-05T09:39:25.304 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-05T09:39:25.304 INFO:teuthology.orchestra.run.smithi097.stdout:ANSI_COLOR="0;31" 2023-12-05T09:39:25.304 INFO:teuthology.orchestra.run.smithi097.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-05T09:39:25.304 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://www.redhat.com/" 2023-12-05T09:39:25.304 INFO:teuthology.orchestra.run.smithi097.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-05T09:39:25.304 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-05T09:39:25.304 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-05T09:39:25.304 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-05T09:39:25.304 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-05T09:39:25.305 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-05T09:39:25.305 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-05T09:39:25.305 INFO:teuthology.provision.fog.smithi097:Deploy complete! 2023-12-05T09:39:25.307 DEBUG:teuthology.parallel:result is None 2023-12-05T09:39:25.547 INFO:teuthology.provision.fog.smithi179:Node is ready 2023-12-05T09:39:25.548 DEBUG:teuthology.orchestra.run.smithi179:> hostname 2023-12-05T09:39:25.567 INFO:teuthology.orchestra.run.smithi179.stdout:smithi179 2023-12-05T09:39:25.567 DEBUG:teuthology.orchestra.run.smithi179:> grep smithi179 /etc/hosts 2023-12-05T09:39:25.626 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.15.179 smithi179.front.sepia.ceph.com smithi179 2023-12-05T09:39:25.626 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname smithi179 2023-12-05T09:39:25.745 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/smithi179/smithi179/g' /etc/hosts 2023-12-05T09:39:25.775 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/172.21.15.179/172.21.15.179/g' /etc/hosts 2023-12-05T09:39:25.841 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/smithi179/smithi179/g' /etc/hostname 2023-12-05T09:39:25.907 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname smithi179 2023-12-05T09:39:25.974 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2023-12-05T09:39:26.030 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="Red Hat Enterprise Linux" 2023-12-05T09:39:26.030 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="8.6 (Ootpa)" 2023-12-05T09:39:26.030 INFO:teuthology.orchestra.run.smithi179.stdout:ID="rhel" 2023-12-05T09:39:26.030 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="fedora" 2023-12-05T09:39:26.030 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="8.6" 2023-12-05T09:39:26.031 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el8" 2023-12-05T09:39:26.031 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-05T09:39:26.031 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31" 2023-12-05T09:39:26.031 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-05T09:39:26.031 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://www.redhat.com/" 2023-12-05T09:39:26.031 INFO:teuthology.orchestra.run.smithi179.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-05T09:39:26.031 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-05T09:39:26.031 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-05T09:39:26.031 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-05T09:39:26.031 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-05T09:39:26.032 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-05T09:39:26.032 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-05T09:39:26.032 INFO:teuthology.provision.fog.smithi179:Deploy complete! 2023-12-05T09:39:26.033 DEBUG:teuthology.parallel:result is None 2023-12-05T09:39:31.294 WARNING:teuthology.provision.fog.smithi063:timed out 2023-12-05T09:39:37.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T09:39:37.634 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-05T09:39:37.634 DEBUG:teuthology.orchestra.run.smithi063:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-05T09:39:38.106 INFO:teuthology.provision.fog.smithi063:Node is ready 2023-12-05T09:39:38.106 DEBUG:teuthology.orchestra.run.smithi063:> hostname 2023-12-05T09:39:38.127 INFO:teuthology.orchestra.run.smithi063.stdout:smithi063.front.sepia.ceph.com 2023-12-05T09:39:38.127 DEBUG:teuthology.orchestra.run.smithi063:> grep smithi063.front.sepia.ceph.com /etc/hosts 2023-12-05T09:39:38.186 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63 smithi063.front.sepia.ceph.com smithi063 2023-12-05T09:39:38.187 DEBUG:teuthology.orchestra.run.smithi063:> sudo hostname smithi063 2023-12-05T09:39:38.309 DEBUG:teuthology.orchestra.run.smithi063:> sudo sed -i -e 's/smithi063.front.sepia.ceph.com/smithi063/g' /etc/hosts 2023-12-05T09:39:38.340 DEBUG:teuthology.orchestra.run.smithi063:> sudo sed -i -e 's/172.21.15.63/172.21.15.63/g' /etc/hosts 2023-12-05T09:39:38.409 DEBUG:teuthology.orchestra.run.smithi063:> sudo sed -i -e 's/smithi063.front.sepia.ceph.com/smithi063/g' /etc/hostname 2023-12-05T09:39:38.478 DEBUG:teuthology.orchestra.run.smithi063:> sudo hostname smithi063 2023-12-05T09:39:38.545 DEBUG:teuthology.orchestra.run.smithi063:> cat /etc/os-release 2023-12-05T09:39:38.603 INFO:teuthology.orchestra.run.smithi063.stdout:NAME="Red Hat Enterprise Linux" 2023-12-05T09:39:38.603 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION="8.6 (Ootpa)" 2023-12-05T09:39:38.603 INFO:teuthology.orchestra.run.smithi063.stdout:ID="rhel" 2023-12-05T09:39:38.604 INFO:teuthology.orchestra.run.smithi063.stdout:ID_LIKE="fedora" 2023-12-05T09:39:38.604 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_ID="8.6" 2023-12-05T09:39:38.604 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM_ID="platform:el8" 2023-12-05T09:39:38.604 INFO:teuthology.orchestra.run.smithi063.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-05T09:39:38.604 INFO:teuthology.orchestra.run.smithi063.stdout:ANSI_COLOR="0;31" 2023-12-05T09:39:38.604 INFO:teuthology.orchestra.run.smithi063.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-05T09:39:38.604 INFO:teuthology.orchestra.run.smithi063.stdout:HOME_URL="https://www.redhat.com/" 2023-12-05T09:39:38.604 INFO:teuthology.orchestra.run.smithi063.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-05T09:39:38.604 INFO:teuthology.orchestra.run.smithi063.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-05T09:39:38.604 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-05T09:39:38.604 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-05T09:39:38.605 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-05T09:39:38.605 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-05T09:39:38.605 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-05T09:39:38.605 INFO:teuthology.provision.fog.smithi063:Deploy complete! 2023-12-05T09:39:38.605 DEBUG:teuthology.parallel:result is None 2023-12-05T09:39:38.833 INFO:teuthology.lock.ops:Checking smithi063.front.sepia.ceph.com 2023-12-05T09:39:38.834 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-05T09:39:38.860 INFO:teuthology.lock.ops:Checking smithi097.front.sepia.ceph.com 2023-12-05T09:39:38.860 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-05T09:39:38.885 INFO:teuthology.lock.ops:Checking smithi179.front.sepia.ceph.com 2023-12-05T09:39:38.887 INFO:teuthology.lock.ops:Updating [smithi063.front.sepia.ceph.com]: set os type and version on server 2023-12-05T09:39:38.887 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2023-12-05T09:39:38.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T09:39:38.954 DEBUG:teuthology.orchestra.run.smithi063:> true 2023-12-05T09:39:39.024 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi063.front.sepia.ceph.com' 2023-12-05T09:39:39.024 DEBUG:teuthology.orchestra.run.smithi063:> uname -m 2023-12-05T09:39:39.081 INFO:teuthology.orchestra.run.smithi063.stdout:x86_64 2023-12-05T09:39:39.081 DEBUG:teuthology.orchestra.run.smithi063:> cat /etc/os-release 2023-12-05T09:39:39.139 INFO:teuthology.orchestra.run.smithi063.stdout:NAME="Red Hat Enterprise Linux" 2023-12-05T09:39:39.139 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION="8.6 (Ootpa)" 2023-12-05T09:39:39.139 INFO:teuthology.orchestra.run.smithi063.stdout:ID="rhel" 2023-12-05T09:39:39.139 INFO:teuthology.orchestra.run.smithi063.stdout:ID_LIKE="fedora" 2023-12-05T09:39:39.139 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_ID="8.6" 2023-12-05T09:39:39.139 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM_ID="platform:el8" 2023-12-05T09:39:39.140 INFO:teuthology.orchestra.run.smithi063.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-05T09:39:39.140 INFO:teuthology.orchestra.run.smithi063.stdout:ANSI_COLOR="0;31" 2023-12-05T09:39:39.140 INFO:teuthology.orchestra.run.smithi063.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-05T09:39:39.140 INFO:teuthology.orchestra.run.smithi063.stdout:HOME_URL="https://www.redhat.com/" 2023-12-05T09:39:39.140 INFO:teuthology.orchestra.run.smithi063.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-05T09:39:39.140 INFO:teuthology.orchestra.run.smithi063.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-05T09:39:39.140 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-05T09:39:39.140 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-05T09:39:39.140 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-05T09:39:39.140 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-05T09:39:39.140 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-05T09:39:39.141 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server 2023-12-05T09:39:39.160 INFO:teuthology.lock.ops:Updating [smithi097.front.sepia.ceph.com]: set os type and version on server 2023-12-05T09:39:39.160 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2023-12-05T09:39:39.161 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T09:39:39.230 DEBUG:teuthology.orchestra.run.smithi097:> true 2023-12-05T09:39:39.355 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi097.front.sepia.ceph.com' 2023-12-05T09:39:39.356 DEBUG:teuthology.orchestra.run.smithi097:> uname -m 2023-12-05T09:39:39.413 INFO:teuthology.orchestra.run.smithi097.stdout:x86_64 2023-12-05T09:39:39.413 DEBUG:teuthology.orchestra.run.smithi097:> cat /etc/os-release 2023-12-05T09:39:39.470 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="Red Hat Enterprise Linux" 2023-12-05T09:39:39.470 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="8.6 (Ootpa)" 2023-12-05T09:39:39.470 INFO:teuthology.orchestra.run.smithi097.stdout:ID="rhel" 2023-12-05T09:39:39.470 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE="fedora" 2023-12-05T09:39:39.470 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="8.6" 2023-12-05T09:39:39.470 INFO:teuthology.orchestra.run.smithi097.stdout:PLATFORM_ID="platform:el8" 2023-12-05T09:39:39.470 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-05T09:39:39.470 INFO:teuthology.orchestra.run.smithi097.stdout:ANSI_COLOR="0;31" 2023-12-05T09:39:39.470 INFO:teuthology.orchestra.run.smithi097.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-05T09:39:39.471 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://www.redhat.com/" 2023-12-05T09:39:39.471 INFO:teuthology.orchestra.run.smithi097.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-05T09:39:39.471 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-05T09:39:39.471 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-05T09:39:39.471 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-05T09:39:39.471 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-05T09:39:39.471 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-05T09:39:39.471 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-05T09:39:39.472 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server 2023-12-05T09:39:39.493 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: set os type and version on server 2023-12-05T09:39:39.494 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-12-05T09:39:39.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T09:39:39.566 DEBUG:teuthology.orchestra.run.smithi179:> true 2023-12-05T09:39:39.693 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-12-05T09:39:39.693 DEBUG:teuthology.orchestra.run.smithi179:> uname -m 2023-12-05T09:39:39.751 INFO:teuthology.orchestra.run.smithi179.stdout:x86_64 2023-12-05T09:39:39.752 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2023-12-05T09:39:39.811 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="Red Hat Enterprise Linux" 2023-12-05T09:39:39.811 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="8.6 (Ootpa)" 2023-12-05T09:39:39.811 INFO:teuthology.orchestra.run.smithi179.stdout:ID="rhel" 2023-12-05T09:39:39.811 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="fedora" 2023-12-05T09:39:39.812 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="8.6" 2023-12-05T09:39:39.812 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el8" 2023-12-05T09:39:39.812 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-05T09:39:39.812 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31" 2023-12-05T09:39:39.812 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-05T09:39:39.812 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://www.redhat.com/" 2023-12-05T09:39:39.812 INFO:teuthology.orchestra.run.smithi179.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-05T09:39:39.813 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-05T09:39:39.813 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-05T09:39:39.813 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-05T09:39:39.813 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-05T09:39:39.813 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-05T09:39:39.813 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-05T09:39:39.814 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2023-12-05T09:39:39.844 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T09:39:39.950 INFO:teuthology.dispatcher.supervisor:Running job 7477516 2023-12-05T09:39:39.951 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/virtualenv/bin/teuthology -v --owner mchangir --archive /home/teuthworker/archive/mchangir-2023-12-05_08:35:01-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7477516 --name mchangir-2023-12-05_08:35:01-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/kernel_untar_build}} -- /home/teuthworker/archive/mchangir-2023-12-05_08:35:01-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7477516/orig.config.yaml 2023-12-05T09:39:39.955 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mchangir-2023-12-05_08:35:01-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7477516 2023-12-05T09:39:39.955 INFO:teuthology.dispatcher.supervisor:Job PID: 903740 2023-12-05T09:39:39.955 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-05T09:41:40.056 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T09:43:40.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T09:45:40.399 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T09:47:40.565 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T09:49:40.727 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T09:51:40.900 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T09:51:41.000 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-05T09:51:41.148 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-05T09:51:41.148 INFO:teuthology.nuke:Checking targets against current locks 2023-12-05T09:51:41.197 DEBUG:teuthology.nuke:shortname: smithi063 2023-12-05T09:51:41.197 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-05T09:51:41.225 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi063.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-12-05_08:35:01-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7477516', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-05 09:34:23.444450', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-05T09:51:41.229 DEBUG:teuthology.nuke:shortname: smithi097 2023-12-05T09:51:41.229 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-05T09:51:41.256 DEBUG:teuthology.nuke:shortname: smithi179 2023-12-05T09:51:41.256 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-05T09:51:41.260 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi097.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-12-05_08:35:01-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7477516', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-05 09:34:23.445954', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-05T09:51:41.291 INFO:teuthology.orchestra.console.smithi063:Power off 2023-12-05T09:51:41.291 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-05T09:51:41.300 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi179.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-12-05_08:35:01-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7477516', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-05 09:34:23.447187', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-05T09:51:41.315 DEBUG:teuthology.orchestra.console.smithi063:power off output: Chassis Power Control: Down/Off 2023-12-05T09:51:41.315 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T09:51:41.330 INFO:teuthology.orchestra.console.smithi097:Power off 2023-12-05T09:51:41.331 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-05T09:51:41.342 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is off 2023-12-05T09:51:41.351 DEBUG:teuthology.orchestra.console.smithi097:power off output: Chassis Power Control: Down/Off 2023-12-05T09:51:41.351 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T09:51:41.369 INFO:teuthology.orchestra.console.smithi179:Power off 2023-12-05T09:51:41.369 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-05T09:51:41.377 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off 2023-12-05T09:51:41.389 DEBUG:teuthology.orchestra.console.smithi179:power off output: Chassis Power Control: Down/Off 2023-12-05T09:51:41.389 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T09:51:41.409 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2023-12-05T09:51:41.443 INFO:teuthology.orchestra.console.smithi063:Power off completed 2023-12-05T09:51:41.478 INFO:teuthology.orchestra.console.smithi097:Power off completed 2023-12-05T09:51:41.510 INFO:teuthology.orchestra.console.smithi179:Power off completed 2023-12-05T09:51:41.600 INFO:teuthology.lock.ops:unlocked: smithi063.front.sepia.ceph.com 2023-12-05T09:51:41.624 INFO:teuthology.lock.ops:unlocked: smithi097.front.sepia.ceph.com 2023-12-05T09:51:41.647 INFO:teuthology.lock.ops:unlocked: smithi179.front.sepia.ceph.com