2024-01-24T09:40:43.998 INFO:root:teuthology version: 0.0.1.dev251+gc856e0f 2024-01-24T09:40:43.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-24T09:40:44.155 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4c379f1c10>, signals=[15]) 2024-01-24T09:40:44.156 INFO:teuthology.lock.ops:Start node 'smithi026.front.sepia.ceph.com' reimaging 2024-01-24T09:40:44.156 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: reset os type and version on server 2024-01-24T09:40:44.156 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2024-01-24T09:40:44.176 INFO:teuthology.lock.ops:Start node 'smithi093.front.sepia.ceph.com' reimaging 2024-01-24T09:40:44.176 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: reset os type and version on server 2024-01-24T09:40:44.176 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server 2024-01-24T09:40:44.234 INFO:teuthology.lock.ops:Start node 'smithi105.front.sepia.ceph.com' reimaging 2024-01-24T09:40:44.234 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: reset os type and version on server 2024-01-24T09:40:44.234 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2024-01-24T09:40:44.290 DEBUG:teuthology.provision.fog.smithi026:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-24T09:40:44.337 INFO:teuthology.provision.fog.smithi026:Scheduling deploy of rhel 8.6 2024-01-24T09:40:44.354 DEBUG:teuthology.provision.fog.smithi093:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-24T09:40:44.397 INFO:teuthology.provision.fog.smithi093:Scheduling deploy of rhel 8.6 2024-01-24T09:40:44.400 DEBUG:teuthology.provision.fog.smithi105:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-24T09:40:44.450 INFO:teuthology.provision.fog.smithi105:Scheduling deploy of rhel 8.6 2024-01-24T09:40:44.621 INFO:teuthology.orchestra.console.smithi026:Power off 2024-01-24T09:40:44.621 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-24T09:40:44.644 DEBUG:teuthology.orchestra.console.smithi026:power off output: Chassis Power Control: Down/Off 2024-01-24T09:40:44.645 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T09:40:44.667 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off 2024-01-24T09:40:44.689 INFO:teuthology.orchestra.console.smithi093:Power off 2024-01-24T09:40:44.689 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-24T09:40:44.705 INFO:teuthology.orchestra.console.smithi105:Power off 2024-01-24T09:40:44.706 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-24T09:40:44.714 DEBUG:teuthology.orchestra.console.smithi093:power off output: Chassis Power Control: Down/Off 2024-01-24T09:40:44.715 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T09:40:44.729 DEBUG:teuthology.orchestra.console.smithi105:power off output: Chassis Power Control: Down/Off 2024-01-24T09:40:44.730 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T09:40:44.742 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off 2024-01-24T09:40:44.754 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2024-01-24T09:40:44.769 INFO:teuthology.orchestra.console.smithi026:Power off completed 2024-01-24T09:40:44.843 INFO:teuthology.orchestra.console.smithi093:Power off completed 2024-01-24T09:40:44.870 INFO:teuthology.orchestra.console.smithi026:Power on 2024-01-24T09:40:44.870 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-24T09:40:44.895 DEBUG:teuthology.orchestra.console.smithi026:power on output: Chassis Power Control: Up/On 2024-01-24T09:40:44.895 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T09:40:44.917 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off 2024-01-24T09:40:44.944 INFO:teuthology.orchestra.console.smithi093:Power on 2024-01-24T09:40:44.944 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-24T09:40:44.965 DEBUG:teuthology.orchestra.console.smithi093:power on output: Chassis Power Control: Up/On 2024-01-24T09:40:44.965 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T09:40:44.986 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off 2024-01-24T09:40:48.756 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T09:40:48.864 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2024-01-24T09:40:48.918 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T09:40:48.986 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T09:40:49.026 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on 2024-01-24T09:40:49.096 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off 2024-01-24T09:40:49.128 INFO:teuthology.orchestra.console.smithi026:Power on completed 2024-01-24T09:40:49.228 INFO:teuthology.provision.fog.smithi026:Waiting for deploy to finish 2024-01-24T09:40:52.868 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T09:40:52.977 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2024-01-24T09:40:53.078 INFO:teuthology.orchestra.console.smithi105:Power off completed 2024-01-24T09:40:53.097 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T09:40:53.179 INFO:teuthology.orchestra.console.smithi105:Power on 2024-01-24T09:40:53.180 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-24T09:40:53.203 DEBUG:teuthology.orchestra.console.smithi105:power on output: Chassis Power Control: Up/On 2024-01-24T09:40:53.203 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T09:40:53.211 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on 2024-01-24T09:40:53.224 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2024-01-24T09:40:53.312 INFO:teuthology.orchestra.console.smithi093:Power on completed 2024-01-24T09:40:53.413 INFO:teuthology.provision.fog.smithi093:Waiting for deploy to finish 2024-01-24T09:40:57.226 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T09:40:57.335 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2024-01-24T09:41:01.340 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T09:41:01.448 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2024-01-24T09:41:01.549 INFO:teuthology.orchestra.console.smithi105:Power on completed 2024-01-24T09:41:01.650 INFO:teuthology.provision.fog.smithi105:Waiting for deploy to finish 2024-01-24T09:43:20.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T09:43:23.452 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2024-01-24T09:43:29.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T09:43:32.540 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2024-01-24T09:43:38.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T09:43:39.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T09:43:41.600 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2024-01-24T09:43:42.620 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2024-01-24T09:43:47.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T09:43:47.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T09:43:48.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T09:43:50.684 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2024-01-24T09:43:50.848 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-01-24T09:43:51.680 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2024-01-24T09:43:56.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T09:43:56.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T09:43:57.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T09:43:59.900 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-01-24T09:44:00.764 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2024-01-24T09:44:05.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T09:44:06.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T09:44:08.956 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-01-24T09:44:09.820 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2024-01-24T09:44:14.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T09:44:15.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T09:44:18.012 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-01-24T09:44:18.876 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2024-01-24T09:44:24.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T09:44:24.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T09:44:27.068 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-01-24T09:44:33.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T09:44:36.156 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-01-24T09:44:42.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T09:44:56.705 WARNING:teuthology.provision.fog.smithi026:timed out 2024-01-24T09:45:02.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T09:45:02.962 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-24T09:45:02.963 DEBUG:teuthology.orchestra.run.smithi026:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-24T09:45:03.271 INFO:teuthology.provision.fog.smithi026:Node is ready 2024-01-24T09:45:03.272 DEBUG:teuthology.orchestra.run.smithi026:> hostname 2024-01-24T09:45:03.292 INFO:teuthology.orchestra.run.smithi026.stdout:smithi026.front.sepia.ceph.com 2024-01-24T09:45:03.293 DEBUG:teuthology.orchestra.run.smithi026:> grep smithi026.front.sepia.ceph.com /etc/hosts 2024-01-24T09:45:03.354 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26 smithi026.front.sepia.ceph.com smithi026 2024-01-24T09:45:03.354 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026 2024-01-24T09:45:03.468 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi026.front.sepia.ceph.com/smithi026/g' /etc/hosts 2024-01-24T09:45:03.503 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/172.21.15.26/172.21.15.26/g' /etc/hosts 2024-01-24T09:45:03.578 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi026.front.sepia.ceph.com/smithi026/g' /etc/hostname 2024-01-24T09:45:03.654 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026 2024-01-24T09:45:03.727 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2024-01-24T09:45:03.788 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="Red Hat Enterprise Linux" 2024-01-24T09:45:03.788 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="8.6 (Ootpa)" 2024-01-24T09:45:03.789 INFO:teuthology.orchestra.run.smithi026.stdout:ID="rhel" 2024-01-24T09:45:03.789 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="fedora" 2024-01-24T09:45:03.789 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="8.6" 2024-01-24T09:45:03.789 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el8" 2024-01-24T09:45:03.789 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-24T09:45:03.789 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31" 2024-01-24T09:45:03.789 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-24T09:45:03.789 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://www.redhat.com/" 2024-01-24T09:45:03.789 INFO:teuthology.orchestra.run.smithi026.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-24T09:45:03.789 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-24T09:45:03.789 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-24T09:45:03.789 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-24T09:45:03.789 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-24T09:45:03.790 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-24T09:45:03.790 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-24T09:45:03.790 INFO:teuthology.provision.fog.smithi026:Deploy complete! 2024-01-24T09:45:03.791 DEBUG:teuthology.parallel:result is None 2024-01-24T09:45:24.900 WARNING:teuthology.provision.fog.smithi093:timed out 2024-01-24T09:45:30.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T09:45:31.198 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-24T09:45:31.199 DEBUG:teuthology.orchestra.run.smithi093:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-24T09:45:31.448 INFO:teuthology.provision.fog.smithi093:Node is ready 2024-01-24T09:45:31.448 DEBUG:teuthology.orchestra.run.smithi093:> hostname 2024-01-24T09:45:31.508 INFO:teuthology.orchestra.run.smithi093.stdout:smithi093 2024-01-24T09:45:31.508 DEBUG:teuthology.orchestra.run.smithi093:> grep smithi093 /etc/hosts 2024-01-24T09:45:31.565 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93 smithi093.front.sepia.ceph.com smithi093 2024-01-24T09:45:31.565 DEBUG:teuthology.orchestra.run.smithi093:> sudo hostname smithi093 2024-01-24T09:45:31.675 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/smithi093/smithi093/g' /etc/hosts 2024-01-24T09:45:31.703 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/172.21.15.93/172.21.15.93/g' /etc/hosts 2024-01-24T09:45:31.770 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/smithi093/smithi093/g' /etc/hostname 2024-01-24T09:45:31.837 DEBUG:teuthology.orchestra.run.smithi093:> sudo hostname smithi093 2024-01-24T09:45:31.904 DEBUG:teuthology.orchestra.run.smithi093:> cat /etc/os-release 2024-01-24T09:45:31.961 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="Red Hat Enterprise Linux" 2024-01-24T09:45:31.961 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="8.6 (Ootpa)" 2024-01-24T09:45:31.961 INFO:teuthology.orchestra.run.smithi093.stdout:ID="rhel" 2024-01-24T09:45:31.961 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE="fedora" 2024-01-24T09:45:31.961 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="8.6" 2024-01-24T09:45:31.961 INFO:teuthology.orchestra.run.smithi093.stdout:PLATFORM_ID="platform:el8" 2024-01-24T09:45:31.962 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-24T09:45:31.962 INFO:teuthology.orchestra.run.smithi093.stdout:ANSI_COLOR="0;31" 2024-01-24T09:45:31.962 INFO:teuthology.orchestra.run.smithi093.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-24T09:45:31.962 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://www.redhat.com/" 2024-01-24T09:45:31.962 INFO:teuthology.orchestra.run.smithi093.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-24T09:45:31.962 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-24T09:45:31.962 INFO:teuthology.orchestra.run.smithi093.stdout: 2024-01-24T09:45:31.962 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-24T09:45:31.962 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-24T09:45:31.962 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-24T09:45:31.962 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-24T09:45:31.962 INFO:teuthology.provision.fog.smithi093:Deploy complete! 2024-01-24T09:45:31.963 DEBUG:teuthology.parallel:result is None 2024-01-24T09:45:42.172 WARNING:teuthology.provision.fog.smithi105:timed out 2024-01-24T09:45:48.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T09:45:48.425 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-24T09:45:48.426 DEBUG:teuthology.orchestra.run.smithi105:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-24T09:45:48.682 INFO:teuthology.provision.fog.smithi105:Node is ready 2024-01-24T09:45:48.682 DEBUG:teuthology.orchestra.run.smithi105:> hostname 2024-01-24T09:45:48.699 INFO:teuthology.orchestra.run.smithi105.stdout:smithi105 2024-01-24T09:45:48.699 DEBUG:teuthology.orchestra.run.smithi105:> grep smithi105 /etc/hosts 2024-01-24T09:45:48.760 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.15.105 smithi105.front.sepia.ceph.com smithi105 2024-01-24T09:45:48.760 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105 2024-01-24T09:45:48.875 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105/smithi105/g' /etc/hosts 2024-01-24T09:45:48.902 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/172.21.15.105/172.21.15.105/g' /etc/hosts 2024-01-24T09:45:48.971 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105/smithi105/g' /etc/hostname 2024-01-24T09:45:49.040 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105 2024-01-24T09:45:49.109 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release 2024-01-24T09:45:49.168 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="Red Hat Enterprise Linux" 2024-01-24T09:45:49.168 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="8.6 (Ootpa)" 2024-01-24T09:45:49.168 INFO:teuthology.orchestra.run.smithi105.stdout:ID="rhel" 2024-01-24T09:45:49.169 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="fedora" 2024-01-24T09:45:49.169 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="8.6" 2024-01-24T09:45:49.169 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el8" 2024-01-24T09:45:49.169 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-24T09:45:49.169 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31" 2024-01-24T09:45:49.169 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-24T09:45:49.169 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://www.redhat.com/" 2024-01-24T09:45:49.170 INFO:teuthology.orchestra.run.smithi105.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-24T09:45:49.170 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-24T09:45:49.170 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-01-24T09:45:49.170 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-24T09:45:49.170 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-24T09:45:49.170 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-24T09:45:49.170 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-24T09:45:49.171 INFO:teuthology.provision.fog.smithi105:Deploy complete! 2024-01-24T09:45:49.172 DEBUG:teuthology.parallel:result is None 2024-01-24T09:45:49.394 INFO:teuthology.lock.ops:Checking smithi026.front.sepia.ceph.com 2024-01-24T09:45:49.394 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-24T09:45:49.432 INFO:teuthology.lock.ops:Checking smithi093.front.sepia.ceph.com 2024-01-24T09:45:49.432 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-24T09:45:49.456 INFO:teuthology.lock.ops:Checking smithi105.front.sepia.ceph.com 2024-01-24T09:45:49.457 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-24T09:45:49.482 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: set os type and version on server 2024-01-24T09:45:49.483 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2024-01-24T09:45:49.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T09:45:49.562 DEBUG:teuthology.orchestra.run.smithi026:> true 2024-01-24T09:45:49.705 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi026.front.sepia.ceph.com' 2024-01-24T09:45:49.705 DEBUG:teuthology.orchestra.run.smithi026:> uname -m 2024-01-24T09:45:49.766 INFO:teuthology.orchestra.run.smithi026.stdout:x86_64 2024-01-24T09:45:49.767 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2024-01-24T09:45:49.827 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="Red Hat Enterprise Linux" 2024-01-24T09:45:49.827 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="8.6 (Ootpa)" 2024-01-24T09:45:49.827 INFO:teuthology.orchestra.run.smithi026.stdout:ID="rhel" 2024-01-24T09:45:49.828 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="fedora" 2024-01-24T09:45:49.828 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="8.6" 2024-01-24T09:45:49.828 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el8" 2024-01-24T09:45:49.828 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-24T09:45:49.828 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31" 2024-01-24T09:45:49.828 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-24T09:45:49.828 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://www.redhat.com/" 2024-01-24T09:45:49.828 INFO:teuthology.orchestra.run.smithi026.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-24T09:45:49.828 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-24T09:45:49.828 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-24T09:45:49.828 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-24T09:45:49.828 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-24T09:45:49.828 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-24T09:45:49.828 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-24T09:45:49.829 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2024-01-24T09:45:49.849 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: set os type and version on server 2024-01-24T09:45:49.849 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com' 2024-01-24T09:45:49.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T09:45:49.922 DEBUG:teuthology.orchestra.run.smithi093:> true 2024-01-24T09:45:50.062 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi093.front.sepia.ceph.com' 2024-01-24T09:45:50.062 DEBUG:teuthology.orchestra.run.smithi093:> uname -m 2024-01-24T09:45:50.120 INFO:teuthology.orchestra.run.smithi093.stdout:x86_64 2024-01-24T09:45:50.121 DEBUG:teuthology.orchestra.run.smithi093:> cat /etc/os-release 2024-01-24T09:45:50.179 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="Red Hat Enterprise Linux" 2024-01-24T09:45:50.179 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="8.6 (Ootpa)" 2024-01-24T09:45:50.179 INFO:teuthology.orchestra.run.smithi093.stdout:ID="rhel" 2024-01-24T09:45:50.179 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE="fedora" 2024-01-24T09:45:50.179 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="8.6" 2024-01-24T09:45:50.179 INFO:teuthology.orchestra.run.smithi093.stdout:PLATFORM_ID="platform:el8" 2024-01-24T09:45:50.179 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-24T09:45:50.179 INFO:teuthology.orchestra.run.smithi093.stdout:ANSI_COLOR="0;31" 2024-01-24T09:45:50.179 INFO:teuthology.orchestra.run.smithi093.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-24T09:45:50.179 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://www.redhat.com/" 2024-01-24T09:45:50.179 INFO:teuthology.orchestra.run.smithi093.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-24T09:45:50.180 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-24T09:45:50.180 INFO:teuthology.orchestra.run.smithi093.stdout: 2024-01-24T09:45:50.180 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-24T09:45:50.180 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-24T09:45:50.180 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-24T09:45:50.180 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-24T09:45:50.180 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server 2024-01-24T09:45:50.207 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: set os type and version on server 2024-01-24T09:45:50.207 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2024-01-24T09:45:50.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T09:45:50.282 DEBUG:teuthology.orchestra.run.smithi105:> true 2024-01-24T09:45:50.352 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi105.front.sepia.ceph.com' 2024-01-24T09:45:50.352 DEBUG:teuthology.orchestra.run.smithi105:> uname -m 2024-01-24T09:45:50.411 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64 2024-01-24T09:45:50.412 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release 2024-01-24T09:45:50.471 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="Red Hat Enterprise Linux" 2024-01-24T09:45:50.472 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="8.6 (Ootpa)" 2024-01-24T09:45:50.472 INFO:teuthology.orchestra.run.smithi105.stdout:ID="rhel" 2024-01-24T09:45:50.472 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="fedora" 2024-01-24T09:45:50.472 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="8.6" 2024-01-24T09:45:50.472 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el8" 2024-01-24T09:45:50.472 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-24T09:45:50.472 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31" 2024-01-24T09:45:50.472 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-24T09:45:50.472 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://www.redhat.com/" 2024-01-24T09:45:50.472 INFO:teuthology.orchestra.run.smithi105.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-24T09:45:50.472 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-24T09:45:50.472 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-01-24T09:45:50.473 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-24T09:45:50.473 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-24T09:45:50.473 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-24T09:45:50.473 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-24T09:45:50.473 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2024-01-24T09:45:50.493 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-24T09:45:50.584 INFO:teuthology.dispatcher.supervisor:Running job 7528287 2024-01-24T09:45:50.584 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-01-23_14:05:57-fs-wip-vshankar-testing1-reef-2024-01-23-1317-testing-default-smithi/7528287 --name vshankar-2024-01-23_14:05:57-fs-wip-vshankar-testing1-reef-2024-01-23-1317-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/suites/fsx}} -- /home/teuthworker/archive/vshankar-2024-01-23_14:05:57-fs-wip-vshankar-testing1-reef-2024-01-23-1317-testing-default-smithi/7528287/orig.config.yaml 2024-01-24T09:45:50.587 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-01-23_14:05:57-fs-wip-vshankar-testing1-reef-2024-01-23-1317-testing-default-smithi/7528287 2024-01-24T09:45:50.588 INFO:teuthology.dispatcher.supervisor:Job PID: 1875048 2024-01-24T09:45:50.588 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-24T09:47:50.689 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-24T09:49:50.861 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-24T09:51:51.036 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-24T09:53:51.204 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-24T09:55:51.369 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-24T09:57:51.534 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-24T09:57:51.592 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-01-24T09:57:51.739 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2024-01-24T09:57:51.739 INFO:teuthology.nuke:Checking targets against current locks 2024-01-24T09:57:51.787 DEBUG:teuthology.nuke:shortname: smithi026 2024-01-24T09:57:51.787 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-24T09:57:51.816 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi026.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-23_14:05:57-fs-wip-vshankar-testing1-reef-2024-01-23-1317-testing-default-smithi/7528287', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-24 09:40:42.915038', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBlBhoezs1Nw3pum/9hSLxtXbe5nABrVLh5LOm7gYykFAOlexWXQkjo2I1KqP0bHLGLV51EpVDfZF4QlNXzJq+I='} 2024-01-24T09:57:51.817 DEBUG:teuthology.nuke:shortname: smithi093 2024-01-24T09:57:51.818 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-24T09:57:51.843 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi093.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-23_14:05:57-fs-wip-vshankar-testing1-reef-2024-01-23-1317-testing-default-smithi/7528287', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-24 09:40:42.913174', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPkndq/SUC2mCSi7fxgMKEC5UheE435Q3EcB8oodxpZknM1vCLf2H8pnYc1jsMj/9shDCeMkenNTh0G3wZvlyHo='} 2024-01-24T09:57:51.844 DEBUG:teuthology.nuke:shortname: smithi105 2024-01-24T09:57:51.844 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-24T09:57:51.863 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi105.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-23_14:05:57-fs-wip-vshankar-testing1-reef-2024-01-23-1317-testing-default-smithi/7528287', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-24 09:40:42.916782', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO4kZvmMBHzegcIHyBZlyV2pLbprb7ZZ9D/c8ax3pcECVSXkDjpp4YOrdM6IukDExL8+SBHCdIcBgmVGOBKKD3g='} 2024-01-24T09:57:51.873 INFO:teuthology.orchestra.console.smithi026:Power off 2024-01-24T09:57:51.873 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-24T09:57:51.895 DEBUG:teuthology.orchestra.console.smithi026:power off output: Chassis Power Control: Down/Off 2024-01-24T09:57:51.896 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T09:57:51.915 INFO:teuthology.orchestra.console.smithi093:Power off 2024-01-24T09:57:51.916 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-24T09:57:51.929 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off 2024-01-24T09:57:51.944 DEBUG:teuthology.orchestra.console.smithi093:power off output: Chassis Power Control: Down/Off 2024-01-24T09:57:51.944 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T09:57:51.958 INFO:teuthology.orchestra.console.smithi105:Power off 2024-01-24T09:57:51.958 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-24T09:57:51.968 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off 2024-01-24T09:57:51.979 DEBUG:teuthology.orchestra.console.smithi105:power off output: Chassis Power Control: Down/Off 2024-01-24T09:57:51.979 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T09:57:52.001 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2024-01-24T09:57:52.031 INFO:teuthology.orchestra.console.smithi026:Power off completed 2024-01-24T09:57:52.069 INFO:teuthology.orchestra.console.smithi093:Power off completed 2024-01-24T09:57:52.102 INFO:teuthology.orchestra.console.smithi105:Power off completed 2024-01-24T09:57:52.182 INFO:teuthology.lock.ops:unlocked: smithi026.front.sepia.ceph.com 2024-01-24T09:57:52.216 INFO:teuthology.lock.ops:unlocked: smithi093.front.sepia.ceph.com 2024-01-24T09:57:52.249 INFO:teuthology.lock.ops:unlocked: smithi105.front.sepia.ceph.com