2024-01-17T06:57:38.471 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-17T06:57:38.472 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-17T06:57:38.640 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fca3dbddc10>, signals=[15]) 2024-01-17T06:57:38.641 INFO:teuthology.lock.ops:Start node 'smithi026.front.sepia.ceph.com' reimaging 2024-01-17T06:57:38.641 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: reset os type and version on server 2024-01-17T06:57:38.641 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2024-01-17T06:57:38.661 INFO:teuthology.lock.ops:Start node 'smithi093.front.sepia.ceph.com' reimaging 2024-01-17T06:57:38.661 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: reset os type and version on server 2024-01-17T06:57:38.661 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server 2024-01-17T06:57:38.685 INFO:teuthology.lock.ops:Start node 'smithi137.front.sepia.ceph.com' reimaging 2024-01-17T06:57:38.685 INFO:teuthology.lock.ops:Updating [smithi137.front.sepia.ceph.com]: reset os type and version on server 2024-01-17T06:57:38.685 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server 2024-01-17T06:57:38.774 DEBUG:teuthology.provision.fog.smithi026:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-17T06:57:38.796 DEBUG:teuthology.provision.fog.smithi093:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-17T06:57:38.820 DEBUG:teuthology.provision.fog.smithi137:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-17T06:57:38.823 INFO:teuthology.provision.fog.smithi026:Scheduling deploy of rhel 8.6 2024-01-17T06:57:38.833 INFO:teuthology.provision.fog.smithi093:Scheduling deploy of rhel 8.6 2024-01-17T06:57:38.876 INFO:teuthology.provision.fog.smithi137:Scheduling deploy of rhel 8.6 2024-01-17T06:57:39.116 INFO:teuthology.orchestra.console.smithi093:Power off 2024-01-17T06:57:39.116 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-17T06:57:39.142 DEBUG:teuthology.orchestra.console.smithi093:power off output: Chassis Power Control: Down/Off 2024-01-17T06:57:39.142 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-17T06:57:39.158 INFO:teuthology.orchestra.console.smithi026:Power off 2024-01-17T06:57:39.158 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-17T06:57:39.171 INFO:teuthology.orchestra.console.smithi137:Power off 2024-01-17T06:57:39.171 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-17T06:57:39.179 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on 2024-01-17T06:57:39.180 DEBUG:teuthology.orchestra.console.smithi026:power off output: Chassis Power Control: Down/Off 2024-01-17T06:57:39.180 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-17T06:57:39.194 DEBUG:teuthology.orchestra.console.smithi137:power off output: Chassis Power Control: Down/Off 2024-01-17T06:57:39.194 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-17T06:57:39.202 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on 2024-01-17T06:57:39.222 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is on 2024-01-17T06:57:43.184 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-17T06:57:43.203 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-17T06:57:43.223 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-17T06:57:43.293 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on 2024-01-17T06:57:43.316 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on 2024-01-17T06:57:43.331 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is on 2024-01-17T06:57:47.299 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-17T06:57:47.317 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-17T06:57:47.333 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-17T06:57:47.409 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off 2024-01-17T06:57:47.426 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off 2024-01-17T06:57:47.443 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is on 2024-01-17T06:57:47.510 INFO:teuthology.orchestra.console.smithi093:Power off completed 2024-01-17T06:57:47.526 INFO:teuthology.orchestra.console.smithi026:Power off completed 2024-01-17T06:57:47.611 INFO:teuthology.orchestra.console.smithi093:Power on 2024-01-17T06:57:47.611 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-17T06:57:47.628 INFO:teuthology.orchestra.console.smithi026:Power on 2024-01-17T06:57:47.628 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-17T06:57:47.635 DEBUG:teuthology.orchestra.console.smithi093:power on output: Chassis Power Control: Up/On 2024-01-17T06:57:47.636 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-17T06:57:47.650 DEBUG:teuthology.orchestra.console.smithi026:power on output: Chassis Power Control: Up/On 2024-01-17T06:57:47.651 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-17T06:57:47.665 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off 2024-01-17T06:57:47.671 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off 2024-01-17T06:57:51.444 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-17T06:57:51.553 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is off 2024-01-17T06:57:51.653 INFO:teuthology.orchestra.console.smithi137:Power off completed 2024-01-17T06:57:51.667 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-17T06:57:51.673 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-17T06:57:51.755 INFO:teuthology.orchestra.console.smithi137:Power on 2024-01-17T06:57:51.755 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-17T06:57:51.775 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off 2024-01-17T06:57:51.776 DEBUG:teuthology.orchestra.console.smithi137:power on output: Chassis Power Control: Up/On 2024-01-17T06:57:51.777 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-17T06:57:51.784 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off 2024-01-17T06:57:51.799 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is off 2024-01-17T06:57:55.776 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-17T06:57:55.786 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-17T06:57:55.800 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-17T06:57:55.885 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on 2024-01-17T06:57:55.895 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on 2024-01-17T06:57:55.909 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is on 2024-01-17T06:57:55.986 INFO:teuthology.orchestra.console.smithi093:Power on completed 2024-01-17T06:57:55.995 INFO:teuthology.orchestra.console.smithi026:Power on completed 2024-01-17T06:57:56.010 INFO:teuthology.orchestra.console.smithi137:Power on completed 2024-01-17T06:57:56.087 INFO:teuthology.provision.fog.smithi093:Waiting for deploy to finish 2024-01-17T06:57:56.096 INFO:teuthology.provision.fog.smithi026:Waiting for deploy to finish 2024-01-17T06:57:56.111 INFO:teuthology.provision.fog.smithi137:Waiting for deploy to finish 2024-01-17T07:00:27.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T07:00:42.557 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T07:00:42.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T07:00:46.012 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2024-01-17T07:00:52.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T07:00:55.068 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2024-01-17T07:01:01.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T07:01:01.116 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2024-01-17T07:01:01.116 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-01-17T07:01:04.124 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2024-01-17T07:01:07.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T07:01:07.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T07:01:10.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T07:01:10.176 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2024-01-17T07:01:10.176 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-01-17T07:01:16.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T07:01:16.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T07:01:19.260 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2024-01-17T07:01:19.260 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-01-17T07:01:25.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T07:01:25.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T07:01:28.348 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2024-01-17T07:01:28.348 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-01-17T07:01:34.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T07:01:34.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T07:01:52.828 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-01-17T07:01:58.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T07:02:01.887 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-01-17T07:02:07.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T07:02:10.134 WARNING:teuthology.provision.fog.smithi026:timed out 2024-01-17T07:02:10.976 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-01-17T07:02:16.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T07:02:16.425 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-17T07:02:16.426 DEBUG:teuthology.orchestra.run.smithi026:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-17T07:02:16.703 INFO:teuthology.provision.fog.smithi026:Node is ready 2024-01-17T07:02:16.703 DEBUG:teuthology.orchestra.run.smithi026:> hostname 2024-01-17T07:02:16.724 INFO:teuthology.orchestra.run.smithi026.stdout:smithi026.front.sepia.ceph.com 2024-01-17T07:02:16.724 DEBUG:teuthology.orchestra.run.smithi026:> grep smithi026.front.sepia.ceph.com /etc/hosts 2024-01-17T07:02:16.785 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26 smithi026.front.sepia.ceph.com smithi026 2024-01-17T07:02:16.786 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026 2024-01-17T07:02:16.913 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi026.front.sepia.ceph.com/smithi026/g' /etc/hosts 2024-01-17T07:02:16.948 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/172.21.15.26/172.21.15.26/g' /etc/hosts 2024-01-17T07:02:16.977 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T07:02:17.068 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi026.front.sepia.ceph.com/smithi026/g' /etc/hostname 2024-01-17T07:02:17.144 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026 2024-01-17T07:02:17.218 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2024-01-17T07:02:17.279 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="Red Hat Enterprise Linux" 2024-01-17T07:02:17.279 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="8.6 (Ootpa)" 2024-01-17T07:02:17.279 INFO:teuthology.orchestra.run.smithi026.stdout:ID="rhel" 2024-01-17T07:02:17.280 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="fedora" 2024-01-17T07:02:17.280 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="8.6" 2024-01-17T07:02:17.280 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el8" 2024-01-17T07:02:17.280 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-17T07:02:17.280 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31" 2024-01-17T07:02:17.280 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-17T07:02:17.280 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://www.redhat.com/" 2024-01-17T07:02:17.280 INFO:teuthology.orchestra.run.smithi026.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-17T07:02:17.280 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-17T07:02:17.280 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T07:02:17.280 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-17T07:02:17.280 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-17T07:02:17.280 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-17T07:02:17.281 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-17T07:02:17.281 INFO:teuthology.provision.fog.smithi026:Deploy complete! 2024-01-17T07:02:17.284 DEBUG:teuthology.parallel:result is None 2024-01-17T07:02:17.284 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-17T07:02:17.284 DEBUG:teuthology.orchestra.run.smithi137:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-17T07:02:34.356 WARNING:teuthology.provision.fog.smithi093:timed out 2024-01-17T07:02:37.534 INFO:teuthology.provision.fog.smithi137:Node is ready 2024-01-17T07:02:37.534 DEBUG:teuthology.orchestra.run.smithi137:> hostname 2024-01-17T07:02:37.557 INFO:teuthology.orchestra.run.smithi137.stdout:smithi137 2024-01-17T07:02:37.557 DEBUG:teuthology.orchestra.run.smithi137:> grep smithi137 /etc/hosts 2024-01-17T07:02:37.617 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.137 smithi137.front.sepia.ceph.com smithi137 2024-01-17T07:02:37.619 DEBUG:teuthology.orchestra.run.smithi137:> sudo hostname smithi137 2024-01-17T07:02:37.756 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i -e 's/smithi137/smithi137/g' /etc/hosts 2024-01-17T07:02:37.785 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i -e 's/172.21.15.137/172.21.15.137/g' /etc/hosts 2024-01-17T07:02:37.854 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i -e 's/smithi137/smithi137/g' /etc/hostname 2024-01-17T07:02:37.922 DEBUG:teuthology.orchestra.run.smithi137:> sudo hostname smithi137 2024-01-17T07:02:37.989 DEBUG:teuthology.orchestra.run.smithi137:> cat /etc/os-release 2024-01-17T07:02:38.045 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="Red Hat Enterprise Linux" 2024-01-17T07:02:38.046 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="8.6 (Ootpa)" 2024-01-17T07:02:38.047 INFO:teuthology.orchestra.run.smithi137.stdout:ID="rhel" 2024-01-17T07:02:38.047 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE="fedora" 2024-01-17T07:02:38.047 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="8.6" 2024-01-17T07:02:38.047 INFO:teuthology.orchestra.run.smithi137.stdout:PLATFORM_ID="platform:el8" 2024-01-17T07:02:38.047 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-17T07:02:38.047 INFO:teuthology.orchestra.run.smithi137.stdout:ANSI_COLOR="0;31" 2024-01-17T07:02:38.047 INFO:teuthology.orchestra.run.smithi137.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-17T07:02:38.047 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://www.redhat.com/" 2024-01-17T07:02:38.047 INFO:teuthology.orchestra.run.smithi137.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-17T07:02:38.047 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-17T07:02:38.047 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T07:02:38.047 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-17T07:02:38.047 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-17T07:02:38.047 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-17T07:02:38.047 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-17T07:02:38.048 INFO:teuthology.provision.fog.smithi137:Deploy complete! 2024-01-17T07:02:38.048 DEBUG:teuthology.parallel:result is None 2024-01-17T07:02:40.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T07:02:40.616 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-17T07:02:40.617 DEBUG:teuthology.orchestra.run.smithi093:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-17T07:02:40.883 INFO:teuthology.provision.fog.smithi093:Node is ready 2024-01-17T07:02:40.883 DEBUG:teuthology.orchestra.run.smithi093:> hostname 2024-01-17T07:02:40.900 INFO:teuthology.orchestra.run.smithi093.stdout:smithi093 2024-01-17T07:02:40.901 DEBUG:teuthology.orchestra.run.smithi093:> grep smithi093 /etc/hosts 2024-01-17T07:02:40.958 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93 smithi093.front.sepia.ceph.com smithi093 2024-01-17T07:02:40.958 DEBUG:teuthology.orchestra.run.smithi093:> sudo hostname smithi093 2024-01-17T07:02:41.079 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/smithi093/smithi093/g' /etc/hosts 2024-01-17T07:02:41.106 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/172.21.15.93/172.21.15.93/g' /etc/hosts 2024-01-17T07:02:41.173 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/smithi093/smithi093/g' /etc/hostname 2024-01-17T07:02:41.241 DEBUG:teuthology.orchestra.run.smithi093:> sudo hostname smithi093 2024-01-17T07:02:41.306 DEBUG:teuthology.orchestra.run.smithi093:> cat /etc/os-release 2024-01-17T07:02:41.363 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="Red Hat Enterprise Linux" 2024-01-17T07:02:41.363 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="8.6 (Ootpa)" 2024-01-17T07:02:41.364 INFO:teuthology.orchestra.run.smithi093.stdout:ID="rhel" 2024-01-17T07:02:41.364 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE="fedora" 2024-01-17T07:02:41.364 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="8.6" 2024-01-17T07:02:41.364 INFO:teuthology.orchestra.run.smithi093.stdout:PLATFORM_ID="platform:el8" 2024-01-17T07:02:41.364 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-17T07:02:41.364 INFO:teuthology.orchestra.run.smithi093.stdout:ANSI_COLOR="0;31" 2024-01-17T07:02:41.364 INFO:teuthology.orchestra.run.smithi093.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-17T07:02:41.364 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://www.redhat.com/" 2024-01-17T07:02:41.364 INFO:teuthology.orchestra.run.smithi093.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-17T07:02:41.364 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-17T07:02:41.364 INFO:teuthology.orchestra.run.smithi093.stdout: 2024-01-17T07:02:41.364 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-17T07:02:41.365 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-17T07:02:41.365 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-17T07:02:41.365 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-17T07:02:41.365 INFO:teuthology.provision.fog.smithi093:Deploy complete! 2024-01-17T07:02:41.365 DEBUG:teuthology.parallel:result is None 2024-01-17T07:02:41.556 INFO:teuthology.lock.ops:Checking smithi026.front.sepia.ceph.com 2024-01-17T07:02:41.556 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-17T07:02:41.575 INFO:teuthology.lock.ops:Checking smithi093.front.sepia.ceph.com 2024-01-17T07:02:41.575 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-17T07:02:41.591 INFO:teuthology.lock.ops:Checking smithi137.front.sepia.ceph.com 2024-01-17T07:02:41.591 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-17T07:02:41.609 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: set os type and version on server 2024-01-17T07:02:41.609 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2024-01-17T07:02:41.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T07:02:41.686 DEBUG:teuthology.orchestra.run.smithi026:> true 2024-01-17T07:02:41.832 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi026.front.sepia.ceph.com' 2024-01-17T07:02:41.832 DEBUG:teuthology.orchestra.run.smithi026:> uname -m 2024-01-17T07:02:41.893 INFO:teuthology.orchestra.run.smithi026.stdout:x86_64 2024-01-17T07:02:41.893 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2024-01-17T07:02:41.953 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="Red Hat Enterprise Linux" 2024-01-17T07:02:41.954 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="8.6 (Ootpa)" 2024-01-17T07:02:41.954 INFO:teuthology.orchestra.run.smithi026.stdout:ID="rhel" 2024-01-17T07:02:41.954 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="fedora" 2024-01-17T07:02:41.954 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="8.6" 2024-01-17T07:02:41.954 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el8" 2024-01-17T07:02:41.954 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-17T07:02:41.954 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31" 2024-01-17T07:02:41.954 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-17T07:02:41.954 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://www.redhat.com/" 2024-01-17T07:02:41.954 INFO:teuthology.orchestra.run.smithi026.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-17T07:02:41.954 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-17T07:02:41.954 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T07:02:41.954 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-17T07:02:41.954 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-17T07:02:41.955 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-17T07:02:41.955 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-17T07:02:41.955 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2024-01-17T07:02:41.975 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: set os type and version on server 2024-01-17T07:02:41.975 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com' 2024-01-17T07:02:41.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T07:02:42.046 DEBUG:teuthology.orchestra.run.smithi093:> true 2024-01-17T07:02:42.113 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi093.front.sepia.ceph.com' 2024-01-17T07:02:42.113 DEBUG:teuthology.orchestra.run.smithi093:> uname -m 2024-01-17T07:02:42.169 INFO:teuthology.orchestra.run.smithi093.stdout:x86_64 2024-01-17T07:02:42.169 DEBUG:teuthology.orchestra.run.smithi093:> cat /etc/os-release 2024-01-17T07:02:42.226 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="Red Hat Enterprise Linux" 2024-01-17T07:02:42.226 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="8.6 (Ootpa)" 2024-01-17T07:02:42.226 INFO:teuthology.orchestra.run.smithi093.stdout:ID="rhel" 2024-01-17T07:02:42.226 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE="fedora" 2024-01-17T07:02:42.226 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="8.6" 2024-01-17T07:02:42.227 INFO:teuthology.orchestra.run.smithi093.stdout:PLATFORM_ID="platform:el8" 2024-01-17T07:02:42.227 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-17T07:02:42.227 INFO:teuthology.orchestra.run.smithi093.stdout:ANSI_COLOR="0;31" 2024-01-17T07:02:42.227 INFO:teuthology.orchestra.run.smithi093.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-17T07:02:42.227 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://www.redhat.com/" 2024-01-17T07:02:42.227 INFO:teuthology.orchestra.run.smithi093.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-17T07:02:42.227 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-17T07:02:42.227 INFO:teuthology.orchestra.run.smithi093.stdout: 2024-01-17T07:02:42.227 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-17T07:02:42.227 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-17T07:02:42.227 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-17T07:02:42.227 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-17T07:02:42.228 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server 2024-01-17T07:02:42.250 INFO:teuthology.lock.ops:Updating [smithi137.front.sepia.ceph.com]: set os type and version on server 2024-01-17T07:02:42.250 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-01-17T07:02:42.250 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T07:02:42.323 DEBUG:teuthology.orchestra.run.smithi137:> true 2024-01-17T07:02:42.395 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-01-17T07:02:42.395 DEBUG:teuthology.orchestra.run.smithi137:> uname -m 2024-01-17T07:02:42.453 INFO:teuthology.orchestra.run.smithi137.stdout:x86_64 2024-01-17T07:02:42.453 DEBUG:teuthology.orchestra.run.smithi137:> cat /etc/os-release 2024-01-17T07:02:42.511 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="Red Hat Enterprise Linux" 2024-01-17T07:02:42.512 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="8.6 (Ootpa)" 2024-01-17T07:02:42.512 INFO:teuthology.orchestra.run.smithi137.stdout:ID="rhel" 2024-01-17T07:02:42.512 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE="fedora" 2024-01-17T07:02:42.512 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="8.6" 2024-01-17T07:02:42.512 INFO:teuthology.orchestra.run.smithi137.stdout:PLATFORM_ID="platform:el8" 2024-01-17T07:02:42.512 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-17T07:02:42.512 INFO:teuthology.orchestra.run.smithi137.stdout:ANSI_COLOR="0;31" 2024-01-17T07:02:42.512 INFO:teuthology.orchestra.run.smithi137.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-17T07:02:42.512 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://www.redhat.com/" 2024-01-17T07:02:42.512 INFO:teuthology.orchestra.run.smithi137.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-17T07:02:42.512 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-17T07:02:42.512 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T07:02:42.512 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-17T07:02:42.513 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-17T07:02:42.513 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-17T07:02:42.513 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-17T07:02:42.513 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server 2024-01-17T07:02:42.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-17T07:02:42.626 INFO:teuthology.dispatcher.supervisor:Running job 7518739 2024-01-17T07:02:42.627 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_khiremat@teuthology --archive /home/teuthworker/archive/khiremat-2024-01-17_06:35:36-fs:workload-wip-khiremat-49945-referent-inode-0-distro-default-smithi/7518739 --name khiremat-2024-01-17_06:35:36-fs:workload-wip-khiremat-49945-referent-inode-0-distro-default-smithi --description fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout single_mds} ranks/1 standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/suites/iogen}} -- /home/teuthworker/archive/khiremat-2024-01-17_06:35:36-fs:workload-wip-khiremat-49945-referent-inode-0-distro-default-smithi/7518739/orig.config.yaml 2024-01-17T07:02:42.630 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/khiremat-2024-01-17_06:35:36-fs:workload-wip-khiremat-49945-referent-inode-0-distro-default-smithi/7518739 2024-01-17T07:02:42.630 INFO:teuthology.dispatcher.supervisor:Job PID: 845609 2024-01-17T07:02:42.630 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-17T07:04:42.730 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-17T07:06:42.896 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-17T07:08:43.056 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-17T07:10:43.228 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-17T07:12:43.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-17T07:14:43.554 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-17T07:16:43.724 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-17T07:16:43.794 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-01-17T07:16:43.932 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2024-01-17T07:16:43.932 INFO:teuthology.nuke:Checking targets against current locks 2024-01-17T07:16:43.976 DEBUG:teuthology.nuke:shortname: smithi026 2024-01-17T07:16:43.976 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-17T07:16:44.001 DEBUG:teuthology.nuke:shortname: smithi093 2024-01-17T07:16:44.001 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-17T07:16:44.005 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi026.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/khiremat-2024-01-17_06:35:36-fs:workload-wip-khiremat-49945-referent-inode-0-distro-default-smithi/7518739', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-17 06:57:37.410509', 'locked_by': 'scheduled_khiremat@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBTgk70EY5JJEmYvTc87h1NwewFib4wGqC/JfwVBpZ0ixxcZOESgnNUBl42PN8qxSaf4iVPu5Y5E2uRgxG+mgOs='} 2024-01-17T07:16:44.025 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi093.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/khiremat-2024-01-17_06:35:36-fs:workload-wip-khiremat-49945-referent-inode-0-distro-default-smithi/7518739', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-17 06:57:37.408917', 'locked_by': 'scheduled_khiremat@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJBXS+XOhTwvgKjEdxMiTNX1nvEWcYJrz9BJp3cMsKqTMqqVFIw0Z2Kdubibg0Snl0IFCIguFtevA6jSGfqFbV0='} 2024-01-17T07:16:44.029 DEBUG:teuthology.nuke:shortname: smithi137 2024-01-17T07:16:44.029 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-17T07:16:44.059 INFO:teuthology.orchestra.console.smithi026:Power off 2024-01-17T07:16:44.059 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-17T07:16:44.066 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi137.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/khiremat-2024-01-17_06:35:36-fs:workload-wip-khiremat-49945-referent-inode-0-distro-default-smithi/7518739', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-17 06:57:37.412066', 'locked_by': 'scheduled_khiremat@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNxZiHSJl+1QuSOv0i0bVCRfm/5t7qI8TzZBuMcWviQ4R26dZk2ZmSVnmzR9My81G6EbRPJ5JdPhpjpUKmGf2z8='} 2024-01-17T07:16:44.080 DEBUG:teuthology.orchestra.console.smithi026:power off output: Chassis Power Control: Down/Off 2024-01-17T07:16:44.080 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-17T07:16:44.095 INFO:teuthology.orchestra.console.smithi093:Power off 2024-01-17T07:16:44.096 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-17T07:16:44.106 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off 2024-01-17T07:16:44.116 DEBUG:teuthology.orchestra.console.smithi093:power off output: Chassis Power Control: Down/Off 2024-01-17T07:16:44.116 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-17T07:16:44.133 INFO:teuthology.orchestra.console.smithi137:Power off 2024-01-17T07:16:44.133 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-17T07:16:44.141 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off 2024-01-17T07:16:44.155 DEBUG:teuthology.orchestra.console.smithi137:power off output: Chassis Power Control: Down/Off 2024-01-17T07:16:44.155 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-17T07:16:44.176 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is off 2024-01-17T07:16:44.207 INFO:teuthology.orchestra.console.smithi026:Power off completed 2024-01-17T07:16:44.242 INFO:teuthology.orchestra.console.smithi093:Power off completed 2024-01-17T07:16:44.277 INFO:teuthology.orchestra.console.smithi137:Power off completed 2024-01-17T07:16:44.360 INFO:teuthology.lock.ops:unlocked: smithi026.front.sepia.ceph.com 2024-01-17T07:16:44.383 INFO:teuthology.lock.ops:unlocked: smithi093.front.sepia.ceph.com 2024-01-17T07:16:44.425 INFO:teuthology.lock.ops:unlocked: smithi137.front.sepia.ceph.com