2023-12-13T23:34:43.594 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-13T23:34:43.595 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T23:34:43.779 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb633f17940>, signals=[15]) 2023-12-13T23:34:43.779 INFO:teuthology.lock.ops:Start node 'smithi069.front.sepia.ceph.com' reimaging 2023-12-13T23:34:43.780 INFO:teuthology.lock.ops:Updating [smithi069.front.sepia.ceph.com]: reset os type and version on server 2023-12-13T23:34:43.780 INFO:teuthology.lock.ops:Updating smithi069.front.sepia.ceph.com on lock server 2023-12-13T23:34:43.804 INFO:teuthology.lock.ops:Start node 'smithi070.front.sepia.ceph.com' reimaging 2023-12-13T23:34:43.805 INFO:teuthology.lock.ops:Updating [smithi070.front.sepia.ceph.com]: reset os type and version on server 2023-12-13T23:34:43.805 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server 2023-12-13T23:34:43.829 INFO:teuthology.lock.ops:Start node 'smithi186.front.sepia.ceph.com' reimaging 2023-12-13T23:34:43.829 INFO:teuthology.lock.ops:Updating [smithi186.front.sepia.ceph.com]: reset os type and version on server 2023-12-13T23:34:43.829 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server 2023-12-13T23:34:43.920 DEBUG:teuthology.provision.fog.smithi069:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-13T23:34:43.926 DEBUG:teuthology.provision.fog.smithi070:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-13T23:34:43.958 INFO:teuthology.provision.fog.smithi069:Scheduling deploy of rhel 8.6 2023-12-13T23:34:43.965 INFO:teuthology.provision.fog.smithi070:Scheduling deploy of rhel 8.6 2023-12-13T23:34:43.968 DEBUG:teuthology.provision.fog.smithi186:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-13T23:34:44.004 INFO:teuthology.provision.fog.smithi186:Scheduling deploy of rhel 8.6 2023-12-13T23:34:44.303 INFO:teuthology.orchestra.console.smithi069:Power off 2023-12-13T23:34:44.303 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-13T23:34:44.320 INFO:teuthology.orchestra.console.smithi070:Power off 2023-12-13T23:34:44.321 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-13T23:34:44.334 DEBUG:teuthology.orchestra.console.smithi069:power off output: Chassis Power Control: Down/Off 2023-12-13T23:34:44.334 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:34:44.345 DEBUG:teuthology.orchestra.console.smithi070:power off output: Chassis Power Control: Down/Off 2023-12-13T23:34:44.345 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:34:44.356 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2023-12-13T23:34:44.372 INFO:teuthology.orchestra.console.smithi186:Power off 2023-12-13T23:34:44.372 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-13T23:34:44.380 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is off 2023-12-13T23:34:44.394 DEBUG:teuthology.orchestra.console.smithi186:power off output: Chassis Power Control: Down/Off 2023-12-13T23:34:44.394 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:34:44.420 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2023-12-13T23:34:44.457 INFO:teuthology.orchestra.console.smithi069:Power off completed 2023-12-13T23:34:44.481 INFO:teuthology.orchestra.console.smithi070:Power off completed 2023-12-13T23:34:44.521 INFO:teuthology.orchestra.console.smithi186:Power off completed 2023-12-13T23:34:44.559 INFO:teuthology.orchestra.console.smithi069:Power on 2023-12-13T23:34:44.559 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-13T23:34:44.583 INFO:teuthology.orchestra.console.smithi070:Power on 2023-12-13T23:34:44.583 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-13T23:34:44.591 DEBUG:teuthology.orchestra.console.smithi069:power on output: Chassis Power Control: Up/On 2023-12-13T23:34:44.591 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:34:44.605 DEBUG:teuthology.orchestra.console.smithi070:power on output: Chassis Power Control: Up/On 2023-12-13T23:34:44.606 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:34:44.620 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2023-12-13T23:34:44.622 INFO:teuthology.orchestra.console.smithi186:Power on 2023-12-13T23:34:44.622 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-13T23:34:44.631 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is off 2023-12-13T23:34:44.642 DEBUG:teuthology.orchestra.console.smithi186:power on output: Chassis Power Control: Up/On 2023-12-13T23:34:44.642 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:34:44.663 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2023-12-13T23:34:48.626 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:34:48.632 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:34:48.666 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:34:48.735 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2023-12-13T23:34:48.740 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is off 2023-12-13T23:34:48.775 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2023-12-13T23:34:48.876 INFO:teuthology.orchestra.console.smithi186:Power on completed 2023-12-13T23:34:48.976 INFO:teuthology.provision.fog.smithi186:Waiting for deploy to finish 2023-12-13T23:34:52.737 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:34:52.745 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:34:52.847 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2023-12-13T23:34:52.853 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is on 2023-12-13T23:34:52.948 INFO:teuthology.orchestra.console.smithi069:Power on completed 2023-12-13T23:34:52.954 INFO:teuthology.orchestra.console.smithi070:Power on completed 2023-12-13T23:34:53.049 INFO:teuthology.provision.fog.smithi069:Waiting for deploy to finish 2023-12-13T23:34:53.055 INFO:teuthology.provision.fog.smithi070:Waiting for deploy to finish 2023-12-13T23:37:23.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:37:26.898 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-12-13T23:37:32.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:37:34.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:37:35.953 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-12-13T23:37:37.969 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-12-13T23:37:38.884 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:37:41.937 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2023-12-13T23:37:41.954 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:37:43.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:37:45.009 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-12-13T23:37:47.029 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-12-13T23:37:47.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:37:50.993 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2023-12-13T23:37:51.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:37:53.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:37:54.065 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-12-13T23:37:56.113 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-12-13T23:37:56.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:38:00.049 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2023-12-13T23:38:00.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:38:02.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:38:03.121 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-12-13T23:38:05.173 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-12-13T23:38:06.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:38:09.105 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2023-12-13T23:38:09.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:38:11.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:38:12.177 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-12-13T23:38:14.225 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-12-13T23:38:15.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:38:18.161 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2023-12-13T23:38:18.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:38:20.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:38:21.233 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-12-13T23:38:23.281 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-12-13T23:38:24.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:38:27.221 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2023-12-13T23:38:27.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:38:29.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:38:32.341 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-12-13T23:38:33.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:38:38.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:38:56.918 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-12-13T23:39:02.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:39:06.001 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-12-13T23:39:12.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:39:13.903 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-13T23:39:13.903 DEBUG:teuthology.orchestra.run.smithi186:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-13T23:39:14.223 INFO:teuthology.provision.fog.smithi186:Node is ready 2023-12-13T23:39:14.223 DEBUG:teuthology.orchestra.run.smithi186:> hostname 2023-12-13T23:39:14.240 INFO:teuthology.orchestra.run.smithi186.stdout:smithi022 2023-12-13T23:39:14.240 DEBUG:teuthology.orchestra.run.smithi186:> grep smithi022 /etc/hosts 2023-12-13T23:39:14.296 INFO:teuthology.orchestra.run.smithi186.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-12-13T23:39:14.297 DEBUG:teuthology.orchestra.run.smithi186:> sudo hostname smithi186 2023-12-13T23:39:14.416 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/smithi022/smithi186/g' /etc/hosts 2023-12-13T23:39:14.443 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/172.21.15.22/172.21.15.186/g' /etc/hosts 2023-12-13T23:39:14.510 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/smithi022/smithi186/g' /etc/hostname 2023-12-13T23:39:14.577 DEBUG:teuthology.orchestra.run.smithi186:> sudo hostname smithi186 2023-12-13T23:39:14.643 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release 2023-12-13T23:39:14.703 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="Red Hat Enterprise Linux" 2023-12-13T23:39:14.703 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="8.6 (Ootpa)" 2023-12-13T23:39:14.703 INFO:teuthology.orchestra.run.smithi186.stdout:ID="rhel" 2023-12-13T23:39:14.704 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE="fedora" 2023-12-13T23:39:14.704 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="8.6" 2023-12-13T23:39:14.704 INFO:teuthology.orchestra.run.smithi186.stdout:PLATFORM_ID="platform:el8" 2023-12-13T23:39:14.704 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-13T23:39:14.704 INFO:teuthology.orchestra.run.smithi186.stdout:ANSI_COLOR="0;31" 2023-12-13T23:39:14.704 INFO:teuthology.orchestra.run.smithi186.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-13T23:39:14.704 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://www.redhat.com/" 2023-12-13T23:39:14.704 INFO:teuthology.orchestra.run.smithi186.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-13T23:39:14.704 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-13T23:39:14.704 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-12-13T23:39:14.704 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-13T23:39:14.704 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-13T23:39:14.704 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-13T23:39:14.705 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-13T23:39:14.705 INFO:teuthology.provision.fog.smithi186:Deploy complete! 2023-12-13T23:39:14.707 DEBUG:teuthology.parallel:result is None 2023-12-13T23:39:27.250 WARNING:teuthology.provision.fog.smithi069:timed out 2023-12-13T23:39:33.229 WARNING:teuthology.provision.fog.smithi070:timed out 2023-12-13T23:39:33.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:39:33.582 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-13T23:39:33.582 DEBUG:teuthology.orchestra.run.smithi069:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-13T23:39:33.892 INFO:teuthology.provision.fog.smithi069:Node is ready 2023-12-13T23:39:33.893 DEBUG:teuthology.orchestra.run.smithi069:> hostname 2023-12-13T23:39:33.911 INFO:teuthology.orchestra.run.smithi069.stdout:smithi069.front.sepia.ceph.com 2023-12-13T23:39:33.912 DEBUG:teuthology.orchestra.run.smithi069:> grep smithi069.front.sepia.ceph.com /etc/hosts 2023-12-13T23:39:33.971 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69 smithi069.front.sepia.ceph.com smithi069 2023-12-13T23:39:33.971 DEBUG:teuthology.orchestra.run.smithi069:> sudo hostname smithi069 2023-12-13T23:39:34.093 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/smithi069.front.sepia.ceph.com/smithi069/g' /etc/hosts 2023-12-13T23:39:34.123 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/172.21.15.69/172.21.15.69/g' /etc/hosts 2023-12-13T23:39:34.192 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/smithi069.front.sepia.ceph.com/smithi069/g' /etc/hostname 2023-12-13T23:39:34.260 DEBUG:teuthology.orchestra.run.smithi069:> sudo hostname smithi069 2023-12-13T23:39:34.327 DEBUG:teuthology.orchestra.run.smithi069:> cat /etc/os-release 2023-12-13T23:39:34.384 INFO:teuthology.orchestra.run.smithi069.stdout:NAME="Red Hat Enterprise Linux" 2023-12-13T23:39:34.384 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION="8.6 (Ootpa)" 2023-12-13T23:39:34.384 INFO:teuthology.orchestra.run.smithi069.stdout:ID="rhel" 2023-12-13T23:39:34.384 INFO:teuthology.orchestra.run.smithi069.stdout:ID_LIKE="fedora" 2023-12-13T23:39:34.384 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_ID="8.6" 2023-12-13T23:39:34.384 INFO:teuthology.orchestra.run.smithi069.stdout:PLATFORM_ID="platform:el8" 2023-12-13T23:39:34.385 INFO:teuthology.orchestra.run.smithi069.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-13T23:39:34.385 INFO:teuthology.orchestra.run.smithi069.stdout:ANSI_COLOR="0;31" 2023-12-13T23:39:34.385 INFO:teuthology.orchestra.run.smithi069.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-13T23:39:34.385 INFO:teuthology.orchestra.run.smithi069.stdout:HOME_URL="https://www.redhat.com/" 2023-12-13T23:39:34.385 INFO:teuthology.orchestra.run.smithi069.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-13T23:39:34.385 INFO:teuthology.orchestra.run.smithi069.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-13T23:39:34.385 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-13T23:39:34.385 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-13T23:39:34.385 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-13T23:39:34.385 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-13T23:39:34.385 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-13T23:39:34.386 INFO:teuthology.provision.fog.smithi069:Deploy complete! 2023-12-13T23:39:34.386 DEBUG:teuthology.parallel:result is None 2023-12-13T23:39:39.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:39:39.961 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-13T23:39:40.355 DEBUG:teuthology.orchestra.run.smithi070:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-13T23:39:40.429 INFO:teuthology.provision.fog.smithi070:Node is ready 2023-12-13T23:39:40.429 DEBUG:teuthology.orchestra.run.smithi070:> hostname 2023-12-13T23:39:40.448 INFO:teuthology.orchestra.run.smithi070.stdout:smithi070.front.sepia.ceph.com 2023-12-13T23:39:40.449 DEBUG:teuthology.orchestra.run.smithi070:> grep smithi070.front.sepia.ceph.com /etc/hosts 2023-12-13T23:39:40.508 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70 smithi070.front.sepia.ceph.com smithi070 2023-12-13T23:39:40.508 DEBUG:teuthology.orchestra.run.smithi070:> sudo hostname smithi070 2023-12-13T23:39:40.630 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i -e 's/smithi070.front.sepia.ceph.com/smithi070/g' /etc/hosts 2023-12-13T23:39:40.661 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i -e 's/172.21.15.70/172.21.15.70/g' /etc/hosts 2023-12-13T23:39:40.730 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i -e 's/smithi070.front.sepia.ceph.com/smithi070/g' /etc/hostname 2023-12-13T23:39:40.799 DEBUG:teuthology.orchestra.run.smithi070:> sudo hostname smithi070 2023-12-13T23:39:40.867 DEBUG:teuthology.orchestra.run.smithi070:> cat /etc/os-release 2023-12-13T23:39:40.925 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="Red Hat Enterprise Linux" 2023-12-13T23:39:40.925 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="8.6 (Ootpa)" 2023-12-13T23:39:40.925 INFO:teuthology.orchestra.run.smithi070.stdout:ID="rhel" 2023-12-13T23:39:40.925 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE="fedora" 2023-12-13T23:39:40.926 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="8.6" 2023-12-13T23:39:40.926 INFO:teuthology.orchestra.run.smithi070.stdout:PLATFORM_ID="platform:el8" 2023-12-13T23:39:40.926 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-13T23:39:40.926 INFO:teuthology.orchestra.run.smithi070.stdout:ANSI_COLOR="0;31" 2023-12-13T23:39:40.926 INFO:teuthology.orchestra.run.smithi070.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-13T23:39:40.926 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://www.redhat.com/" 2023-12-13T23:39:40.926 INFO:teuthology.orchestra.run.smithi070.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-13T23:39:40.926 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-13T23:39:40.926 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-12-13T23:39:40.926 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-13T23:39:40.926 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-13T23:39:40.927 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-13T23:39:40.927 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-13T23:39:40.927 INFO:teuthology.provision.fog.smithi070:Deploy complete! 2023-12-13T23:39:40.928 DEBUG:teuthology.parallel:result is None 2023-12-13T23:39:41.151 INFO:teuthology.lock.ops:Checking smithi069.front.sepia.ceph.com 2023-12-13T23:39:41.151 INFO:teuthology.lock.ops:Checking smithi070.front.sepia.ceph.com 2023-12-13T23:39:41.152 INFO:teuthology.lock.ops:Checking smithi186.front.sepia.ceph.com 2023-12-13T23:39:41.153 INFO:teuthology.lock.ops:Updating [smithi069.front.sepia.ceph.com]: set os type and version on server 2023-12-13T23:39:41.153 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-12-13T23:39:41.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:39:41.221 DEBUG:teuthology.orchestra.run.smithi069:> true 2023-12-13T23:39:41.293 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-12-13T23:39:41.293 DEBUG:teuthology.orchestra.run.smithi069:> uname -m 2023-12-13T23:39:41.352 INFO:teuthology.orchestra.run.smithi069.stdout:x86_64 2023-12-13T23:39:41.353 DEBUG:teuthology.orchestra.run.smithi069:> cat /etc/os-release 2023-12-13T23:39:41.411 INFO:teuthology.orchestra.run.smithi069.stdout:NAME="Red Hat Enterprise Linux" 2023-12-13T23:39:41.411 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION="8.6 (Ootpa)" 2023-12-13T23:39:41.411 INFO:teuthology.orchestra.run.smithi069.stdout:ID="rhel" 2023-12-13T23:39:41.412 INFO:teuthology.orchestra.run.smithi069.stdout:ID_LIKE="fedora" 2023-12-13T23:39:41.412 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_ID="8.6" 2023-12-13T23:39:41.412 INFO:teuthology.orchestra.run.smithi069.stdout:PLATFORM_ID="platform:el8" 2023-12-13T23:39:41.412 INFO:teuthology.orchestra.run.smithi069.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-13T23:39:41.412 INFO:teuthology.orchestra.run.smithi069.stdout:ANSI_COLOR="0;31" 2023-12-13T23:39:41.412 INFO:teuthology.orchestra.run.smithi069.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-13T23:39:41.412 INFO:teuthology.orchestra.run.smithi069.stdout:HOME_URL="https://www.redhat.com/" 2023-12-13T23:39:41.412 INFO:teuthology.orchestra.run.smithi069.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-13T23:39:41.412 INFO:teuthology.orchestra.run.smithi069.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-13T23:39:41.412 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-13T23:39:41.412 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-13T23:39:41.412 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-13T23:39:41.413 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-13T23:39:41.413 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-13T23:39:41.414 INFO:teuthology.lock.ops:Updating smithi069.front.sepia.ceph.com on lock server 2023-12-13T23:39:41.442 INFO:teuthology.lock.ops:Updating [smithi070.front.sepia.ceph.com]: set os type and version on server 2023-12-13T23:39:41.442 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2023-12-13T23:39:41.442 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:39:41.509 DEBUG:teuthology.orchestra.run.smithi070:> true 2023-12-13T23:39:41.581 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com' 2023-12-13T23:39:41.581 DEBUG:teuthology.orchestra.run.smithi070:> uname -m 2023-12-13T23:39:41.640 INFO:teuthology.orchestra.run.smithi070.stdout:x86_64 2023-12-13T23:39:41.641 DEBUG:teuthology.orchestra.run.smithi070:> cat /etc/os-release 2023-12-13T23:39:41.699 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="Red Hat Enterprise Linux" 2023-12-13T23:39:41.700 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="8.6 (Ootpa)" 2023-12-13T23:39:41.700 INFO:teuthology.orchestra.run.smithi070.stdout:ID="rhel" 2023-12-13T23:39:41.700 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE="fedora" 2023-12-13T23:39:41.700 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="8.6" 2023-12-13T23:39:41.700 INFO:teuthology.orchestra.run.smithi070.stdout:PLATFORM_ID="platform:el8" 2023-12-13T23:39:41.700 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-13T23:39:41.700 INFO:teuthology.orchestra.run.smithi070.stdout:ANSI_COLOR="0;31" 2023-12-13T23:39:41.700 INFO:teuthology.orchestra.run.smithi070.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-13T23:39:41.700 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://www.redhat.com/" 2023-12-13T23:39:41.700 INFO:teuthology.orchestra.run.smithi070.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-13T23:39:41.700 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-13T23:39:41.700 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-12-13T23:39:41.701 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-13T23:39:41.701 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-13T23:39:41.701 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-13T23:39:41.701 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-13T23:39:41.701 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server 2023-12-13T23:39:41.724 INFO:teuthology.lock.ops:Updating [smithi186.front.sepia.ceph.com]: set os type and version on server 2023-12-13T23:39:41.724 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2023-12-13T23:39:41.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:39:41.792 DEBUG:teuthology.orchestra.run.smithi186:> true 2023-12-13T23:39:41.923 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi186.front.sepia.ceph.com' 2023-12-13T23:39:41.924 DEBUG:teuthology.orchestra.run.smithi186:> uname -m 2023-12-13T23:39:41.982 INFO:teuthology.orchestra.run.smithi186.stdout:x86_64 2023-12-13T23:39:41.983 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release 2023-12-13T23:39:42.040 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="Red Hat Enterprise Linux" 2023-12-13T23:39:42.040 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="8.6 (Ootpa)" 2023-12-13T23:39:42.040 INFO:teuthology.orchestra.run.smithi186.stdout:ID="rhel" 2023-12-13T23:39:42.040 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE="fedora" 2023-12-13T23:39:42.040 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="8.6" 2023-12-13T23:39:42.041 INFO:teuthology.orchestra.run.smithi186.stdout:PLATFORM_ID="platform:el8" 2023-12-13T23:39:42.041 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-13T23:39:42.041 INFO:teuthology.orchestra.run.smithi186.stdout:ANSI_COLOR="0;31" 2023-12-13T23:39:42.041 INFO:teuthology.orchestra.run.smithi186.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-13T23:39:42.041 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://www.redhat.com/" 2023-12-13T23:39:42.042 INFO:teuthology.orchestra.run.smithi186.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-13T23:39:42.042 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-13T23:39:42.042 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-12-13T23:39:42.042 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-13T23:39:42.042 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-13T23:39:42.043 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-13T23:39:42.043 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-13T23:39:42.043 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server 2023-12-13T23:39:42.066 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T23:39:42.178 INFO:teuthology.dispatcher.supervisor:Running job 7490664 2023-12-13T23:39:42.178 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490664 --name yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/fs/misc}} -- /home/teuthworker/archive/yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490664/orig.config.yaml 2023-12-13T23:39:42.181 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490664 2023-12-13T23:39:42.182 INFO:teuthology.dispatcher.supervisor:Job PID: 2195060 2023-12-13T23:39:42.182 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-13T23:41:42.282 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T23:43:42.450 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T23:45:42.646 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T23:47:42.814 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T23:47:42.881 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-13T23:47:43.032 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-13T23:47:43.032 INFO:teuthology.nuke:Checking targets against current locks 2023-12-13T23:47:43.090 DEBUG:teuthology.nuke:shortname: smithi069 2023-12-13T23:47:43.090 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-13T23:47:43.111 DEBUG:teuthology.nuke:shortname: smithi070 2023-12-13T23:47:43.111 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-13T23:47:43.114 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi069.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490664', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-13 23:34:42.685218', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-13T23:47:43.126 DEBUG:teuthology.nuke:shortname: smithi186 2023-12-13T23:47:43.127 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-13T23:47:43.138 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi070.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490664', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-13 23:34:42.686991', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-13T23:47:43.148 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi186.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490664', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-13 23:34:42.688618', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-13T23:47:43.161 INFO:teuthology.orchestra.console.smithi069:Power off 2023-12-13T23:47:43.161 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-13T23:47:43.186 DEBUG:teuthology.orchestra.console.smithi069:power off output: Chassis Power Control: Down/Off 2023-12-13T23:47:43.186 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:47:43.201 INFO:teuthology.orchestra.console.smithi186:Power off 2023-12-13T23:47:43.201 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-13T23:47:43.215 INFO:teuthology.orchestra.console.smithi070:Power off 2023-12-13T23:47:43.216 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-13T23:47:43.223 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2023-12-13T23:47:43.225 DEBUG:teuthology.orchestra.console.smithi186:power off output: Chassis Power Control: Down/Off 2023-12-13T23:47:43.226 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:47:43.238 DEBUG:teuthology.orchestra.console.smithi070:power off output: Chassis Power Control: Down/Off 2023-12-13T23:47:43.238 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:47:43.250 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2023-12-13T23:47:43.259 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is off 2023-12-13T23:47:43.325 INFO:teuthology.orchestra.console.smithi069:Power off completed 2023-12-13T23:47:43.351 INFO:teuthology.orchestra.console.smithi186:Power off completed 2023-12-13T23:47:43.360 INFO:teuthology.orchestra.console.smithi070:Power off completed 2023-12-13T23:47:43.487 INFO:teuthology.lock.ops:unlocked: smithi069.front.sepia.ceph.com 2023-12-13T23:47:43.495 INFO:teuthology.lock.ops:unlocked: smithi186.front.sepia.ceph.com 2023-12-13T23:47:43.503 INFO:teuthology.lock.ops:unlocked: smithi070.front.sepia.ceph.com