2023-12-13T22:14:35.729 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-13T22:14:35.730 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T22:14:35.915 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc85fbea940>, signals=[15]) 2023-12-13T22:14:35.915 INFO:teuthology.lock.ops:Start node 'smithi001.front.sepia.ceph.com' reimaging 2023-12-13T22:14:35.915 INFO:teuthology.lock.ops:Updating [smithi001.front.sepia.ceph.com]: reset os type and version on server 2023-12-13T22:14:35.916 INFO:teuthology.lock.ops:Updating smithi001.front.sepia.ceph.com on lock server 2023-12-13T22:14:35.937 INFO:teuthology.lock.ops:Start node 'smithi115.front.sepia.ceph.com' reimaging 2023-12-13T22:14:35.938 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: reset os type and version on server 2023-12-13T22:14:35.938 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2023-12-13T22:14:35.962 INFO:teuthology.lock.ops:Start node 'smithi156.front.sepia.ceph.com' reimaging 2023-12-13T22:14:35.963 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: reset os type and version on server 2023-12-13T22:14:35.963 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2023-12-13T22:14:36.054 DEBUG:teuthology.provision.fog.smithi001:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-13T22:14:36.075 DEBUG:teuthology.provision.fog.smithi115:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-13T22:14:36.093 INFO:teuthology.provision.fog.smithi001:Scheduling deploy of rhel 8.6 2023-12-13T22:14:36.103 DEBUG:teuthology.provision.fog.smithi156:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-13T22:14:36.117 INFO:teuthology.provision.fog.smithi115:Scheduling deploy of rhel 8.6 2023-12-13T22:14:36.145 INFO:teuthology.provision.fog.smithi156:Scheduling deploy of rhel 8.6 2023-12-13T22:14:36.312 INFO:teuthology.orchestra.console.smithi001:Power off 2023-12-13T22:14:36.313 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-13T22:14:36.338 DEBUG:teuthology.orchestra.console.smithi001:power off output: Chassis Power Control: Down/Off 2023-12-13T22:14:36.338 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T22:14:36.351 INFO:teuthology.orchestra.console.smithi115:Power off 2023-12-13T22:14:36.352 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-13T22:14:36.368 INFO:teuthology.orchestra.console.smithi156:Power off 2023-12-13T22:14:36.368 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-13T22:14:36.376 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is on 2023-12-13T22:14:36.376 DEBUG:teuthology.orchestra.console.smithi115:power off output: Chassis Power Control: Down/Off 2023-12-13T22:14:36.376 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T22:14:36.390 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off 2023-12-13T22:14:36.390 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T22:14:36.399 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off 2023-12-13T22:14:36.413 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-12-13T22:14:36.501 INFO:teuthology.orchestra.console.smithi115:Power off completed 2023-12-13T22:14:36.602 INFO:teuthology.orchestra.console.smithi115:Power on 2023-12-13T22:14:36.602 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-13T22:14:36.624 DEBUG:teuthology.orchestra.console.smithi115:power on output: Chassis Power Control: Up/On 2023-12-13T22:14:36.624 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T22:14:36.647 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off 2023-12-13T22:14:40.379 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T22:14:40.415 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T22:14:40.489 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is on 2023-12-13T22:14:40.524 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-12-13T22:14:40.648 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T22:14:40.757 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off 2023-12-13T22:14:44.496 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T22:14:44.525 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T22:14:44.606 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is off 2023-12-13T22:14:44.636 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-12-13T22:14:44.708 INFO:teuthology.orchestra.console.smithi001:Power off completed 2023-12-13T22:14:44.737 INFO:teuthology.orchestra.console.smithi156:Power off completed 2023-12-13T22:14:44.759 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T22:14:44.808 INFO:teuthology.orchestra.console.smithi001:Power on 2023-12-13T22:14:44.809 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-13T22:14:44.830 DEBUG:teuthology.orchestra.console.smithi001:power on output: Chassis Power Control: Up/On 2023-12-13T22:14:44.831 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T22:14:44.838 INFO:teuthology.orchestra.console.smithi156:Power on 2023-12-13T22:14:44.839 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-13T22:14:44.851 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is off 2023-12-13T22:14:44.859 DEBUG:teuthology.orchestra.console.smithi156:power on output: Chassis Power Control: Up/On 2023-12-13T22:14:44.859 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T22:14:44.869 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on 2023-12-13T22:14:44.880 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-12-13T22:14:44.970 INFO:teuthology.orchestra.console.smithi115:Power on completed 2023-12-13T22:14:45.071 INFO:teuthology.provision.fog.smithi115:Waiting for deploy to finish 2023-12-13T22:14:48.853 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T22:14:48.881 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T22:14:48.963 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is off 2023-12-13T22:14:48.989 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-12-13T22:14:52.968 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T22:14:52.990 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T22:14:53.078 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is on 2023-12-13T22:14:53.146 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-12-13T22:14:53.179 INFO:teuthology.orchestra.console.smithi001:Power on completed 2023-12-13T22:14:53.247 INFO:teuthology.orchestra.console.smithi156:Power on completed 2023-12-13T22:14:53.280 INFO:teuthology.provision.fog.smithi001:Waiting for deploy to finish 2023-12-13T22:14:53.348 INFO:teuthology.provision.fog.smithi156:Waiting for deploy to finish 2023-12-13T22:17:24.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T22:17:27.057 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1 2023-12-13T22:17:30.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T22:17:33.059 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T22:17:33.905 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-12-13T22:17:36.113 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1 2023-12-13T22:17:39.063 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T22:17:39.907 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T22:17:42.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T22:17:42.129 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-12-13T22:17:42.961 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-12-13T22:17:45.169 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1 2023-12-13T22:17:48.133 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T22:17:48.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T22:17:51.173 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T22:17:51.185 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-12-13T22:17:52.017 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-12-13T22:17:54.225 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1 2023-12-13T22:17:57.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T22:17:58.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T22:18:00.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T22:18:00.241 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-12-13T22:18:01.077 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-12-13T22:18:03.281 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1 2023-12-13T22:18:06.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T22:18:07.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T22:18:09.283 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T22:18:09.301 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-12-13T22:18:10.134 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-12-13T22:18:12.341 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1 2023-12-13T22:18:15.304 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T22:18:16.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T22:18:18.345 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T22:18:18.385 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-12-13T22:18:19.185 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-12-13T22:18:24.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T22:18:25.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T22:18:27.441 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-12-13T22:18:28.241 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-12-13T22:18:33.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T22:18:34.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T22:18:36.501 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-12-13T22:18:42.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T22:19:18.382 WARNING:teuthology.provision.fog.smithi001:timed out 2023-12-13T22:19:24.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T22:19:24.717 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-13T22:19:24.718 DEBUG:teuthology.orchestra.run.smithi001:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-13T22:19:25.024 INFO:teuthology.provision.fog.smithi001:Node is ready 2023-12-13T22:19:25.024 DEBUG:teuthology.orchestra.run.smithi001:> hostname 2023-12-13T22:19:25.042 INFO:teuthology.orchestra.run.smithi001.stdout:smithi001.front.sepia.ceph.com 2023-12-13T22:19:25.043 DEBUG:teuthology.orchestra.run.smithi001:> grep smithi001.front.sepia.ceph.com /etc/hosts 2023-12-13T22:19:25.100 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1 smithi001.front.sepia.ceph.com smithi001 2023-12-13T22:19:25.101 DEBUG:teuthology.orchestra.run.smithi001:> sudo hostname smithi001 2023-12-13T22:19:25.232 DEBUG:teuthology.orchestra.run.smithi001:> sudo sed -i -e 's/smithi001.front.sepia.ceph.com/smithi001/g' /etc/hosts 2023-12-13T22:19:25.262 DEBUG:teuthology.orchestra.run.smithi001:> sudo sed -i -e 's/172.21.15.1/172.21.15.1/g' /etc/hosts 2023-12-13T22:19:25.330 DEBUG:teuthology.orchestra.run.smithi001:> sudo sed -i -e 's/smithi001.front.sepia.ceph.com/smithi001/g' /etc/hostname 2023-12-13T22:19:25.398 DEBUG:teuthology.orchestra.run.smithi001:> sudo hostname smithi001 2023-12-13T22:19:25.466 DEBUG:teuthology.orchestra.run.smithi001:> cat /etc/os-release 2023-12-13T22:19:25.522 INFO:teuthology.orchestra.run.smithi001.stdout:NAME="Red Hat Enterprise Linux" 2023-12-13T22:19:25.522 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION="8.6 (Ootpa)" 2023-12-13T22:19:25.523 INFO:teuthology.orchestra.run.smithi001.stdout:ID="rhel" 2023-12-13T22:19:25.523 INFO:teuthology.orchestra.run.smithi001.stdout:ID_LIKE="fedora" 2023-12-13T22:19:25.523 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION_ID="8.6" 2023-12-13T22:19:25.523 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM_ID="platform:el8" 2023-12-13T22:19:25.523 INFO:teuthology.orchestra.run.smithi001.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-13T22:19:25.523 INFO:teuthology.orchestra.run.smithi001.stdout:ANSI_COLOR="0;31" 2023-12-13T22:19:25.523 INFO:teuthology.orchestra.run.smithi001.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-13T22:19:25.523 INFO:teuthology.orchestra.run.smithi001.stdout:HOME_URL="https://www.redhat.com/" 2023-12-13T22:19:25.523 INFO:teuthology.orchestra.run.smithi001.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-13T22:19:25.524 INFO:teuthology.orchestra.run.smithi001.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-13T22:19:25.524 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-13T22:19:25.524 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-13T22:19:25.524 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-13T22:19:25.524 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-13T22:19:25.524 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-13T22:19:25.525 INFO:teuthology.provision.fog.smithi001:Deploy complete! 2023-12-13T22:19:25.527 DEBUG:teuthology.parallel:result is None 2023-12-13T22:19:34.254 WARNING:teuthology.provision.fog.smithi115:timed out 2023-12-13T22:19:40.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T22:19:40.601 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-13T22:19:40.601 DEBUG:teuthology.orchestra.run.smithi115:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-13T22:19:40.928 INFO:teuthology.provision.fog.smithi115:Node is ready 2023-12-13T22:19:40.928 DEBUG:teuthology.orchestra.run.smithi115:> hostname 2023-12-13T22:19:40.946 INFO:teuthology.orchestra.run.smithi115.stdout:smithi115.front.sepia.ceph.com 2023-12-13T22:19:40.947 DEBUG:teuthology.orchestra.run.smithi115:> grep smithi115.front.sepia.ceph.com /etc/hosts 2023-12-13T22:19:41.006 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115 smithi115.front.sepia.ceph.com smithi115 2023-12-13T22:19:41.007 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname smithi115 2023-12-13T22:19:41.136 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/smithi115.front.sepia.ceph.com/smithi115/g' /etc/hosts 2023-12-13T22:19:41.165 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/172.21.15.115/172.21.15.115/g' /etc/hosts 2023-12-13T22:19:41.234 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/smithi115.front.sepia.ceph.com/smithi115/g' /etc/hostname 2023-12-13T22:19:41.302 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname smithi115 2023-12-13T22:19:41.369 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release 2023-12-13T22:19:41.426 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="Red Hat Enterprise Linux" 2023-12-13T22:19:41.427 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="8.6 (Ootpa)" 2023-12-13T22:19:41.427 INFO:teuthology.orchestra.run.smithi115.stdout:ID="rhel" 2023-12-13T22:19:41.427 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="fedora" 2023-12-13T22:19:41.427 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="8.6" 2023-12-13T22:19:41.428 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el8" 2023-12-13T22:19:41.428 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-13T22:19:41.428 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31" 2023-12-13T22:19:41.428 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-13T22:19:41.429 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://www.redhat.com/" 2023-12-13T22:19:41.429 INFO:teuthology.orchestra.run.smithi115.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-13T22:19:41.429 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-13T22:19:41.429 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-12-13T22:19:41.430 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-13T22:19:41.430 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-13T22:19:41.430 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-13T22:19:41.431 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-13T22:19:41.431 INFO:teuthology.provision.fog.smithi115:Deploy complete! 2023-12-13T22:19:41.432 DEBUG:teuthology.parallel:result is None 2023-12-13T22:19:42.508 WARNING:teuthology.provision.fog.smithi156:timed out 2023-12-13T22:19:48.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T22:19:48.847 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-13T22:19:48.848 DEBUG:teuthology.orchestra.run.smithi156:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-13T22:19:49.167 INFO:teuthology.provision.fog.smithi156:Node is ready 2023-12-13T22:19:49.168 DEBUG:teuthology.orchestra.run.smithi156:> hostname 2023-12-13T22:19:49.187 INFO:teuthology.orchestra.run.smithi156.stdout:smithi156.front.sepia.ceph.com 2023-12-13T22:19:49.188 DEBUG:teuthology.orchestra.run.smithi156:> grep smithi156.front.sepia.ceph.com /etc/hosts 2023-12-13T22:19:49.247 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156 smithi156.front.sepia.ceph.com smithi156 2023-12-13T22:19:49.249 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156 2023-12-13T22:19:49.368 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hosts 2023-12-13T22:19:49.397 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/172.21.15.156/172.21.15.156/g' /etc/hosts 2023-12-13T22:19:49.465 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hostname 2023-12-13T22:19:49.533 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156 2023-12-13T22:19:49.599 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2023-12-13T22:19:49.656 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="Red Hat Enterprise Linux" 2023-12-13T22:19:49.656 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="8.6 (Ootpa)" 2023-12-13T22:19:49.656 INFO:teuthology.orchestra.run.smithi156.stdout:ID="rhel" 2023-12-13T22:19:49.657 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="fedora" 2023-12-13T22:19:49.657 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="8.6" 2023-12-13T22:19:49.657 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el8" 2023-12-13T22:19:49.657 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-13T22:19:49.657 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31" 2023-12-13T22:19:49.657 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-13T22:19:49.657 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://www.redhat.com/" 2023-12-13T22:19:49.657 INFO:teuthology.orchestra.run.smithi156.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-13T22:19:49.657 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-13T22:19:49.657 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-13T22:19:49.657 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-13T22:19:49.657 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-13T22:19:49.657 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-13T22:19:49.658 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-13T22:19:49.658 INFO:teuthology.provision.fog.smithi156:Deploy complete! 2023-12-13T22:19:49.659 DEBUG:teuthology.parallel:result is None 2023-12-13T22:19:49.884 INFO:teuthology.lock.ops:Checking smithi001.front.sepia.ceph.com 2023-12-13T22:19:49.885 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-13T22:19:49.902 INFO:teuthology.lock.ops:Checking smithi115.front.sepia.ceph.com 2023-12-13T22:19:49.902 INFO:teuthology.lock.ops:Checking smithi156.front.sepia.ceph.com 2023-12-13T22:19:49.902 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-13T22:19:49.920 INFO:teuthology.lock.ops:Updating [smithi001.front.sepia.ceph.com]: set os type and version on server 2023-12-13T22:19:49.920 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com' 2023-12-13T22:19:49.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T22:19:49.988 DEBUG:teuthology.orchestra.run.smithi001:> true 2023-12-13T22:19:50.123 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi001.front.sepia.ceph.com' 2023-12-13T22:19:50.123 DEBUG:teuthology.orchestra.run.smithi001:> uname -m 2023-12-13T22:19:50.181 INFO:teuthology.orchestra.run.smithi001.stdout:x86_64 2023-12-13T22:19:50.181 DEBUG:teuthology.orchestra.run.smithi001:> cat /etc/os-release 2023-12-13T22:19:50.239 INFO:teuthology.orchestra.run.smithi001.stdout:NAME="Red Hat Enterprise Linux" 2023-12-13T22:19:50.239 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION="8.6 (Ootpa)" 2023-12-13T22:19:50.239 INFO:teuthology.orchestra.run.smithi001.stdout:ID="rhel" 2023-12-13T22:19:50.239 INFO:teuthology.orchestra.run.smithi001.stdout:ID_LIKE="fedora" 2023-12-13T22:19:50.239 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION_ID="8.6" 2023-12-13T22:19:50.239 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM_ID="platform:el8" 2023-12-13T22:19:50.240 INFO:teuthology.orchestra.run.smithi001.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-13T22:19:50.240 INFO:teuthology.orchestra.run.smithi001.stdout:ANSI_COLOR="0;31" 2023-12-13T22:19:50.240 INFO:teuthology.orchestra.run.smithi001.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-13T22:19:50.240 INFO:teuthology.orchestra.run.smithi001.stdout:HOME_URL="https://www.redhat.com/" 2023-12-13T22:19:50.240 INFO:teuthology.orchestra.run.smithi001.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-13T22:19:50.240 INFO:teuthology.orchestra.run.smithi001.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-13T22:19:50.240 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-13T22:19:50.240 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-13T22:19:50.240 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-13T22:19:50.240 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-13T22:19:50.240 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-13T22:19:50.241 INFO:teuthology.lock.ops:Updating smithi001.front.sepia.ceph.com on lock server 2023-12-13T22:19:50.268 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: set os type and version on server 2023-12-13T22:19:50.268 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2023-12-13T22:19:50.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T22:19:50.336 DEBUG:teuthology.orchestra.run.smithi115:> true 2023-12-13T22:19:50.405 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2023-12-13T22:19:50.405 DEBUG:teuthology.orchestra.run.smithi115:> uname -m 2023-12-13T22:19:50.464 INFO:teuthology.orchestra.run.smithi115.stdout:x86_64 2023-12-13T22:19:50.464 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release 2023-12-13T22:19:50.525 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="Red Hat Enterprise Linux" 2023-12-13T22:19:50.525 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="8.6 (Ootpa)" 2023-12-13T22:19:50.526 INFO:teuthology.orchestra.run.smithi115.stdout:ID="rhel" 2023-12-13T22:19:50.526 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="fedora" 2023-12-13T22:19:50.526 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="8.6" 2023-12-13T22:19:50.526 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el8" 2023-12-13T22:19:50.526 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-13T22:19:50.526 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31" 2023-12-13T22:19:50.526 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-13T22:19:50.526 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://www.redhat.com/" 2023-12-13T22:19:50.526 INFO:teuthology.orchestra.run.smithi115.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-13T22:19:50.526 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-13T22:19:50.526 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-12-13T22:19:50.526 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-13T22:19:50.527 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-13T22:19:50.527 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-13T22:19:50.527 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-13T22:19:50.527 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2023-12-13T22:19:50.552 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: set os type and version on server 2023-12-13T22:19:50.552 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-12-13T22:19:50.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T22:19:50.623 DEBUG:teuthology.orchestra.run.smithi156:> true 2023-12-13T22:19:50.697 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-12-13T22:19:50.697 DEBUG:teuthology.orchestra.run.smithi156:> uname -m 2023-12-13T22:19:50.759 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64 2023-12-13T22:19:50.760 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2023-12-13T22:19:50.821 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="Red Hat Enterprise Linux" 2023-12-13T22:19:50.822 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="8.6 (Ootpa)" 2023-12-13T22:19:50.822 INFO:teuthology.orchestra.run.smithi156.stdout:ID="rhel" 2023-12-13T22:19:50.822 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="fedora" 2023-12-13T22:19:50.822 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="8.6" 2023-12-13T22:19:50.822 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el8" 2023-12-13T22:19:50.822 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-13T22:19:50.822 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31" 2023-12-13T22:19:50.822 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-13T22:19:50.822 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://www.redhat.com/" 2023-12-13T22:19:50.822 INFO:teuthology.orchestra.run.smithi156.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-13T22:19:50.823 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-13T22:19:50.823 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-13T22:19:50.823 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-13T22:19:50.823 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-13T22:19:50.823 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-13T22:19:50.823 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-13T22:19:50.823 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2023-12-13T22:19:50.844 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T22:19:50.938 INFO:teuthology.dispatcher.supervisor:Running job 7490547 2023-12-13T22:19:50.938 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490547 --name yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/suites/ffsb}} -- /home/teuthworker/archive/yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490547/orig.config.yaml 2023-12-13T22:19:50.941 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490547 2023-12-13T22:19:50.942 INFO:teuthology.dispatcher.supervisor:Job PID: 1035987 2023-12-13T22:19:50.942 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-13T22:21:51.042 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T22:23:51.230 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T22:25:51.394 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T22:27:51.533 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T22:27:51.603 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-13T22:27:51.750 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-13T22:27:51.751 INFO:teuthology.nuke:Checking targets against current locks 2023-12-13T22:27:51.803 DEBUG:teuthology.nuke:shortname: smithi001 2023-12-13T22:27:51.804 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-13T22:27:51.825 DEBUG:teuthology.nuke:shortname: smithi115 2023-12-13T22:27:51.826 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-13T22:27:51.829 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi001.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490547', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-13 22:14:34.862320', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-13T22:27:51.848 DEBUG:teuthology.nuke:shortname: smithi156 2023-12-13T22:27:51.849 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-13T22:27:51.854 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi115.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490547', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-13 22:14:34.865977', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-13T22:27:51.880 INFO:teuthology.orchestra.console.smithi001:Power off 2023-12-13T22:27:51.880 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-13T22:27:51.890 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi156.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490547', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-13 22:14:34.864234', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-13T22:27:51.902 DEBUG:teuthology.orchestra.console.smithi001:power off output: Chassis Power Control: Down/Off 2023-12-13T22:27:51.902 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T22:27:51.923 INFO:teuthology.orchestra.console.smithi115:Power off 2023-12-13T22:27:51.923 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-13T22:27:51.936 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is off 2023-12-13T22:27:51.944 DEBUG:teuthology.orchestra.console.smithi115:power off output: Chassis Power Control: Down/Off 2023-12-13T22:27:51.944 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T22:27:51.963 INFO:teuthology.orchestra.console.smithi156:Power off 2023-12-13T22:27:51.964 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-13T22:27:51.973 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off 2023-12-13T22:27:51.985 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off 2023-12-13T22:27:51.986 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T22:27:52.008 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-12-13T22:27:52.037 INFO:teuthology.orchestra.console.smithi001:Power off completed 2023-12-13T22:27:52.075 INFO:teuthology.orchestra.console.smithi115:Power off completed 2023-12-13T22:27:52.108 INFO:teuthology.orchestra.console.smithi156:Power off completed 2023-12-13T22:27:52.193 INFO:teuthology.lock.ops:unlocked: smithi001.front.sepia.ceph.com 2023-12-13T22:27:52.218 INFO:teuthology.lock.ops:unlocked: smithi115.front.sepia.ceph.com 2023-12-13T22:27:52.250 INFO:teuthology.lock.ops:unlocked: smithi156.front.sepia.ceph.com