2024-01-17T07:05:06.279 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-17T07:05:06.280 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-17T07:05:06.471 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6246bd2c10>, signals=[15]) 2024-01-17T07:05:06.472 INFO:teuthology.lock.ops:Start node 'smithi078.front.sepia.ceph.com' reimaging 2024-01-17T07:05:06.472 INFO:teuthology.lock.ops:Updating [smithi078.front.sepia.ceph.com]: reset os type and version on server 2024-01-17T07:05:06.472 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2024-01-17T07:05:06.506 INFO:teuthology.lock.ops:Start node 'smithi150.front.sepia.ceph.com' reimaging 2024-01-17T07:05:06.507 INFO:teuthology.lock.ops:Updating [smithi150.front.sepia.ceph.com]: reset os type and version on server 2024-01-17T07:05:06.507 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server 2024-01-17T07:05:06.530 INFO:teuthology.lock.ops:Start node 'smithi157.front.sepia.ceph.com' reimaging 2024-01-17T07:05:06.530 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: reset os type and version on server 2024-01-17T07:05:06.530 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2024-01-17T07:05:06.642 DEBUG:teuthology.provision.fog.smithi078:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-17T07:05:06.645 DEBUG:teuthology.provision.fog.smithi150:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-17T07:05:06.652 DEBUG:teuthology.provision.fog.smithi157:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-17T07:05:06.684 INFO:teuthology.provision.fog.smithi078:Scheduling deploy of rhel 8.6 2024-01-17T07:05:06.690 INFO:teuthology.provision.fog.smithi150:Scheduling deploy of rhel 8.6 2024-01-17T07:05:06.703 INFO:teuthology.provision.fog.smithi157:Scheduling deploy of rhel 8.6 2024-01-17T07:05:06.956 INFO:teuthology.orchestra.console.smithi150:Power off 2024-01-17T07:05:06.957 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-17T07:05:06.971 INFO:teuthology.orchestra.console.smithi078:Power off 2024-01-17T07:05:06.971 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-17T07:05:06.984 INFO:teuthology.orchestra.console.smithi157:Power off 2024-01-17T07:05:06.984 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-17T07:05:06.994 DEBUG:teuthology.orchestra.console.smithi150:power off output: Chassis Power Control: Down/Off 2024-01-17T07:05:06.994 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-17T07:05:07.005 DEBUG:teuthology.orchestra.console.smithi078:power off output: Chassis Power Control: Down/Off 2024-01-17T07:05:07.005 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-17T07:05:07.014 DEBUG:teuthology.orchestra.console.smithi157:power off output: Chassis Power Control: Down/Off 2024-01-17T07:05:07.015 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-17T07:05:07.024 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off 2024-01-17T07:05:07.027 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is off 2024-01-17T07:05:07.041 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2024-01-17T07:05:07.125 INFO:teuthology.orchestra.console.smithi150:Power off completed 2024-01-17T07:05:07.128 INFO:teuthology.orchestra.console.smithi078:Power off completed 2024-01-17T07:05:07.143 INFO:teuthology.orchestra.console.smithi157:Power off completed 2024-01-17T07:05:07.226 INFO:teuthology.orchestra.console.smithi150:Power on 2024-01-17T07:05:07.227 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-17T07:05:07.235 INFO:teuthology.orchestra.console.smithi078:Power on 2024-01-17T07:05:07.235 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-17T07:05:07.243 INFO:teuthology.orchestra.console.smithi157:Power on 2024-01-17T07:05:07.244 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-17T07:05:07.252 DEBUG:teuthology.orchestra.console.smithi150:power on output: Chassis Power Control: Up/On 2024-01-17T07:05:07.252 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-17T07:05:07.260 DEBUG:teuthology.orchestra.console.smithi078:power on output: Chassis Power Control: Up/On 2024-01-17T07:05:07.261 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-17T07:05:07.270 DEBUG:teuthology.orchestra.console.smithi157:power on output: Chassis Power Control: Up/On 2024-01-17T07:05:07.270 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-17T07:05:07.279 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off 2024-01-17T07:05:07.283 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is off 2024-01-17T07:05:07.293 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2024-01-17T07:05:11.284 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-17T07:05:11.291 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-17T07:05:11.297 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-17T07:05:11.393 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off 2024-01-17T07:05:11.399 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is off 2024-01-17T07:05:11.405 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2024-01-17T07:05:11.506 INFO:teuthology.orchestra.console.smithi157:Power on completed 2024-01-17T07:05:11.606 INFO:teuthology.provision.fog.smithi157:Waiting for deploy to finish 2024-01-17T07:05:15.396 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-17T07:05:15.402 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-17T07:05:15.511 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on 2024-01-17T07:05:15.531 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on 2024-01-17T07:05:15.612 INFO:teuthology.orchestra.console.smithi078:Power on completed 2024-01-17T07:05:15.632 INFO:teuthology.orchestra.console.smithi150:Power on completed 2024-01-17T07:05:15.714 INFO:teuthology.provision.fog.smithi078:Waiting for deploy to finish 2024-01-17T07:05:15.733 INFO:teuthology.provision.fog.smithi150:Waiting for deploy to finish 2024-01-17T07:08:01.617 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T07:08:01.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T07:08:12.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T07:08:20.156 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2024-01-17T07:08:20.156 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-01-17T07:08:26.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T07:08:26.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T07:08:29.212 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2024-01-17T07:08:29.212 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-01-17T07:08:31.164 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-01-17T07:08:35.216 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T07:08:35.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T07:08:37.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T07:08:38.268 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2024-01-17T07:08:38.268 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-01-17T07:08:40.220 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-01-17T07:08:44.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T07:08:44.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T07:08:46.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T07:08:47.324 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2024-01-17T07:08:47.324 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-01-17T07:08:49.276 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-01-17T07:08:53.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T07:08:53.330 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T07:08:55.279 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T07:08:56.380 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-01-17T07:08:58.332 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-01-17T07:09:02.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T07:09:04.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T07:09:05.436 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-01-17T07:09:07.388 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-01-17T07:09:11.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T07:09:11.872 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2024-01-17T07:09:13.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T07:09:16.444 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-01-17T07:09:17.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T07:09:20.956 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2024-01-17T07:09:22.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T07:09:25.500 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-01-17T07:09:26.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T07:09:30.012 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2024-01-17T07:09:31.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T07:09:34.556 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-01-17T07:09:36.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T07:09:36.314 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-17T07:09:36.314 DEBUG:teuthology.orchestra.run.smithi078:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-17T07:09:40.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T07:09:56.548 INFO:teuthology.provision.fog.smithi078:Node is ready 2024-01-17T07:09:56.548 DEBUG:teuthology.orchestra.run.smithi078:> hostname 2024-01-17T07:09:56.570 INFO:teuthology.orchestra.run.smithi078.stdout:smithi078.front.sepia.ceph.com 2024-01-17T07:09:56.570 DEBUG:teuthology.orchestra.run.smithi078:> grep smithi078.front.sepia.ceph.com /etc/hosts 2024-01-17T07:09:56.630 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78 smithi078.front.sepia.ceph.com smithi078 2024-01-17T07:09:56.631 DEBUG:teuthology.orchestra.run.smithi078:> sudo hostname smithi078 2024-01-17T07:09:56.758 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i -e 's/smithi078.front.sepia.ceph.com/smithi078/g' /etc/hosts 2024-01-17T07:09:56.792 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i -e 's/172.21.15.78/172.21.15.78/g' /etc/hosts 2024-01-17T07:09:56.865 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i -e 's/smithi078.front.sepia.ceph.com/smithi078/g' /etc/hostname 2024-01-17T07:09:56.938 DEBUG:teuthology.orchestra.run.smithi078:> sudo hostname smithi078 2024-01-17T07:09:57.010 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release 2024-01-17T07:09:57.070 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="Red Hat Enterprise Linux" 2024-01-17T07:09:57.071 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="8.6 (Ootpa)" 2024-01-17T07:09:57.071 INFO:teuthology.orchestra.run.smithi078.stdout:ID="rhel" 2024-01-17T07:09:57.071 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="fedora" 2024-01-17T07:09:57.071 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="8.6" 2024-01-17T07:09:57.071 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el8" 2024-01-17T07:09:57.071 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-17T07:09:57.071 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31" 2024-01-17T07:09:57.071 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-17T07:09:57.071 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://www.redhat.com/" 2024-01-17T07:09:57.071 INFO:teuthology.orchestra.run.smithi078.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-17T07:09:57.071 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-17T07:09:57.072 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-01-17T07:09:57.072 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-17T07:09:57.072 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-17T07:09:57.072 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-17T07:09:57.072 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-17T07:09:57.072 INFO:teuthology.provision.fog.smithi078:Deploy complete! 2024-01-17T07:09:57.074 DEBUG:teuthology.parallel:result is None 2024-01-17T07:10:11.452 WARNING:teuthology.provision.fog.smithi150:timed out 2024-01-17T07:10:17.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T07:10:17.722 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-17T07:10:17.722 DEBUG:teuthology.orchestra.run.smithi150:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-17T07:10:18.000 INFO:teuthology.provision.fog.smithi150:Node is ready 2024-01-17T07:10:18.000 DEBUG:teuthology.orchestra.run.smithi150:> hostname 2024-01-17T07:10:18.018 INFO:teuthology.orchestra.run.smithi150.stdout:smithi150 2024-01-17T07:10:18.018 DEBUG:teuthology.orchestra.run.smithi150:> grep smithi150 /etc/hosts 2024-01-17T07:10:18.077 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.15.150 smithi150.front.sepia.ceph.com smithi150 2024-01-17T07:10:18.077 DEBUG:teuthology.orchestra.run.smithi150:> sudo hostname smithi150 2024-01-17T07:10:18.215 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/smithi150/smithi150/g' /etc/hosts 2024-01-17T07:10:18.244 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/172.21.15.150/172.21.15.150/g' /etc/hosts 2024-01-17T07:10:18.311 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/smithi150/smithi150/g' /etc/hostname 2024-01-17T07:10:18.378 DEBUG:teuthology.orchestra.run.smithi150:> sudo hostname smithi150 2024-01-17T07:10:18.444 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release 2024-01-17T07:10:18.501 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="Red Hat Enterprise Linux" 2024-01-17T07:10:18.501 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="8.6 (Ootpa)" 2024-01-17T07:10:18.501 INFO:teuthology.orchestra.run.smithi150.stdout:ID="rhel" 2024-01-17T07:10:18.501 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="fedora" 2024-01-17T07:10:18.501 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="8.6" 2024-01-17T07:10:18.501 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el8" 2024-01-17T07:10:18.501 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-17T07:10:18.501 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31" 2024-01-17T07:10:18.501 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-17T07:10:18.501 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://www.redhat.com/" 2024-01-17T07:10:18.501 INFO:teuthology.orchestra.run.smithi150.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-17T07:10:18.502 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-17T07:10:18.502 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-01-17T07:10:18.502 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-17T07:10:18.502 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-17T07:10:18.502 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-17T07:10:18.502 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-17T07:10:18.502 INFO:teuthology.provision.fog.smithi150:Deploy complete! 2024-01-17T07:10:18.503 DEBUG:teuthology.parallel:result is None 2024-01-17T07:10:40.580 WARNING:teuthology.provision.fog.smithi157:timed out 2024-01-17T07:10:46.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T07:10:46.835 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-17T07:10:46.835 DEBUG:teuthology.orchestra.run.smithi157:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-17T07:10:47.065 INFO:teuthology.provision.fog.smithi157:Node is ready 2024-01-17T07:10:47.066 DEBUG:teuthology.orchestra.run.smithi157:> hostname 2024-01-17T07:10:47.127 INFO:teuthology.orchestra.run.smithi157.stdout:smithi157.front.sepia.ceph.com 2024-01-17T07:10:47.127 DEBUG:teuthology.orchestra.run.smithi157:> grep smithi157.front.sepia.ceph.com /etc/hosts 2024-01-17T07:10:47.187 INFO:teuthology.orchestra.run.smithi157.stdout:172.21.15.157 smithi157.front.sepia.ceph.com smithi157 2024-01-17T07:10:47.188 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname smithi157 2024-01-17T07:10:47.305 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/smithi157.front.sepia.ceph.com/smithi157/g' /etc/hosts 2024-01-17T07:10:47.333 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/172.21.15.157/172.21.15.157/g' /etc/hosts 2024-01-17T07:10:47.403 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/smithi157.front.sepia.ceph.com/smithi157/g' /etc/hostname 2024-01-17T07:10:47.474 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname smithi157 2024-01-17T07:10:47.544 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2024-01-17T07:10:47.605 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="Red Hat Enterprise Linux" 2024-01-17T07:10:47.605 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="8.6 (Ootpa)" 2024-01-17T07:10:47.605 INFO:teuthology.orchestra.run.smithi157.stdout:ID="rhel" 2024-01-17T07:10:47.605 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="fedora" 2024-01-17T07:10:47.605 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="8.6" 2024-01-17T07:10:47.605 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el8" 2024-01-17T07:10:47.605 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-17T07:10:47.605 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31" 2024-01-17T07:10:47.605 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-17T07:10:47.605 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://www.redhat.com/" 2024-01-17T07:10:47.605 INFO:teuthology.orchestra.run.smithi157.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-17T07:10:47.605 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-17T07:10:47.606 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-01-17T07:10:47.606 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-17T07:10:47.606 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-17T07:10:47.606 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-17T07:10:47.606 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-17T07:10:47.606 INFO:teuthology.provision.fog.smithi157:Deploy complete! 2024-01-17T07:10:47.606 DEBUG:teuthology.parallel:result is None 2024-01-17T07:10:47.803 INFO:teuthology.lock.ops:Checking smithi078.front.sepia.ceph.com 2024-01-17T07:10:47.803 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-17T07:10:47.829 INFO:teuthology.lock.ops:Checking smithi150.front.sepia.ceph.com 2024-01-17T07:10:47.830 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-17T07:10:47.846 INFO:teuthology.lock.ops:Checking smithi157.front.sepia.ceph.com 2024-01-17T07:10:47.846 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-17T07:10:47.864 INFO:teuthology.lock.ops:Updating [smithi078.front.sepia.ceph.com]: set os type and version on server 2024-01-17T07:10:47.864 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-01-17T07:10:47.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T07:10:47.939 DEBUG:teuthology.orchestra.run.smithi078:> true 2024-01-17T07:10:48.075 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-01-17T07:10:48.076 DEBUG:teuthology.orchestra.run.smithi078:> uname -m 2024-01-17T07:10:48.133 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64 2024-01-17T07:10:48.134 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release 2024-01-17T07:10:48.190 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="Red Hat Enterprise Linux" 2024-01-17T07:10:48.191 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="8.6 (Ootpa)" 2024-01-17T07:10:48.191 INFO:teuthology.orchestra.run.smithi078.stdout:ID="rhel" 2024-01-17T07:10:48.191 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="fedora" 2024-01-17T07:10:48.191 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="8.6" 2024-01-17T07:10:48.191 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el8" 2024-01-17T07:10:48.191 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-17T07:10:48.191 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31" 2024-01-17T07:10:48.191 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-17T07:10:48.191 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://www.redhat.com/" 2024-01-17T07:10:48.191 INFO:teuthology.orchestra.run.smithi078.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-17T07:10:48.191 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-17T07:10:48.191 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-01-17T07:10:48.192 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-17T07:10:48.192 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-17T07:10:48.192 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-17T07:10:48.192 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-17T07:10:48.192 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2024-01-17T07:10:48.213 INFO:teuthology.lock.ops:Updating [smithi150.front.sepia.ceph.com]: set os type and version on server 2024-01-17T07:10:48.213 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-01-17T07:10:48.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T07:10:48.286 DEBUG:teuthology.orchestra.run.smithi150:> true 2024-01-17T07:10:48.422 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-01-17T07:10:48.422 DEBUG:teuthology.orchestra.run.smithi150:> uname -m 2024-01-17T07:10:48.480 INFO:teuthology.orchestra.run.smithi150.stdout:x86_64 2024-01-17T07:10:48.480 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release 2024-01-17T07:10:48.538 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="Red Hat Enterprise Linux" 2024-01-17T07:10:48.538 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="8.6 (Ootpa)" 2024-01-17T07:10:48.538 INFO:teuthology.orchestra.run.smithi150.stdout:ID="rhel" 2024-01-17T07:10:48.538 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="fedora" 2024-01-17T07:10:48.538 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="8.6" 2024-01-17T07:10:48.538 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el8" 2024-01-17T07:10:48.538 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-17T07:10:48.538 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31" 2024-01-17T07:10:48.538 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-17T07:10:48.538 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://www.redhat.com/" 2024-01-17T07:10:48.539 INFO:teuthology.orchestra.run.smithi150.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-17T07:10:48.539 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-17T07:10:48.539 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-01-17T07:10:48.539 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-17T07:10:48.539 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-17T07:10:48.539 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-17T07:10:48.539 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-17T07:10:48.539 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server 2024-01-17T07:10:48.563 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: set os type and version on server 2024-01-17T07:10:48.563 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-01-17T07:10:48.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T07:10:48.640 DEBUG:teuthology.orchestra.run.smithi157:> true 2024-01-17T07:10:48.709 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-01-17T07:10:48.710 DEBUG:teuthology.orchestra.run.smithi157:> uname -m 2024-01-17T07:10:48.771 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64 2024-01-17T07:10:48.771 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2024-01-17T07:10:48.833 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="Red Hat Enterprise Linux" 2024-01-17T07:10:48.833 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="8.6 (Ootpa)" 2024-01-17T07:10:48.833 INFO:teuthology.orchestra.run.smithi157.stdout:ID="rhel" 2024-01-17T07:10:48.833 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="fedora" 2024-01-17T07:10:48.833 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="8.6" 2024-01-17T07:10:48.834 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el8" 2024-01-17T07:10:48.834 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-17T07:10:48.834 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31" 2024-01-17T07:10:48.834 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-17T07:10:48.834 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://www.redhat.com/" 2024-01-17T07:10:48.834 INFO:teuthology.orchestra.run.smithi157.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-17T07:10:48.834 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-17T07:10:48.834 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-01-17T07:10:48.834 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-17T07:10:48.834 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-17T07:10:48.834 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-17T07:10:48.835 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-17T07:10:48.835 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2024-01-17T07:10:48.863 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-17T07:10:48.969 INFO:teuthology.dispatcher.supervisor:Running job 7518755 2024-01-17T07:10:48.969 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_khiremat@teuthology --archive /home/teuthworker/archive/khiremat-2024-01-17_06:35:36-fs:workload-wip-khiremat-49945-referent-inode-0-distro-default-smithi/7518755 --name khiremat-2024-01-17_06:35:36-fs:workload-wip-khiremat-49945-referent-inode-0-distro-default-smithi --description fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout single_mds} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/suites/iogen}} -- /home/teuthworker/archive/khiremat-2024-01-17_06:35:36-fs:workload-wip-khiremat-49945-referent-inode-0-distro-default-smithi/7518755/orig.config.yaml 2024-01-17T07:10:48.972 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/khiremat-2024-01-17_06:35:36-fs:workload-wip-khiremat-49945-referent-inode-0-distro-default-smithi/7518755 2024-01-17T07:10:48.972 INFO:teuthology.dispatcher.supervisor:Job PID: 900209 2024-01-17T07:10:48.972 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-17T07:12:48.973 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-17T07:14:49.049 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-17T07:16:49.121 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-17T07:18:49.184 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-17T07:20:49.254 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-17T07:22:49.340 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-17T07:22:49.413 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-01-17T07:22:49.549 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2024-01-17T07:22:49.549 INFO:teuthology.nuke:Checking targets against current locks 2024-01-17T07:22:49.599 DEBUG:teuthology.nuke:shortname: smithi078 2024-01-17T07:22:49.599 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-17T07:22:49.620 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi078.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/khiremat-2024-01-17_06:35:36-fs:workload-wip-khiremat-49945-referent-inode-0-distro-default-smithi/7518755', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-17 07:05:05.137980', 'locked_by': 'scheduled_khiremat@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFSOy0//wWJY5AVCPQwHQNLSAPmxjvV1Im/nPRgfGjZH4lZ1TO6KSyeN684VsHPmHV+Lw3vdh8U/aES1FGR3l8A='} 2024-01-17T07:22:49.621 DEBUG:teuthology.nuke:shortname: smithi150 2024-01-17T07:22:49.621 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-17T07:22:49.646 DEBUG:teuthology.nuke:shortname: smithi157 2024-01-17T07:22:49.646 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-17T07:22:49.647 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi150.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/khiremat-2024-01-17_06:35:36-fs:workload-wip-khiremat-49945-referent-inode-0-distro-default-smithi/7518755', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-17 07:05:05.139771', 'locked_by': 'scheduled_khiremat@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLcGVq7ZII7NrNdUiusHSyO5vxJ0cqIUPftRKOKwisi9UfBxC6DqW/nAaPkTpts87G74x8nim0Z3/CJYV+p3gU4='} 2024-01-17T07:22:49.675 INFO:teuthology.orchestra.console.smithi078:Power off 2024-01-17T07:22:49.676 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-17T07:22:49.685 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi157.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/khiremat-2024-01-17_06:35:36-fs:workload-wip-khiremat-49945-referent-inode-0-distro-default-smithi/7518755', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-17 07:05:05.141351', 'locked_by': 'scheduled_khiremat@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN9ZQsa22S5kEJhz4k+oOE049sNei237TnnOYErymCLhQXx4iKWZbti7SwDnCswbB6kbQ5Ugwbvz/4mp+F44SHI='} 2024-01-17T07:22:49.698 DEBUG:teuthology.orchestra.console.smithi078:power off output: Chassis Power Control: Down/Off 2024-01-17T07:22:49.698 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-17T07:22:49.720 INFO:teuthology.orchestra.console.smithi150:Power off 2024-01-17T07:22:49.720 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-17T07:22:49.728 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is off 2024-01-17T07:22:49.739 DEBUG:teuthology.orchestra.console.smithi150:power off output: Chassis Power Control: Down/Off 2024-01-17T07:22:49.740 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-17T07:22:49.756 INFO:teuthology.orchestra.console.smithi157:Power off 2024-01-17T07:22:49.757 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-17T07:22:49.765 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off 2024-01-17T07:22:49.776 DEBUG:teuthology.orchestra.console.smithi157:power off output: Chassis Power Control: Down/Off 2024-01-17T07:22:49.776 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-17T07:22:49.798 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2024-01-17T07:22:49.829 INFO:teuthology.orchestra.console.smithi078:Power off completed 2024-01-17T07:22:49.866 INFO:teuthology.orchestra.console.smithi150:Power off completed 2024-01-17T07:22:49.899 INFO:teuthology.orchestra.console.smithi157:Power off completed 2024-01-17T07:22:49.977 INFO:teuthology.lock.ops:unlocked: smithi078.front.sepia.ceph.com 2024-01-17T07:22:50.011 INFO:teuthology.lock.ops:unlocked: smithi150.front.sepia.ceph.com 2024-01-17T07:22:50.044 INFO:teuthology.lock.ops:unlocked: smithi157.front.sepia.ceph.com