2023-12-13T16:18:28.745 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-13T16:18:28.745 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T16:18:28.894 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fbd9404a940>, signals=[15]) 2023-12-13T16:18:28.895 INFO:teuthology.lock.ops:Start node 'smithi027.front.sepia.ceph.com' reimaging 2023-12-13T16:18:28.895 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: reset os type and version on server 2023-12-13T16:18:28.895 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server 2023-12-13T16:18:28.917 INFO:teuthology.lock.ops:Start node 'smithi093.front.sepia.ceph.com' reimaging 2023-12-13T16:18:28.917 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: reset os type and version on server 2023-12-13T16:18:28.918 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server 2023-12-13T16:18:29.042 DEBUG:teuthology.provision.fog.smithi027:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-13T16:18:29.066 DEBUG:teuthology.provision.fog.smithi093:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-13T16:18:29.089 INFO:teuthology.provision.fog.smithi027:Scheduling deploy of rhel 8.6 2023-12-13T16:18:29.112 INFO:teuthology.provision.fog.smithi093:Scheduling deploy of rhel 8.6 2023-12-13T16:18:29.327 INFO:teuthology.orchestra.console.smithi027:Power off 2023-12-13T16:18:29.328 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-13T16:18:29.341 INFO:teuthology.orchestra.console.smithi093:Power off 2023-12-13T16:18:29.341 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-13T16:18:29.349 DEBUG:teuthology.orchestra.console.smithi027:power off output: Chassis Power Control: Down/Off 2023-12-13T16:18:29.350 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T16:18:29.363 DEBUG:teuthology.orchestra.console.smithi093:power off output: Chassis Power Control: Down/Off 2023-12-13T16:18:29.364 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T16:18:29.372 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off 2023-12-13T16:18:29.384 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off 2023-12-13T16:18:29.473 INFO:teuthology.orchestra.console.smithi027:Power off completed 2023-12-13T16:18:29.485 INFO:teuthology.orchestra.console.smithi093:Power off completed 2023-12-13T16:18:29.574 INFO:teuthology.orchestra.console.smithi027:Power on 2023-12-13T16:18:29.574 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-13T16:18:29.586 INFO:teuthology.orchestra.console.smithi093:Power on 2023-12-13T16:18:29.586 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-13T16:18:29.597 DEBUG:teuthology.orchestra.console.smithi027:power on output: Chassis Power Control: Up/On 2023-12-13T16:18:29.598 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T16:18:29.607 DEBUG:teuthology.orchestra.console.smithi093:power on output: Chassis Power Control: Up/On 2023-12-13T16:18:29.608 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T16:18:29.618 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off 2023-12-13T16:18:29.628 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off 2023-12-13T16:18:33.623 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T16:18:33.630 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T16:18:33.732 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off 2023-12-13T16:18:33.740 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off 2023-12-13T16:18:37.737 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T16:18:37.744 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T16:18:37.847 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on 2023-12-13T16:18:37.853 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on 2023-12-13T16:18:37.948 INFO:teuthology.orchestra.console.smithi027:Power on completed 2023-12-13T16:18:37.954 INFO:teuthology.orchestra.console.smithi093:Power on completed 2023-12-13T16:18:38.050 INFO:teuthology.provision.fog.smithi027:Waiting for deploy to finish 2023-12-13T16:18:38.055 INFO:teuthology.provision.fog.smithi093:Waiting for deploy to finish 2023-12-13T16:21:08.895 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T16:21:11.970 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-12-13T16:21:17.978 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T16:21:21.062 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-12-13T16:21:27.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T16:21:30.150 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-12-13T16:21:36.157 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T16:21:39.234 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-12-13T16:21:45.241 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T16:21:48.322 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-12-13T16:21:54.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T16:21:57.382 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-12-13T16:22:03.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T16:22:09.182 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T16:22:12.258 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-12-13T16:22:18.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T16:22:21.318 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-12-13T16:22:27.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T16:22:30.406 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-12-13T16:22:36.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T16:22:39.493 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-12-13T16:22:45.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T16:22:48.578 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-12-13T16:22:54.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T16:22:57.634 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-12-13T16:23:03.390 WARNING:teuthology.provision.fog.smithi093:timed out 2023-12-13T16:23:03.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T16:23:06.690 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-12-13T16:23:09.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T16:23:09.741 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-13T16:23:09.742 DEBUG:teuthology.orchestra.run.smithi093:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-13T16:23:10.052 INFO:teuthology.provision.fog.smithi093:Node is ready 2023-12-13T16:23:10.052 DEBUG:teuthology.orchestra.run.smithi093:> hostname 2023-12-13T16:23:10.073 INFO:teuthology.orchestra.run.smithi093.stdout:smithi093 2023-12-13T16:23:10.074 DEBUG:teuthology.orchestra.run.smithi093:> grep smithi093 /etc/hosts 2023-12-13T16:23:10.133 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93 smithi093.front.sepia.ceph.com smithi093 2023-12-13T16:23:10.134 DEBUG:teuthology.orchestra.run.smithi093:> sudo hostname smithi093 2023-12-13T16:23:10.249 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/smithi093/smithi093/g' /etc/hosts 2023-12-13T16:23:10.283 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/172.21.15.93/172.21.15.93/g' /etc/hosts 2023-12-13T16:23:10.356 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/smithi093/smithi093/g' /etc/hostname 2023-12-13T16:23:10.429 DEBUG:teuthology.orchestra.run.smithi093:> sudo hostname smithi093 2023-12-13T16:23:10.501 DEBUG:teuthology.orchestra.run.smithi093:> cat /etc/os-release 2023-12-13T16:23:10.561 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="Red Hat Enterprise Linux" 2023-12-13T16:23:10.561 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="8.6 (Ootpa)" 2023-12-13T16:23:10.562 INFO:teuthology.orchestra.run.smithi093.stdout:ID="rhel" 2023-12-13T16:23:10.562 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE="fedora" 2023-12-13T16:23:10.562 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="8.6" 2023-12-13T16:23:10.562 INFO:teuthology.orchestra.run.smithi093.stdout:PLATFORM_ID="platform:el8" 2023-12-13T16:23:10.562 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-13T16:23:10.562 INFO:teuthology.orchestra.run.smithi093.stdout:ANSI_COLOR="0;31" 2023-12-13T16:23:10.562 INFO:teuthology.orchestra.run.smithi093.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-13T16:23:10.562 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://www.redhat.com/" 2023-12-13T16:23:10.562 INFO:teuthology.orchestra.run.smithi093.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-13T16:23:10.563 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-13T16:23:10.563 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-13T16:23:10.563 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-13T16:23:10.563 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-13T16:23:10.563 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-13T16:23:10.563 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-13T16:23:10.564 INFO:teuthology.provision.fog.smithi093:Deploy complete! 2023-12-13T16:23:10.565 DEBUG:teuthology.parallel:result is None 2023-12-13T16:23:12.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T16:23:15.746 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-12-13T16:23:21.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T16:23:24.838 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-12-13T16:23:30.842 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T16:23:33.922 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-12-13T16:23:39.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T16:23:42.982 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-12-13T16:23:48.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T16:24:49.047 WARNING:teuthology.provision.fog.smithi027:timed out 2023-12-13T16:24:55.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T16:24:55.382 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-13T16:24:55.382 DEBUG:teuthology.orchestra.run.smithi027:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-13T16:24:55.686 INFO:teuthology.provision.fog.smithi027:Node is ready 2023-12-13T16:24:55.686 DEBUG:teuthology.orchestra.run.smithi027:> hostname 2023-12-13T16:24:55.704 INFO:teuthology.orchestra.run.smithi027.stdout:smithi027.front.sepia.ceph.com 2023-12-13T16:24:55.704 DEBUG:teuthology.orchestra.run.smithi027:> grep smithi027.front.sepia.ceph.com /etc/hosts 2023-12-13T16:24:55.763 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27 smithi027.front.sepia.ceph.com smithi027 2023-12-13T16:24:55.763 DEBUG:teuthology.orchestra.run.smithi027:> sudo hostname smithi027 2023-12-13T16:24:55.888 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/smithi027.front.sepia.ceph.com/smithi027/g' /etc/hosts 2023-12-13T16:24:55.918 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/172.21.15.27/172.21.15.27/g' /etc/hosts 2023-12-13T16:24:55.987 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/smithi027.front.sepia.ceph.com/smithi027/g' /etc/hostname 2023-12-13T16:24:56.055 DEBUG:teuthology.orchestra.run.smithi027:> sudo hostname smithi027 2023-12-13T16:24:56.122 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release 2023-12-13T16:24:56.179 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="Red Hat Enterprise Linux" 2023-12-13T16:24:56.179 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="8.6 (Ootpa)" 2023-12-13T16:24:56.179 INFO:teuthology.orchestra.run.smithi027.stdout:ID="rhel" 2023-12-13T16:24:56.179 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="fedora" 2023-12-13T16:24:56.179 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="8.6" 2023-12-13T16:24:56.179 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el8" 2023-12-13T16:24:56.179 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-13T16:24:56.179 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31" 2023-12-13T16:24:56.180 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-13T16:24:56.180 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://www.redhat.com/" 2023-12-13T16:24:56.180 INFO:teuthology.orchestra.run.smithi027.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-13T16:24:56.180 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-13T16:24:56.180 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-12-13T16:24:56.180 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-13T16:24:56.180 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-13T16:24:56.180 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-13T16:24:56.180 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-13T16:24:56.181 INFO:teuthology.provision.fog.smithi027:Deploy complete! 2023-12-13T16:24:56.181 DEBUG:teuthology.parallel:result is None 2023-12-13T16:24:56.366 INFO:teuthology.lock.ops:Checking smithi027.front.sepia.ceph.com 2023-12-13T16:24:56.367 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-13T16:24:56.396 INFO:teuthology.lock.ops:Checking smithi093.front.sepia.ceph.com 2023-12-13T16:24:56.396 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-13T16:24:56.413 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: set os type and version on server 2023-12-13T16:24:56.414 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-12-13T16:24:56.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T16:24:56.480 DEBUG:teuthology.orchestra.run.smithi027:> true 2023-12-13T16:24:56.547 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-12-13T16:24:56.547 DEBUG:teuthology.orchestra.run.smithi027:> uname -m 2023-12-13T16:24:56.604 INFO:teuthology.orchestra.run.smithi027.stdout:x86_64 2023-12-13T16:24:56.605 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release 2023-12-13T16:24:56.661 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="Red Hat Enterprise Linux" 2023-12-13T16:24:56.662 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="8.6 (Ootpa)" 2023-12-13T16:24:56.662 INFO:teuthology.orchestra.run.smithi027.stdout:ID="rhel" 2023-12-13T16:24:56.662 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="fedora" 2023-12-13T16:24:56.662 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="8.6" 2023-12-13T16:24:56.662 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el8" 2023-12-13T16:24:56.663 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-13T16:24:56.663 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31" 2023-12-13T16:24:56.663 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-13T16:24:56.663 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://www.redhat.com/" 2023-12-13T16:24:56.663 INFO:teuthology.orchestra.run.smithi027.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-13T16:24:56.664 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-13T16:24:56.664 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-12-13T16:24:56.664 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-13T16:24:56.664 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-13T16:24:56.664 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-13T16:24:56.665 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-13T16:24:56.665 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server 2023-12-13T16:24:56.688 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: set os type and version on server 2023-12-13T16:24:56.689 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-12-13T16:24:56.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T16:24:56.759 DEBUG:teuthology.orchestra.run.smithi093:> true 2023-12-13T16:24:56.897 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-12-13T16:24:56.897 DEBUG:teuthology.orchestra.run.smithi093:> uname -m 2023-12-13T16:24:56.956 INFO:teuthology.orchestra.run.smithi093.stdout:x86_64 2023-12-13T16:24:56.957 DEBUG:teuthology.orchestra.run.smithi093:> cat /etc/os-release 2023-12-13T16:24:57.015 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="Red Hat Enterprise Linux" 2023-12-13T16:24:57.015 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="8.6 (Ootpa)" 2023-12-13T16:24:57.016 INFO:teuthology.orchestra.run.smithi093.stdout:ID="rhel" 2023-12-13T16:24:57.016 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE="fedora" 2023-12-13T16:24:57.016 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="8.6" 2023-12-13T16:24:57.016 INFO:teuthology.orchestra.run.smithi093.stdout:PLATFORM_ID="platform:el8" 2023-12-13T16:24:57.016 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-13T16:24:57.016 INFO:teuthology.orchestra.run.smithi093.stdout:ANSI_COLOR="0;31" 2023-12-13T16:24:57.016 INFO:teuthology.orchestra.run.smithi093.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-13T16:24:57.016 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://www.redhat.com/" 2023-12-13T16:24:57.016 INFO:teuthology.orchestra.run.smithi093.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-13T16:24:57.016 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-13T16:24:57.016 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-13T16:24:57.016 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-13T16:24:57.016 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-13T16:24:57.017 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-13T16:24:57.017 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-13T16:24:57.017 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server 2023-12-13T16:24:57.037 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T16:24:57.129 INFO:teuthology.dispatcher.supervisor:Running job 7489981 2023-12-13T16:24:57.129 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-12-13_12:45:12-fs-wip-vshankar-testing-20231213.072106-testing-default-smithi/7489981 --name vshankar-2023-12-13_12:45:12-fs-wip-vshankar-testing-20231213.072106-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/quota} -- /home/teuthworker/archive/vshankar-2023-12-13_12:45:12-fs-wip-vshankar-testing-20231213.072106-testing-default-smithi/7489981/orig.config.yaml 2023-12-13T16:24:57.132 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-12-13_12:45:12-fs-wip-vshankar-testing-20231213.072106-testing-default-smithi/7489981 2023-12-13T16:24:57.133 INFO:teuthology.dispatcher.supervisor:Job PID: 444481 2023-12-13T16:24:57.133 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-13T16:26:57.232 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T16:28:57.399 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T16:30:57.571 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T16:32:57.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T16:32:57.813 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-13T16:32:57.920 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-13T16:32:57.921 INFO:teuthology.nuke:Checking targets against current locks 2023-12-13T16:32:57.969 DEBUG:teuthology.nuke:shortname: smithi027 2023-12-13T16:32:57.970 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-13T16:32:57.984 DEBUG:teuthology.nuke:shortname: smithi093 2023-12-13T16:32:57.984 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-13T16:32:57.990 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi027.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-13_12:45:12-fs-wip-vshankar-testing-20231213.072106-testing-default-smithi/7489981', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-13 16:18:27.819910', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-13T16:32:58.001 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi093.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-13_12:45:12-fs-wip-vshankar-testing-20231213.072106-testing-default-smithi/7489981', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-13 16:18:27.821663', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-13T16:32:58.035 INFO:teuthology.orchestra.console.smithi027:Power off 2023-12-13T16:32:58.035 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-13T16:32:58.049 INFO:teuthology.orchestra.console.smithi093:Power off 2023-12-13T16:32:58.049 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-13T16:32:58.082 DEBUG:teuthology.orchestra.console.smithi093:power off output: Chassis Power Control: Down/Off 2023-12-13T16:32:58.083 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T16:32:58.091 DEBUG:teuthology.orchestra.console.smithi027:power off output: Chassis Power Control: Down/Off 2023-12-13T16:32:58.091 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T16:32:58.107 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off 2023-12-13T16:32:58.112 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off 2023-12-13T16:32:58.209 INFO:teuthology.orchestra.console.smithi093:Power off completed 2023-12-13T16:32:58.213 INFO:teuthology.orchestra.console.smithi027:Power off completed 2023-12-13T16:32:58.372 INFO:teuthology.lock.ops:unlocked: smithi027.front.sepia.ceph.com 2023-12-13T16:32:58.378 INFO:teuthology.lock.ops:unlocked: smithi093.front.sepia.ceph.com