2023-12-22T08:12:04.129 INFO:root:teuthology version: 0.0.1.dev226+g9680d2a 2023-12-22T08:12:04.130 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T08:12:04.245 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8882d67940>, signals=[15]) 2023-12-22T08:12:04.246 INFO:teuthology.lock.ops:Start node 'smithi086.front.sepia.ceph.com' reimaging 2023-12-22T08:12:04.246 INFO:teuthology.lock.ops:Updating [smithi086.front.sepia.ceph.com]: reset os type and version on server 2023-12-22T08:12:04.246 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2023-12-22T08:12:04.262 INFO:teuthology.lock.ops:Start node 'smithi144.front.sepia.ceph.com' reimaging 2023-12-22T08:12:04.262 INFO:teuthology.lock.ops:Updating [smithi144.front.sepia.ceph.com]: reset os type and version on server 2023-12-22T08:12:04.262 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server 2023-12-22T08:12:04.380 DEBUG:teuthology.provision.fog.smithi086:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-22T08:12:04.401 DEBUG:teuthology.provision.fog.smithi144:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-22T08:12:04.436 INFO:teuthology.provision.fog.smithi086:Scheduling deploy of rhel 8.6 2023-12-22T08:12:04.455 INFO:teuthology.provision.fog.smithi144:Scheduling deploy of rhel 8.6 2023-12-22T08:12:05.037 INFO:teuthology.orchestra.console.smithi144:Power off 2023-12-22T08:12:05.037 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-22T08:12:05.049 INFO:teuthology.orchestra.console.smithi086:Power off 2023-12-22T08:12:05.050 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-22T08:12:05.060 DEBUG:teuthology.orchestra.console.smithi144:power off output: Chassis Power Control: Down/Off 2023-12-22T08:12:05.060 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T08:12:05.069 DEBUG:teuthology.orchestra.console.smithi086:power off output: Chassis Power Control: Down/Off 2023-12-22T08:12:05.070 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T08:12:05.082 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is on 2023-12-22T08:12:05.090 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off 2023-12-22T08:12:05.191 INFO:teuthology.orchestra.console.smithi086:Power off completed 2023-12-22T08:12:05.292 INFO:teuthology.orchestra.console.smithi086:Power on 2023-12-22T08:12:05.292 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-22T08:12:05.312 DEBUG:teuthology.orchestra.console.smithi086:power on output: Chassis Power Control: Up/On 2023-12-22T08:12:05.312 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T08:12:05.334 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off 2023-12-22T08:12:09.085 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T08:12:09.194 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is on 2023-12-22T08:12:09.335 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T08:12:09.443 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off 2023-12-22T08:12:13.198 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T08:12:13.307 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is on 2023-12-22T08:12:13.444 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T08:12:13.671 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on 2023-12-22T08:12:13.772 INFO:teuthology.orchestra.console.smithi086:Power on completed 2023-12-22T08:12:13.872 INFO:teuthology.provision.fog.smithi086:Waiting for deploy to finish 2023-12-22T08:12:17.310 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T08:12:17.419 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is off 2023-12-22T08:12:17.519 INFO:teuthology.orchestra.console.smithi144:Power off completed 2023-12-22T08:12:17.620 INFO:teuthology.orchestra.console.smithi144:Power on 2023-12-22T08:12:17.620 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-22T08:12:17.640 DEBUG:teuthology.orchestra.console.smithi144:power on output: Chassis Power Control: Up/On 2023-12-22T08:12:17.641 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T08:12:17.660 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is off 2023-12-22T08:12:21.661 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T08:12:21.770 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is on 2023-12-22T08:12:21.871 INFO:teuthology.orchestra.console.smithi144:Power on completed 2023-12-22T08:12:21.971 INFO:teuthology.provision.fog.smithi144:Waiting for deploy to finish 2023-12-22T08:18:10.861 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:18:13.938 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-12-22T08:18:19.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:18:22.993 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-12-22T08:18:29.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:18:32.081 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-12-22T08:18:38.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:18:41.137 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-12-22T08:18:47.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:18:50.225 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-12-22T08:18:56.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:18:59.281 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-12-22T08:19:05.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:19:08.369 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-12-22T08:19:14.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:19:32.754 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-12-22T08:19:38.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:19:41.810 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-12-22T08:19:47.817 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:19:50.897 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-12-22T08:19:56.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:19:57.757 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-22T08:19:57.758 DEBUG:teuthology.orchestra.run.smithi144:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-22T08:20:06.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:20:06.361 ERROR:teuthology.orchestra.connection:Error authenticating with smithi086.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-22T08:20:13.533 INFO:teuthology.provision.fog.smithi144:Node is ready 2023-12-22T08:20:13.533 DEBUG:teuthology.orchestra.run.smithi144:> hostname 2023-12-22T08:20:13.555 INFO:teuthology.orchestra.run.smithi144.stdout:smithi144.front.sepia.ceph.com 2023-12-22T08:20:13.555 DEBUG:teuthology.orchestra.run.smithi144:> grep smithi144.front.sepia.ceph.com /etc/hosts 2023-12-22T08:20:13.615 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.15.144 smithi144.front.sepia.ceph.com smithi144 2023-12-22T08:20:13.615 DEBUG:teuthology.orchestra.run.smithi144:> sudo hostname smithi144 2023-12-22T08:20:13.733 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i -e 's/smithi144.front.sepia.ceph.com/smithi144/g' /etc/hosts 2023-12-22T08:20:13.763 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i -e 's/172.21.15.144/172.21.15.144/g' /etc/hosts 2023-12-22T08:20:13.832 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i -e 's/smithi144.front.sepia.ceph.com/smithi144/g' /etc/hostname 2023-12-22T08:20:13.901 DEBUG:teuthology.orchestra.run.smithi144:> sudo hostname smithi144 2023-12-22T08:20:13.969 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release 2023-12-22T08:20:14.026 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="Red Hat Enterprise Linux" 2023-12-22T08:20:14.027 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="8.6 (Ootpa)" 2023-12-22T08:20:14.027 INFO:teuthology.orchestra.run.smithi144.stdout:ID="rhel" 2023-12-22T08:20:14.027 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE="fedora" 2023-12-22T08:20:14.027 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="8.6" 2023-12-22T08:20:14.027 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM_ID="platform:el8" 2023-12-22T08:20:14.027 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-22T08:20:14.027 INFO:teuthology.orchestra.run.smithi144.stdout:ANSI_COLOR="0;31" 2023-12-22T08:20:14.027 INFO:teuthology.orchestra.run.smithi144.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-22T08:20:14.027 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://www.redhat.com/" 2023-12-22T08:20:14.027 INFO:teuthology.orchestra.run.smithi144.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-22T08:20:14.027 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-22T08:20:14.027 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-22T08:20:14.027 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-22T08:20:14.027 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-22T08:20:14.028 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-22T08:20:14.028 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-22T08:20:14.028 INFO:teuthology.provision.fog.smithi144:Deploy complete! 2023-12-22T08:20:14.030 DEBUG:teuthology.parallel:result is None 2023-12-22T08:21:10.363 WARNING:teuthology.provision.fog.smithi086:timed out 2023-12-22T08:21:16.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:21:34.866 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-12-22T08:21:40.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:21:43.922 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-12-22T08:21:49.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:21:50.181 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-22T08:21:50.182 DEBUG:teuthology.orchestra.run.smithi086:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-22T08:22:05.648 INFO:teuthology.provision.fog.smithi086:Node is ready 2023-12-22T08:22:05.648 DEBUG:teuthology.orchestra.run.smithi086:> hostname 2023-12-22T08:22:05.710 INFO:teuthology.orchestra.run.smithi086.stdout:smithi045 2023-12-22T08:22:05.710 DEBUG:teuthology.orchestra.run.smithi086:> grep smithi045 /etc/hosts 2023-12-22T08:22:05.769 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T08:22:05.770 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/smithi045/smithi086/g' /etc/hostname 2023-12-22T08:22:05.904 DEBUG:teuthology.orchestra.run.smithi086:> sudo hostname smithi086 2023-12-22T08:22:05.934 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release 2023-12-22T08:22:05.992 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="Red Hat Enterprise Linux" 2023-12-22T08:22:05.992 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="8.6 (Ootpa)" 2023-12-22T08:22:05.993 INFO:teuthology.orchestra.run.smithi086.stdout:ID="rhel" 2023-12-22T08:22:05.993 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="fedora" 2023-12-22T08:22:05.993 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="8.6" 2023-12-22T08:22:05.993 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el8" 2023-12-22T08:22:05.993 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-22T08:22:05.993 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31" 2023-12-22T08:22:05.993 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-22T08:22:05.993 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://www.redhat.com/" 2023-12-22T08:22:05.993 INFO:teuthology.orchestra.run.smithi086.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-22T08:22:05.993 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-22T08:22:05.993 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-12-22T08:22:05.993 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-22T08:22:05.993 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-22T08:22:05.993 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-22T08:22:05.994 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-22T08:22:05.994 INFO:teuthology.provision.fog.smithi086:Deploy complete! 2023-12-22T08:22:05.994 DEBUG:teuthology.parallel:result is None 2023-12-22T08:22:06.140 INFO:teuthology.lock.ops:Checking smithi086.front.sepia.ceph.com 2023-12-22T08:22:06.140 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-22T08:22:06.164 INFO:teuthology.lock.ops:Checking smithi144.front.sepia.ceph.com 2023-12-22T08:22:06.164 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-22T08:22:06.182 INFO:teuthology.lock.ops:Updating [smithi086.front.sepia.ceph.com]: set os type and version on server 2023-12-22T08:22:06.182 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2023-12-22T08:22:06.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:22:06.249 DEBUG:teuthology.orchestra.run.smithi086:> true 2023-12-22T08:22:06.315 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi086.front.sepia.ceph.com' 2023-12-22T08:22:06.315 DEBUG:teuthology.orchestra.run.smithi086:> uname -m 2023-12-22T08:22:06.372 INFO:teuthology.orchestra.run.smithi086.stdout:x86_64 2023-12-22T08:22:06.372 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release 2023-12-22T08:22:06.429 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="Red Hat Enterprise Linux" 2023-12-22T08:22:06.429 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="8.6 (Ootpa)" 2023-12-22T08:22:06.429 INFO:teuthology.orchestra.run.smithi086.stdout:ID="rhel" 2023-12-22T08:22:06.429 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="fedora" 2023-12-22T08:22:06.429 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="8.6" 2023-12-22T08:22:06.429 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el8" 2023-12-22T08:22:06.429 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-22T08:22:06.429 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31" 2023-12-22T08:22:06.429 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-22T08:22:06.430 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://www.redhat.com/" 2023-12-22T08:22:06.430 INFO:teuthology.orchestra.run.smithi086.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-22T08:22:06.430 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-22T08:22:06.430 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-12-22T08:22:06.430 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-22T08:22:06.430 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-22T08:22:06.430 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-22T08:22:06.430 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-22T08:22:06.430 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2023-12-22T08:22:06.456 INFO:teuthology.lock.ops:Updating [smithi144.front.sepia.ceph.com]: set os type and version on server 2023-12-22T08:22:06.456 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-12-22T08:22:06.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:22:06.526 DEBUG:teuthology.orchestra.run.smithi144:> true 2023-12-22T08:22:06.663 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-12-22T08:22:06.663 DEBUG:teuthology.orchestra.run.smithi144:> uname -m 2023-12-22T08:22:06.721 INFO:teuthology.orchestra.run.smithi144.stdout:x86_64 2023-12-22T08:22:06.721 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release 2023-12-22T08:22:06.778 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="Red Hat Enterprise Linux" 2023-12-22T08:22:06.779 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="8.6 (Ootpa)" 2023-12-22T08:22:06.779 INFO:teuthology.orchestra.run.smithi144.stdout:ID="rhel" 2023-12-22T08:22:06.779 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE="fedora" 2023-12-22T08:22:06.779 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="8.6" 2023-12-22T08:22:06.779 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM_ID="platform:el8" 2023-12-22T08:22:06.779 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-22T08:22:06.779 INFO:teuthology.orchestra.run.smithi144.stdout:ANSI_COLOR="0;31" 2023-12-22T08:22:06.779 INFO:teuthology.orchestra.run.smithi144.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-22T08:22:06.779 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://www.redhat.com/" 2023-12-22T08:22:06.779 INFO:teuthology.orchestra.run.smithi144.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-22T08:22:06.779 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-22T08:22:06.779 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-22T08:22:06.779 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-22T08:22:06.779 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-22T08:22:06.780 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-22T08:22:06.780 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-22T08:22:06.780 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server 2023-12-22T08:22:06.798 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T08:22:06.888 INFO:teuthology.dispatcher.supervisor:Running job 7499291 2023-12-22T08:22:06.888 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_9680d2aba1e76f64ade295c81599c97907457848/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499291 --name rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi --description fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} -- /home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499291/orig.config.yaml 2023-12-22T08:22:06.891 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499291 2023-12-22T08:22:06.891 INFO:teuthology.dispatcher.supervisor:Job PID: 1081627 2023-12-22T08:22:06.892 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-22T08:24:06.893 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T08:26:06.961 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T08:28:07.034 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T08:30:07.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T08:32:07.184 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T08:32:07.256 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-22T08:32:07.388 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-22T08:32:07.389 INFO:teuthology.nuke:Checking targets against current locks 2023-12-22T08:32:07.437 DEBUG:teuthology.nuke:shortname: smithi086 2023-12-22T08:32:07.438 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-22T08:32:07.461 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi086.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499291', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-22 08:12:03.303407', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOrpoYomu/6dEDyuMHB5Erq0nr32HcBzGZsSQ4VqkQ7z+iS2DbByrGEdicbv/gB3Tsp8BiD7u4zPi2BkoaAhCBo='} 2023-12-22T08:32:07.466 DEBUG:teuthology.nuke:shortname: smithi144 2023-12-22T08:32:07.467 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-22T08:32:07.486 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi144.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499291', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-22 08:12:03.305248', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFgJ46EkcQc31Gy9lmU6ly7sNu96SjjQxUe0iW+2KHJfX7pG4y8vMEm4Lur2qr2RFuGxVMUONjq5FWxZccvXzxY='} 2023-12-22T08:32:07.523 INFO:teuthology.orchestra.console.smithi086:Power off 2023-12-22T08:32:07.523 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-22T08:32:07.549 DEBUG:teuthology.orchestra.console.smithi086:power off output: Chassis Power Control: Down/Off 2023-12-22T08:32:07.550 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T08:32:07.568 INFO:teuthology.orchestra.console.smithi144:Power off 2023-12-22T08:32:07.568 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-22T08:32:07.580 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off 2023-12-22T08:32:07.617 DEBUG:teuthology.orchestra.console.smithi144:power off output: Chassis Power Control: Down/Off 2023-12-22T08:32:07.617 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T08:32:07.647 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is off 2023-12-22T08:32:07.682 INFO:teuthology.orchestra.console.smithi086:Power off completed 2023-12-22T08:32:07.749 INFO:teuthology.orchestra.console.smithi144:Power off completed 2023-12-22T08:32:07.846 INFO:teuthology.lock.ops:unlocked: smithi086.front.sepia.ceph.com 2023-12-22T08:32:07.896 INFO:teuthology.lock.ops:unlocked: smithi144.front.sepia.ceph.com