2023-12-14T04:13:36.345 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-14T04:13:36.346 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T04:13:36.493 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd99a9a6940>, signals=[15]) 2023-12-14T04:13:36.494 INFO:teuthology.lock.ops:Start node 'smithi093.front.sepia.ceph.com' reimaging 2023-12-14T04:13:36.494 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: reset os type and version on server 2023-12-14T04:13:36.494 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server 2023-12-14T04:13:36.519 INFO:teuthology.lock.ops:Start node 'smithi188.front.sepia.ceph.com' reimaging 2023-12-14T04:13:36.520 INFO:teuthology.lock.ops:Updating [smithi188.front.sepia.ceph.com]: reset os type and version on server 2023-12-14T04:13:36.520 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server 2023-12-14T04:13:36.636 DEBUG:teuthology.provision.fog.smithi093:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-14T04:13:36.652 DEBUG:teuthology.provision.fog.smithi188:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-14T04:13:36.683 INFO:teuthology.provision.fog.smithi093:Scheduling deploy of rhel 8.6 2023-12-14T04:13:36.691 INFO:teuthology.provision.fog.smithi188:Scheduling deploy of rhel 8.6 2023-12-14T04:13:36.902 INFO:teuthology.orchestra.console.smithi188:Power off 2023-12-14T04:13:36.902 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-14T04:13:36.918 INFO:teuthology.orchestra.console.smithi093:Power off 2023-12-14T04:13:36.919 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-14T04:13:36.930 DEBUG:teuthology.orchestra.console.smithi188:power off output: Chassis Power Control: Down/Off 2023-12-14T04:13:36.930 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T04:13:36.945 DEBUG:teuthology.orchestra.console.smithi093:power off output: Chassis Power Control: Down/Off 2023-12-14T04:13:36.945 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T04:13:36.955 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is off 2023-12-14T04:13:36.969 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on 2023-12-14T04:13:37.057 INFO:teuthology.orchestra.console.smithi188:Power off completed 2023-12-14T04:13:37.157 INFO:teuthology.orchestra.console.smithi188:Power on 2023-12-14T04:13:37.158 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-14T04:13:37.182 DEBUG:teuthology.orchestra.console.smithi188:power on output: Chassis Power Control: Up/On 2023-12-14T04:13:37.182 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T04:13:37.207 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is off 2023-12-14T04:13:40.973 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T04:13:41.083 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on 2023-12-14T04:13:41.208 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T04:13:41.317 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on 2023-12-14T04:13:41.418 INFO:teuthology.orchestra.console.smithi188:Power on completed 2023-12-14T04:13:41.518 INFO:teuthology.provision.fog.smithi188:Waiting for deploy to finish 2023-12-14T04:13:45.088 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T04:13:45.197 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on 2023-12-14T04:13:49.201 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T04:13:49.310 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off 2023-12-14T04:13:49.410 INFO:teuthology.orchestra.console.smithi093:Power off completed 2023-12-14T04:13:49.511 INFO:teuthology.orchestra.console.smithi093:Power on 2023-12-14T04:13:49.511 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-14T04:13:49.537 DEBUG:teuthology.orchestra.console.smithi093:power on output: Chassis Power Control: Up/On 2023-12-14T04:13:49.537 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T04:13:49.562 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off 2023-12-14T04:13:53.566 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T04:13:53.676 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off 2023-12-14T04:13:57.678 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T04:13:57.788 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on 2023-12-14T04:13:57.888 INFO:teuthology.orchestra.console.smithi093:Power on completed 2023-12-14T04:13:57.989 INFO:teuthology.provision.fog.smithi093:Waiting for deploy to finish 2023-12-14T04:16:27.325 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T04:16:30.385 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-12-14T04:16:36.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T04:16:39.477 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-12-14T04:16:43.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T04:16:45.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T04:16:46.805 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-12-14T04:16:48.561 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-12-14T04:16:52.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T04:16:54.565 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T04:16:55.889 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-12-14T04:16:57.617 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-12-14T04:17:01.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T04:17:03.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T04:17:04.949 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-12-14T04:17:06.673 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-12-14T04:17:10.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T04:17:12.677 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T04:17:14.035 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-12-14T04:17:15.729 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-12-14T04:17:20.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T04:17:21.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T04:17:23.121 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-12-14T04:17:29.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T04:17:32.177 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-12-14T04:17:38.182 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T04:18:21.774 WARNING:teuthology.provision.fog.smithi188:timed out 2023-12-14T04:18:27.778 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T04:18:28.225 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-14T04:18:28.225 DEBUG:teuthology.orchestra.run.smithi188:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-14T04:18:28.524 INFO:teuthology.provision.fog.smithi188:Node is ready 2023-12-14T04:18:28.525 DEBUG:teuthology.orchestra.run.smithi188:> hostname 2023-12-14T04:18:28.542 INFO:teuthology.orchestra.run.smithi188.stdout:smithi188.front.sepia.ceph.com 2023-12-14T04:18:28.542 DEBUG:teuthology.orchestra.run.smithi188:> grep smithi188.front.sepia.ceph.com /etc/hosts 2023-12-14T04:18:28.603 INFO:teuthology.orchestra.run.smithi188.stdout:172.21.15.188 smithi188.front.sepia.ceph.com smithi188 2023-12-14T04:18:28.603 DEBUG:teuthology.orchestra.run.smithi188:> sudo hostname smithi188 2023-12-14T04:18:28.739 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/smithi188.front.sepia.ceph.com/smithi188/g' /etc/hosts 2023-12-14T04:18:28.767 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/172.21.15.188/172.21.15.188/g' /etc/hosts 2023-12-14T04:18:28.837 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/smithi188.front.sepia.ceph.com/smithi188/g' /etc/hostname 2023-12-14T04:18:28.908 DEBUG:teuthology.orchestra.run.smithi188:> sudo hostname smithi188 2023-12-14T04:18:28.978 DEBUG:teuthology.orchestra.run.smithi188:> cat /etc/os-release 2023-12-14T04:18:29.038 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="Red Hat Enterprise Linux" 2023-12-14T04:18:29.038 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="8.6 (Ootpa)" 2023-12-14T04:18:29.038 INFO:teuthology.orchestra.run.smithi188.stdout:ID="rhel" 2023-12-14T04:18:29.038 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="fedora" 2023-12-14T04:18:29.038 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="8.6" 2023-12-14T04:18:29.039 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el8" 2023-12-14T04:18:29.039 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-14T04:18:29.039 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31" 2023-12-14T04:18:29.039 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-14T04:18:29.039 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://www.redhat.com/" 2023-12-14T04:18:29.039 INFO:teuthology.orchestra.run.smithi188.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-14T04:18:29.039 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-14T04:18:29.039 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-14T04:18:29.040 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-14T04:18:29.040 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-14T04:18:29.040 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-14T04:18:29.041 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-14T04:18:29.041 INFO:teuthology.provision.fog.smithi188:Deploy complete! 2023-12-14T04:18:29.043 DEBUG:teuthology.parallel:result is None 2023-12-14T04:18:38.189 WARNING:teuthology.provision.fog.smithi093:timed out 2023-12-14T04:18:44.196 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T04:18:44.586 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-14T04:18:44.587 DEBUG:teuthology.orchestra.run.smithi093:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-14T04:18:44.882 INFO:teuthology.provision.fog.smithi093:Node is ready 2023-12-14T04:18:44.883 DEBUG:teuthology.orchestra.run.smithi093:> hostname 2023-12-14T04:18:44.903 INFO:teuthology.orchestra.run.smithi093.stdout:smithi093 2023-12-14T04:18:44.903 DEBUG:teuthology.orchestra.run.smithi093:> grep smithi093 /etc/hosts 2023-12-14T04:18:44.963 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93 smithi093.front.sepia.ceph.com smithi093 2023-12-14T04:18:44.964 DEBUG:teuthology.orchestra.run.smithi093:> sudo hostname smithi093 2023-12-14T04:18:45.083 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/smithi093/smithi093/g' /etc/hosts 2023-12-14T04:18:45.114 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/172.21.15.93/172.21.15.93/g' /etc/hosts 2023-12-14T04:18:45.181 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/smithi093/smithi093/g' /etc/hostname 2023-12-14T04:18:45.248 DEBUG:teuthology.orchestra.run.smithi093:> sudo hostname smithi093 2023-12-14T04:18:45.312 DEBUG:teuthology.orchestra.run.smithi093:> cat /etc/os-release 2023-12-14T04:18:45.367 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="Red Hat Enterprise Linux" 2023-12-14T04:18:45.367 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="8.6 (Ootpa)" 2023-12-14T04:18:45.367 INFO:teuthology.orchestra.run.smithi093.stdout:ID="rhel" 2023-12-14T04:18:45.367 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE="fedora" 2023-12-14T04:18:45.367 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="8.6" 2023-12-14T04:18:45.367 INFO:teuthology.orchestra.run.smithi093.stdout:PLATFORM_ID="platform:el8" 2023-12-14T04:18:45.367 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-14T04:18:45.367 INFO:teuthology.orchestra.run.smithi093.stdout:ANSI_COLOR="0;31" 2023-12-14T04:18:45.367 INFO:teuthology.orchestra.run.smithi093.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-14T04:18:45.367 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://www.redhat.com/" 2023-12-14T04:18:45.368 INFO:teuthology.orchestra.run.smithi093.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-14T04:18:45.368 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-14T04:18:45.368 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-14T04:18:45.368 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-14T04:18:45.368 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-14T04:18:45.368 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-14T04:18:45.368 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-14T04:18:45.369 INFO:teuthology.provision.fog.smithi093:Deploy complete! 2023-12-14T04:18:45.369 DEBUG:teuthology.parallel:result is None 2023-12-14T04:18:45.524 INFO:teuthology.lock.ops:Checking smithi093.front.sepia.ceph.com 2023-12-14T04:18:45.524 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-14T04:18:45.543 INFO:teuthology.lock.ops:Checking smithi188.front.sepia.ceph.com 2023-12-14T04:18:45.543 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-14T04:18:45.561 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: set os type and version on server 2023-12-14T04:18:45.561 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-12-14T04:18:45.562 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T04:18:45.627 DEBUG:teuthology.orchestra.run.smithi093:> true 2023-12-14T04:18:45.694 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-12-14T04:18:45.694 DEBUG:teuthology.orchestra.run.smithi093:> uname -m 2023-12-14T04:18:45.750 INFO:teuthology.orchestra.run.smithi093.stdout:x86_64 2023-12-14T04:18:45.750 DEBUG:teuthology.orchestra.run.smithi093:> cat /etc/os-release 2023-12-14T04:18:45.806 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="Red Hat Enterprise Linux" 2023-12-14T04:18:45.806 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="8.6 (Ootpa)" 2023-12-14T04:18:45.806 INFO:teuthology.orchestra.run.smithi093.stdout:ID="rhel" 2023-12-14T04:18:45.806 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE="fedora" 2023-12-14T04:18:45.807 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="8.6" 2023-12-14T04:18:45.807 INFO:teuthology.orchestra.run.smithi093.stdout:PLATFORM_ID="platform:el8" 2023-12-14T04:18:45.807 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-14T04:18:45.807 INFO:teuthology.orchestra.run.smithi093.stdout:ANSI_COLOR="0;31" 2023-12-14T04:18:45.807 INFO:teuthology.orchestra.run.smithi093.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-14T04:18:45.807 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://www.redhat.com/" 2023-12-14T04:18:45.807 INFO:teuthology.orchestra.run.smithi093.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-14T04:18:45.807 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-14T04:18:45.807 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-14T04:18:45.807 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-14T04:18:45.807 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-14T04:18:45.807 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-14T04:18:45.807 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-14T04:18:45.808 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server 2023-12-14T04:18:45.827 INFO:teuthology.lock.ops:Updating [smithi188.front.sepia.ceph.com]: set os type and version on server 2023-12-14T04:18:45.827 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2023-12-14T04:18:45.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T04:18:45.895 DEBUG:teuthology.orchestra.run.smithi188:> true 2023-12-14T04:18:46.031 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi188.front.sepia.ceph.com' 2023-12-14T04:18:46.032 DEBUG:teuthology.orchestra.run.smithi188:> uname -m 2023-12-14T04:18:46.090 INFO:teuthology.orchestra.run.smithi188.stdout:x86_64 2023-12-14T04:18:46.090 DEBUG:teuthology.orchestra.run.smithi188:> cat /etc/os-release 2023-12-14T04:18:46.148 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="Red Hat Enterprise Linux" 2023-12-14T04:18:46.148 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="8.6 (Ootpa)" 2023-12-14T04:18:46.148 INFO:teuthology.orchestra.run.smithi188.stdout:ID="rhel" 2023-12-14T04:18:46.148 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="fedora" 2023-12-14T04:18:46.148 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="8.6" 2023-12-14T04:18:46.148 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el8" 2023-12-14T04:18:46.149 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-14T04:18:46.149 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31" 2023-12-14T04:18:46.149 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-14T04:18:46.149 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://www.redhat.com/" 2023-12-14T04:18:46.149 INFO:teuthology.orchestra.run.smithi188.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-14T04:18:46.149 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-14T04:18:46.149 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-14T04:18:46.149 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-14T04:18:46.149 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-14T04:18:46.149 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-14T04:18:46.149 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-14T04:18:46.150 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server 2023-12-14T04:18:46.177 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T04:18:46.273 INFO:teuthology.dispatcher.supervisor:Running job 7490117 2023-12-14T04:18:46.273 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-12-13_12:45:12-fs-wip-vshankar-testing-20231213.072106-testing-default-smithi/7490117 --name vshankar-2023-12-13_12:45:12-fs-wip-vshankar-testing-20231213.072106-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds_creation_retry} -- /home/teuthworker/archive/vshankar-2023-12-13_12:45:12-fs-wip-vshankar-testing-20231213.072106-testing-default-smithi/7490117/orig.config.yaml 2023-12-14T04:18:46.276 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-12-13_12:45:12-fs-wip-vshankar-testing-20231213.072106-testing-default-smithi/7490117 2023-12-14T04:18:46.277 INFO:teuthology.dispatcher.supervisor:Job PID: 2983832 2023-12-14T04:18:46.278 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-14T04:20:46.378 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T04:22:46.562 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T04:24:46.726 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T04:26:46.902 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T04:26:46.984 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-14T04:26:47.090 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-14T04:26:47.090 INFO:teuthology.nuke:Checking targets against current locks 2023-12-14T04:26:47.139 DEBUG:teuthology.nuke:shortname: smithi093 2023-12-14T04:26:47.140 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-14T04:26:47.151 DEBUG:teuthology.nuke:shortname: smithi188 2023-12-14T04:26:47.151 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-14T04:26:47.161 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi093.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-13_12:45:12-fs-wip-vshankar-testing-20231213.072106-testing-default-smithi/7490117', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-14 04:13:35.484523', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB3R/s4x+o54ih9Uz5kPSXiRyLWVLCaJ9cKp1BNBbY4BMfE40ClL8QiAmNFBPa9HkLz4lVgyyCVMcdhxOcfMlNM='} 2023-12-14T04:26:47.173 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi188.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-13_12:45:12-fs-wip-vshankar-testing-20231213.072106-testing-default-smithi/7490117', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-14 04:13:35.482962', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF5mNfGnUhSeYWdIjzxvQaUF+jDi9UplsrJ5HgIJ6w7Y1KwJH5SUk9mIggvF1t98IoaR8h1ogVBBzMRP3hlDVU4='} 2023-12-14T04:26:47.205 INFO:teuthology.orchestra.console.smithi093:Power off 2023-12-14T04:26:47.205 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-14T04:26:47.218 INFO:teuthology.orchestra.console.smithi188:Power off 2023-12-14T04:26:47.219 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-14T04:26:47.228 DEBUG:teuthology.orchestra.console.smithi093:power off output: Chassis Power Control: Down/Off 2023-12-14T04:26:47.229 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T04:26:47.241 DEBUG:teuthology.orchestra.console.smithi188:power off output: Chassis Power Control: Down/Off 2023-12-14T04:26:47.241 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T04:26:47.251 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off 2023-12-14T04:26:47.261 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is off 2023-12-14T04:26:47.351 INFO:teuthology.orchestra.console.smithi093:Power off completed 2023-12-14T04:26:47.362 INFO:teuthology.orchestra.console.smithi188:Power off completed 2023-12-14T04:26:47.508 INFO:teuthology.lock.ops:unlocked: smithi093.front.sepia.ceph.com 2023-12-14T04:26:47.515 INFO:teuthology.lock.ops:unlocked: smithi188.front.sepia.ceph.com