2023-12-22T09:40:09.396 INFO:root:teuthology version: 0.0.1.dev226+g9680d2a 2023-12-22T09:40:09.396 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T09:40:09.546 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa257e27940>, signals=[15]) 2023-12-22T09:40:09.547 INFO:teuthology.lock.ops:Start node 'smithi016.front.sepia.ceph.com' reimaging 2023-12-22T09:40:09.547 INFO:teuthology.lock.ops:Updating [smithi016.front.sepia.ceph.com]: reset os type and version on server 2023-12-22T09:40:09.547 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server 2023-12-22T09:40:09.568 INFO:teuthology.lock.ops:Start node 'smithi038.front.sepia.ceph.com' reimaging 2023-12-22T09:40:09.568 INFO:teuthology.lock.ops:Updating [smithi038.front.sepia.ceph.com]: reset os type and version on server 2023-12-22T09:40:09.569 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2023-12-22T09:40:09.694 DEBUG:teuthology.provision.fog.smithi016:Requesting image smithi_rhel_8.4 (ID 7) 2023-12-22T09:40:09.717 DEBUG:teuthology.provision.fog.smithi038:Requesting image smithi_rhel_8.4 (ID 7) 2023-12-22T09:40:09.746 INFO:teuthology.provision.fog.smithi016:Scheduling deploy of rhel 8.4 2023-12-22T09:40:09.769 INFO:teuthology.provision.fog.smithi038:Scheduling deploy of rhel 8.4 2023-12-22T09:40:10.034 INFO:teuthology.orchestra.console.smithi016:Power off 2023-12-22T09:40:10.034 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-22T09:40:10.048 INFO:teuthology.orchestra.console.smithi038:Power off 2023-12-22T09:40:10.048 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-22T09:40:10.057 DEBUG:teuthology.orchestra.console.smithi016:power off output: Chassis Power Control: Down/Off 2023-12-22T09:40:10.057 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T09:40:10.067 DEBUG:teuthology.orchestra.console.smithi038:power off output: Chassis Power Control: Down/Off 2023-12-22T09:40:10.068 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T09:40:10.078 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is off 2023-12-22T09:40:10.089 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is off 2023-12-22T09:40:10.179 INFO:teuthology.orchestra.console.smithi016:Power off completed 2023-12-22T09:40:10.190 INFO:teuthology.orchestra.console.smithi038:Power off completed 2023-12-22T09:40:10.280 INFO:teuthology.orchestra.console.smithi016:Power on 2023-12-22T09:40:10.280 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-22T09:40:10.293 INFO:teuthology.orchestra.console.smithi038:Power on 2023-12-22T09:40:10.293 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-22T09:40:10.308 DEBUG:teuthology.orchestra.console.smithi016:power on output: Chassis Power Control: Up/On 2023-12-22T09:40:10.308 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T09:40:10.317 DEBUG:teuthology.orchestra.console.smithi038:power on output: Chassis Power Control: Up/On 2023-12-22T09:40:10.318 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T09:40:10.332 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is off 2023-12-22T09:40:10.343 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is off 2023-12-22T09:40:14.334 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T09:40:14.343 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T09:40:14.444 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is off 2023-12-22T09:40:14.452 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is off 2023-12-22T09:40:18.445 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T09:40:18.453 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T09:40:18.556 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is on 2023-12-22T09:40:18.562 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is on 2023-12-22T09:40:18.657 INFO:teuthology.orchestra.console.smithi016:Power on completed 2023-12-22T09:40:18.663 INFO:teuthology.orchestra.console.smithi038:Power on completed 2023-12-22T09:40:18.758 INFO:teuthology.provision.fog.smithi016:Waiting for deploy to finish 2023-12-22T09:40:18.763 INFO:teuthology.provision.fog.smithi038:Waiting for deploy to finish 2023-12-22T09:42:49.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T09:42:49.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T09:42:52.722 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16 2023-12-22T09:42:52.722 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2023-12-22T09:42:58.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T09:42:58.730 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T09:43:01.813 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2023-12-22T09:43:01.814 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16 2023-12-22T09:43:07.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T09:43:07.821 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T09:43:10.898 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2023-12-22T09:43:10.898 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16 2023-12-22T09:43:16.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T09:43:16.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T09:43:19.957 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2023-12-22T09:43:19.989 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16 2023-12-22T09:43:25.962 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T09:43:25.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T09:43:29.045 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16 2023-12-22T09:43:29.046 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2023-12-22T09:43:35.050 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T09:43:35.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T09:43:38.129 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16 2023-12-22T09:43:38.130 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2023-12-22T09:43:44.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T09:43:44.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T09:44:44.195 WARNING:teuthology.provision.fog.smithi016:timed out 2023-12-22T09:44:44.196 WARNING:teuthology.provision.fog.smithi038:timed out 2023-12-22T09:44:50.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T09:44:50.205 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T09:44:50.472 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-22T09:44:50.473 DEBUG:teuthology.orchestra.run.smithi016:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-22T09:44:50.554 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-22T09:44:50.554 DEBUG:teuthology.orchestra.run.smithi038:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-22T09:44:50.751 INFO:teuthology.provision.fog.smithi016:Node is ready 2023-12-22T09:44:50.751 DEBUG:teuthology.orchestra.run.smithi016:> hostname 2023-12-22T09:44:50.767 INFO:teuthology.orchestra.run.smithi016.stdout:smithi016.front.sepia.ceph.com 2023-12-22T09:44:50.768 DEBUG:teuthology.orchestra.run.smithi016:> grep smithi016.front.sepia.ceph.com /etc/hosts 2023-12-22T09:44:50.824 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16 smithi016.front.sepia.ceph.com smithi016 2023-12-22T09:44:50.824 DEBUG:teuthology.orchestra.run.smithi016:> sudo hostname smithi016 2023-12-22T09:44:50.862 INFO:teuthology.provision.fog.smithi038:Node is ready 2023-12-22T09:44:50.862 DEBUG:teuthology.orchestra.run.smithi038:> hostname 2023-12-22T09:44:50.919 INFO:teuthology.orchestra.run.smithi038.stdout:smithi038.front.sepia.ceph.com 2023-12-22T09:44:50.919 DEBUG:teuthology.orchestra.run.smithi038:> grep smithi038.front.sepia.ceph.com /etc/hosts 2023-12-22T09:44:50.920 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i -e 's/smithi016.front.sepia.ceph.com/smithi016/g' /etc/hosts 2023-12-22T09:44:50.946 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i -e 's/172.21.15.16/172.21.15.16/g' /etc/hosts 2023-12-22T09:44:50.978 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38 smithi038.front.sepia.ceph.com smithi038 2023-12-22T09:44:50.978 DEBUG:teuthology.orchestra.run.smithi038:> sudo hostname smithi038 2023-12-22T09:44:51.014 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i -e 's/smithi016.front.sepia.ceph.com/smithi016/g' /etc/hostname 2023-12-22T09:44:51.079 DEBUG:teuthology.orchestra.run.smithi016:> sudo hostname smithi016 2023-12-22T09:44:51.112 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/smithi038.front.sepia.ceph.com/smithi038/g' /etc/hosts 2023-12-22T09:44:51.139 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/172.21.15.38/172.21.15.38/g' /etc/hosts 2023-12-22T09:44:51.142 DEBUG:teuthology.orchestra.run.smithi016:> cat /etc/os-release 2023-12-22T09:44:51.198 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="Red Hat Enterprise Linux" 2023-12-22T09:44:51.198 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="8.4 (Ootpa)" 2023-12-22T09:44:51.198 INFO:teuthology.orchestra.run.smithi016.stdout:ID="rhel" 2023-12-22T09:44:51.198 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE="fedora" 2023-12-22T09:44:51.198 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="8.4" 2023-12-22T09:44:51.198 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM_ID="platform:el8" 2023-12-22T09:44:51.198 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-22T09:44:51.198 INFO:teuthology.orchestra.run.smithi016.stdout:ANSI_COLOR="0;31" 2023-12-22T09:44:51.198 INFO:teuthology.orchestra.run.smithi016.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-22T09:44:51.198 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://www.redhat.com/" 2023-12-22T09:44:51.199 INFO:teuthology.orchestra.run.smithi016.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-22T09:44:51.199 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-22T09:44:51.199 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-12-22T09:44:51.199 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-22T09:44:51.199 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-22T09:44:51.199 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-22T09:44:51.199 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-22T09:44:51.200 INFO:teuthology.provision.fog.smithi016:Deploy complete! 2023-12-22T09:44:51.201 DEBUG:teuthology.parallel:result is None 2023-12-22T09:44:51.206 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/smithi038.front.sepia.ceph.com/smithi038/g' /etc/hostname 2023-12-22T09:44:51.272 DEBUG:teuthology.orchestra.run.smithi038:> sudo hostname smithi038 2023-12-22T09:44:51.339 DEBUG:teuthology.orchestra.run.smithi038:> cat /etc/os-release 2023-12-22T09:44:51.394 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="Red Hat Enterprise Linux" 2023-12-22T09:44:51.394 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="8.4 (Ootpa)" 2023-12-22T09:44:51.394 INFO:teuthology.orchestra.run.smithi038.stdout:ID="rhel" 2023-12-22T09:44:51.394 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="fedora" 2023-12-22T09:44:51.394 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="8.4" 2023-12-22T09:44:51.394 INFO:teuthology.orchestra.run.smithi038.stdout:PLATFORM_ID="platform:el8" 2023-12-22T09:44:51.395 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-22T09:44:51.395 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31" 2023-12-22T09:44:51.395 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-22T09:44:51.395 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://www.redhat.com/" 2023-12-22T09:44:51.395 INFO:teuthology.orchestra.run.smithi038.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-22T09:44:51.395 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-22T09:44:51.395 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T09:44:51.395 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-22T09:44:51.395 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-22T09:44:51.395 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-22T09:44:51.395 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-22T09:44:51.396 INFO:teuthology.provision.fog.smithi038:Deploy complete! 2023-12-22T09:44:51.396 DEBUG:teuthology.parallel:result is None 2023-12-22T09:44:51.554 INFO:teuthology.lock.ops:Checking smithi016.front.sepia.ceph.com 2023-12-22T09:44:51.554 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-22T09:44:51.589 INFO:teuthology.lock.ops:Checking smithi038.front.sepia.ceph.com 2023-12-22T09:44:51.589 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-22T09:44:51.607 INFO:teuthology.lock.ops:Updating [smithi016.front.sepia.ceph.com]: set os type and version on server 2023-12-22T09:44:51.607 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2023-12-22T09:44:51.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T09:44:51.676 DEBUG:teuthology.orchestra.run.smithi016:> true 2023-12-22T09:44:51.697 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi016.front.sepia.ceph.com' 2023-12-22T09:44:51.697 DEBUG:teuthology.orchestra.run.smithi016:> uname -m 2023-12-22T09:44:51.751 INFO:teuthology.orchestra.run.smithi016.stdout:x86_64 2023-12-22T09:44:51.751 DEBUG:teuthology.orchestra.run.smithi016:> cat /etc/os-release 2023-12-22T09:44:51.805 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="Red Hat Enterprise Linux" 2023-12-22T09:44:51.805 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="8.4 (Ootpa)" 2023-12-22T09:44:51.805 INFO:teuthology.orchestra.run.smithi016.stdout:ID="rhel" 2023-12-22T09:44:51.805 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE="fedora" 2023-12-22T09:44:51.805 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="8.4" 2023-12-22T09:44:51.806 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM_ID="platform:el8" 2023-12-22T09:44:51.806 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-22T09:44:51.806 INFO:teuthology.orchestra.run.smithi016.stdout:ANSI_COLOR="0;31" 2023-12-22T09:44:51.806 INFO:teuthology.orchestra.run.smithi016.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-22T09:44:51.806 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://www.redhat.com/" 2023-12-22T09:44:51.806 INFO:teuthology.orchestra.run.smithi016.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-22T09:44:51.806 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-22T09:44:51.806 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-12-22T09:44:51.806 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-22T09:44:51.806 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-22T09:44:51.806 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-22T09:44:51.806 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-22T09:44:51.807 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server 2023-12-22T09:44:51.831 INFO:teuthology.lock.ops:Updating [smithi038.front.sepia.ceph.com]: set os type and version on server 2023-12-22T09:44:51.831 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2023-12-22T09:44:51.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T09:44:51.898 DEBUG:teuthology.orchestra.run.smithi038:> true 2023-12-22T09:44:51.920 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi038.front.sepia.ceph.com' 2023-12-22T09:44:51.920 DEBUG:teuthology.orchestra.run.smithi038:> uname -m 2023-12-22T09:44:51.977 INFO:teuthology.orchestra.run.smithi038.stdout:x86_64 2023-12-22T09:44:51.977 DEBUG:teuthology.orchestra.run.smithi038:> cat /etc/os-release 2023-12-22T09:44:52.032 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="Red Hat Enterprise Linux" 2023-12-22T09:44:52.033 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="8.4 (Ootpa)" 2023-12-22T09:44:52.033 INFO:teuthology.orchestra.run.smithi038.stdout:ID="rhel" 2023-12-22T09:44:52.033 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="fedora" 2023-12-22T09:44:52.033 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="8.4" 2023-12-22T09:44:52.033 INFO:teuthology.orchestra.run.smithi038.stdout:PLATFORM_ID="platform:el8" 2023-12-22T09:44:52.033 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-22T09:44:52.033 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31" 2023-12-22T09:44:52.033 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-22T09:44:52.033 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://www.redhat.com/" 2023-12-22T09:44:52.033 INFO:teuthology.orchestra.run.smithi038.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-22T09:44:52.033 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-22T09:44:52.033 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T09:44:52.034 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-22T09:44:52.034 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-22T09:44:52.034 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-22T09:44:52.034 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-22T09:44:52.034 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2023-12-22T09:44:52.057 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T09:44:52.147 INFO:teuthology.dispatcher.supervisor:Running job 7499501 2023-12-22T09:44:52.148 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_9680d2aba1e76f64ade295c81599c97907457848/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-12-22_08:19:05-fs-rishabh-mdscap-pacific-testing-default-smithi/7499501 --name rishabh-2023-12-22_08:19:05-fs-rishabh-mdscap-pacific-testing-default-smithi --description fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} -- /home/teuthworker/archive/rishabh-2023-12-22_08:19:05-fs-rishabh-mdscap-pacific-testing-default-smithi/7499501/orig.config.yaml 2023-12-22T09:44:52.151 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-12-22_08:19:05-fs-rishabh-mdscap-pacific-testing-default-smithi/7499501 2023-12-22T09:44:52.151 INFO:teuthology.dispatcher.supervisor:Job PID: 2558943 2023-12-22T09:44:52.152 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-22T09:46:52.250 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T09:48:52.438 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T09:50:52.618 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T09:52:52.794 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T09:54:52.978 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T09:54:53.217 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-22T09:54:53.336 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-22T09:54:53.337 INFO:teuthology.nuke:Checking targets against current locks 2023-12-22T09:54:53.380 DEBUG:teuthology.nuke:shortname: smithi016 2023-12-22T09:54:53.381 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-22T09:54:53.404 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi016.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-22_08:19:05-fs-rishabh-mdscap-pacific-testing-default-smithi/7499501', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-22 09:40:08.483994', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC2UijMsPC1YqvmmxqV96ptamjnzvJAF4Wg5WXoG4dVqAr7EVDBGylJiwIxITKfvtZSZ3Sx6wjYbadT0cw2iX1Q='} 2023-12-22T09:54:53.409 DEBUG:teuthology.nuke:shortname: smithi038 2023-12-22T09:54:53.409 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-22T09:54:53.432 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi038.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-22_08:19:05-fs-rishabh-mdscap-pacific-testing-default-smithi/7499501', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-22 09:40:08.485667', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFTXp8qZoTkAn6LUeWtO/X/fPHr+hvqK9lbNrLEHvT/iIUgqAFhszTdMv1/73ElPw/2/5SJgwN/GvBT0iVE8RMA='} 2023-12-22T09:54:53.463 INFO:teuthology.orchestra.console.smithi016:Power off 2023-12-22T09:54:53.463 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-22T09:54:53.490 INFO:teuthology.orchestra.console.smithi038:Power off 2023-12-22T09:54:53.490 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-22T09:54:53.500 DEBUG:teuthology.orchestra.console.smithi016:power off output: Chassis Power Control: Down/Off 2023-12-22T09:54:53.501 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T09:54:53.514 DEBUG:teuthology.orchestra.console.smithi038:power off output: Chassis Power Control: Down/Off 2023-12-22T09:54:53.515 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T09:54:53.523 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is off 2023-12-22T09:54:53.537 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is off 2023-12-22T09:54:53.624 INFO:teuthology.orchestra.console.smithi016:Power off completed 2023-12-22T09:54:53.638 INFO:teuthology.orchestra.console.smithi038:Power off completed 2023-12-22T09:54:53.780 INFO:teuthology.lock.ops:unlocked: smithi016.front.sepia.ceph.com 2023-12-22T09:54:53.789 INFO:teuthology.lock.ops:unlocked: smithi038.front.sepia.ceph.com