2023-12-19T07:36:54.288 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-19T07:36:54.289 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T07:36:54.442 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fdf7f19a940>, signals=[15]) 2023-12-19T07:36:54.443 INFO:teuthology.lock.ops:Start node 'smithi053.front.sepia.ceph.com' reimaging 2023-12-19T07:36:54.443 INFO:teuthology.lock.ops:Updating [smithi053.front.sepia.ceph.com]: reset os type and version on server 2023-12-19T07:36:54.443 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server 2023-12-19T07:36:54.478 INFO:teuthology.lock.ops:Start node 'smithi124.front.sepia.ceph.com' reimaging 2023-12-19T07:36:54.478 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: reset os type and version on server 2023-12-19T07:36:54.478 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server 2023-12-19T07:36:54.617 DEBUG:teuthology.provision.fog.smithi053:Requesting image smithi_rhel_8.4 (ID 7) 2023-12-19T07:36:54.623 DEBUG:teuthology.provision.fog.smithi124:Requesting image smithi_rhel_8.4 (ID 7) 2023-12-19T07:36:54.672 INFO:teuthology.provision.fog.smithi053:Scheduling deploy of rhel 8.4 2023-12-19T07:36:54.677 INFO:teuthology.provision.fog.smithi124:Scheduling deploy of rhel 8.4 2023-12-19T07:36:55.039 INFO:teuthology.orchestra.console.smithi124:Power off 2023-12-19T07:36:55.040 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T07:36:55.054 INFO:teuthology.orchestra.console.smithi053:Power off 2023-12-19T07:36:55.054 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T07:36:55.064 DEBUG:teuthology.orchestra.console.smithi124:power off output: Chassis Power Control: Down/Off 2023-12-19T07:36:55.064 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T07:36:55.077 DEBUG:teuthology.orchestra.console.smithi053:power off output: Chassis Power Control: Down/Off 2023-12-19T07:36:55.077 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T07:36:55.090 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on 2023-12-19T07:36:55.102 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is on 2023-12-19T07:36:59.093 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T07:36:59.103 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T07:36:59.204 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on 2023-12-19T07:36:59.213 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is on 2023-12-19T07:37:03.209 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T07:37:03.217 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T07:37:03.320 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-12-19T07:37:03.328 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off 2023-12-19T07:37:03.421 INFO:teuthology.orchestra.console.smithi124:Power off completed 2023-12-19T07:37:03.429 INFO:teuthology.orchestra.console.smithi053:Power off completed 2023-12-19T07:37:03.523 INFO:teuthology.orchestra.console.smithi124:Power on 2023-12-19T07:37:03.523 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-19T07:37:03.540 INFO:teuthology.orchestra.console.smithi053:Power on 2023-12-19T07:37:03.541 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-19T07:37:03.557 DEBUG:teuthology.orchestra.console.smithi124:power on output: Chassis Power Control: Up/On 2023-12-19T07:37:03.558 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T07:37:03.570 DEBUG:teuthology.orchestra.console.smithi053:power on output: Chassis Power Control: Up/On 2023-12-19T07:37:03.570 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T07:37:03.583 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-12-19T07:37:03.591 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off 2023-12-19T07:37:07.585 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T07:37:07.592 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T07:37:07.695 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-12-19T07:37:07.702 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off 2023-12-19T07:37:11.701 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T07:37:11.707 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T07:37:11.809 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on 2023-12-19T07:37:11.816 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is on 2023-12-19T07:37:11.911 INFO:teuthology.orchestra.console.smithi124:Power on completed 2023-12-19T07:37:11.917 INFO:teuthology.orchestra.console.smithi053:Power on completed 2023-12-19T07:37:12.012 INFO:teuthology.provision.fog.smithi124:Waiting for deploy to finish 2023-12-19T07:37:12.018 INFO:teuthology.provision.fog.smithi053:Waiting for deploy to finish 2023-12-19T07:39:42.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T07:39:46.001 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53 2023-12-19T07:39:52.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T07:39:55.089 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53 2023-12-19T07:39:57.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T07:40:01.074 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-12-19T07:40:01.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T07:40:04.145 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53 2023-12-19T07:40:07.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T07:40:10.129 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-12-19T07:40:10.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T07:40:13.201 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53 2023-12-19T07:40:16.133 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T07:40:19.185 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-12-19T07:40:19.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T07:40:25.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T07:40:28.242 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-12-19T07:40:34.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T07:40:37.298 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-12-19T07:40:43.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T07:41:01.846 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-12-19T07:41:07.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T07:41:10.929 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-12-19T07:41:16.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T07:41:19.206 WARNING:teuthology.provision.fog.smithi053:timed out 2023-12-19T07:41:19.985 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-12-19T07:41:25.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T07:41:25.447 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-19T07:41:25.448 DEBUG:teuthology.orchestra.run.smithi053:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-19T07:41:25.711 INFO:teuthology.provision.fog.smithi053:Node is ready 2023-12-19T07:41:25.711 DEBUG:teuthology.orchestra.run.smithi053:> hostname 2023-12-19T07:41:25.728 INFO:teuthology.orchestra.run.smithi053.stdout:smithi053.front.sepia.ceph.com 2023-12-19T07:41:25.729 DEBUG:teuthology.orchestra.run.smithi053:> grep smithi053.front.sepia.ceph.com /etc/hosts 2023-12-19T07:41:25.786 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53 smithi053.front.sepia.ceph.com smithi053 2023-12-19T07:41:25.786 DEBUG:teuthology.orchestra.run.smithi053:> sudo hostname smithi053 2023-12-19T07:41:25.898 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i -e 's/smithi053.front.sepia.ceph.com/smithi053/g' /etc/hosts 2023-12-19T07:41:25.926 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i -e 's/172.21.15.53/172.21.15.53/g' /etc/hosts 2023-12-19T07:41:25.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T07:41:25.994 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i -e 's/smithi053.front.sepia.ceph.com/smithi053/g' /etc/hostname 2023-12-19T07:41:26.063 DEBUG:teuthology.orchestra.run.smithi053:> sudo hostname smithi053 2023-12-19T07:41:26.131 DEBUG:teuthology.orchestra.run.smithi053:> cat /etc/os-release 2023-12-19T07:41:26.187 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T07:41:26.187 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="8.4 (Ootpa)" 2023-12-19T07:41:26.187 INFO:teuthology.orchestra.run.smithi053.stdout:ID="rhel" 2023-12-19T07:41:26.187 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE="fedora" 2023-12-19T07:41:26.187 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="8.4" 2023-12-19T07:41:26.187 INFO:teuthology.orchestra.run.smithi053.stdout:PLATFORM_ID="platform:el8" 2023-12-19T07:41:26.188 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-19T07:41:26.188 INFO:teuthology.orchestra.run.smithi053.stdout:ANSI_COLOR="0;31" 2023-12-19T07:41:26.188 INFO:teuthology.orchestra.run.smithi053.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-19T07:41:26.188 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T07:41:26.188 INFO:teuthology.orchestra.run.smithi053.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T07:41:26.188 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T07:41:26.188 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-19T07:41:26.188 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T07:41:26.188 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-19T07:41:26.188 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T07:41:26.188 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-19T07:41:26.189 INFO:teuthology.provision.fog.smithi053:Deploy complete! 2023-12-19T07:41:26.190 DEBUG:teuthology.parallel:result is None 2023-12-19T07:41:26.336 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-19T07:41:26.336 DEBUG:teuthology.orchestra.run.smithi124:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-19T07:41:46.589 INFO:teuthology.provision.fog.smithi124:Node is ready 2023-12-19T07:41:46.590 DEBUG:teuthology.orchestra.run.smithi124:> hostname 2023-12-19T07:41:46.647 INFO:teuthology.orchestra.run.smithi124.stdout:smithi124.front.sepia.ceph.com 2023-12-19T07:41:46.647 DEBUG:teuthology.orchestra.run.smithi124:> grep smithi124.front.sepia.ceph.com /etc/hosts 2023-12-19T07:41:46.702 INFO:teuthology.orchestra.run.smithi124.stdout:172.21.15.124 smithi124.front.sepia.ceph.com smithi124 2023-12-19T07:41:46.703 DEBUG:teuthology.orchestra.run.smithi124:> sudo hostname smithi124 2023-12-19T07:41:46.861 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi124.front.sepia.ceph.com/smithi124/g' /etc/hosts 2023-12-19T07:41:46.887 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/172.21.15.124/172.21.15.124/g' /etc/hosts 2023-12-19T07:41:46.952 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi124.front.sepia.ceph.com/smithi124/g' /etc/hostname 2023-12-19T07:41:47.017 DEBUG:teuthology.orchestra.run.smithi124:> sudo hostname smithi124 2023-12-19T07:41:47.079 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release 2023-12-19T07:41:47.137 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T07:41:47.137 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="8.4 (Ootpa)" 2023-12-19T07:41:47.137 INFO:teuthology.orchestra.run.smithi124.stdout:ID="rhel" 2023-12-19T07:41:47.137 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="fedora" 2023-12-19T07:41:47.137 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="8.4" 2023-12-19T07:41:47.137 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM_ID="platform:el8" 2023-12-19T07:41:47.138 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-19T07:41:47.138 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31" 2023-12-19T07:41:47.138 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-19T07:41:47.138 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T07:41:47.138 INFO:teuthology.orchestra.run.smithi124.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T07:41:47.138 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T07:41:47.138 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-19T07:41:47.138 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T07:41:47.138 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-19T07:41:47.138 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T07:41:47.138 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-19T07:41:47.139 INFO:teuthology.provision.fog.smithi124:Deploy complete! 2023-12-19T07:41:47.140 DEBUG:teuthology.parallel:result is None 2023-12-19T07:41:47.336 INFO:teuthology.lock.ops:Checking smithi053.front.sepia.ceph.com 2023-12-19T07:41:47.336 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-19T07:41:47.358 INFO:teuthology.lock.ops:Checking smithi124.front.sepia.ceph.com 2023-12-19T07:41:47.358 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-19T07:41:47.384 INFO:teuthology.lock.ops:Updating [smithi053.front.sepia.ceph.com]: set os type and version on server 2023-12-19T07:41:47.384 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2023-12-19T07:41:47.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T07:41:47.453 DEBUG:teuthology.orchestra.run.smithi053:> true 2023-12-19T07:41:47.573 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi053.front.sepia.ceph.com' 2023-12-19T07:41:47.573 DEBUG:teuthology.orchestra.run.smithi053:> uname -m 2023-12-19T07:41:47.628 INFO:teuthology.orchestra.run.smithi053.stdout:x86_64 2023-12-19T07:41:47.628 DEBUG:teuthology.orchestra.run.smithi053:> cat /etc/os-release 2023-12-19T07:41:47.684 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T07:41:47.684 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="8.4 (Ootpa)" 2023-12-19T07:41:47.684 INFO:teuthology.orchestra.run.smithi053.stdout:ID="rhel" 2023-12-19T07:41:47.684 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE="fedora" 2023-12-19T07:41:47.685 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="8.4" 2023-12-19T07:41:47.685 INFO:teuthology.orchestra.run.smithi053.stdout:PLATFORM_ID="platform:el8" 2023-12-19T07:41:47.685 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-19T07:41:47.685 INFO:teuthology.orchestra.run.smithi053.stdout:ANSI_COLOR="0;31" 2023-12-19T07:41:47.685 INFO:teuthology.orchestra.run.smithi053.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-19T07:41:47.685 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T07:41:47.685 INFO:teuthology.orchestra.run.smithi053.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T07:41:47.685 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T07:41:47.685 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-19T07:41:47.686 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T07:41:47.686 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-19T07:41:47.686 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T07:41:47.686 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-19T07:41:47.687 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server 2023-12-19T07:41:47.708 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: set os type and version on server 2023-12-19T07:41:47.709 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-12-19T07:41:47.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T07:41:47.775 DEBUG:teuthology.orchestra.run.smithi124:> true 2023-12-19T07:41:47.840 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-12-19T07:41:47.840 DEBUG:teuthology.orchestra.run.smithi124:> uname -m 2023-12-19T07:41:47.895 INFO:teuthology.orchestra.run.smithi124.stdout:x86_64 2023-12-19T07:41:47.895 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release 2023-12-19T07:41:47.949 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T07:41:47.949 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="8.4 (Ootpa)" 2023-12-19T07:41:47.949 INFO:teuthology.orchestra.run.smithi124.stdout:ID="rhel" 2023-12-19T07:41:47.949 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="fedora" 2023-12-19T07:41:47.949 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="8.4" 2023-12-19T07:41:47.949 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM_ID="platform:el8" 2023-12-19T07:41:47.949 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-19T07:41:47.949 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31" 2023-12-19T07:41:47.950 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-19T07:41:47.950 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T07:41:47.950 INFO:teuthology.orchestra.run.smithi124.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T07:41:47.950 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T07:41:47.950 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-19T07:41:47.950 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T07:41:47.950 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-19T07:41:47.950 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T07:41:47.950 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-19T07:41:47.951 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server 2023-12-19T07:41:47.966 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T07:41:48.062 INFO:teuthology.dispatcher.supervisor:Running job 7495902 2023-12-19T07:41:48.062 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-12-19_05:13:44-fs-rishabh-mdscap-quincy-testing-default-smithi/7495902 --name rishabh-2023-12-19_05:13:44-fs-rishabh-mdscap-quincy-testing-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mon 2-workunit/fs/snaps}} -- /home/teuthworker/archive/rishabh-2023-12-19_05:13:44-fs-rishabh-mdscap-quincy-testing-default-smithi/7495902/orig.config.yaml 2023-12-19T07:41:48.065 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-12-19_05:13:44-fs-rishabh-mdscap-quincy-testing-default-smithi/7495902 2023-12-19T07:41:48.066 INFO:teuthology.dispatcher.supervisor:Job PID: 4089281 2023-12-19T07:41:48.066 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-19T07:43:48.166 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T07:45:48.342 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T07:47:48.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T07:49:48.682 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T07:51:48.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T07:51:48.919 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-19T07:51:49.041 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-19T07:51:49.041 INFO:teuthology.nuke:Checking targets against current locks 2023-12-19T07:51:49.095 DEBUG:teuthology.nuke:shortname: smithi053 2023-12-19T07:51:49.096 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T07:51:49.116 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi053.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_05:13:44-fs-rishabh-mdscap-quincy-testing-default-smithi/7495902', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 07:36:53.443318', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOI4zi8ntkAmk+1XRO0lQphUEQdlv4G0XCIzVbbO/h2kC0P+B0alyTB0oGCrhXJW9cA8mpp6TNf5m63yrv1cqag='} 2023-12-19T07:51:49.120 DEBUG:teuthology.nuke:shortname: smithi124 2023-12-19T07:51:49.120 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T07:51:49.144 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi124.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_05:13:44-fs-rishabh-mdscap-quincy-testing-default-smithi/7495902', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 07:36:53.444843', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPkDYvjShSxrB+HsIOcqYPm/QuCGfFlxRvVMr8UIjdGJMlS4oLlo8kMro9SQfds4CidVdkfJTZIfDtvVq9ctlqo='} 2023-12-19T07:51:49.169 INFO:teuthology.orchestra.console.smithi053:Power off 2023-12-19T07:51:49.169 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T07:51:49.193 DEBUG:teuthology.orchestra.console.smithi053:power off output: Chassis Power Control: Down/Off 2023-12-19T07:51:49.193 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T07:51:49.212 INFO:teuthology.orchestra.console.smithi124:Power off 2023-12-19T07:51:49.212 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T07:51:49.221 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off 2023-12-19T07:51:49.234 DEBUG:teuthology.orchestra.console.smithi124:power off output: Chassis Power Control: Down/Off 2023-12-19T07:51:49.235 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T07:51:49.256 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-12-19T07:51:49.322 INFO:teuthology.orchestra.console.smithi053:Power off completed 2023-12-19T07:51:49.357 INFO:teuthology.orchestra.console.smithi124:Power off completed 2023-12-19T07:51:49.485 INFO:teuthology.lock.ops:unlocked: smithi053.front.sepia.ceph.com 2023-12-19T07:51:49.509 INFO:teuthology.lock.ops:unlocked: smithi124.front.sepia.ceph.com