2023-11-23T14:38:09.214 INFO:root:teuthology version: 0.0.1.dev205+g2442239 2023-11-23T14:38:09.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T14:38:09.372 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7e3f0b7ca0>, signals=[15]) 2023-11-23T14:38:09.373 INFO:teuthology.lock.ops:Start node 'smithi043.front.sepia.ceph.com' reimaging 2023-11-23T14:38:09.373 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: reset os type and version on server 2023-11-23T14:38:09.373 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server 2023-11-23T14:38:09.387 INFO:teuthology.lock.ops:Start node 'smithi139.front.sepia.ceph.com' reimaging 2023-11-23T14:38:09.388 INFO:teuthology.lock.ops:Updating [smithi139.front.sepia.ceph.com]: reset os type and version on server 2023-11-23T14:38:09.388 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2023-11-23T14:38:09.502 DEBUG:teuthology.provision.fog.smithi043:Requesting image smithi_rhel_8.6 (ID 5) 2023-11-23T14:38:09.508 DEBUG:teuthology.provision.fog.smithi139:Requesting image smithi_rhel_8.6 (ID 5) 2023-11-23T14:38:09.544 INFO:teuthology.provision.fog.smithi043:Scheduling deploy of rhel 8.6 2023-11-23T14:38:09.550 INFO:teuthology.provision.fog.smithi139:Scheduling deploy of rhel 8.6 2023-11-23T14:38:09.812 INFO:teuthology.orchestra.console.smithi139:Power off 2023-11-23T14:38:09.812 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-23T14:38:09.823 INFO:teuthology.orchestra.console.smithi043:Power off 2023-11-23T14:38:09.824 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-23T14:38:09.832 DEBUG:teuthology.orchestra.console.smithi139:power off output: Chassis Power Control: Down/Off 2023-11-23T14:38:09.832 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T14:38:09.849 DEBUG:teuthology.orchestra.console.smithi043:power off output: Chassis Power Control: Down/Off 2023-11-23T14:38:09.849 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T14:38:09.858 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on 2023-11-23T14:38:09.869 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is on 2023-11-23T14:38:13.860 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T14:38:17.825 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T14:38:17.927 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is off 2023-11-23T14:38:17.936 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off 2023-11-23T14:38:18.029 INFO:teuthology.orchestra.console.smithi139:Power off completed 2023-11-23T14:38:18.037 INFO:teuthology.orchestra.console.smithi043:Power off completed 2023-11-23T14:38:18.130 INFO:teuthology.orchestra.console.smithi139:Power on 2023-11-23T14:38:18.130 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-23T14:38:18.138 INFO:teuthology.orchestra.console.smithi043:Power on 2023-11-23T14:38:18.139 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-23T14:38:18.151 DEBUG:teuthology.orchestra.console.smithi139:power on output: Chassis Power Control: Up/On 2023-11-23T14:38:18.151 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T14:38:18.159 DEBUG:teuthology.orchestra.console.smithi043:power on output: Chassis Power Control: Up/On 2023-11-23T14:38:18.160 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T14:38:18.174 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is off 2023-11-23T14:38:18.179 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off 2023-11-23T14:38:22.177 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T14:38:22.184 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T14:38:22.286 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is off 2023-11-23T14:38:22.293 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off 2023-11-23T14:38:26.291 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T14:38:26.298 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T14:38:26.401 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on 2023-11-23T14:38:26.408 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is on 2023-11-23T14:38:26.502 INFO:teuthology.orchestra.console.smithi139:Power on completed 2023-11-23T14:38:26.509 INFO:teuthology.orchestra.console.smithi043:Power on completed 2023-11-23T14:38:26.603 INFO:teuthology.provision.fog.smithi139:Waiting for deploy to finish 2023-11-23T14:38:26.610 INFO:teuthology.provision.fog.smithi043:Waiting for deploy to finish 2023-11-23T14:40:58.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T14:41:13.997 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T14:41:17.410 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2023-11-23T14:41:23.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T14:41:26.498 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2023-11-23T14:41:32.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T14:41:32.518 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-11-23T14:41:35.554 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2023-11-23T14:41:38.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T14:41:41.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T14:41:41.603 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-11-23T14:41:47.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T14:41:50.690 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-11-23T14:41:56.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T14:41:59.746 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-11-23T14:42:05.753 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T14:42:08.834 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-11-23T14:42:14.841 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T14:42:41.586 WARNING:teuthology.provision.fog.smithi043:timed out 2023-11-23T14:42:47.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T14:42:48.678 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-23T14:42:48.679 DEBUG:teuthology.orchestra.run.smithi043:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-23T14:42:48.998 INFO:teuthology.provision.fog.smithi043:Node is ready 2023-11-23T14:42:48.998 DEBUG:teuthology.orchestra.run.smithi043:> hostname 2023-11-23T14:42:49.017 INFO:teuthology.orchestra.run.smithi043.stdout:smithi043.front.sepia.ceph.com 2023-11-23T14:42:49.017 DEBUG:teuthology.orchestra.run.smithi043:> grep smithi043.front.sepia.ceph.com /etc/hosts 2023-11-23T14:42:49.076 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43 smithi043.front.sepia.ceph.com smithi043 2023-11-23T14:42:49.077 DEBUG:teuthology.orchestra.run.smithi043:> sudo hostname smithi043 2023-11-23T14:42:49.208 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/smithi043.front.sepia.ceph.com/smithi043/g' /etc/hosts 2023-11-23T14:42:49.238 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/172.21.15.43/172.21.15.43/g' /etc/hosts 2023-11-23T14:42:49.307 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/smithi043.front.sepia.ceph.com/smithi043/g' /etc/hostname 2023-11-23T14:42:49.376 DEBUG:teuthology.orchestra.run.smithi043:> sudo hostname smithi043 2023-11-23T14:42:49.444 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release 2023-11-23T14:42:49.503 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="Red Hat Enterprise Linux" 2023-11-23T14:42:49.503 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="8.6 (Ootpa)" 2023-11-23T14:42:49.503 INFO:teuthology.orchestra.run.smithi043.stdout:ID="rhel" 2023-11-23T14:42:49.503 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="fedora" 2023-11-23T14:42:49.503 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="8.6" 2023-11-23T14:42:49.503 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el8" 2023-11-23T14:42:49.504 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-23T14:42:49.504 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31" 2023-11-23T14:42:49.504 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-23T14:42:49.504 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://www.redhat.com/" 2023-11-23T14:42:49.504 INFO:teuthology.orchestra.run.smithi043.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-23T14:42:49.504 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-23T14:42:49.504 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-11-23T14:42:49.504 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-23T14:42:49.504 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-23T14:42:49.504 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-23T14:42:49.505 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-23T14:42:49.505 INFO:teuthology.provision.fog.smithi043:Deploy complete! 2023-11-23T14:42:49.507 DEBUG:teuthology.parallel:result is None 2023-11-23T14:43:14.868 WARNING:teuthology.provision.fog.smithi139:timed out 2023-11-23T14:43:20.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T14:43:21.111 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-23T14:43:21.111 DEBUG:teuthology.orchestra.run.smithi139:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-23T14:43:21.432 INFO:teuthology.provision.fog.smithi139:Node is ready 2023-11-23T14:43:21.432 DEBUG:teuthology.orchestra.run.smithi139:> hostname 2023-11-23T14:43:21.450 INFO:teuthology.orchestra.run.smithi139.stdout:smithi139 2023-11-23T14:43:21.450 DEBUG:teuthology.orchestra.run.smithi139:> grep smithi139 /etc/hosts 2023-11-23T14:43:21.508 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139 smithi139.front.sepia.ceph.com smithi139 2023-11-23T14:43:21.508 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname smithi139 2023-11-23T14:43:21.603 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/smithi139/smithi139/g' /etc/hosts 2023-11-23T14:43:21.630 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/172.21.15.139/172.21.15.139/g' /etc/hosts 2023-11-23T14:43:21.701 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/smithi139/smithi139/g' /etc/hostname 2023-11-23T14:43:21.771 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname smithi139 2023-11-23T14:43:21.840 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2023-11-23T14:43:21.899 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="Red Hat Enterprise Linux" 2023-11-23T14:43:21.900 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="8.6 (Ootpa)" 2023-11-23T14:43:21.900 INFO:teuthology.orchestra.run.smithi139.stdout:ID="rhel" 2023-11-23T14:43:21.900 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE="fedora" 2023-11-23T14:43:21.900 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="8.6" 2023-11-23T14:43:21.900 INFO:teuthology.orchestra.run.smithi139.stdout:PLATFORM_ID="platform:el8" 2023-11-23T14:43:21.900 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-23T14:43:21.900 INFO:teuthology.orchestra.run.smithi139.stdout:ANSI_COLOR="0;31" 2023-11-23T14:43:21.900 INFO:teuthology.orchestra.run.smithi139.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-23T14:43:21.900 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://www.redhat.com/" 2023-11-23T14:43:21.900 INFO:teuthology.orchestra.run.smithi139.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-23T14:43:21.900 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-23T14:43:21.900 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-23T14:43:21.900 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-23T14:43:21.901 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-23T14:43:21.901 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-23T14:43:21.901 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-23T14:43:21.901 INFO:teuthology.provision.fog.smithi139:Deploy complete! 2023-11-23T14:43:21.901 DEBUG:teuthology.parallel:result is None 2023-11-23T14:43:22.088 INFO:teuthology.lock.ops:Checking smithi043.front.sepia.ceph.com 2023-11-23T14:43:22.089 INFO:teuthology.lock.ops:Checking smithi139.front.sepia.ceph.com 2023-11-23T14:43:22.090 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: set os type and version on server 2023-11-23T14:43:22.090 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2023-11-23T14:43:22.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T14:43:22.158 DEBUG:teuthology.orchestra.run.smithi043:> true 2023-11-23T14:43:22.287 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi043.front.sepia.ceph.com' 2023-11-23T14:43:22.287 DEBUG:teuthology.orchestra.run.smithi043:> uname -m 2023-11-23T14:43:22.345 INFO:teuthology.orchestra.run.smithi043.stdout:x86_64 2023-11-23T14:43:22.346 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release 2023-11-23T14:43:22.403 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="Red Hat Enterprise Linux" 2023-11-23T14:43:22.404 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="8.6 (Ootpa)" 2023-11-23T14:43:22.404 INFO:teuthology.orchestra.run.smithi043.stdout:ID="rhel" 2023-11-23T14:43:22.404 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="fedora" 2023-11-23T14:43:22.404 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="8.6" 2023-11-23T14:43:22.404 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el8" 2023-11-23T14:43:22.404 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-23T14:43:22.404 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31" 2023-11-23T14:43:22.404 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-23T14:43:22.404 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://www.redhat.com/" 2023-11-23T14:43:22.404 INFO:teuthology.orchestra.run.smithi043.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-23T14:43:22.404 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-23T14:43:22.404 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-11-23T14:43:22.405 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-23T14:43:22.405 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-23T14:43:22.405 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-23T14:43:22.405 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-23T14:43:22.405 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server 2023-11-23T14:43:22.431 INFO:teuthology.lock.ops:Updating [smithi139.front.sepia.ceph.com]: set os type and version on server 2023-11-23T14:43:22.431 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2023-11-23T14:43:22.431 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T14:43:22.500 DEBUG:teuthology.orchestra.run.smithi139:> true 2023-11-23T14:43:22.566 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi139.front.sepia.ceph.com' 2023-11-23T14:43:22.567 DEBUG:teuthology.orchestra.run.smithi139:> uname -m 2023-11-23T14:43:22.626 INFO:teuthology.orchestra.run.smithi139.stdout:x86_64 2023-11-23T14:43:22.626 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2023-11-23T14:43:22.687 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="Red Hat Enterprise Linux" 2023-11-23T14:43:22.687 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="8.6 (Ootpa)" 2023-11-23T14:43:22.687 INFO:teuthology.orchestra.run.smithi139.stdout:ID="rhel" 2023-11-23T14:43:22.687 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE="fedora" 2023-11-23T14:43:22.687 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="8.6" 2023-11-23T14:43:22.687 INFO:teuthology.orchestra.run.smithi139.stdout:PLATFORM_ID="platform:el8" 2023-11-23T14:43:22.687 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-23T14:43:22.687 INFO:teuthology.orchestra.run.smithi139.stdout:ANSI_COLOR="0;31" 2023-11-23T14:43:22.687 INFO:teuthology.orchestra.run.smithi139.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-23T14:43:22.687 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://www.redhat.com/" 2023-11-23T14:43:22.687 INFO:teuthology.orchestra.run.smithi139.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-23T14:43:22.688 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-23T14:43:22.688 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-23T14:43:22.688 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-23T14:43:22.688 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-23T14:43:22.688 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-23T14:43:22.688 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-23T14:43:22.688 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2023-11-23T14:43:22.714 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T14:43:22.796 INFO:teuthology.dispatcher.supervisor:Running job 7464808 2023-11-23T14:43:22.796 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-11-23_14:37:05-fs:volumes-mgr-vol-misc2-testing-default-smithi/7464808 --name rishabh-2023-11-23_14:37:05-fs:volumes-mgr-vol-misc2-testing-default-smithi --description fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/finisher_per_module}} -- /home/teuthworker/archive/rishabh-2023-11-23_14:37:05-fs:volumes-mgr-vol-misc2-testing-default-smithi/7464808/orig.config.yaml 2023-11-23T14:43:22.798 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-11-23_14:37:05-fs:volumes-mgr-vol-misc2-testing-default-smithi/7464808 2023-11-23T14:43:22.799 INFO:teuthology.dispatcher.supervisor:Job PID: 3253117 2023-11-23T14:43:22.799 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-23T14:45:22.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T14:47:23.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T14:49:23.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T14:51:23.407 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T14:53:23.577 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T14:55:23.747 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T14:57:24.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T14:59:24.947 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T15:01:25.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T15:01:25.185 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-11-23T15:01:25.292 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-23T15:01:25.292 INFO:teuthology.nuke:Checking targets against current locks 2023-11-23T15:01:25.340 DEBUG:teuthology.nuke:shortname: smithi043 2023-11-23T15:01:25.340 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-23T15:01:25.363 DEBUG:teuthology.nuke:shortname: smithi139 2023-11-23T15:01:25.363 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-23T15:01:25.366 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi043.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-23_14:37:05-fs:volumes-mgr-vol-misc2-testing-default-smithi/7464808', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-23 14:38:08.416363', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-23T15:01:25.387 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi139.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-23_14:37:05-fs:volumes-mgr-vol-misc2-testing-default-smithi/7464808', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-23 14:38:08.418061', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-23T15:01:25.415 INFO:teuthology.orchestra.console.smithi043:Power off 2023-11-23T15:01:25.415 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-23T15:01:25.436 DEBUG:teuthology.orchestra.console.smithi043:power off output: Chassis Power Control: Down/Off 2023-11-23T15:01:25.437 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T15:01:25.452 INFO:teuthology.orchestra.console.smithi139:Power off 2023-11-23T15:01:25.453 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-23T15:01:25.461 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off 2023-11-23T15:01:25.472 DEBUG:teuthology.orchestra.console.smithi139:power off output: Chassis Power Control: Down/Off 2023-11-23T15:01:25.472 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T15:01:25.492 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is off 2023-11-23T15:01:25.562 INFO:teuthology.orchestra.console.smithi043:Power off completed 2023-11-23T15:01:25.593 INFO:teuthology.orchestra.console.smithi139:Power off completed 2023-11-23T15:01:25.718 INFO:teuthology.lock.ops:unlocked: smithi043.front.sepia.ceph.com 2023-11-23T15:01:25.742 INFO:teuthology.lock.ops:unlocked: smithi139.front.sepia.ceph.com