2023-12-19T15:26:39.240 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-19T15:26:39.240 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T15:26:39.383 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8204574940>, signals=[15]) 2023-12-19T15:26:39.383 INFO:teuthology.lock.ops:Start node 'smithi161.front.sepia.ceph.com' reimaging 2023-12-19T15:26:39.384 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: reset os type and version on server 2023-12-19T15:26:39.384 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2023-12-19T15:26:39.402 INFO:teuthology.lock.ops:Start node 'smithi174.front.sepia.ceph.com' reimaging 2023-12-19T15:26:39.402 INFO:teuthology.lock.ops:Updating [smithi174.front.sepia.ceph.com]: reset os type and version on server 2023-12-19T15:26:39.402 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2023-12-19T15:26:39.524 DEBUG:teuthology.provision.fog.smithi161:Requesting image smithi_rhel_8.4 (ID 7) 2023-12-19T15:26:39.538 DEBUG:teuthology.provision.fog.smithi174:Requesting image smithi_rhel_8.4 (ID 7) 2023-12-19T15:26:39.576 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of rhel 8.4 2023-12-19T15:26:39.592 INFO:teuthology.provision.fog.smithi174:Scheduling deploy of rhel 8.4 2023-12-19T15:26:39.944 INFO:teuthology.orchestra.console.smithi161:Power off 2023-12-19T15:26:39.945 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T15:26:39.957 INFO:teuthology.orchestra.console.smithi174:Power off 2023-12-19T15:26:39.957 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T15:26:39.966 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off 2023-12-19T15:26:39.966 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T15:26:39.979 DEBUG:teuthology.orchestra.console.smithi174:power off output: Chassis Power Control: Down/Off 2023-12-19T15:26:39.979 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T15:26:39.989 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2023-12-19T15:26:40.001 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2023-12-19T15:26:40.091 INFO:teuthology.orchestra.console.smithi161:Power off completed 2023-12-19T15:26:40.102 INFO:teuthology.orchestra.console.smithi174:Power off completed 2023-12-19T15:26:40.192 INFO:teuthology.orchestra.console.smithi161:Power on 2023-12-19T15:26:40.192 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-19T15:26:40.203 INFO:teuthology.orchestra.console.smithi174:Power on 2023-12-19T15:26:40.203 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-19T15:26:40.213 DEBUG:teuthology.orchestra.console.smithi161:power on output: Chassis Power Control: Up/On 2023-12-19T15:26:40.213 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T15:26:40.225 DEBUG:teuthology.orchestra.console.smithi174:power on output: Chassis Power Control: Up/On 2023-12-19T15:26:40.226 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T15:26:40.237 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2023-12-19T15:26:40.249 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2023-12-19T15:26:44.241 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T15:26:44.249 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T15:26:44.351 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2023-12-19T15:26:44.358 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2023-12-19T15:26:48.354 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T15:26:48.361 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T15:26:48.466 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2023-12-19T15:26:48.470 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2023-12-19T15:26:48.567 INFO:teuthology.orchestra.console.smithi161:Power on completed 2023-12-19T15:26:48.571 INFO:teuthology.orchestra.console.smithi174:Power on completed 2023-12-19T15:26:48.668 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish 2023-12-19T15:26:48.672 INFO:teuthology.provision.fog.smithi174:Waiting for deploy to finish 2023-12-19T15:29:19.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:29:22.806 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-12-19T15:29:28.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:29:31.893 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-12-19T15:29:34.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:29:37.874 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-12-19T15:29:37.895 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:29:40.949 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-12-19T15:29:43.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:29:46.929 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-12-19T15:29:46.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:29:50.006 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-12-19T15:29:52.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:29:55.985 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-12-19T15:29:56.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:29:59.057 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-12-19T15:30:01.989 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:30:05.041 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-12-19T15:30:05.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:30:08.117 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-12-19T15:30:11.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:30:14.101 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-12-19T15:30:14.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:30:17.169 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-12-19T15:30:20.105 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:30:23.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:30:23.185 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-12-19T15:30:29.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:30:32.245 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-12-19T15:30:38.250 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:31:23.218 WARNING:teuthology.provision.fog.smithi174:timed out 2023-12-19T15:31:29.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:31:29.551 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-19T15:31:29.551 DEBUG:teuthology.orchestra.run.smithi174:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-19T15:31:29.823 INFO:teuthology.provision.fog.smithi174:Node is ready 2023-12-19T15:31:29.823 DEBUG:teuthology.orchestra.run.smithi174:> hostname 2023-12-19T15:31:29.839 INFO:teuthology.orchestra.run.smithi174.stdout:smithi174.front.sepia.ceph.com 2023-12-19T15:31:29.839 DEBUG:teuthology.orchestra.run.smithi174:> grep smithi174.front.sepia.ceph.com /etc/hosts 2023-12-19T15:31:29.895 INFO:teuthology.orchestra.run.smithi174.stdout:172.21.15.174 smithi174.front.sepia.ceph.com smithi174 2023-12-19T15:31:29.896 DEBUG:teuthology.orchestra.run.smithi174:> sudo hostname smithi174 2023-12-19T15:31:30.021 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/smithi174.front.sepia.ceph.com/smithi174/g' /etc/hosts 2023-12-19T15:31:30.046 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/172.21.15.174/172.21.15.174/g' /etc/hosts 2023-12-19T15:31:30.111 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/smithi174.front.sepia.ceph.com/smithi174/g' /etc/hostname 2023-12-19T15:31:30.175 DEBUG:teuthology.orchestra.run.smithi174:> sudo hostname smithi174 2023-12-19T15:31:30.239 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2023-12-19T15:31:30.293 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T15:31:30.293 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="8.4 (Ootpa)" 2023-12-19T15:31:30.293 INFO:teuthology.orchestra.run.smithi174.stdout:ID="rhel" 2023-12-19T15:31:30.293 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE="fedora" 2023-12-19T15:31:30.293 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="8.4" 2023-12-19T15:31:30.293 INFO:teuthology.orchestra.run.smithi174.stdout:PLATFORM_ID="platform:el8" 2023-12-19T15:31:30.294 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-19T15:31:30.294 INFO:teuthology.orchestra.run.smithi174.stdout:ANSI_COLOR="0;31" 2023-12-19T15:31:30.294 INFO:teuthology.orchestra.run.smithi174.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-19T15:31:30.294 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T15:31:30.294 INFO:teuthology.orchestra.run.smithi174.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T15:31:30.294 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T15:31:30.294 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-12-19T15:31:30.294 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T15:31:30.294 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-19T15:31:30.294 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T15:31:30.294 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-19T15:31:30.295 INFO:teuthology.provision.fog.smithi174:Deploy complete! 2023-12-19T15:31:30.296 DEBUG:teuthology.parallel:result is None 2023-12-19T15:31:38.262 WARNING:teuthology.provision.fog.smithi161:timed out 2023-12-19T15:31:44.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:31:44.637 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-19T15:31:44.637 DEBUG:teuthology.orchestra.run.smithi161:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-19T15:31:44.892 INFO:teuthology.provision.fog.smithi161:Node is ready 2023-12-19T15:31:44.892 DEBUG:teuthology.orchestra.run.smithi161:> hostname 2023-12-19T15:31:44.950 INFO:teuthology.orchestra.run.smithi161.stdout:smithi161 2023-12-19T15:31:44.950 DEBUG:teuthology.orchestra.run.smithi161:> grep smithi161 /etc/hosts 2023-12-19T15:31:45.006 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.15.161 smithi161.front.sepia.ceph.com smithi161 2023-12-19T15:31:45.006 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2023-12-19T15:31:45.116 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161/smithi161/g' /etc/hosts 2023-12-19T15:31:45.142 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/172.21.15.161/172.21.15.161/g' /etc/hosts 2023-12-19T15:31:45.208 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161/smithi161/g' /etc/hostname 2023-12-19T15:31:45.274 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2023-12-19T15:31:45.338 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2023-12-19T15:31:45.393 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T15:31:45.393 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8.4 (Ootpa)" 2023-12-19T15:31:45.393 INFO:teuthology.orchestra.run.smithi161.stdout:ID="rhel" 2023-12-19T15:31:45.393 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="fedora" 2023-12-19T15:31:45.393 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8.4" 2023-12-19T15:31:45.393 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8" 2023-12-19T15:31:45.393 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-19T15:31:45.393 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2023-12-19T15:31:45.393 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-19T15:31:45.393 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T15:31:45.393 INFO:teuthology.orchestra.run.smithi161.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T15:31:45.393 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T15:31:45.394 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-19T15:31:45.394 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T15:31:45.394 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-19T15:31:45.394 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T15:31:45.394 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-19T15:31:45.394 INFO:teuthology.provision.fog.smithi161:Deploy complete! 2023-12-19T15:31:45.395 DEBUG:teuthology.parallel:result is None 2023-12-19T15:31:45.577 INFO:teuthology.lock.ops:Checking smithi161.front.sepia.ceph.com 2023-12-19T15:31:45.577 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-19T15:31:45.601 INFO:teuthology.lock.ops:Checking smithi174.front.sepia.ceph.com 2023-12-19T15:31:45.601 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-19T15:31:45.619 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: set os type and version on server 2023-12-19T15:31:45.619 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-12-19T15:31:45.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:31:45.688 DEBUG:teuthology.orchestra.run.smithi161:> true 2023-12-19T15:31:45.752 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-12-19T15:31:45.752 DEBUG:teuthology.orchestra.run.smithi161:> uname -m 2023-12-19T15:31:45.806 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2023-12-19T15:31:45.807 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2023-12-19T15:31:45.861 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T15:31:45.861 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8.4 (Ootpa)" 2023-12-19T15:31:45.861 INFO:teuthology.orchestra.run.smithi161.stdout:ID="rhel" 2023-12-19T15:31:45.861 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="fedora" 2023-12-19T15:31:45.861 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8.4" 2023-12-19T15:31:45.862 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8" 2023-12-19T15:31:45.862 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-19T15:31:45.862 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2023-12-19T15:31:45.862 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-19T15:31:45.862 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T15:31:45.862 INFO:teuthology.orchestra.run.smithi161.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T15:31:45.862 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T15:31:45.862 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-19T15:31:45.862 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T15:31:45.862 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-19T15:31:45.862 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T15:31:45.862 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-19T15:31:45.863 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2023-12-19T15:31:45.885 INFO:teuthology.lock.ops:Updating [smithi174.front.sepia.ceph.com]: set os type and version on server 2023-12-19T15:31:45.885 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2023-12-19T15:31:45.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:31:45.950 DEBUG:teuthology.orchestra.run.smithi174:> true 2023-12-19T15:31:46.071 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi174.front.sepia.ceph.com' 2023-12-19T15:31:46.071 DEBUG:teuthology.orchestra.run.smithi174:> uname -m 2023-12-19T15:31:46.126 INFO:teuthology.orchestra.run.smithi174.stdout:x86_64 2023-12-19T15:31:46.126 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2023-12-19T15:31:46.181 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T15:31:46.181 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="8.4 (Ootpa)" 2023-12-19T15:31:46.181 INFO:teuthology.orchestra.run.smithi174.stdout:ID="rhel" 2023-12-19T15:31:46.181 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE="fedora" 2023-12-19T15:31:46.181 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="8.4" 2023-12-19T15:31:46.181 INFO:teuthology.orchestra.run.smithi174.stdout:PLATFORM_ID="platform:el8" 2023-12-19T15:31:46.181 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-19T15:31:46.181 INFO:teuthology.orchestra.run.smithi174.stdout:ANSI_COLOR="0;31" 2023-12-19T15:31:46.181 INFO:teuthology.orchestra.run.smithi174.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-19T15:31:46.182 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T15:31:46.182 INFO:teuthology.orchestra.run.smithi174.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T15:31:46.182 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T15:31:46.182 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-12-19T15:31:46.182 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T15:31:46.182 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-19T15:31:46.182 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T15:31:46.182 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-19T15:31:46.182 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2023-12-19T15:31:46.218 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T15:31:46.306 INFO:teuthology.dispatcher.supervisor:Running job 7497021 2023-12-19T15:31:46.306 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-12-19_12:42:58-fs-rishabh-mdscap-pacific-testing-default-smithi/7497021 --name rishabh-2023-12-19_12:42:58-fs-rishabh-mdscap-pacific-testing-default-smithi --description fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} -- /home/teuthworker/archive/rishabh-2023-12-19_12:42:58-fs-rishabh-mdscap-pacific-testing-default-smithi/7497021/orig.config.yaml 2023-12-19T15:31:46.311 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-12-19_12:42:58-fs-rishabh-mdscap-pacific-testing-default-smithi/7497021 2023-12-19T15:31:46.312 INFO:teuthology.dispatcher.supervisor:Job PID: 3160116 2023-12-19T15:31:46.312 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-19T15:33:46.410 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T15:35:46.578 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T15:37:46.746 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T15:39:46.914 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T15:41:47.086 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T15:43:47.258 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T15:45:47.434 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T15:45:47.501 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-19T15:45:47.614 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-19T15:45:47.614 INFO:teuthology.nuke:Checking targets against current locks 2023-12-19T15:45:47.659 DEBUG:teuthology.nuke:shortname: smithi161 2023-12-19T15:45:47.659 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T15:45:47.682 DEBUG:teuthology.nuke:shortname: smithi174 2023-12-19T15:45:47.682 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T15:45:47.687 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_12:42:58-fs-rishabh-mdscap-pacific-testing-default-smithi/7497021', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 15:26:38.402105', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCTtAtT+PDx5oD4WyDyr6Vd2vyv71V20aYU1XLHu9wkTe0ywL8PX9O+ldCPXvJ0OkQSucUdK2tzCqA6aj1bv4CM='} 2023-12-19T15:45:47.702 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi174.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_12:42:58-fs-rishabh-mdscap-pacific-testing-default-smithi/7497021', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 15:26:38.400117', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAIn1OKAA42T8e3wbDkeiUTMlv9Ydn2itR6S6rPeu8Fs8M3zUJl9C3WF3IYclh5wqx+Up+jDvIg+8hYGBX9gTEM='} 2023-12-19T15:45:47.742 INFO:teuthology.orchestra.console.smithi161:Power off 2023-12-19T15:45:47.742 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T15:45:47.765 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off 2023-12-19T15:45:47.766 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T15:45:47.779 INFO:teuthology.orchestra.console.smithi174:Power off 2023-12-19T15:45:47.780 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T15:45:47.788 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2023-12-19T15:45:47.802 DEBUG:teuthology.orchestra.console.smithi174:power off output: Chassis Power Control: Down/Off 2023-12-19T15:45:47.802 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T15:45:47.824 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2023-12-19T15:45:47.890 INFO:teuthology.orchestra.console.smithi161:Power off completed 2023-12-19T15:45:47.925 INFO:teuthology.orchestra.console.smithi174:Power off completed 2023-12-19T15:45:48.042 INFO:teuthology.lock.ops:unlocked: smithi161.front.sepia.ceph.com 2023-12-19T15:45:48.066 INFO:teuthology.lock.ops:unlocked: smithi174.front.sepia.ceph.com