2023-12-04T10:15:34.676 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-04T10:15:34.676 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T10:15:34.798 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd613d55550>, signals=[15]) 2023-12-04T10:15:34.798 INFO:teuthology.lock.ops:Start node 'smithi017.front.sepia.ceph.com' reimaging 2023-12-04T10:15:34.798 INFO:teuthology.lock.ops:Updating [smithi017.front.sepia.ceph.com]: reset os type and version on server 2023-12-04T10:15:34.799 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2023-12-04T10:15:34.814 INFO:teuthology.lock.ops:Start node 'smithi167.front.sepia.ceph.com' reimaging 2023-12-04T10:15:34.815 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: reset os type and version on server 2023-12-04T10:15:34.815 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2023-12-04T10:15:34.915 DEBUG:teuthology.provision.fog.smithi017:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-04T10:15:34.945 DEBUG:teuthology.provision.fog.smithi167:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-04T10:15:34.961 INFO:teuthology.provision.fog.smithi017:Scheduling deploy of rhel 8.6 2023-12-04T10:15:34.993 INFO:teuthology.provision.fog.smithi167:Scheduling deploy of rhel 8.6 2023-12-04T10:15:35.317 INFO:teuthology.orchestra.console.smithi167:Power off 2023-12-04T10:15:35.318 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-04T10:15:35.329 INFO:teuthology.orchestra.console.smithi017:Power off 2023-12-04T10:15:35.329 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-04T10:15:35.337 DEBUG:teuthology.orchestra.console.smithi167:power off output: Chassis Power Control: Down/Off 2023-12-04T10:15:35.337 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T10:15:35.347 DEBUG:teuthology.orchestra.console.smithi017:power off output: Chassis Power Control: Down/Off 2023-12-04T10:15:35.347 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T10:15:35.358 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2023-12-04T10:15:35.367 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off 2023-12-04T10:15:35.460 INFO:teuthology.orchestra.console.smithi167:Power off completed 2023-12-04T10:15:35.467 INFO:teuthology.orchestra.console.smithi017:Power off completed 2023-12-04T10:15:35.561 INFO:teuthology.orchestra.console.smithi167:Power on 2023-12-04T10:15:35.561 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-04T10:15:35.569 INFO:teuthology.orchestra.console.smithi017:Power on 2023-12-04T10:15:35.569 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-04T10:15:35.582 DEBUG:teuthology.orchestra.console.smithi167:power on output: Chassis Power Control: Up/On 2023-12-04T10:15:35.583 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T10:15:35.590 DEBUG:teuthology.orchestra.console.smithi017:power on output: Chassis Power Control: Up/On 2023-12-04T10:15:35.591 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T10:15:35.602 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2023-12-04T10:15:35.610 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off 2023-12-04T10:15:39.606 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T10:15:39.613 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T10:15:39.715 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2023-12-04T10:15:39.720 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off 2023-12-04T10:15:39.817 INFO:teuthology.orchestra.console.smithi167:Power on completed 2023-12-04T10:15:39.917 INFO:teuthology.provision.fog.smithi167:Waiting for deploy to finish 2023-12-04T10:15:43.723 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T10:15:43.831 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on 2023-12-04T10:15:43.932 INFO:teuthology.orchestra.console.smithi017:Power on completed 2023-12-04T10:15:44.033 INFO:teuthology.provision.fog.smithi017:Waiting for deploy to finish 2023-12-04T10:18:14.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:18:17.928 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17 2023-12-04T10:18:23.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:18:25.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:18:27.010 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17 2023-12-04T10:18:28.898 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-12-04T10:18:33.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:18:34.901 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:18:36.070 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17 2023-12-04T10:18:37.954 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-12-04T10:18:42.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:18:43.957 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:18:45.158 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17 2023-12-04T10:18:47.014 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-12-04T10:18:51.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:18:53.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:18:54.242 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17 2023-12-04T10:18:56.070 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-12-04T10:19:00.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:19:02.073 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:19:03.302 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17 2023-12-04T10:19:05.154 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-12-04T10:19:09.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:19:11.157 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:19:14.210 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-12-04T10:19:20.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:19:23.266 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-12-04T10:19:29.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:19:32.322 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-12-04T10:19:38.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:20:09.339 WARNING:teuthology.provision.fog.smithi017:timed out 2023-12-04T10:20:15.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:20:15.739 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-04T10:20:15.739 DEBUG:teuthology.orchestra.run.smithi017:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-04T10:20:16.234 INFO:teuthology.provision.fog.smithi017:Node is ready 2023-12-04T10:20:16.235 DEBUG:teuthology.orchestra.run.smithi017:> hostname 2023-12-04T10:20:16.254 INFO:teuthology.orchestra.run.smithi017.stdout:smithi017.front.sepia.ceph.com 2023-12-04T10:20:16.255 DEBUG:teuthology.orchestra.run.smithi017:> grep smithi017.front.sepia.ceph.com /etc/hosts 2023-12-04T10:20:16.314 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17 smithi017.front.sepia.ceph.com smithi017 2023-12-04T10:20:16.315 DEBUG:teuthology.orchestra.run.smithi017:> sudo hostname smithi017 2023-12-04T10:20:16.434 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/smithi017.front.sepia.ceph.com/smithi017/g' /etc/hosts 2023-12-04T10:20:16.464 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/172.21.15.17/172.21.15.17/g' /etc/hosts 2023-12-04T10:20:16.534 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/smithi017.front.sepia.ceph.com/smithi017/g' /etc/hostname 2023-12-04T10:20:16.602 DEBUG:teuthology.orchestra.run.smithi017:> sudo hostname smithi017 2023-12-04T10:20:16.671 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release 2023-12-04T10:20:16.729 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="Red Hat Enterprise Linux" 2023-12-04T10:20:16.729 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="8.6 (Ootpa)" 2023-12-04T10:20:16.729 INFO:teuthology.orchestra.run.smithi017.stdout:ID="rhel" 2023-12-04T10:20:16.729 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="fedora" 2023-12-04T10:20:16.729 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="8.6" 2023-12-04T10:20:16.729 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el8" 2023-12-04T10:20:16.729 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-04T10:20:16.729 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31" 2023-12-04T10:20:16.729 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-04T10:20:16.729 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://www.redhat.com/" 2023-12-04T10:20:16.730 INFO:teuthology.orchestra.run.smithi017.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-04T10:20:16.730 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-04T10:20:16.730 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-12-04T10:20:16.730 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-04T10:20:16.730 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-04T10:20:16.730 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-04T10:20:16.730 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-04T10:20:16.731 INFO:teuthology.provision.fog.smithi017:Deploy complete! 2023-12-04T10:20:16.732 DEBUG:teuthology.parallel:result is None 2023-12-04T10:20:38.350 WARNING:teuthology.provision.fog.smithi167:timed out 2023-12-04T10:20:44.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:20:44.685 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-04T10:20:44.685 DEBUG:teuthology.orchestra.run.smithi167:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-04T10:20:44.971 INFO:teuthology.provision.fog.smithi167:Node is ready 2023-12-04T10:20:44.971 DEBUG:teuthology.orchestra.run.smithi167:> hostname 2023-12-04T10:20:44.989 INFO:teuthology.orchestra.run.smithi167.stdout:smithi167 2023-12-04T10:20:44.989 DEBUG:teuthology.orchestra.run.smithi167:> grep smithi167 /etc/hosts 2023-12-04T10:20:45.047 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.15.167 smithi167.front.sepia.ceph.com smithi167 2023-12-04T10:20:45.047 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname smithi167 2023-12-04T10:20:45.166 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/smithi167/smithi167/g' /etc/hosts 2023-12-04T10:20:45.194 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/172.21.15.167/172.21.15.167/g' /etc/hosts 2023-12-04T10:20:45.261 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/smithi167/smithi167/g' /etc/hostname 2023-12-04T10:20:45.327 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname smithi167 2023-12-04T10:20:45.393 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2023-12-04T10:20:45.450 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="Red Hat Enterprise Linux" 2023-12-04T10:20:45.450 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="8.6 (Ootpa)" 2023-12-04T10:20:45.450 INFO:teuthology.orchestra.run.smithi167.stdout:ID="rhel" 2023-12-04T10:20:45.450 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="fedora" 2023-12-04T10:20:45.450 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="8.6" 2023-12-04T10:20:45.450 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el8" 2023-12-04T10:20:45.450 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-04T10:20:45.450 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31" 2023-12-04T10:20:45.450 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-04T10:20:45.451 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://www.redhat.com/" 2023-12-04T10:20:45.451 INFO:teuthology.orchestra.run.smithi167.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-04T10:20:45.451 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-04T10:20:45.451 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-12-04T10:20:45.451 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-04T10:20:45.451 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-04T10:20:45.451 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-04T10:20:45.451 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-04T10:20:45.451 INFO:teuthology.provision.fog.smithi167:Deploy complete! 2023-12-04T10:20:45.452 DEBUG:teuthology.parallel:result is None 2023-12-04T10:20:45.601 INFO:teuthology.lock.ops:Checking smithi017.front.sepia.ceph.com 2023-12-04T10:20:45.601 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-04T10:20:45.624 INFO:teuthology.lock.ops:Checking smithi167.front.sepia.ceph.com 2023-12-04T10:20:45.624 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-04T10:20:45.649 INFO:teuthology.lock.ops:Updating [smithi017.front.sepia.ceph.com]: set os type and version on server 2023-12-04T10:20:45.650 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2023-12-04T10:20:45.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:20:45.718 DEBUG:teuthology.orchestra.run.smithi017:> true 2023-12-04T10:20:45.853 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com' 2023-12-04T10:20:45.853 DEBUG:teuthology.orchestra.run.smithi017:> uname -m 2023-12-04T10:20:45.912 INFO:teuthology.orchestra.run.smithi017.stdout:x86_64 2023-12-04T10:20:45.912 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release 2023-12-04T10:20:45.971 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="Red Hat Enterprise Linux" 2023-12-04T10:20:45.972 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="8.6 (Ootpa)" 2023-12-04T10:20:45.972 INFO:teuthology.orchestra.run.smithi017.stdout:ID="rhel" 2023-12-04T10:20:45.972 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="fedora" 2023-12-04T10:20:45.972 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="8.6" 2023-12-04T10:20:45.972 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el8" 2023-12-04T10:20:45.972 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-04T10:20:45.972 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31" 2023-12-04T10:20:45.972 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-04T10:20:45.972 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://www.redhat.com/" 2023-12-04T10:20:45.972 INFO:teuthology.orchestra.run.smithi017.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-04T10:20:45.972 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-04T10:20:45.972 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-12-04T10:20:45.973 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-04T10:20:45.973 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-04T10:20:45.973 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-04T10:20:45.973 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-04T10:20:45.973 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2023-12-04T10:20:46.016 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: set os type and version on server 2023-12-04T10:20:46.016 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-12-04T10:20:46.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:20:46.083 DEBUG:teuthology.orchestra.run.smithi167:> true 2023-12-04T10:20:46.156 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-12-04T10:20:46.156 DEBUG:teuthology.orchestra.run.smithi167:> uname -m 2023-12-04T10:20:46.213 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64 2023-12-04T10:20:46.213 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2023-12-04T10:20:46.271 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="Red Hat Enterprise Linux" 2023-12-04T10:20:46.271 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="8.6 (Ootpa)" 2023-12-04T10:20:46.271 INFO:teuthology.orchestra.run.smithi167.stdout:ID="rhel" 2023-12-04T10:20:46.271 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="fedora" 2023-12-04T10:20:46.272 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="8.6" 2023-12-04T10:20:46.272 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el8" 2023-12-04T10:20:46.272 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-04T10:20:46.272 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31" 2023-12-04T10:20:46.272 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-04T10:20:46.272 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://www.redhat.com/" 2023-12-04T10:20:46.272 INFO:teuthology.orchestra.run.smithi167.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-04T10:20:46.272 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-04T10:20:46.272 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-12-04T10:20:46.272 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-04T10:20:46.272 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-04T10:20:46.272 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-04T10:20:46.272 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-04T10:20:46.273 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2023-12-04T10:20:46.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T10:20:46.404 INFO:teuthology.dispatcher.supervisor:Running job 7476892 2023-12-04T10:20:46.404 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-12-04_09:26:31-fs-wip-vshankar-testing-20231204.063332-testing-default-smithi/7476892 --name vshankar-2023-12-04_09:26:31-fs-wip-vshankar-testing-20231204.063332-testing-default-smithi --description fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_snaptests}} -- /home/teuthworker/archive/vshankar-2023-12-04_09:26:31-fs-wip-vshankar-testing-20231204.063332-testing-default-smithi/7476892/orig.config.yaml 2023-12-04T10:20:46.409 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-12-04_09:26:31-fs-wip-vshankar-testing-20231204.063332-testing-default-smithi/7476892 2023-12-04T10:20:46.409 INFO:teuthology.dispatcher.supervisor:Job PID: 2470900 2023-12-04T10:20:46.409 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-04T10:22:46.510 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T10:24:46.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T10:26:46.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T10:28:47.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T10:30:47.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T10:32:47.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T10:32:47.435 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-04T10:32:49.413 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-04T10:32:49.413 INFO:teuthology.nuke:Checking targets against current locks 2023-12-04T10:32:49.458 DEBUG:teuthology.nuke:shortname: smithi017 2023-12-04T10:32:49.458 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-04T10:32:49.479 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi017.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-04_09:26:31-fs-wip-vshankar-testing-20231204.063332-testing-default-smithi/7476892', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-04 10:15:33.841425', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-04T10:32:49.482 DEBUG:teuthology.nuke:shortname: smithi167 2023-12-04T10:32:49.483 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-04T10:32:49.508 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi167.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-04_09:26:31-fs-wip-vshankar-testing-20231204.063332-testing-default-smithi/7476892', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-04 10:15:33.842613', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-04T10:32:49.535 INFO:teuthology.orchestra.console.smithi017:Power off 2023-12-04T10:32:49.535 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-04T10:32:49.561 DEBUG:teuthology.orchestra.console.smithi017:power off output: Chassis Power Control: Down/Off 2023-12-04T10:32:49.562 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T10:32:49.577 INFO:teuthology.orchestra.console.smithi167:Power off 2023-12-04T10:32:49.577 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-04T10:32:49.586 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off 2023-12-04T10:32:49.598 DEBUG:teuthology.orchestra.console.smithi167:power off output: Chassis Power Control: Down/Off 2023-12-04T10:32:49.598 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T10:32:49.621 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2023-12-04T10:32:49.688 INFO:teuthology.orchestra.console.smithi017:Power off completed 2023-12-04T10:32:49.723 INFO:teuthology.orchestra.console.smithi167:Power off completed 2023-12-04T10:32:49.896 INFO:teuthology.lock.ops:unlocked: smithi017.front.sepia.ceph.com 2023-12-04T10:32:49.901 INFO:teuthology.lock.ops:unlocked: smithi167.front.sepia.ceph.com