2023-12-20T04:21:26.002 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-20T04:21:26.003 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-20T04:21:26.143 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7d115a8940>, signals=[15]) 2023-12-20T04:21:26.144 INFO:teuthology.lock.ops:Start node 'smithi169.front.sepia.ceph.com' reimaging 2023-12-20T04:21:26.144 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: reset os type and version on server 2023-12-20T04:21:26.144 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2023-12-20T04:21:26.171 INFO:teuthology.lock.ops:Start node 'smithi184.front.sepia.ceph.com' reimaging 2023-12-20T04:21:26.171 INFO:teuthology.lock.ops:Updating [smithi184.front.sepia.ceph.com]: reset os type and version on server 2023-12-20T04:21:26.171 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2023-12-20T04:21:26.285 DEBUG:teuthology.provision.fog.smithi169:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-20T04:21:26.329 DEBUG:teuthology.provision.fog.smithi184:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-20T04:21:26.341 INFO:teuthology.provision.fog.smithi169:Scheduling deploy of rhel 8.6 2023-12-20T04:21:26.379 INFO:teuthology.provision.fog.smithi184:Scheduling deploy of rhel 8.6 2023-12-20T04:21:26.687 INFO:teuthology.orchestra.console.smithi169:Power off 2023-12-20T04:21:26.687 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-20T04:21:26.707 DEBUG:teuthology.orchestra.console.smithi169:power off output: Chassis Power Control: Down/Off 2023-12-20T04:21:26.708 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-20T04:21:26.721 INFO:teuthology.orchestra.console.smithi184:Power off 2023-12-20T04:21:26.722 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-20T04:21:26.732 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2023-12-20T04:21:26.742 DEBUG:teuthology.orchestra.console.smithi184:power off output: Chassis Power Control: Down/Off 2023-12-20T04:21:26.742 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-20T04:21:26.764 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off 2023-12-20T04:21:26.833 INFO:teuthology.orchestra.console.smithi169:Power off completed 2023-12-20T04:21:26.866 INFO:teuthology.orchestra.console.smithi184:Power off completed 2023-12-20T04:21:26.934 INFO:teuthology.orchestra.console.smithi169:Power on 2023-12-20T04:21:26.936 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-20T04:21:26.957 DEBUG:teuthology.orchestra.console.smithi169:power on output: Chassis Power Control: Up/On 2023-12-20T04:21:26.958 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-20T04:21:26.967 INFO:teuthology.orchestra.console.smithi184:Power on 2023-12-20T04:21:26.967 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-20T04:21:26.981 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2023-12-20T04:21:26.989 DEBUG:teuthology.orchestra.console.smithi184:power on output: Chassis Power Control: Up/On 2023-12-20T04:21:26.989 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-20T04:21:27.011 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off 2023-12-20T04:21:30.982 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-20T04:21:31.013 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-20T04:21:31.093 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2023-12-20T04:21:31.122 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off 2023-12-20T04:21:31.194 INFO:teuthology.orchestra.console.smithi169:Power on completed 2023-12-20T04:21:31.294 INFO:teuthology.provision.fog.smithi169:Waiting for deploy to finish 2023-12-20T04:21:35.125 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-20T04:21:35.239 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on 2023-12-20T04:21:35.340 INFO:teuthology.orchestra.console.smithi184:Power on completed 2023-12-20T04:21:35.441 INFO:teuthology.provision.fog.smithi184:Waiting for deploy to finish 2023-12-20T04:24:21.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T04:24:24.401 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-12-20T04:24:30.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T04:24:32.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T04:24:33.457 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-12-20T04:24:35.473 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-12-20T04:24:39.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T04:24:41.476 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T04:24:42.518 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-12-20T04:24:44.529 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-12-20T04:24:48.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T04:24:50.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T04:24:51.605 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-12-20T04:24:53.589 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-12-20T04:24:57.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T04:24:59.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T04:25:00.689 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-12-20T04:25:02.641 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-12-20T04:25:06.694 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T04:25:08.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T04:25:09.749 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-12-20T04:25:11.702 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-12-20T04:25:15.754 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T04:25:17.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T04:25:20.785 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-12-20T04:25:26.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T04:25:29.845 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-12-20T04:25:34.226 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-12-20T04:25:35.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T04:25:40.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T04:25:43.281 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-12-20T04:25:49.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T04:25:52.341 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-12-20T04:25:58.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T04:25:59.015 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-20T04:25:59.016 DEBUG:teuthology.orchestra.run.smithi184:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-20T04:26:14.858 INFO:teuthology.provision.fog.smithi184:Node is ready 2023-12-20T04:26:14.859 DEBUG:teuthology.orchestra.run.smithi184:> hostname 2023-12-20T04:26:14.882 INFO:teuthology.orchestra.run.smithi184.stdout:smithi184.front.sepia.ceph.com 2023-12-20T04:26:14.882 DEBUG:teuthology.orchestra.run.smithi184:> grep smithi184.front.sepia.ceph.com /etc/hosts 2023-12-20T04:26:14.942 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.15.184 smithi184.front.sepia.ceph.com smithi184 2023-12-20T04:26:14.943 DEBUG:teuthology.orchestra.run.smithi184:> sudo hostname smithi184 2023-12-20T04:26:15.076 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i -e 's/smithi184.front.sepia.ceph.com/smithi184/g' /etc/hosts 2023-12-20T04:26:15.110 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i -e 's/172.21.15.184/172.21.15.184/g' /etc/hosts 2023-12-20T04:26:15.183 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i -e 's/smithi184.front.sepia.ceph.com/smithi184/g' /etc/hostname 2023-12-20T04:26:15.257 DEBUG:teuthology.orchestra.run.smithi184:> sudo hostname smithi184 2023-12-20T04:26:15.331 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release 2023-12-20T04:26:15.392 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="Red Hat Enterprise Linux" 2023-12-20T04:26:15.392 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="8.6 (Ootpa)" 2023-12-20T04:26:15.392 INFO:teuthology.orchestra.run.smithi184.stdout:ID="rhel" 2023-12-20T04:26:15.392 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE="fedora" 2023-12-20T04:26:15.392 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="8.6" 2023-12-20T04:26:15.392 INFO:teuthology.orchestra.run.smithi184.stdout:PLATFORM_ID="platform:el8" 2023-12-20T04:26:15.392 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-20T04:26:15.392 INFO:teuthology.orchestra.run.smithi184.stdout:ANSI_COLOR="0;31" 2023-12-20T04:26:15.392 INFO:teuthology.orchestra.run.smithi184.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-20T04:26:15.392 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://www.redhat.com/" 2023-12-20T04:26:15.393 INFO:teuthology.orchestra.run.smithi184.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-20T04:26:15.393 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-20T04:26:15.393 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-20T04:26:15.393 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-20T04:26:15.393 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-20T04:26:15.393 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-20T04:26:15.393 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-20T04:26:15.394 INFO:teuthology.provision.fog.smithi184:Deploy complete! 2023-12-20T04:26:15.395 DEBUG:teuthology.parallel:result is None 2023-12-20T04:26:35.870 WARNING:teuthology.provision.fog.smithi169:timed out 2023-12-20T04:26:41.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T04:26:42.094 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-20T04:26:42.094 DEBUG:teuthology.orchestra.run.smithi169:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-20T04:26:42.361 INFO:teuthology.provision.fog.smithi169:Node is ready 2023-12-20T04:26:42.362 DEBUG:teuthology.orchestra.run.smithi169:> hostname 2023-12-20T04:26:42.380 INFO:teuthology.orchestra.run.smithi169.stdout:smithi169 2023-12-20T04:26:42.380 DEBUG:teuthology.orchestra.run.smithi169:> grep smithi169 /etc/hosts 2023-12-20T04:26:42.439 INFO:teuthology.orchestra.run.smithi169.stdout:172.21.15.169 smithi169.front.sepia.ceph.com smithi169 2023-12-20T04:26:42.439 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169 2023-12-20T04:26:42.574 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169/smithi169/g' /etc/hosts 2023-12-20T04:26:42.603 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/172.21.15.169/172.21.15.169/g' /etc/hosts 2023-12-20T04:26:42.673 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169/smithi169/g' /etc/hostname 2023-12-20T04:26:42.743 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169 2023-12-20T04:26:42.810 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2023-12-20T04:26:42.870 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="Red Hat Enterprise Linux" 2023-12-20T04:26:42.871 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="8.6 (Ootpa)" 2023-12-20T04:26:42.871 INFO:teuthology.orchestra.run.smithi169.stdout:ID="rhel" 2023-12-20T04:26:42.871 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="fedora" 2023-12-20T04:26:42.871 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="8.6" 2023-12-20T04:26:42.871 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el8" 2023-12-20T04:26:42.871 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-20T04:26:42.871 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2023-12-20T04:26:42.871 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-20T04:26:42.871 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://www.redhat.com/" 2023-12-20T04:26:42.871 INFO:teuthology.orchestra.run.smithi169.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-20T04:26:42.871 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-20T04:26:42.871 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-12-20T04:26:42.871 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-20T04:26:42.872 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-20T04:26:42.872 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-20T04:26:42.872 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-20T04:26:42.872 INFO:teuthology.provision.fog.smithi169:Deploy complete! 2023-12-20T04:26:42.873 DEBUG:teuthology.parallel:result is None 2023-12-20T04:26:43.021 INFO:teuthology.lock.ops:Checking smithi169.front.sepia.ceph.com 2023-12-20T04:26:43.021 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-20T04:26:43.042 INFO:teuthology.lock.ops:Checking smithi184.front.sepia.ceph.com 2023-12-20T04:26:43.043 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-20T04:26:43.069 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: set os type and version on server 2023-12-20T04:26:43.069 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2023-12-20T04:26:43.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T04:26:43.137 DEBUG:teuthology.orchestra.run.smithi169:> true 2023-12-20T04:26:43.160 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2023-12-20T04:26:43.160 DEBUG:teuthology.orchestra.run.smithi169:> uname -m 2023-12-20T04:26:43.216 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64 2023-12-20T04:26:43.217 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2023-12-20T04:26:43.271 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="Red Hat Enterprise Linux" 2023-12-20T04:26:43.271 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="8.6 (Ootpa)" 2023-12-20T04:26:43.271 INFO:teuthology.orchestra.run.smithi169.stdout:ID="rhel" 2023-12-20T04:26:43.271 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="fedora" 2023-12-20T04:26:43.271 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="8.6" 2023-12-20T04:26:43.271 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el8" 2023-12-20T04:26:43.271 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-20T04:26:43.271 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2023-12-20T04:26:43.271 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-20T04:26:43.271 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://www.redhat.com/" 2023-12-20T04:26:43.271 INFO:teuthology.orchestra.run.smithi169.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-20T04:26:43.271 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-20T04:26:43.272 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-12-20T04:26:43.272 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-20T04:26:43.272 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-20T04:26:43.272 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-20T04:26:43.272 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-20T04:26:43.272 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2023-12-20T04:26:43.294 INFO:teuthology.lock.ops:Updating [smithi184.front.sepia.ceph.com]: set os type and version on server 2023-12-20T04:26:43.294 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-12-20T04:26:43.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T04:26:43.404 DEBUG:teuthology.orchestra.run.smithi184:> true 2023-12-20T04:26:43.548 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-12-20T04:26:43.548 DEBUG:teuthology.orchestra.run.smithi184:> uname -m 2023-12-20T04:26:43.606 INFO:teuthology.orchestra.run.smithi184.stdout:x86_64 2023-12-20T04:26:43.606 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release 2023-12-20T04:26:43.664 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="Red Hat Enterprise Linux" 2023-12-20T04:26:43.664 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="8.6 (Ootpa)" 2023-12-20T04:26:43.664 INFO:teuthology.orchestra.run.smithi184.stdout:ID="rhel" 2023-12-20T04:26:43.664 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE="fedora" 2023-12-20T04:26:43.665 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="8.6" 2023-12-20T04:26:43.665 INFO:teuthology.orchestra.run.smithi184.stdout:PLATFORM_ID="platform:el8" 2023-12-20T04:26:43.665 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-20T04:26:43.665 INFO:teuthology.orchestra.run.smithi184.stdout:ANSI_COLOR="0;31" 2023-12-20T04:26:43.665 INFO:teuthology.orchestra.run.smithi184.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-20T04:26:43.665 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://www.redhat.com/" 2023-12-20T04:26:43.665 INFO:teuthology.orchestra.run.smithi184.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-20T04:26:43.665 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-20T04:26:43.666 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-12-20T04:26:43.666 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-20T04:26:43.666 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-20T04:26:43.666 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-20T04:26:43.666 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-20T04:26:43.666 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2023-12-20T04:26:43.684 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-20T04:26:43.784 INFO:teuthology.dispatcher.supervisor:Running job 7497446 2023-12-20T04:26:43.784 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497446 --name vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi --description fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} -- /home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497446/orig.config.yaml 2023-12-20T04:26:43.787 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497446 2023-12-20T04:26:43.787 INFO:teuthology.dispatcher.supervisor:Job PID: 3796847 2023-12-20T04:26:43.787 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-20T04:28:43.886 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-20T04:30:44.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-20T04:32:44.222 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-20T04:34:44.398 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-20T04:36:44.573 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-20T04:36:44.641 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-20T04:36:44.751 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-20T04:36:44.751 INFO:teuthology.nuke:Checking targets against current locks 2023-12-20T04:36:44.802 DEBUG:teuthology.nuke:shortname: smithi169 2023-12-20T04:36:44.803 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-20T04:36:44.828 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi169.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497446', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-20 04:21:25.104878', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJJ33MCRKghNvViKTuucXsYqaz6B3xTAeiHetCfwo3M+HVh3hRU/hhAVhnXWyoY96awldg5mQcgSNcdSig/bUZA='} 2023-12-20T04:36:44.832 DEBUG:teuthology.nuke:shortname: smithi184 2023-12-20T04:36:44.832 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-20T04:36:44.857 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi184.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497446', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-20 04:21:25.106830', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGB8UuOB7otCxWAk/3QI1aDn9Mrh7BW45qiRDmx31JWB3n1XutipDAd3O98LUOyIGL0Sk79EKiQxk28RVaRwrxc='} 2023-12-20T04:36:44.882 INFO:teuthology.orchestra.console.smithi169:Power off 2023-12-20T04:36:44.883 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-20T04:36:44.904 DEBUG:teuthology.orchestra.console.smithi169:power off output: Chassis Power Control: Down/Off 2023-12-20T04:36:44.904 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-20T04:36:44.923 INFO:teuthology.orchestra.console.smithi184:Power off 2023-12-20T04:36:44.923 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-20T04:36:44.931 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2023-12-20T04:36:44.944 DEBUG:teuthology.orchestra.console.smithi184:power off output: Chassis Power Control: Down/Off 2023-12-20T04:36:44.944 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-20T04:36:44.970 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off 2023-12-20T04:36:45.033 INFO:teuthology.orchestra.console.smithi169:Power off completed 2023-12-20T04:36:45.071 INFO:teuthology.orchestra.console.smithi184:Power off completed 2023-12-20T04:36:45.188 INFO:teuthology.lock.ops:unlocked: smithi169.front.sepia.ceph.com 2023-12-20T04:36:45.221 INFO:teuthology.lock.ops:unlocked: smithi184.front.sepia.ceph.com