2023-12-04T18:40:06.870 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-04T18:40:06.870 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T18:40:06.988 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd8a7a46550>, signals=[15]) 2023-12-04T18:40:06.989 INFO:teuthology.lock.ops:Start node 'smithi012.front.sepia.ceph.com' reimaging 2023-12-04T18:40:06.989 INFO:teuthology.lock.ops:Updating [smithi012.front.sepia.ceph.com]: reset os type and version on server 2023-12-04T18:40:06.989 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2023-12-04T18:40:07.015 INFO:teuthology.lock.ops:Start node 'smithi029.front.sepia.ceph.com' reimaging 2023-12-04T18:40:07.015 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: reset os type and version on server 2023-12-04T18:40:07.016 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2023-12-04T18:40:07.120 DEBUG:teuthology.provision.fog.smithi012:Requesting image smithi_centos_9.stream (ID 10) 2023-12-04T18:40:07.157 DEBUG:teuthology.provision.fog.smithi029:Requesting image smithi_centos_9.stream (ID 10) 2023-12-04T18:40:07.177 INFO:teuthology.provision.fog.smithi012:Scheduling deploy of centos 9.stream 2023-12-04T18:40:07.202 INFO:teuthology.provision.fog.smithi029:Scheduling deploy of centos 9.stream 2023-12-04T18:40:07.720 INFO:teuthology.orchestra.console.smithi012:Power off 2023-12-04T18:40:07.721 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-04T18:40:07.732 INFO:teuthology.orchestra.console.smithi029:Power off 2023-12-04T18:40:07.733 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-04T18:40:07.742 DEBUG:teuthology.orchestra.console.smithi012:power off output: Chassis Power Control: Down/Off 2023-12-04T18:40:07.742 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T18:40:07.754 DEBUG:teuthology.orchestra.console.smithi029:power off output: Chassis Power Control: Down/Off 2023-12-04T18:40:07.754 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T18:40:07.763 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2023-12-04T18:40:07.773 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on 2023-12-04T18:40:11.768 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T18:40:11.775 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T18:40:11.877 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2023-12-04T18:40:11.883 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on 2023-12-04T18:40:15.878 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T18:40:15.885 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T18:40:15.987 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off 2023-12-04T18:40:15.993 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off 2023-12-04T18:40:16.089 INFO:teuthology.orchestra.console.smithi012:Power off completed 2023-12-04T18:40:16.094 INFO:teuthology.orchestra.console.smithi029:Power off completed 2023-12-04T18:40:16.190 INFO:teuthology.orchestra.console.smithi012:Power on 2023-12-04T18:40:16.190 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-04T18:40:16.197 INFO:teuthology.orchestra.console.smithi029:Power on 2023-12-04T18:40:16.197 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-04T18:40:16.209 DEBUG:teuthology.orchestra.console.smithi012:power on output: Chassis Power Control: Up/On 2023-12-04T18:40:16.209 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T18:40:16.216 DEBUG:teuthology.orchestra.console.smithi029:power on output: Chassis Power Control: Up/On 2023-12-04T18:40:16.217 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T18:40:16.228 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off 2023-12-04T18:40:16.236 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off 2023-12-04T18:40:20.230 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T18:40:20.237 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T18:40:20.339 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off 2023-12-04T18:40:20.345 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off 2023-12-04T18:40:24.342 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T18:40:24.348 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T18:40:24.456 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on 2023-12-04T18:40:24.547 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2023-12-04T18:40:24.557 INFO:teuthology.orchestra.console.smithi029:Power on completed 2023-12-04T18:40:24.648 INFO:teuthology.orchestra.console.smithi012:Power on completed 2023-12-04T18:40:24.658 INFO:teuthology.provision.fog.smithi029:Waiting for deploy to finish 2023-12-04T18:40:24.748 INFO:teuthology.provision.fog.smithi012:Waiting for deploy to finish 2023-12-04T18:44:42.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T18:44:45.186 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2023-12-04T18:44:51.193 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T18:44:54.274 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2023-12-04T18:45:00.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T18:45:03.366 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2023-12-04T18:45:09.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T18:45:12.450 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2023-12-04T18:45:18.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T18:45:21.510 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2023-12-04T18:45:27.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T18:45:30.594 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2023-12-04T18:45:36.601 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T18:46:36.606 WARNING:teuthology.provision.fog.smithi029:timed out 2023-12-04T18:46:42.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T18:46:42.880 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-04T18:46:42.880 DEBUG:teuthology.orchestra.run.smithi029:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-04T18:46:43.235 INFO:teuthology.provision.fog.smithi029:Node is ready 2023-12-04T18:46:43.235 DEBUG:teuthology.orchestra.run.smithi029:> hostname 2023-12-04T18:46:43.249 INFO:teuthology.orchestra.run.smithi029.stdout:smithi029.front.sepia.ceph.com 2023-12-04T18:46:43.250 DEBUG:teuthology.orchestra.run.smithi029:> grep smithi029.front.sepia.ceph.com /etc/hosts 2023-12-04T18:46:43.305 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29 smithi029.front.sepia.ceph.com smithi029 2023-12-04T18:46:43.305 DEBUG:teuthology.orchestra.run.smithi029:> sudo hostname smithi029 2023-12-04T18:46:43.447 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/smithi029.front.sepia.ceph.com/smithi029/g' /etc/hosts 2023-12-04T18:46:43.479 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/172.21.15.29/172.21.15.29/g' /etc/hosts 2023-12-04T18:46:43.550 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/smithi029.front.sepia.ceph.com/smithi029/g' /etc/hostname 2023-12-04T18:46:43.620 DEBUG:teuthology.orchestra.run.smithi029:> sudo hostname smithi029 2023-12-04T18:46:43.691 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release 2023-12-04T18:46:43.745 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="CentOS Stream" 2023-12-04T18:46:43.745 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="9" 2023-12-04T18:46:43.745 INFO:teuthology.orchestra.run.smithi029.stdout:ID="centos" 2023-12-04T18:46:43.746 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="rhel fedora" 2023-12-04T18:46:43.746 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="9" 2023-12-04T18:46:43.746 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el9" 2023-12-04T18:46:43.746 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-04T18:46:43.746 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31" 2023-12-04T18:46:43.746 INFO:teuthology.orchestra.run.smithi029.stdout:LOGO="fedora-logo-icon" 2023-12-04T18:46:43.746 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-04T18:46:43.746 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://centos.org/" 2023-12-04T18:46:43.746 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-04T18:46:43.746 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-04T18:46:43.746 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-04T18:46:43.747 INFO:teuthology.provision.fog.smithi029:Deploy complete! 2023-12-04T18:46:43.748 DEBUG:teuthology.parallel:result is None 2023-12-04T18:50:03.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T18:50:06.274 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-12-04T18:50:12.278 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T18:50:15.330 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-12-04T18:50:21.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T18:50:24.386 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-12-04T18:50:30.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T18:50:33.474 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-12-04T18:50:39.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T18:50:42.530 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-12-04T18:50:48.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T18:51:48.598 WARNING:teuthology.provision.fog.smithi012:timed out 2023-12-04T18:51:54.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T18:51:54.848 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-04T18:51:54.848 DEBUG:teuthology.orchestra.run.smithi012:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-04T18:51:55.194 INFO:teuthology.provision.fog.smithi012:Node is ready 2023-12-04T18:51:55.195 DEBUG:teuthology.orchestra.run.smithi012:> hostname 2023-12-04T18:51:55.210 INFO:teuthology.orchestra.run.smithi012.stdout:smithi012.front.sepia.ceph.com 2023-12-04T18:51:55.210 DEBUG:teuthology.orchestra.run.smithi012:> grep smithi012.front.sepia.ceph.com /etc/hosts 2023-12-04T18:51:55.266 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12 smithi012.front.sepia.ceph.com smithi012 2023-12-04T18:51:55.266 DEBUG:teuthology.orchestra.run.smithi012:> sudo hostname smithi012 2023-12-04T18:51:55.387 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/smithi012.front.sepia.ceph.com/smithi012/g' /etc/hosts 2023-12-04T18:51:55.419 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/172.21.15.12/172.21.15.12/g' /etc/hosts 2023-12-04T18:51:55.489 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/smithi012.front.sepia.ceph.com/smithi012/g' /etc/hostname 2023-12-04T18:51:55.561 DEBUG:teuthology.orchestra.run.smithi012:> sudo hostname smithi012 2023-12-04T18:51:55.631 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release 2023-12-04T18:51:55.685 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="CentOS Stream" 2023-12-04T18:51:55.686 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="9" 2023-12-04T18:51:55.686 INFO:teuthology.orchestra.run.smithi012.stdout:ID="centos" 2023-12-04T18:51:55.686 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="rhel fedora" 2023-12-04T18:51:55.687 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="9" 2023-12-04T18:51:55.687 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el9" 2023-12-04T18:51:55.687 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-04T18:51:55.688 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31" 2023-12-04T18:51:55.688 INFO:teuthology.orchestra.run.smithi012.stdout:LOGO="fedora-logo-icon" 2023-12-04T18:51:55.688 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-04T18:51:55.688 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://centos.org/" 2023-12-04T18:51:55.689 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-04T18:51:55.689 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-04T18:51:55.690 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-04T18:51:55.690 INFO:teuthology.provision.fog.smithi012:Deploy complete! 2023-12-04T18:51:55.691 DEBUG:teuthology.parallel:result is None 2023-12-04T18:51:55.863 INFO:teuthology.lock.ops:Checking smithi012.front.sepia.ceph.com 2023-12-04T18:51:55.863 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-04T18:51:55.889 INFO:teuthology.lock.ops:Checking smithi029.front.sepia.ceph.com 2023-12-04T18:51:55.889 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-04T18:51:55.907 INFO:teuthology.lock.ops:Updating [smithi012.front.sepia.ceph.com]: set os type and version on server 2023-12-04T18:51:55.907 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-12-04T18:51:55.907 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T18:51:56.001 DEBUG:teuthology.orchestra.run.smithi012:> true 2023-12-04T18:51:56.071 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-12-04T18:51:56.071 DEBUG:teuthology.orchestra.run.smithi012:> uname -m 2023-12-04T18:51:56.126 INFO:teuthology.orchestra.run.smithi012.stdout:x86_64 2023-12-04T18:51:56.127 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release 2023-12-04T18:51:56.181 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="CentOS Stream" 2023-12-04T18:51:56.181 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="9" 2023-12-04T18:51:56.181 INFO:teuthology.orchestra.run.smithi012.stdout:ID="centos" 2023-12-04T18:51:56.181 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="rhel fedora" 2023-12-04T18:51:56.181 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="9" 2023-12-04T18:51:56.181 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el9" 2023-12-04T18:51:56.181 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-04T18:51:56.182 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31" 2023-12-04T18:51:56.182 INFO:teuthology.orchestra.run.smithi012.stdout:LOGO="fedora-logo-icon" 2023-12-04T18:51:56.182 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-04T18:51:56.182 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://centos.org/" 2023-12-04T18:51:56.182 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-04T18:51:56.182 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-04T18:51:56.182 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-04T18:51:56.182 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2023-12-04T18:51:56.206 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: set os type and version on server 2023-12-04T18:51:56.206 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2023-12-04T18:51:56.206 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T18:51:56.304 DEBUG:teuthology.orchestra.run.smithi029:> true 2023-12-04T18:51:56.489 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com' 2023-12-04T18:51:56.491 DEBUG:teuthology.orchestra.run.smithi029:> uname -m 2023-12-04T18:51:56.545 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64 2023-12-04T18:51:56.545 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release 2023-12-04T18:51:56.600 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="CentOS Stream" 2023-12-04T18:51:56.600 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="9" 2023-12-04T18:51:56.600 INFO:teuthology.orchestra.run.smithi029.stdout:ID="centos" 2023-12-04T18:51:56.600 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="rhel fedora" 2023-12-04T18:51:56.600 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="9" 2023-12-04T18:51:56.601 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el9" 2023-12-04T18:51:56.601 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-04T18:51:56.601 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31" 2023-12-04T18:51:56.601 INFO:teuthology.orchestra.run.smithi029.stdout:LOGO="fedora-logo-icon" 2023-12-04T18:51:56.601 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-04T18:51:56.601 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://centos.org/" 2023-12-04T18:51:56.601 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-04T18:51:56.601 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-04T18:51:56.602 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-04T18:51:56.602 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2023-12-04T18:51:56.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T18:51:56.733 INFO:teuthology.dispatcher.supervisor:Running job 7477282 2023-12-04T18:51:56.733 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/virtualenv/bin/teuthology -v --owner scheduled_mkogan@teuthology --archive /home/teuthworker/archive/mkogan-2023-12-04_18:39:17-rgw-rgw-wip-t63445-valg-supp-rb_i001-distro-default-smithi/7477282 --name mkogan-2023-12-04_18:39:17-rgw-rgw-wip-t63445-valg-supp-rb_i001-distro-default-smithi --description rgw/upgrade/{1-install/quincy/{distro$/{centos_latest} install overrides} 2-setup 3-upgrade-sequence/osds-then-rgws cluster frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides} -- /home/teuthworker/archive/mkogan-2023-12-04_18:39:17-rgw-rgw-wip-t63445-valg-supp-rb_i001-distro-default-smithi/7477282/orig.config.yaml 2023-12-04T18:51:56.739 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mkogan-2023-12-04_18:39:17-rgw-rgw-wip-t63445-valg-supp-rb_i001-distro-default-smithi/7477282 2023-12-04T18:51:56.739 INFO:teuthology.dispatcher.supervisor:Job PID: 2053513 2023-12-04T18:51:56.739 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-04T18:53:56.843 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T18:55:57.024 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T18:57:57.200 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T18:59:57.365 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T19:01:57.552 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T19:03:57.727 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T19:05:57.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T19:07:58.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T19:09:58.233 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T19:11:58.400 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T19:13:58.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T19:13:58.631 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-04T19:14:23.164 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-04T19:14:23.164 INFO:teuthology.nuke:Checking targets against current locks 2023-12-04T19:14:23.212 DEBUG:teuthology.nuke:shortname: smithi012 2023-12-04T19:14:23.212 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-04T19:14:23.230 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi012.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mkogan-2023-12-04_18:39:17-rgw-rgw-wip-t63445-valg-supp-rb_i001-distro-default-smithi/7477282', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-04 18:40:06.081434', 'locked_by': 'scheduled_mkogan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAoizyDojWcDzXbsJ0DCOc5bEmCFpUolm/3J0Ev6OV7mAepbvlQ4DWXw4tC1ly24PCfkIT/ot/uQYYs7oNcexEc='} 2023-12-04T19:14:23.233 DEBUG:teuthology.nuke:shortname: smithi029 2023-12-04T19:14:23.234 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-04T19:14:23.250 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi029.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mkogan-2023-12-04_18:39:17-rgw-rgw-wip-t63445-valg-supp-rb_i001-distro-default-smithi/7477282', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-04 18:40:06.082855', 'locked_by': 'scheduled_mkogan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLiza9uRYrxjL93NKzDD4kVUilXgOCX/pAdLDtK8WbKMZaxkG93edS+wWlh6ky4WSL/HrNbcx9A4OgG2ZF9a5dY='} 2023-12-04T19:14:23.277 INFO:teuthology.orchestra.console.smithi012:Power off 2023-12-04T19:14:23.278 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-04T19:14:23.304 DEBUG:teuthology.orchestra.console.smithi012:power off output: Chassis Power Control: Down/Off 2023-12-04T19:14:23.305 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T19:14:23.318 INFO:teuthology.orchestra.console.smithi029:Power off 2023-12-04T19:14:23.319 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-04T19:14:23.327 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off 2023-12-04T19:14:23.341 DEBUG:teuthology.orchestra.console.smithi029:power off output: Chassis Power Control: Down/Off 2023-12-04T19:14:23.341 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T19:14:23.363 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off 2023-12-04T19:14:23.428 INFO:teuthology.orchestra.console.smithi012:Power off completed 2023-12-04T19:14:23.464 INFO:teuthology.orchestra.console.smithi029:Power off completed 2023-12-04T19:14:23.585 INFO:teuthology.lock.ops:unlocked: smithi012.front.sepia.ceph.com 2023-12-04T19:14:23.610 INFO:teuthology.lock.ops:unlocked: smithi029.front.sepia.ceph.com