2023-11-28T14:02:02.959 INFO:root:teuthology version: 0.0.1.dev209+g5ae09a5 2023-11-28T14:02:02.959 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T14:02:03.104 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb7ec983550>, signals=[15]) 2023-11-28T14:02:03.104 INFO:teuthology.lock.ops:Start node 'smithi150.front.sepia.ceph.com' reimaging 2023-11-28T14:02:03.104 INFO:teuthology.lock.ops:Updating [smithi150.front.sepia.ceph.com]: reset os type and version on server 2023-11-28T14:02:03.105 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server 2023-11-28T14:02:03.129 INFO:teuthology.lock.ops:Start node 'smithi156.front.sepia.ceph.com' reimaging 2023-11-28T14:02:03.130 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: reset os type and version on server 2023-11-28T14:02:03.130 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2023-11-28T14:02:03.524 DEBUG:teuthology.provision.fog.smithi156:Requesting image smithi_centos_9.stream (ID 10) 2023-11-28T14:02:03.532 DEBUG:teuthology.provision.fog.smithi150:Requesting image smithi_centos_9.stream (ID 10) 2023-11-28T14:02:03.565 INFO:teuthology.provision.fog.smithi156:Scheduling deploy of centos 9.stream 2023-11-28T14:02:03.574 INFO:teuthology.provision.fog.smithi150:Scheduling deploy of centos 9.stream 2023-11-28T14:02:03.870 INFO:teuthology.orchestra.console.smithi156:Power off 2023-11-28T14:02:03.870 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T14:02:03.883 INFO:teuthology.orchestra.console.smithi150:Power off 2023-11-28T14:02:03.883 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T14:02:03.892 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off 2023-11-28T14:02:03.893 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T14:02:03.906 DEBUG:teuthology.orchestra.console.smithi150:power off output: Chassis Power Control: Down/Off 2023-11-28T14:02:03.906 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T14:02:03.915 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-11-28T14:02:03.928 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off 2023-11-28T14:02:04.017 INFO:teuthology.orchestra.console.smithi156:Power off completed 2023-11-28T14:02:04.029 INFO:teuthology.orchestra.console.smithi150:Power off completed 2023-11-28T14:02:04.118 INFO:teuthology.orchestra.console.smithi156:Power on 2023-11-28T14:02:04.118 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-28T14:02:04.130 INFO:teuthology.orchestra.console.smithi150:Power on 2023-11-28T14:02:04.131 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-28T14:02:04.141 DEBUG:teuthology.orchestra.console.smithi156:power on output: Chassis Power Control: Up/On 2023-11-28T14:02:04.142 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T14:02:04.157 DEBUG:teuthology.orchestra.console.smithi150:power on output: Chassis Power Control: Up/On 2023-11-28T14:02:04.157 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T14:02:04.174 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-11-28T14:02:04.183 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off 2023-11-28T14:02:08.178 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T14:02:08.187 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T14:02:08.289 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-11-28T14:02:08.299 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on 2023-11-28T14:02:08.399 INFO:teuthology.orchestra.console.smithi150:Power on completed 2023-11-28T14:02:08.500 INFO:teuthology.provision.fog.smithi150:Waiting for deploy to finish 2023-11-28T14:02:12.290 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T14:02:12.406 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-11-28T14:02:12.507 INFO:teuthology.orchestra.console.smithi156:Power on completed 2023-11-28T14:02:12.607 INFO:teuthology.provision.fog.smithi156:Waiting for deploy to finish 2023-11-28T14:04:54.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T14:04:57.506 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2023-11-28T14:04:58.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T14:05:01.606 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-11-28T14:05:03.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T14:05:06.594 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2023-11-28T14:05:07.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T14:05:10.690 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-11-28T14:05:12.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T14:05:21.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T14:05:24.770 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2023-11-28T14:05:24.770 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-11-28T14:05:30.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T14:05:30.777 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T14:05:33.830 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2023-11-28T14:05:33.858 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-11-28T14:05:39.837 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T14:05:39.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T14:05:42.918 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2023-11-28T14:05:42.918 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-11-28T14:05:48.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T14:05:48.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T14:05:52.006 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2023-11-28T14:05:52.007 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-11-28T14:05:58.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T14:05:58.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T14:06:58.074 WARNING:teuthology.provision.fog.smithi150:timed out 2023-11-28T14:06:58.075 WARNING:teuthology.provision.fog.smithi156:timed out 2023-11-28T14:07:04.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T14:07:04.081 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T14:07:04.376 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-28T14:07:04.377 DEBUG:teuthology.orchestra.run.smithi156:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-28T14:07:04.440 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-28T14:07:04.440 DEBUG:teuthology.orchestra.run.smithi150:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-28T14:07:04.698 INFO:teuthology.provision.fog.smithi156:Node is ready 2023-11-28T14:07:04.698 DEBUG:teuthology.orchestra.run.smithi156:> hostname 2023-11-28T14:07:04.713 INFO:teuthology.orchestra.run.smithi156.stdout:smithi156.front.sepia.ceph.com 2023-11-28T14:07:04.714 DEBUG:teuthology.orchestra.run.smithi156:> grep smithi156.front.sepia.ceph.com /etc/hosts 2023-11-28T14:07:04.769 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156 smithi156.front.sepia.ceph.com smithi156 2023-11-28T14:07:04.769 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156 2023-11-28T14:07:04.788 INFO:teuthology.provision.fog.smithi150:Node is ready 2023-11-28T14:07:04.788 DEBUG:teuthology.orchestra.run.smithi150:> hostname 2023-11-28T14:07:04.802 INFO:teuthology.orchestra.run.smithi150.stdout:smithi150.front.sepia.ceph.com 2023-11-28T14:07:04.802 DEBUG:teuthology.orchestra.run.smithi150:> grep smithi150.front.sepia.ceph.com /etc/hosts 2023-11-28T14:07:04.856 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.15.150 smithi150.front.sepia.ceph.com smithi150 2023-11-28T14:07:04.857 DEBUG:teuthology.orchestra.run.smithi150:> sudo hostname smithi150 2023-11-28T14:07:04.878 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hosts 2023-11-28T14:07:04.905 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/172.21.15.156/172.21.15.156/g' /etc/hosts 2023-11-28T14:07:04.960 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/smithi150.front.sepia.ceph.com/smithi150/g' /etc/hosts 2023-11-28T14:07:04.973 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hostname 2023-11-28T14:07:04.988 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/172.21.15.150/172.21.15.150/g' /etc/hosts 2023-11-28T14:07:05.040 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156 2023-11-28T14:07:05.055 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/smithi150.front.sepia.ceph.com/smithi150/g' /etc/hostname 2023-11-28T14:07:05.106 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2023-11-28T14:07:05.122 DEBUG:teuthology.orchestra.run.smithi150:> sudo hostname smithi150 2023-11-28T14:07:05.161 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="CentOS Stream" 2023-11-28T14:07:05.161 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="9" 2023-11-28T14:07:05.161 INFO:teuthology.orchestra.run.smithi156.stdout:ID="centos" 2023-11-28T14:07:05.161 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="rhel fedora" 2023-11-28T14:07:05.161 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="9" 2023-11-28T14:07:05.161 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el9" 2023-11-28T14:07:05.161 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-28T14:07:05.162 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31" 2023-11-28T14:07:05.162 INFO:teuthology.orchestra.run.smithi156.stdout:LOGO="fedora-logo-icon" 2023-11-28T14:07:05.162 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-28T14:07:05.162 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://centos.org/" 2023-11-28T14:07:05.162 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-28T14:07:05.162 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-28T14:07:05.162 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-28T14:07:05.163 INFO:teuthology.provision.fog.smithi156:Deploy complete! 2023-11-28T14:07:05.164 DEBUG:teuthology.parallel:result is None 2023-11-28T14:07:05.191 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release 2023-11-28T14:07:05.245 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="CentOS Stream" 2023-11-28T14:07:05.245 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="9" 2023-11-28T14:07:05.245 INFO:teuthology.orchestra.run.smithi150.stdout:ID="centos" 2023-11-28T14:07:05.245 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="rhel fedora" 2023-11-28T14:07:05.245 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="9" 2023-11-28T14:07:05.245 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el9" 2023-11-28T14:07:05.246 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-28T14:07:05.246 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31" 2023-11-28T14:07:05.246 INFO:teuthology.orchestra.run.smithi150.stdout:LOGO="fedora-logo-icon" 2023-11-28T14:07:05.246 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-28T14:07:05.246 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://centos.org/" 2023-11-28T14:07:05.246 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-28T14:07:05.246 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-28T14:07:05.246 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-28T14:07:05.246 INFO:teuthology.provision.fog.smithi150:Deploy complete! 2023-11-28T14:07:05.247 DEBUG:teuthology.parallel:result is None 2023-11-28T14:07:05.437 INFO:teuthology.lock.ops:Checking smithi150.front.sepia.ceph.com 2023-11-28T14:07:05.437 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-28T14:07:05.456 INFO:teuthology.lock.ops:Checking smithi156.front.sepia.ceph.com 2023-11-28T14:07:05.456 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-28T14:07:05.483 INFO:teuthology.lock.ops:Updating [smithi150.front.sepia.ceph.com]: set os type and version on server 2023-11-28T14:07:05.483 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2023-11-28T14:07:05.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T14:07:05.567 DEBUG:teuthology.orchestra.run.smithi150:> true 2023-11-28T14:07:05.636 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi150.front.sepia.ceph.com' 2023-11-28T14:07:05.636 DEBUG:teuthology.orchestra.run.smithi150:> uname -m 2023-11-28T14:07:05.691 INFO:teuthology.orchestra.run.smithi150.stdout:x86_64 2023-11-28T14:07:05.691 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release 2023-11-28T14:07:05.746 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="CentOS Stream" 2023-11-28T14:07:05.746 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="9" 2023-11-28T14:07:05.746 INFO:teuthology.orchestra.run.smithi150.stdout:ID="centos" 2023-11-28T14:07:05.746 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="rhel fedora" 2023-11-28T14:07:05.746 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="9" 2023-11-28T14:07:05.746 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el9" 2023-11-28T14:07:05.747 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-28T14:07:05.747 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31" 2023-11-28T14:07:05.747 INFO:teuthology.orchestra.run.smithi150.stdout:LOGO="fedora-logo-icon" 2023-11-28T14:07:05.747 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-28T14:07:05.747 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://centos.org/" 2023-11-28T14:07:05.747 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-28T14:07:05.747 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-28T14:07:05.748 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-28T14:07:05.748 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server 2023-11-28T14:07:05.773 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: set os type and version on server 2023-11-28T14:07:05.773 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-11-28T14:07:05.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T14:07:05.855 DEBUG:teuthology.orchestra.run.smithi156:> true 2023-11-28T14:07:05.924 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-11-28T14:07:05.925 DEBUG:teuthology.orchestra.run.smithi156:> uname -m 2023-11-28T14:07:05.979 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64 2023-11-28T14:07:05.980 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2023-11-28T14:07:06.034 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="CentOS Stream" 2023-11-28T14:07:06.034 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="9" 2023-11-28T14:07:06.035 INFO:teuthology.orchestra.run.smithi156.stdout:ID="centos" 2023-11-28T14:07:06.035 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="rhel fedora" 2023-11-28T14:07:06.035 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="9" 2023-11-28T14:07:06.035 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el9" 2023-11-28T14:07:06.036 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-28T14:07:06.036 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31" 2023-11-28T14:07:06.036 INFO:teuthology.orchestra.run.smithi156.stdout:LOGO="fedora-logo-icon" 2023-11-28T14:07:06.036 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-28T14:07:06.036 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://centos.org/" 2023-11-28T14:07:06.037 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-28T14:07:06.037 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-28T14:07:06.037 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-28T14:07:06.037 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2023-11-28T14:07:06.056 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T14:07:06.146 INFO:teuthology.dispatcher.supervisor:Running job 7469282 2023-11-28T14:07:06.146 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/virtualenv/bin/teuthology -v --owner scheduled_kkeithle@teuthology --archive /home/teuthworker/archive/kkeithle-2023-11-27_23:57:32-rgw:verify-wip-kkeithley-zipper-ayb-distro-default-smithi/7469282 --name kkeithle-2023-11-27_23:57:32-rgw:verify-wip-kkeithley-zipper-ayb-distro-default-smithi --description rgw:verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} -- /home/teuthworker/archive/kkeithle-2023-11-27_23:57:32-rgw:verify-wip-kkeithley-zipper-ayb-distro-default-smithi/7469282/orig.config.yaml 2023-11-28T14:07:06.149 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/kkeithle-2023-11-27_23:57:32-rgw:verify-wip-kkeithley-zipper-ayb-distro-default-smithi/7469282 2023-11-28T14:07:06.150 INFO:teuthology.dispatcher.supervisor:Job PID: 395628 2023-11-28T14:07:06.150 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-28T14:09:06.251 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T14:11:06.429 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T14:13:06.603 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T14:15:06.759 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T14:17:06.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T14:19:07.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T14:21:07.264 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T14:23:07.438 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T14:25:07.613 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T14:27:07.779 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T14:29:07.955 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T14:31:08.147 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T14:31:08.213 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-11-28T14:31:08.327 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-28T14:31:08.327 INFO:teuthology.nuke:Checking targets against current locks 2023-11-28T14:31:08.380 DEBUG:teuthology.nuke:shortname: smithi150 2023-11-28T14:31:08.380 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T14:31:08.399 DEBUG:teuthology.nuke:shortname: smithi156 2023-11-28T14:31:08.400 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T14:31:08.403 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi150.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/kkeithle-2023-11-27_23:57:32-rgw:verify-wip-kkeithley-zipper-ayb-distro-default-smithi/7469282', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 14:02:02.086018', 'locked_by': 'scheduled_kkeithle@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDVZrY72+NsasHrZbR16VSRmmzbubBGS8uKLJRmBqslz8J62h4g7pQitOa+10h8wLzVY7+rYDAO5p86Nit7SMt0='} 2023-11-28T14:31:08.424 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi156.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/kkeithle-2023-11-27_23:57:32-rgw:verify-wip-kkeithley-zipper-ayb-distro-default-smithi/7469282', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 14:02:02.084513', 'locked_by': 'scheduled_kkeithle@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBoab6LZZ5J3J0/7S3SSOY7JtTvJ+mGAmKibzfyO7xsek2D7WWsG9+IRx0m9MgoMNFZ0MqH0Ib6gLB72LEAPxuY='} 2023-11-28T14:31:08.457 INFO:teuthology.orchestra.console.smithi150:Power off 2023-11-28T14:31:08.457 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T14:31:08.479 DEBUG:teuthology.orchestra.console.smithi150:power off output: Chassis Power Control: Down/Off 2023-11-28T14:31:08.479 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T14:31:08.493 INFO:teuthology.orchestra.console.smithi156:Power off 2023-11-28T14:31:08.493 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T14:31:08.500 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off 2023-11-28T14:31:08.513 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off 2023-11-28T14:31:08.514 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T14:31:08.537 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-11-28T14:31:08.601 INFO:teuthology.orchestra.console.smithi150:Power off completed 2023-11-28T14:31:08.638 INFO:teuthology.orchestra.console.smithi156:Power off completed 2023-11-28T14:31:08.746 INFO:teuthology.lock.ops:unlocked: smithi150.front.sepia.ceph.com 2023-11-28T14:31:08.788 INFO:teuthology.lock.ops:unlocked: smithi156.front.sepia.ceph.com