2023-11-28T14:02:43.446 INFO:root:teuthology version: 0.0.1.dev209+g5ae09a5 2023-11-28T14:02:43.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T14:02:43.595 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f72b8565550>, signals=[15]) 2023-11-28T14:02:43.595 INFO:teuthology.lock.ops:Start node 'smithi110.front.sepia.ceph.com' reimaging 2023-11-28T14:02:43.595 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: reset os type and version on server 2023-11-28T14:02:43.596 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2023-11-28T14:02:43.615 INFO:teuthology.lock.ops:Start node 'smithi152.front.sepia.ceph.com' reimaging 2023-11-28T14:02:43.615 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: reset os type and version on server 2023-11-28T14:02:43.615 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2023-11-28T14:02:43.727 DEBUG:teuthology.provision.fog.smithi110:Requesting image smithi_centos_9.stream (ID 10) 2023-11-28T14:02:43.753 DEBUG:teuthology.provision.fog.smithi152:Requesting image smithi_centos_9.stream (ID 10) 2023-11-28T14:02:43.777 INFO:teuthology.provision.fog.smithi110:Scheduling deploy of centos 9.stream 2023-11-28T14:02:43.801 INFO:teuthology.provision.fog.smithi152:Scheduling deploy of centos 9.stream 2023-11-28T14:02:44.032 INFO:teuthology.orchestra.console.smithi110:Power off 2023-11-28T14:02:44.032 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T14:02:44.052 DEBUG:teuthology.orchestra.console.smithi110:power off output: Chassis Power Control: Down/Off 2023-11-28T14:02:44.053 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T14:02:44.065 INFO:teuthology.orchestra.console.smithi152:Power off 2023-11-28T14:02:44.066 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T14:02:44.075 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off 2023-11-28T14:02:44.088 DEBUG:teuthology.orchestra.console.smithi152:power off output: Chassis Power Control: Down/Off 2023-11-28T14:02:44.088 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T14:02:44.109 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2023-11-28T14:02:44.176 INFO:teuthology.orchestra.console.smithi110:Power off completed 2023-11-28T14:02:44.210 INFO:teuthology.orchestra.console.smithi152:Power off completed 2023-11-28T14:02:44.278 INFO:teuthology.orchestra.console.smithi110:Power on 2023-11-28T14:02:44.278 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-28T14:02:44.308 DEBUG:teuthology.orchestra.console.smithi110:power on output: Chassis Power Control: Up/On 2023-11-28T14:02:44.309 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T14:02:44.319 INFO:teuthology.orchestra.console.smithi152:Power on 2023-11-28T14:02:44.319 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-28T14:02:44.334 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off 2023-11-28T14:02:44.342 DEBUG:teuthology.orchestra.console.smithi152:power on output: Chassis Power Control: Up/On 2023-11-28T14:02:44.342 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T14:02:44.366 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2023-11-28T14:02:48.338 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T14:02:48.367 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T14:02:48.448 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off 2023-11-28T14:02:48.477 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2023-11-28T14:02:52.450 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T14:02:52.477 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T14:02:52.563 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on 2023-11-28T14:02:52.586 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2023-11-28T14:02:52.665 INFO:teuthology.orchestra.console.smithi110:Power on completed 2023-11-28T14:02:52.687 INFO:teuthology.orchestra.console.smithi152:Power on completed 2023-11-28T14:02:52.766 INFO:teuthology.provision.fog.smithi110:Waiting for deploy to finish 2023-11-28T14:02:52.788 INFO:teuthology.provision.fog.smithi152:Waiting for deploy to finish 2023-11-28T14:05:23.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T14:05:26.754 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-11-28T14:05:32.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T14:05:35.810 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-11-28T14:05:38.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T14:05:41.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T14:05:41.829 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-11-28T14:05:44.866 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-11-28T14:05:47.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T14:05:50.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T14:05:50.914 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-11-28T14:05:53.926 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-11-28T14:05:56.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T14:05:59.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T14:05:59.970 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-11-28T14:06:03.014 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-11-28T14:06:05.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T14:06:09.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T14:06:09.026 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-11-28T14:06:12.098 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-11-28T14:06:15.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T14:06:18.086 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-11-28T14:06:18.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T14:06:24.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T14:06:27.174 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-11-28T14:06:33.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T14:06:36.642 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-11-28T14:06:42.647 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T14:06:45.698 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-11-28T14:06:51.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T14:06:54.754 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-11-28T14:07:00.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T14:07:00.976 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-28T14:07:00.976 DEBUG:teuthology.orchestra.run.smithi110:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-28T14:07:21.706 INFO:teuthology.provision.fog.smithi110:Node is ready 2023-11-28T14:07:21.706 DEBUG:teuthology.orchestra.run.smithi110:> hostname 2023-11-28T14:07:21.725 INFO:teuthology.orchestra.run.smithi110.stdout:smithi110.front.sepia.ceph.com 2023-11-28T14:07:21.725 DEBUG:teuthology.orchestra.run.smithi110:> grep smithi110.front.sepia.ceph.com /etc/hosts 2023-11-28T14:07:21.782 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110 smithi110.front.sepia.ceph.com smithi110 2023-11-28T14:07:21.782 DEBUG:teuthology.orchestra.run.smithi110:> sudo hostname smithi110 2023-11-28T14:07:21.926 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/smithi110.front.sepia.ceph.com/smithi110/g' /etc/hosts 2023-11-28T14:07:21.956 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/172.21.15.110/172.21.15.110/g' /etc/hosts 2023-11-28T14:07:22.027 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/smithi110.front.sepia.ceph.com/smithi110/g' /etc/hostname 2023-11-28T14:07:22.096 DEBUG:teuthology.orchestra.run.smithi110:> sudo hostname smithi110 2023-11-28T14:07:22.164 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2023-11-28T14:07:22.219 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="CentOS Stream" 2023-11-28T14:07:22.219 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="9" 2023-11-28T14:07:22.219 INFO:teuthology.orchestra.run.smithi110.stdout:ID="centos" 2023-11-28T14:07:22.219 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="rhel fedora" 2023-11-28T14:07:22.219 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="9" 2023-11-28T14:07:22.219 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el9" 2023-11-28T14:07:22.220 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-28T14:07:22.220 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31" 2023-11-28T14:07:22.220 INFO:teuthology.orchestra.run.smithi110.stdout:LOGO="fedora-logo-icon" 2023-11-28T14:07:22.220 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-28T14:07:22.220 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://centos.org/" 2023-11-28T14:07:22.220 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-28T14:07:22.220 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-28T14:07:22.220 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-28T14:07:22.221 INFO:teuthology.provision.fog.smithi110:Deploy complete! 2023-11-28T14:07:22.222 DEBUG:teuthology.parallel:result is None 2023-11-28T14:07:33.181 WARNING:teuthology.provision.fog.smithi152:timed out 2023-11-28T14:07:39.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T14:07:39.391 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-28T14:07:39.391 DEBUG:teuthology.orchestra.run.smithi152:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-28T14:07:39.728 INFO:teuthology.provision.fog.smithi152:Node is ready 2023-11-28T14:07:39.728 DEBUG:teuthology.orchestra.run.smithi152:> hostname 2023-11-28T14:07:39.744 INFO:teuthology.orchestra.run.smithi152.stdout:smithi152.front.sepia.ceph.com 2023-11-28T14:07:39.745 DEBUG:teuthology.orchestra.run.smithi152:> grep smithi152.front.sepia.ceph.com /etc/hosts 2023-11-28T14:07:39.801 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152 smithi152.front.sepia.ceph.com smithi152 2023-11-28T14:07:39.801 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname smithi152 2023-11-28T14:07:39.934 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/smithi152.front.sepia.ceph.com/smithi152/g' /etc/hosts 2023-11-28T14:07:39.964 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/172.21.15.152/172.21.15.152/g' /etc/hosts 2023-11-28T14:07:40.033 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/smithi152.front.sepia.ceph.com/smithi152/g' /etc/hostname 2023-11-28T14:07:40.101 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname smithi152 2023-11-28T14:07:40.168 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2023-11-28T14:07:40.224 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="CentOS Stream" 2023-11-28T14:07:40.224 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="9" 2023-11-28T14:07:40.224 INFO:teuthology.orchestra.run.smithi152.stdout:ID="centos" 2023-11-28T14:07:40.224 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="rhel fedora" 2023-11-28T14:07:40.224 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="9" 2023-11-28T14:07:40.224 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el9" 2023-11-28T14:07:40.224 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-28T14:07:40.224 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2023-11-28T14:07:40.224 INFO:teuthology.orchestra.run.smithi152.stdout:LOGO="fedora-logo-icon" 2023-11-28T14:07:40.225 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-28T14:07:40.225 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://centos.org/" 2023-11-28T14:07:40.225 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-28T14:07:40.225 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-28T14:07:40.225 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-28T14:07:40.225 INFO:teuthology.provision.fog.smithi152:Deploy complete! 2023-11-28T14:07:40.226 DEBUG:teuthology.parallel:result is None 2023-11-28T14:07:40.390 INFO:teuthology.lock.ops:Checking smithi110.front.sepia.ceph.com 2023-11-28T14:07:40.391 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-28T14:07:40.418 INFO:teuthology.lock.ops:Checking smithi152.front.sepia.ceph.com 2023-11-28T14:07:40.418 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-28T14:07:40.443 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: set os type and version on server 2023-11-28T14:07:40.443 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2023-11-28T14:07:40.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T14:07:40.526 DEBUG:teuthology.orchestra.run.smithi110:> true 2023-11-28T14:07:40.594 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2023-11-28T14:07:40.594 DEBUG:teuthology.orchestra.run.smithi110:> uname -m 2023-11-28T14:07:40.649 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64 2023-11-28T14:07:40.650 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2023-11-28T14:07:40.705 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="CentOS Stream" 2023-11-28T14:07:40.705 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="9" 2023-11-28T14:07:40.705 INFO:teuthology.orchestra.run.smithi110.stdout:ID="centos" 2023-11-28T14:07:40.706 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="rhel fedora" 2023-11-28T14:07:40.706 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="9" 2023-11-28T14:07:40.706 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el9" 2023-11-28T14:07:40.706 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-28T14:07:40.706 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31" 2023-11-28T14:07:40.706 INFO:teuthology.orchestra.run.smithi110.stdout:LOGO="fedora-logo-icon" 2023-11-28T14:07:40.706 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-28T14:07:40.707 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://centos.org/" 2023-11-28T14:07:40.707 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-28T14:07:40.707 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-28T14:07:40.707 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-28T14:07:40.707 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2023-11-28T14:07:40.734 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: set os type and version on server 2023-11-28T14:07:40.734 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-11-28T14:07:40.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T14:07:40.815 DEBUG:teuthology.orchestra.run.smithi152:> true 2023-11-28T14:07:40.881 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-11-28T14:07:40.881 DEBUG:teuthology.orchestra.run.smithi152:> uname -m 2023-11-28T14:07:40.935 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64 2023-11-28T14:07:40.936 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2023-11-28T14:07:40.990 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="CentOS Stream" 2023-11-28T14:07:40.991 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="9" 2023-11-28T14:07:40.991 INFO:teuthology.orchestra.run.smithi152.stdout:ID="centos" 2023-11-28T14:07:40.991 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="rhel fedora" 2023-11-28T14:07:40.991 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="9" 2023-11-28T14:07:40.991 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el9" 2023-11-28T14:07:40.991 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-28T14:07:40.991 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2023-11-28T14:07:40.991 INFO:teuthology.orchestra.run.smithi152.stdout:LOGO="fedora-logo-icon" 2023-11-28T14:07:40.992 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-28T14:07:40.992 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://centos.org/" 2023-11-28T14:07:40.992 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-28T14:07:40.992 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-28T14:07:40.992 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-28T14:07:40.992 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2023-11-28T14:07:41.017 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T14:07:41.109 INFO:teuthology.dispatcher.supervisor:Running job 7469283 2023-11-28T14:07:41.109 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/virtualenv/bin/teuthology -v --owner scheduled_kkeithle@teuthology --archive /home/teuthworker/archive/kkeithle-2023-11-27_23:57:32-rgw:verify-wip-kkeithley-zipper-ayb-distro-default-smithi/7469283 --name kkeithle-2023-11-27_23:57:32-rgw:verify-wip-kkeithley-zipper-ayb-distro-default-smithi --description rgw:verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} -- /home/teuthworker/archive/kkeithle-2023-11-27_23:57:32-rgw:verify-wip-kkeithley-zipper-ayb-distro-default-smithi/7469283/orig.config.yaml 2023-11-28T14:07:41.113 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/kkeithle-2023-11-27_23:57:32-rgw:verify-wip-kkeithley-zipper-ayb-distro-default-smithi/7469283 2023-11-28T14:07:41.113 INFO:teuthology.dispatcher.supervisor:Job PID: 402228 2023-11-28T14:07:41.113 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-28T14:09:41.214 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T14:11:41.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T14:13:41.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T14:15:41.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T14:17:41.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T14:19:42.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T14:21:42.251 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T14:23:42.418 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T14:25:42.594 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T14:27:42.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T14:29:42.916 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T14:31:43.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T14:31:43.150 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-11-28T14:31:43.264 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-28T14:31:43.265 INFO:teuthology.nuke:Checking targets against current locks 2023-11-28T14:31:43.317 DEBUG:teuthology.nuke:shortname: smithi110 2023-11-28T14:31:43.318 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T14:31:43.338 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi110.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/kkeithle-2023-11-27_23:57:32-rgw:verify-wip-kkeithley-zipper-ayb-distro-default-smithi/7469283', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 14:02:42.563399', 'locked_by': 'scheduled_kkeithle@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAzvOca5HTGWvovnzv4a9O+YDtyyuA1WSAMbNr0nXd6WBYsUCrm+VqOWvMtmCaPOok8rcGRIU9REEnI9d8cXfQ4='} 2023-11-28T14:31:43.339 DEBUG:teuthology.nuke:shortname: smithi152 2023-11-28T14:31:43.339 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T14:31:43.364 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/kkeithle-2023-11-27_23:57:32-rgw:verify-wip-kkeithley-zipper-ayb-distro-default-smithi/7469283', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 14:02:42.565442', 'locked_by': 'scheduled_kkeithle@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE6QHK5TbF4blci5MY7rrmgzmpkSVshDu3JLSzpOGDmKXaVHG7TIgzhokVm00ftmZwE1U0owuiM80Ol8vssEOhg='} 2023-11-28T14:31:43.388 INFO:teuthology.orchestra.console.smithi110:Power off 2023-11-28T14:31:43.388 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T14:31:43.408 DEBUG:teuthology.orchestra.console.smithi110:power off output: Chassis Power Control: Down/Off 2023-11-28T14:31:43.408 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T14:31:43.426 INFO:teuthology.orchestra.console.smithi152:Power off 2023-11-28T14:31:43.426 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T14:31:43.434 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off 2023-11-28T14:31:43.447 DEBUG:teuthology.orchestra.console.smithi152:power off output: Chassis Power Control: Down/Off 2023-11-28T14:31:43.447 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T14:31:43.467 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2023-11-28T14:31:43.535 INFO:teuthology.orchestra.console.smithi110:Power off completed 2023-11-28T14:31:43.568 INFO:teuthology.orchestra.console.smithi152:Power off completed 2023-11-28T14:31:43.692 INFO:teuthology.lock.ops:unlocked: smithi110.front.sepia.ceph.com 2023-11-28T14:31:43.715 INFO:teuthology.lock.ops:unlocked: smithi152.front.sepia.ceph.com