2023-12-13T10:36:38.685 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-13T10:36:38.685 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T10:36:38.854 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5b74fd8940>, signals=[15]) 2023-12-13T10:36:38.854 INFO:teuthology.lock.ops:Start node 'smithi008.front.sepia.ceph.com' reimaging 2023-12-13T10:36:38.854 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: reset os type and version on server 2023-12-13T10:36:38.854 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2023-12-13T10:36:38.873 INFO:teuthology.lock.ops:Start node 'smithi135.front.sepia.ceph.com' reimaging 2023-12-13T10:36:38.874 INFO:teuthology.lock.ops:Updating [smithi135.front.sepia.ceph.com]: reset os type and version on server 2023-12-13T10:36:38.874 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2023-12-13T10:36:38.898 INFO:teuthology.lock.ops:Start node 'smithi196.front.sepia.ceph.com' reimaging 2023-12-13T10:36:38.899 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: reset os type and version on server 2023-12-13T10:36:38.899 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server 2023-12-13T10:36:38.988 DEBUG:teuthology.provision.fog.smithi008:Requesting image smithi_centos_8.stream (ID 3) 2023-12-13T10:36:39.021 DEBUG:teuthology.provision.fog.smithi135:Requesting image smithi_centos_8.stream (ID 3) 2023-12-13T10:36:39.035 INFO:teuthology.provision.fog.smithi008:Scheduling deploy of centos 8.stream 2023-12-13T10:36:39.038 DEBUG:teuthology.provision.fog.smithi196:Requesting image smithi_centos_8.stream (ID 3) 2023-12-13T10:36:39.072 INFO:teuthology.provision.fog.smithi135:Scheduling deploy of centos 8.stream 2023-12-13T10:36:39.078 INFO:teuthology.provision.fog.smithi196:Scheduling deploy of centos 8.stream 2023-12-13T10:36:39.282 INFO:teuthology.orchestra.console.smithi008:Power off 2023-12-13T10:36:39.282 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-13T10:36:39.303 DEBUG:teuthology.orchestra.console.smithi008:power off output: Chassis Power Control: Down/Off 2023-12-13T10:36:39.304 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T10:36:39.322 INFO:teuthology.orchestra.console.smithi135:Power off 2023-12-13T10:36:39.322 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-13T10:36:39.335 INFO:teuthology.orchestra.console.smithi196:Power off 2023-12-13T10:36:39.335 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-13T10:36:39.342 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is on 2023-12-13T10:36:39.343 DEBUG:teuthology.orchestra.console.smithi135:power off output: Chassis Power Control: Down/Off 2023-12-13T10:36:39.343 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T10:36:39.355 DEBUG:teuthology.orchestra.console.smithi196:power off output: Chassis Power Control: Down/Off 2023-12-13T10:36:39.355 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T10:36:39.363 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off 2023-12-13T10:36:39.376 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off 2023-12-13T10:36:39.464 INFO:teuthology.orchestra.console.smithi135:Power off completed 2023-12-13T10:36:39.476 INFO:teuthology.orchestra.console.smithi196:Power off completed 2023-12-13T10:36:39.566 INFO:teuthology.orchestra.console.smithi135:Power on 2023-12-13T10:36:39.566 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-13T10:36:39.578 INFO:teuthology.orchestra.console.smithi196:Power on 2023-12-13T10:36:39.578 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-13T10:36:39.587 DEBUG:teuthology.orchestra.console.smithi135:power on output: Chassis Power Control: Up/On 2023-12-13T10:36:39.587 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T10:36:39.599 DEBUG:teuthology.orchestra.console.smithi196:power on output: Chassis Power Control: Up/On 2023-12-13T10:36:39.600 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T10:36:39.608 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off 2023-12-13T10:36:39.618 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off 2023-12-13T10:36:43.346 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T10:36:43.454 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is on 2023-12-13T10:36:43.609 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T10:36:43.619 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T10:36:43.718 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off 2023-12-13T10:36:43.727 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2023-12-13T10:36:43.828 INFO:teuthology.orchestra.console.smithi196:Power on completed 2023-12-13T10:36:43.929 INFO:teuthology.provision.fog.smithi196:Waiting for deploy to finish 2023-12-13T10:36:47.458 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T10:36:47.567 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is off 2023-12-13T10:36:47.668 INFO:teuthology.orchestra.console.smithi008:Power off completed 2023-12-13T10:36:47.719 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T10:36:47.769 INFO:teuthology.orchestra.console.smithi008:Power on 2023-12-13T10:36:47.769 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-13T10:36:47.789 DEBUG:teuthology.orchestra.console.smithi008:power on output: Chassis Power Control: Up/On 2023-12-13T10:36:47.790 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T10:36:47.809 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is off 2023-12-13T10:36:47.828 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2023-12-13T10:36:47.928 INFO:teuthology.orchestra.console.smithi135:Power on completed 2023-12-13T10:36:48.029 INFO:teuthology.provision.fog.smithi135:Waiting for deploy to finish 2023-12-13T10:36:51.814 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T10:36:51.923 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is on 2023-12-13T10:36:52.023 INFO:teuthology.orchestra.console.smithi008:Power on completed 2023-12-13T10:36:52.124 INFO:teuthology.provision.fog.smithi008:Waiting for deploy to finish 2023-12-13T10:39:22.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T10:39:26.018 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2023-12-13T10:39:29.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T10:39:32.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T10:39:32.902 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2023-12-13T10:39:33.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T10:39:35.078 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2023-12-13T10:39:36.962 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-12-13T10:39:38.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T10:39:41.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T10:39:41.986 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2023-12-13T10:39:42.965 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T10:39:44.162 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2023-12-13T10:39:46.018 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-12-13T10:39:47.989 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T10:39:50.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T10:39:51.042 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2023-12-13T10:39:52.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T10:39:53.218 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2023-12-13T10:39:55.074 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-12-13T10:39:57.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T10:39:59.221 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T10:40:00.098 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2023-12-13T10:40:01.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T10:40:02.274 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2023-12-13T10:40:04.130 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-12-13T10:40:06.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T10:40:08.278 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T10:40:09.154 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2023-12-13T10:40:10.133 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T10:40:11.335 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2023-12-13T10:40:13.186 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-12-13T10:40:15.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T10:40:17.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T10:40:18.210 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2023-12-13T10:40:19.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T10:40:20.422 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2023-12-13T10:40:22.246 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-12-13T10:40:24.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T10:40:26.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T10:40:28.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T10:41:24.271 WARNING:teuthology.provision.fog.smithi196:timed out 2023-12-13T10:41:26.429 WARNING:teuthology.provision.fog.smithi008:timed out 2023-12-13T10:41:28.252 WARNING:teuthology.provision.fog.smithi135:timed out 2023-12-13T10:41:30.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T10:41:30.594 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-13T10:41:30.594 DEBUG:teuthology.orchestra.run.smithi196:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-13T10:41:30.856 INFO:teuthology.provision.fog.smithi196:Node is ready 2023-12-13T10:41:30.856 DEBUG:teuthology.orchestra.run.smithi196:> hostname 2023-12-13T10:41:30.876 INFO:teuthology.orchestra.run.smithi196.stdout:smithi196.front.sepia.ceph.com 2023-12-13T10:41:30.876 DEBUG:teuthology.orchestra.run.smithi196:> grep smithi196.front.sepia.ceph.com /etc/hosts 2023-12-13T10:41:30.936 INFO:teuthology.orchestra.run.smithi196.stdout:172.21.15.196 smithi196.front.sepia.ceph.com smithi196 2023-12-13T10:41:30.936 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname smithi196 2023-12-13T10:41:31.052 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/smithi196.front.sepia.ceph.com/smithi196/g' /etc/hosts 2023-12-13T10:41:31.082 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/172.21.15.196/172.21.15.196/g' /etc/hosts 2023-12-13T10:41:31.152 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/smithi196.front.sepia.ceph.com/smithi196/g' /etc/hostname 2023-12-13T10:41:31.221 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname smithi196 2023-12-13T10:41:31.289 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release 2023-12-13T10:41:31.347 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="CentOS Stream" 2023-12-13T10:41:31.347 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="8" 2023-12-13T10:41:31.348 INFO:teuthology.orchestra.run.smithi196.stdout:ID="centos" 2023-12-13T10:41:31.348 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="rhel fedora" 2023-12-13T10:41:31.348 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="8" 2023-12-13T10:41:31.348 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el8" 2023-12-13T10:41:31.348 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-13T10:41:31.348 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31" 2023-12-13T10:41:31.348 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-13T10:41:31.348 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://centos.org/" 2023-12-13T10:41:31.348 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-13T10:41:31.348 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-13T10:41:31.348 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-13T10:41:31.349 INFO:teuthology.provision.fog.smithi196:Deploy complete! 2023-12-13T10:41:31.350 DEBUG:teuthology.parallel:result is None 2023-12-13T10:41:32.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T10:41:32.662 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-13T10:41:32.663 DEBUG:teuthology.orchestra.run.smithi008:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-13T10:41:32.930 INFO:teuthology.provision.fog.smithi008:Node is ready 2023-12-13T10:41:32.930 DEBUG:teuthology.orchestra.run.smithi008:> hostname 2023-12-13T10:41:32.950 INFO:teuthology.orchestra.run.smithi008.stdout:smithi008.front.sepia.ceph.com 2023-12-13T10:41:32.951 DEBUG:teuthology.orchestra.run.smithi008:> grep smithi008.front.sepia.ceph.com /etc/hosts 2023-12-13T10:41:33.011 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8 smithi008.front.sepia.ceph.com smithi008 2023-12-13T10:41:33.012 DEBUG:teuthology.orchestra.run.smithi008:> sudo hostname smithi008 2023-12-13T10:41:33.129 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/smithi008.front.sepia.ceph.com/smithi008/g' /etc/hosts 2023-12-13T10:41:33.161 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/172.21.15.8/172.21.15.8/g' /etc/hosts 2023-12-13T10:41:33.232 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/smithi008.front.sepia.ceph.com/smithi008/g' /etc/hostname 2023-12-13T10:41:33.303 DEBUG:teuthology.orchestra.run.smithi008:> sudo hostname smithi008 2023-12-13T10:41:33.372 DEBUG:teuthology.orchestra.run.smithi008:> cat /etc/os-release 2023-12-13T10:41:33.431 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="CentOS Stream" 2023-12-13T10:41:33.432 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="8" 2023-12-13T10:41:33.432 INFO:teuthology.orchestra.run.smithi008.stdout:ID="centos" 2023-12-13T10:41:33.432 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="rhel fedora" 2023-12-13T10:41:33.432 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="8" 2023-12-13T10:41:33.432 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el8" 2023-12-13T10:41:33.432 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-13T10:41:33.432 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31" 2023-12-13T10:41:33.432 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-13T10:41:33.432 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://centos.org/" 2023-12-13T10:41:33.432 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-13T10:41:33.432 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-13T10:41:33.433 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-13T10:41:33.433 INFO:teuthology.provision.fog.smithi008:Deploy complete! 2023-12-13T10:41:33.433 DEBUG:teuthology.parallel:result is None 2023-12-13T10:41:34.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T10:41:34.511 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-13T10:41:34.511 DEBUG:teuthology.orchestra.run.smithi135:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-13T10:41:34.765 INFO:teuthology.provision.fog.smithi135:Node is ready 2023-12-13T10:41:34.765 DEBUG:teuthology.orchestra.run.smithi135:> hostname 2023-12-13T10:41:34.783 INFO:teuthology.orchestra.run.smithi135.stdout:smithi135.front.sepia.ceph.com 2023-12-13T10:41:34.783 DEBUG:teuthology.orchestra.run.smithi135:> grep smithi135.front.sepia.ceph.com /etc/hosts 2023-12-13T10:41:34.842 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135 smithi135.front.sepia.ceph.com smithi135 2023-12-13T10:41:34.842 DEBUG:teuthology.orchestra.run.smithi135:> sudo hostname smithi135 2023-12-13T10:41:34.930 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i -e 's/smithi135.front.sepia.ceph.com/smithi135/g' /etc/hosts 2023-12-13T10:41:34.959 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i -e 's/172.21.15.135/172.21.15.135/g' /etc/hosts 2023-12-13T10:41:35.026 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i -e 's/smithi135.front.sepia.ceph.com/smithi135/g' /etc/hostname 2023-12-13T10:41:35.094 DEBUG:teuthology.orchestra.run.smithi135:> sudo hostname smithi135 2023-12-13T10:41:35.161 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2023-12-13T10:41:35.219 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="CentOS Stream" 2023-12-13T10:41:35.219 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="8" 2023-12-13T10:41:35.220 INFO:teuthology.orchestra.run.smithi135.stdout:ID="centos" 2023-12-13T10:41:35.220 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="rhel fedora" 2023-12-13T10:41:35.220 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="8" 2023-12-13T10:41:35.220 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el8" 2023-12-13T10:41:35.220 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-13T10:41:35.220 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31" 2023-12-13T10:41:35.220 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-13T10:41:35.220 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://centos.org/" 2023-12-13T10:41:35.220 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-13T10:41:35.220 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-13T10:41:35.220 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-13T10:41:35.221 INFO:teuthology.provision.fog.smithi135:Deploy complete! 2023-12-13T10:41:35.221 DEBUG:teuthology.parallel:result is None 2023-12-13T10:41:35.410 INFO:teuthology.lock.ops:Checking smithi008.front.sepia.ceph.com 2023-12-13T10:41:35.410 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-13T10:41:35.434 INFO:teuthology.lock.ops:Checking smithi135.front.sepia.ceph.com 2023-12-13T10:41:35.434 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-13T10:41:35.458 INFO:teuthology.lock.ops:Checking smithi196.front.sepia.ceph.com 2023-12-13T10:41:35.458 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-13T10:41:35.476 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: set os type and version on server 2023-12-13T10:41:35.476 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-12-13T10:41:35.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T10:41:35.544 DEBUG:teuthology.orchestra.run.smithi008:> true 2023-12-13T10:41:35.620 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-12-13T10:41:35.621 DEBUG:teuthology.orchestra.run.smithi008:> uname -m 2023-12-13T10:41:35.683 INFO:teuthology.orchestra.run.smithi008.stdout:x86_64 2023-12-13T10:41:35.684 DEBUG:teuthology.orchestra.run.smithi008:> cat /etc/os-release 2023-12-13T10:41:35.745 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="CentOS Stream" 2023-12-13T10:41:35.746 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="8" 2023-12-13T10:41:35.746 INFO:teuthology.orchestra.run.smithi008.stdout:ID="centos" 2023-12-13T10:41:35.747 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="rhel fedora" 2023-12-13T10:41:35.747 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="8" 2023-12-13T10:41:35.747 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el8" 2023-12-13T10:41:35.747 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-13T10:41:35.747 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31" 2023-12-13T10:41:35.747 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-13T10:41:35.747 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://centos.org/" 2023-12-13T10:41:35.748 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-13T10:41:35.748 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-13T10:41:35.748 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-13T10:41:35.749 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2023-12-13T10:41:35.775 INFO:teuthology.lock.ops:Updating [smithi135.front.sepia.ceph.com]: set os type and version on server 2023-12-13T10:41:35.775 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-12-13T10:41:35.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T10:41:35.842 DEBUG:teuthology.orchestra.run.smithi135:> true 2023-12-13T10:41:35.908 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-12-13T10:41:35.908 DEBUG:teuthology.orchestra.run.smithi135:> uname -m 2023-12-13T10:41:35.966 INFO:teuthology.orchestra.run.smithi135.stdout:x86_64 2023-12-13T10:41:35.967 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2023-12-13T10:41:36.024 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="CentOS Stream" 2023-12-13T10:41:36.024 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="8" 2023-12-13T10:41:36.024 INFO:teuthology.orchestra.run.smithi135.stdout:ID="centos" 2023-12-13T10:41:36.024 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="rhel fedora" 2023-12-13T10:41:36.024 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="8" 2023-12-13T10:41:36.024 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el8" 2023-12-13T10:41:36.025 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-13T10:41:36.025 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31" 2023-12-13T10:41:36.025 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-13T10:41:36.025 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://centos.org/" 2023-12-13T10:41:36.025 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-13T10:41:36.025 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-13T10:41:36.025 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-13T10:41:36.025 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2023-12-13T10:41:36.050 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: set os type and version on server 2023-12-13T10:41:36.051 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2023-12-13T10:41:36.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T10:41:36.116 DEBUG:teuthology.orchestra.run.smithi196:> true 2023-12-13T10:41:36.187 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi196.front.sepia.ceph.com' 2023-12-13T10:41:36.188 DEBUG:teuthology.orchestra.run.smithi196:> uname -m 2023-12-13T10:41:36.248 INFO:teuthology.orchestra.run.smithi196.stdout:x86_64 2023-12-13T10:41:36.249 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release 2023-12-13T10:41:36.309 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="CentOS Stream" 2023-12-13T10:41:36.310 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="8" 2023-12-13T10:41:36.310 INFO:teuthology.orchestra.run.smithi196.stdout:ID="centos" 2023-12-13T10:41:36.310 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="rhel fedora" 2023-12-13T10:41:36.310 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="8" 2023-12-13T10:41:36.310 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el8" 2023-12-13T10:41:36.310 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-13T10:41:36.311 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31" 2023-12-13T10:41:36.311 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-13T10:41:36.311 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://centos.org/" 2023-12-13T10:41:36.311 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-13T10:41:36.311 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-13T10:41:36.311 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-13T10:41:36.311 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server 2023-12-13T10:41:36.333 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T10:41:36.420 INFO:teuthology.dispatcher.supervisor:Running job 7489806 2023-12-13T10:41:36.421 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-12-13_09:47:05-smoke-wip-vshankar-testing3-2023-12-13-1225-quincy-distro-default-smithi/7489806 --name vshankar-2023-12-13_09:47:05-smoke-wip-vshankar-testing3-2023-12-13-1225-quincy-distro-default-smithi --description smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/{0-install test/rados_bench}} -- /home/teuthworker/archive/vshankar-2023-12-13_09:47:05-smoke-wip-vshankar-testing3-2023-12-13-1225-quincy-distro-default-smithi/7489806/orig.config.yaml 2023-12-13T10:41:36.424 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-12-13_09:47:05-smoke-wip-vshankar-testing3-2023-12-13-1225-quincy-distro-default-smithi/7489806 2023-12-13T10:41:36.424 INFO:teuthology.dispatcher.supervisor:Job PID: 3904294 2023-12-13T10:41:36.424 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-13T10:43:36.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T10:43:36.562 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-13T10:43:36.653 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-13T10:43:36.653 INFO:teuthology.nuke:Checking targets against current locks 2023-12-13T10:43:36.699 DEBUG:teuthology.nuke:shortname: smithi008 2023-12-13T10:43:36.699 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-13T10:43:36.730 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi008.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-13_09:47:05-smoke-wip-vshankar-testing3-2023-12-13-1225-quincy-distro-default-smithi/7489806', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-13 10:36:37.879159', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPv/C67UCh5HDKI2z/NdvjW3cMnnYlg9H8ciQjJ1E8we4VonYhlWRfs6aUWp8Zp5tMlyXbHtMygMWCtuftx3Q6g='} 2023-12-13T10:43:36.731 DEBUG:teuthology.nuke:shortname: smithi135 2023-12-13T10:43:36.731 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-13T10:43:36.756 DEBUG:teuthology.nuke:shortname: smithi196 2023-12-13T10:43:36.756 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-13T10:43:36.757 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi135.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-13_09:47:05-smoke-wip-vshankar-testing3-2023-12-13-1225-quincy-distro-default-smithi/7489806', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-13 10:36:37.877982', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHuAqhHUzfme9kr0yX30TCMEwVaaJCXuRi+l3cV6iRKKFnvoMIoU7hOtwwXOTmvN+iRMd8266onJ+sIFSoHuK2E='} 2023-12-13T10:43:36.776 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi196.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-13_09:47:05-smoke-wip-vshankar-testing3-2023-12-13-1225-quincy-distro-default-smithi/7489806', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-13 10:36:37.876604', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKiD/PnR7Ud1XSU1DksEOJCGH6m4HMo1vqfGCgYSr6EdGgNZPLzQCzgAJhfk3BrOa7r8/569CyrygQGdPHANino='} 2023-12-13T10:43:36.786 INFO:teuthology.orchestra.console.smithi008:Power off 2023-12-13T10:43:36.786 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-13T10:43:36.807 DEBUG:teuthology.orchestra.console.smithi008:power off output: Chassis Power Control: Down/Off 2023-12-13T10:43:36.808 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T10:43:36.819 INFO:teuthology.orchestra.console.smithi135:Power off 2023-12-13T10:43:36.820 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-13T10:43:36.832 INFO:teuthology.orchestra.console.smithi196:Power off 2023-12-13T10:43:36.832 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-13T10:43:36.838 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is off 2023-12-13T10:43:36.841 DEBUG:teuthology.orchestra.console.smithi135:power off output: Chassis Power Control: Down/Off 2023-12-13T10:43:36.841 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T10:43:36.852 DEBUG:teuthology.orchestra.console.smithi196:power off output: Chassis Power Control: Down/Off 2023-12-13T10:43:36.852 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T10:43:36.861 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off 2023-12-13T10:43:36.872 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off 2023-12-13T10:43:36.939 INFO:teuthology.orchestra.console.smithi008:Power off completed 2023-12-13T10:43:36.962 INFO:teuthology.orchestra.console.smithi135:Power off completed 2023-12-13T10:43:36.973 INFO:teuthology.orchestra.console.smithi196:Power off completed 2023-12-13T10:43:37.095 INFO:teuthology.lock.ops:unlocked: smithi008.front.sepia.ceph.com 2023-12-13T10:43:37.101 INFO:teuthology.lock.ops:unlocked: smithi135.front.sepia.ceph.com 2023-12-13T10:43:37.110 INFO:teuthology.lock.ops:unlocked: smithi196.front.sepia.ceph.com