2024-03-16T11:18:57.348 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-16T11:18:57.348 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T11:18:57.526 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8bc2ff1c10>, signals=[15]) 2024-03-16T11:18:57.527 INFO:teuthology.lock.ops:Start node 'smithi022.front.sepia.ceph.com' reimaging 2024-03-16T11:18:57.527 INFO:teuthology.lock.ops:Updating [smithi022.front.sepia.ceph.com]: reset os type and version on server 2024-03-16T11:18:57.527 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2024-03-16T11:18:57.552 INFO:teuthology.lock.ops:Start node 'smithi044.front.sepia.ceph.com' reimaging 2024-03-16T11:18:57.552 INFO:teuthology.lock.ops:Updating [smithi044.front.sepia.ceph.com]: reset os type and version on server 2024-03-16T11:18:57.552 INFO:teuthology.lock.ops:Updating smithi044.front.sepia.ceph.com on lock server 2024-03-16T11:18:57.576 INFO:teuthology.lock.ops:Start node 'smithi196.front.sepia.ceph.com' reimaging 2024-03-16T11:18:57.577 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: reset os type and version on server 2024-03-16T11:18:57.577 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server 2024-03-16T11:18:57.666 DEBUG:teuthology.provision.fog.smithi022:Requesting image smithi_centos_9.stream (ID 10) 2024-03-16T11:18:57.679 DEBUG:teuthology.provision.fog.smithi044:Requesting image smithi_centos_9.stream (ID 10) 2024-03-16T11:18:57.706 DEBUG:teuthology.provision.fog.smithi196:Requesting image smithi_centos_9.stream (ID 10) 2024-03-16T11:18:57.715 INFO:teuthology.provision.fog.smithi022:Scheduling deploy of centos 9.stream 2024-03-16T11:18:57.718 INFO:teuthology.provision.fog.smithi044:Scheduling deploy of centos 9.stream 2024-03-16T11:18:57.767 INFO:teuthology.provision.fog.smithi196:Scheduling deploy of centos 9.stream 2024-03-16T11:18:57.980 INFO:teuthology.orchestra.console.smithi022:Power off 2024-03-16T11:18:57.981 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-16T11:18:57.996 INFO:teuthology.orchestra.console.smithi044:Power off 2024-03-16T11:18:57.996 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-16T11:18:58.005 DEBUG:teuthology.orchestra.console.smithi022:power off output: Chassis Power Control: Down/Off 2024-03-16T11:18:58.005 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T11:18:58.019 DEBUG:teuthology.orchestra.console.smithi044:power off output: Chassis Power Control: Down/Off 2024-03-16T11:18:58.019 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T11:18:58.028 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on 2024-03-16T11:18:58.040 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is on 2024-03-16T11:18:58.058 INFO:teuthology.orchestra.console.smithi196:Power off 2024-03-16T11:18:58.058 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-16T11:18:58.079 DEBUG:teuthology.orchestra.console.smithi196:power off output: Chassis Power Control: Down/Off 2024-03-16T11:18:58.080 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T11:18:58.101 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2024-03-16T11:19:02.033 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T11:19:02.041 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T11:19:02.103 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T11:19:02.142 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on 2024-03-16T11:19:02.150 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is on 2024-03-16T11:19:02.212 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2024-03-16T11:19:06.147 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T11:19:06.154 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T11:19:06.213 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T11:19:06.256 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off 2024-03-16T11:19:06.263 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is off 2024-03-16T11:19:06.322 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off 2024-03-16T11:19:06.357 INFO:teuthology.orchestra.console.smithi022:Power off completed 2024-03-16T11:19:06.363 INFO:teuthology.orchestra.console.smithi044:Power off completed 2024-03-16T11:19:06.423 INFO:teuthology.orchestra.console.smithi196:Power off completed 2024-03-16T11:19:06.458 INFO:teuthology.orchestra.console.smithi022:Power on 2024-03-16T11:19:06.458 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-16T11:19:06.466 INFO:teuthology.orchestra.console.smithi044:Power on 2024-03-16T11:19:06.466 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-16T11:19:06.480 DEBUG:teuthology.orchestra.console.smithi022:power on output: Chassis Power Control: Up/On 2024-03-16T11:19:06.480 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T11:19:06.490 DEBUG:teuthology.orchestra.console.smithi044:power on output: Chassis Power Control: Up/On 2024-03-16T11:19:06.490 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T11:19:06.503 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off 2024-03-16T11:19:06.511 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is off 2024-03-16T11:19:06.524 INFO:teuthology.orchestra.console.smithi196:Power on 2024-03-16T11:19:06.524 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-16T11:19:06.543 DEBUG:teuthology.orchestra.console.smithi196:power on output: Chassis Power Control: Up/On 2024-03-16T11:19:06.544 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T11:19:06.564 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off 2024-03-16T11:19:10.507 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T11:19:10.513 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T11:19:10.565 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T11:19:10.616 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off 2024-03-16T11:19:10.622 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is on 2024-03-16T11:19:10.673 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off 2024-03-16T11:19:10.723 INFO:teuthology.orchestra.console.smithi044:Power on completed 2024-03-16T11:19:10.823 INFO:teuthology.provision.fog.smithi044:Waiting for deploy to finish 2024-03-16T11:19:14.618 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T11:19:14.674 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T11:19:14.727 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on 2024-03-16T11:19:14.782 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2024-03-16T11:19:14.828 INFO:teuthology.orchestra.console.smithi022:Power on completed 2024-03-16T11:19:14.884 INFO:teuthology.orchestra.console.smithi196:Power on completed 2024-03-16T11:19:14.929 INFO:teuthology.provision.fog.smithi022:Waiting for deploy to finish 2024-03-16T11:19:14.985 INFO:teuthology.provision.fog.smithi196:Waiting for deploy to finish 2024-03-16T11:21:41.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T11:21:45.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T11:21:45.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T11:22:00.094 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44 2024-03-16T11:22:04.194 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2024-03-16T11:22:04.195 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-03-16T11:22:06.097 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T11:22:09.150 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44 2024-03-16T11:22:10.196 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T11:22:10.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T11:22:13.246 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2024-03-16T11:22:13.278 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-03-16T11:22:15.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T11:22:18.210 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44 2024-03-16T11:22:19.249 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T11:22:19.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T11:22:22.302 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2024-03-16T11:22:22.334 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-03-16T11:22:24.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T11:22:27.294 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44 2024-03-16T11:22:28.304 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T11:22:28.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T11:22:31.390 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-03-16T11:22:33.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T11:22:37.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T11:22:40.450 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-03-16T11:22:46.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T11:23:28.344 WARNING:teuthology.provision.fog.smithi022:timed out 2024-03-16T11:23:33.304 WARNING:teuthology.provision.fog.smithi044:timed out 2024-03-16T11:23:34.347 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T11:23:34.693 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-16T11:23:34.694 DEBUG:teuthology.orchestra.run.smithi022:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-16T11:23:35.025 INFO:teuthology.provision.fog.smithi022:Node is ready 2024-03-16T11:23:35.025 DEBUG:teuthology.orchestra.run.smithi022:> hostname 2024-03-16T11:23:35.040 INFO:teuthology.orchestra.run.smithi022.stdout:smithi022.front.sepia.ceph.com 2024-03-16T11:23:35.041 DEBUG:teuthology.orchestra.run.smithi022:> grep smithi022.front.sepia.ceph.com /etc/hosts 2024-03-16T11:23:35.096 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2024-03-16T11:23:35.097 DEBUG:teuthology.orchestra.run.smithi022:> sudo hostname smithi022 2024-03-16T11:23:35.226 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/smithi022.front.sepia.ceph.com/smithi022/g' /etc/hosts 2024-03-16T11:23:35.257 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/172.21.15.22/172.21.15.22/g' /etc/hosts 2024-03-16T11:23:35.329 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/smithi022.front.sepia.ceph.com/smithi022/g' /etc/hostname 2024-03-16T11:23:35.399 DEBUG:teuthology.orchestra.run.smithi022:> sudo hostname smithi022 2024-03-16T11:23:35.469 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release 2024-03-16T11:23:35.525 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="CentOS Stream" 2024-03-16T11:23:35.525 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="9" 2024-03-16T11:23:35.525 INFO:teuthology.orchestra.run.smithi022.stdout:ID="centos" 2024-03-16T11:23:35.525 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="rhel fedora" 2024-03-16T11:23:35.525 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="9" 2024-03-16T11:23:35.525 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el9" 2024-03-16T11:23:35.525 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-16T11:23:35.525 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31" 2024-03-16T11:23:35.525 INFO:teuthology.orchestra.run.smithi022.stdout:LOGO="fedora-logo-icon" 2024-03-16T11:23:35.526 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-16T11:23:35.526 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://centos.org/" 2024-03-16T11:23:35.526 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-16T11:23:35.526 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-16T11:23:35.526 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-16T11:23:35.527 INFO:teuthology.provision.fog.smithi022:Deploy complete! 2024-03-16T11:23:35.528 DEBUG:teuthology.parallel:result is None 2024-03-16T11:23:39.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T11:23:39.578 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-16T11:23:39.578 DEBUG:teuthology.orchestra.run.smithi044:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-16T11:23:39.915 INFO:teuthology.provision.fog.smithi044:Node is ready 2024-03-16T11:23:39.916 DEBUG:teuthology.orchestra.run.smithi044:> hostname 2024-03-16T11:23:39.930 INFO:teuthology.orchestra.run.smithi044.stdout:smithi044.front.sepia.ceph.com 2024-03-16T11:23:39.931 DEBUG:teuthology.orchestra.run.smithi044:> grep smithi044.front.sepia.ceph.com /etc/hosts 2024-03-16T11:23:39.987 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44 smithi044.front.sepia.ceph.com smithi044 2024-03-16T11:23:39.987 DEBUG:teuthology.orchestra.run.smithi044:> sudo hostname smithi044 2024-03-16T11:23:40.090 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i -e 's/smithi044.front.sepia.ceph.com/smithi044/g' /etc/hosts 2024-03-16T11:23:40.121 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i -e 's/172.21.15.44/172.21.15.44/g' /etc/hosts 2024-03-16T11:23:40.193 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i -e 's/smithi044.front.sepia.ceph.com/smithi044/g' /etc/hostname 2024-03-16T11:23:40.264 DEBUG:teuthology.orchestra.run.smithi044:> sudo hostname smithi044 2024-03-16T11:23:40.336 DEBUG:teuthology.orchestra.run.smithi044:> cat /etc/os-release 2024-03-16T11:23:40.390 INFO:teuthology.orchestra.run.smithi044.stdout:NAME="CentOS Stream" 2024-03-16T11:23:40.390 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION="9" 2024-03-16T11:23:40.390 INFO:teuthology.orchestra.run.smithi044.stdout:ID="centos" 2024-03-16T11:23:40.391 INFO:teuthology.orchestra.run.smithi044.stdout:ID_LIKE="rhel fedora" 2024-03-16T11:23:40.391 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_ID="9" 2024-03-16T11:23:40.391 INFO:teuthology.orchestra.run.smithi044.stdout:PLATFORM_ID="platform:el9" 2024-03-16T11:23:40.391 INFO:teuthology.orchestra.run.smithi044.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-16T11:23:40.391 INFO:teuthology.orchestra.run.smithi044.stdout:ANSI_COLOR="0;31" 2024-03-16T11:23:40.391 INFO:teuthology.orchestra.run.smithi044.stdout:LOGO="fedora-logo-icon" 2024-03-16T11:23:40.391 INFO:teuthology.orchestra.run.smithi044.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-16T11:23:40.391 INFO:teuthology.orchestra.run.smithi044.stdout:HOME_URL="https://centos.org/" 2024-03-16T11:23:40.391 INFO:teuthology.orchestra.run.smithi044.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-16T11:23:40.391 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-16T11:23:40.391 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-16T11:23:40.391 INFO:teuthology.provision.fog.smithi044:Deploy complete! 2024-03-16T11:23:40.392 DEBUG:teuthology.parallel:result is None 2024-03-16T11:23:46.463 WARNING:teuthology.provision.fog.smithi196:timed out 2024-03-16T11:23:52.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T11:23:52.699 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-16T11:23:52.699 DEBUG:teuthology.orchestra.run.smithi196:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-16T11:23:53.004 INFO:teuthology.provision.fog.smithi196:Node is ready 2024-03-16T11:23:53.004 DEBUG:teuthology.orchestra.run.smithi196:> hostname 2024-03-16T11:23:53.019 INFO:teuthology.orchestra.run.smithi196.stdout:smithi196.front.sepia.ceph.com 2024-03-16T11:23:53.019 DEBUG:teuthology.orchestra.run.smithi196:> grep smithi196.front.sepia.ceph.com /etc/hosts 2024-03-16T11:23:53.074 INFO:teuthology.orchestra.run.smithi196.stdout:172.21.15.196 smithi196.front.sepia.ceph.com smithi196 2024-03-16T11:23:53.075 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname smithi196 2024-03-16T11:23:53.187 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/smithi196.front.sepia.ceph.com/smithi196/g' /etc/hosts 2024-03-16T11:23:53.215 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/172.21.15.196/172.21.15.196/g' /etc/hosts 2024-03-16T11:23:53.281 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/smithi196.front.sepia.ceph.com/smithi196/g' /etc/hostname 2024-03-16T11:23:53.348 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname smithi196 2024-03-16T11:23:53.414 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release 2024-03-16T11:23:53.468 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="CentOS Stream" 2024-03-16T11:23:53.469 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="9" 2024-03-16T11:23:53.469 INFO:teuthology.orchestra.run.smithi196.stdout:ID="centos" 2024-03-16T11:23:53.469 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="rhel fedora" 2024-03-16T11:23:53.469 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="9" 2024-03-16T11:23:53.469 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el9" 2024-03-16T11:23:53.469 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-16T11:23:53.469 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31" 2024-03-16T11:23:53.469 INFO:teuthology.orchestra.run.smithi196.stdout:LOGO="fedora-logo-icon" 2024-03-16T11:23:53.469 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-16T11:23:53.469 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://centos.org/" 2024-03-16T11:23:53.469 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-16T11:23:53.469 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-16T11:23:53.469 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-16T11:23:53.470 INFO:teuthology.provision.fog.smithi196:Deploy complete! 2024-03-16T11:23:53.470 DEBUG:teuthology.parallel:result is None 2024-03-16T11:23:53.690 INFO:teuthology.lock.ops:Checking smithi022.front.sepia.ceph.com 2024-03-16T11:23:53.690 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-16T11:23:53.716 INFO:teuthology.lock.ops:Checking smithi044.front.sepia.ceph.com 2024-03-16T11:23:53.717 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-16T11:23:53.733 INFO:teuthology.lock.ops:Checking smithi196.front.sepia.ceph.com 2024-03-16T11:23:53.733 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-16T11:23:53.751 INFO:teuthology.lock.ops:Updating [smithi022.front.sepia.ceph.com]: set os type and version on server 2024-03-16T11:23:53.751 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-03-16T11:23:53.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T11:23:53.855 DEBUG:teuthology.orchestra.run.smithi022:> true 2024-03-16T11:23:54.032 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-03-16T11:23:54.033 DEBUG:teuthology.orchestra.run.smithi022:> uname -m 2024-03-16T11:23:54.087 INFO:teuthology.orchestra.run.smithi022.stdout:x86_64 2024-03-16T11:23:54.088 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release 2024-03-16T11:23:54.142 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="CentOS Stream" 2024-03-16T11:23:54.143 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="9" 2024-03-16T11:23:54.143 INFO:teuthology.orchestra.run.smithi022.stdout:ID="centos" 2024-03-16T11:23:54.143 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="rhel fedora" 2024-03-16T11:23:54.143 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="9" 2024-03-16T11:23:54.143 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el9" 2024-03-16T11:23:54.143 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-16T11:23:54.143 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31" 2024-03-16T11:23:54.143 INFO:teuthology.orchestra.run.smithi022.stdout:LOGO="fedora-logo-icon" 2024-03-16T11:23:54.143 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-16T11:23:54.143 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://centos.org/" 2024-03-16T11:23:54.143 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-16T11:23:54.143 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-16T11:23:54.143 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-16T11:23:54.144 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2024-03-16T11:23:54.167 INFO:teuthology.lock.ops:Updating [smithi044.front.sepia.ceph.com]: set os type and version on server 2024-03-16T11:23:54.167 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-03-16T11:23:54.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T11:23:54.270 DEBUG:teuthology.orchestra.run.smithi044:> true 2024-03-16T11:23:54.452 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-03-16T11:23:54.452 DEBUG:teuthology.orchestra.run.smithi044:> uname -m 2024-03-16T11:23:54.508 INFO:teuthology.orchestra.run.smithi044.stdout:x86_64 2024-03-16T11:23:54.508 DEBUG:teuthology.orchestra.run.smithi044:> cat /etc/os-release 2024-03-16T11:23:54.562 INFO:teuthology.orchestra.run.smithi044.stdout:NAME="CentOS Stream" 2024-03-16T11:23:54.563 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION="9" 2024-03-16T11:23:54.563 INFO:teuthology.orchestra.run.smithi044.stdout:ID="centos" 2024-03-16T11:23:54.563 INFO:teuthology.orchestra.run.smithi044.stdout:ID_LIKE="rhel fedora" 2024-03-16T11:23:54.563 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_ID="9" 2024-03-16T11:23:54.563 INFO:teuthology.orchestra.run.smithi044.stdout:PLATFORM_ID="platform:el9" 2024-03-16T11:23:54.563 INFO:teuthology.orchestra.run.smithi044.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-16T11:23:54.563 INFO:teuthology.orchestra.run.smithi044.stdout:ANSI_COLOR="0;31" 2024-03-16T11:23:54.563 INFO:teuthology.orchestra.run.smithi044.stdout:LOGO="fedora-logo-icon" 2024-03-16T11:23:54.563 INFO:teuthology.orchestra.run.smithi044.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-16T11:23:54.563 INFO:teuthology.orchestra.run.smithi044.stdout:HOME_URL="https://centos.org/" 2024-03-16T11:23:54.563 INFO:teuthology.orchestra.run.smithi044.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-16T11:23:54.563 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-16T11:23:54.563 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-16T11:23:54.564 INFO:teuthology.lock.ops:Updating smithi044.front.sepia.ceph.com on lock server 2024-03-16T11:23:54.583 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: set os type and version on server 2024-03-16T11:23:54.583 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-03-16T11:23:54.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T11:23:54.669 DEBUG:teuthology.orchestra.run.smithi196:> true 2024-03-16T11:23:54.739 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-03-16T11:23:54.739 DEBUG:teuthology.orchestra.run.smithi196:> uname -m 2024-03-16T11:23:54.795 INFO:teuthology.orchestra.run.smithi196.stdout:x86_64 2024-03-16T11:23:54.796 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release 2024-03-16T11:23:54.851 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="CentOS Stream" 2024-03-16T11:23:54.851 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="9" 2024-03-16T11:23:54.851 INFO:teuthology.orchestra.run.smithi196.stdout:ID="centos" 2024-03-16T11:23:54.851 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="rhel fedora" 2024-03-16T11:23:54.851 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="9" 2024-03-16T11:23:54.852 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el9" 2024-03-16T11:23:54.852 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-16T11:23:54.852 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31" 2024-03-16T11:23:54.852 INFO:teuthology.orchestra.run.smithi196.stdout:LOGO="fedora-logo-icon" 2024-03-16T11:23:54.852 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-16T11:23:54.852 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://centos.org/" 2024-03-16T11:23:54.852 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-16T11:23:54.852 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-16T11:23:54.852 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-16T11:23:54.852 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server 2024-03-16T11:23:54.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T11:23:54.969 INFO:teuthology.dispatcher.supervisor:Running job 7602414 2024-03-16T11:23:54.970 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-03-15_13:00:41-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7602414 --name pdonnell-2024-03-15_13:00:41-fs-wip-batrick-testing-20240314.183243-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/suites/blogbench}} -- /home/teuthworker/archive/pdonnell-2024-03-15_13:00:41-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7602414/orig.config.yaml 2024-03-16T11:23:54.972 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-03-15_13:00:41-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7602414 2024-03-16T11:23:54.973 INFO:teuthology.dispatcher.supervisor:Job PID: 1813301 2024-03-16T11:23:54.973 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-16T11:25:55.048 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T11:27:55.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T11:29:55.366 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T11:31:55.538 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T11:33:55.710 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T11:35:55.850 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T11:37:56.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T11:39:56.178 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T11:41:56.287 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T11:43:56.452 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T11:45:56.625 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T11:47:56.798 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T11:49:56.958 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T11:51:57.126 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T11:53:57.307 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T11:55:57.481 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T11:57:57.630 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T11:59:57.726 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T12:01:57.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T12:03:58.068 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T12:05:58.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T12:07:58.370 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T12:09:58.561 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T12:11:58.744 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T12:11:58.811 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1