2024-03-24T10:18:42.360 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-24T10:18:42.360 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T10:18:42.530 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1695cd2c10>, signals=[15]) 2024-03-24T10:18:42.530 INFO:teuthology.lock.ops:Start node 'smithi045.front.sepia.ceph.com' reimaging 2024-03-24T10:18:42.530 INFO:teuthology.lock.ops:Updating [smithi045.front.sepia.ceph.com]: reset os type and version on server 2024-03-24T10:18:42.530 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server 2024-03-24T10:18:42.547 INFO:teuthology.lock.ops:Start node 'smithi047.front.sepia.ceph.com' reimaging 2024-03-24T10:18:42.547 INFO:teuthology.lock.ops:Updating [smithi047.front.sepia.ceph.com]: reset os type and version on server 2024-03-24T10:18:42.547 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server 2024-03-24T10:18:42.572 INFO:teuthology.lock.ops:Start node 'smithi052.front.sepia.ceph.com' reimaging 2024-03-24T10:18:42.572 INFO:teuthology.lock.ops:Updating [smithi052.front.sepia.ceph.com]: reset os type and version on server 2024-03-24T10:18:42.572 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server 2024-03-24T10:18:42.648 DEBUG:teuthology.provision.fog.smithi045:Requesting image smithi_centos_9.stream (ID 10) 2024-03-24T10:18:42.686 DEBUG:teuthology.provision.fog.smithi047:Requesting image smithi_centos_9.stream (ID 10) 2024-03-24T10:18:42.699 DEBUG:teuthology.provision.fog.smithi052:Requesting image smithi_centos_9.stream (ID 10) 2024-03-24T10:18:42.701 INFO:teuthology.provision.fog.smithi045:Scheduling deploy of centos 9.stream 2024-03-24T10:18:42.728 INFO:teuthology.provision.fog.smithi047:Scheduling deploy of centos 9.stream 2024-03-24T10:18:42.751 INFO:teuthology.provision.fog.smithi052:Scheduling deploy of centos 9.stream 2024-03-24T10:18:43.016 INFO:teuthology.orchestra.console.smithi047:Power off 2024-03-24T10:18:43.017 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-24T10:18:43.030 INFO:teuthology.orchestra.console.smithi052:Power off 2024-03-24T10:18:43.031 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-24T10:18:43.041 INFO:teuthology.orchestra.console.smithi045:Power off 2024-03-24T10:18:43.041 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-24T10:18:43.049 DEBUG:teuthology.orchestra.console.smithi047:power off output: Chassis Power Control: Down/Off 2024-03-24T10:18:43.049 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T10:18:43.056 DEBUG:teuthology.orchestra.console.smithi052:power off output: Chassis Power Control: Down/Off 2024-03-24T10:18:43.057 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T10:18:43.067 DEBUG:teuthology.orchestra.console.smithi045:power off output: Chassis Power Control: Down/Off 2024-03-24T10:18:43.067 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T10:18:43.074 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is off 2024-03-24T10:18:43.081 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off 2024-03-24T10:18:43.090 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is off 2024-03-24T10:18:43.174 INFO:teuthology.orchestra.console.smithi047:Power off completed 2024-03-24T10:18:43.182 INFO:teuthology.orchestra.console.smithi052:Power off completed 2024-03-24T10:18:43.191 INFO:teuthology.orchestra.console.smithi045:Power off completed 2024-03-24T10:18:43.276 INFO:teuthology.orchestra.console.smithi047:Power on 2024-03-24T10:18:43.276 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-24T10:18:43.283 INFO:teuthology.orchestra.console.smithi052:Power on 2024-03-24T10:18:43.283 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-24T10:18:43.292 INFO:teuthology.orchestra.console.smithi045:Power on 2024-03-24T10:18:43.292 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-24T10:18:43.300 DEBUG:teuthology.orchestra.console.smithi047:power on output: Chassis Power Control: Up/On 2024-03-24T10:18:43.300 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T10:18:43.308 DEBUG:teuthology.orchestra.console.smithi052:power on output: Chassis Power Control: Up/On 2024-03-24T10:18:43.308 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T10:18:43.314 DEBUG:teuthology.orchestra.console.smithi045:power on output: Chassis Power Control: Up/On 2024-03-24T10:18:43.315 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T10:18:43.321 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is off 2024-03-24T10:18:43.327 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off 2024-03-24T10:18:43.333 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is off 2024-03-24T10:18:47.327 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T10:18:47.334 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T10:18:47.339 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T10:18:47.436 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is off 2024-03-24T10:18:47.442 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off 2024-03-24T10:18:47.448 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is off 2024-03-24T10:18:51.440 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T10:18:51.448 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T10:18:51.455 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T10:18:51.550 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is on 2024-03-24T10:18:51.563 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is on 2024-03-24T10:18:51.652 INFO:teuthology.orchestra.console.smithi047:Power on completed 2024-03-24T10:18:51.663 INFO:teuthology.orchestra.console.smithi045:Power on completed 2024-03-24T10:18:51.669 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is on 2024-03-24T10:18:51.753 INFO:teuthology.provision.fog.smithi047:Waiting for deploy to finish 2024-03-24T10:18:51.765 INFO:teuthology.provision.fog.smithi045:Waiting for deploy to finish 2024-03-24T10:18:51.770 INFO:teuthology.orchestra.console.smithi052:Power on completed 2024-03-24T10:18:51.871 INFO:teuthology.provision.fog.smithi052:Waiting for deploy to finish 2024-03-24T10:21:39.767 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:21:39.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:21:42.846 WARNING:teuthology.provision.fog.smithi047:[Errno None] Unable to connect to port 22 on 172.21.15.47 2024-03-24T10:21:43.038 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45 2024-03-24T10:21:48.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:21:49.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:21:51.902 WARNING:teuthology.provision.fog.smithi047:[Errno None] Unable to connect to port 22 on 172.21.15.47 2024-03-24T10:21:52.094 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45 2024-03-24T10:21:55.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:21:57.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:21:58.095 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:21:58.174 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2024-03-24T10:22:00.958 WARNING:teuthology.provision.fog.smithi047:[Errno None] Unable to connect to port 22 on 172.21.15.47 2024-03-24T10:22:01.150 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45 2024-03-24T10:22:04.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:22:06.962 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:22:07.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:22:07.230 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2024-03-24T10:22:10.014 WARNING:teuthology.provision.fog.smithi047:[Errno None] Unable to connect to port 22 on 172.21.15.47 2024-03-24T10:22:10.206 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45 2024-03-24T10:22:13.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:22:16.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:22:16.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:22:16.286 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2024-03-24T10:22:19.070 WARNING:teuthology.provision.fog.smithi047:[Errno None] Unable to connect to port 22 on 172.21.15.47 2024-03-24T10:22:19.262 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45 2024-03-24T10:22:22.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:22:25.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:22:25.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:22:25.346 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2024-03-24T10:22:28.126 WARNING:teuthology.provision.fog.smithi047:[Errno None] Unable to connect to port 22 on 172.21.15.47 2024-03-24T10:22:28.322 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45 2024-03-24T10:22:31.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:22:34.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:22:34.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:22:34.434 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2024-03-24T10:22:40.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:23:34.156 WARNING:teuthology.provision.fog.smithi047:timed out 2024-03-24T10:23:34.327 WARNING:teuthology.provision.fog.smithi045:timed out 2024-03-24T10:23:40.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:23:40.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:23:40.428 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-24T10:23:40.429 DEBUG:teuthology.orchestra.run.smithi047:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-24T10:23:40.443 WARNING:teuthology.provision.fog.smithi052:timed out 2024-03-24T10:23:40.556 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-24T10:23:40.556 DEBUG:teuthology.orchestra.run.smithi045:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-24T10:23:40.783 INFO:teuthology.provision.fog.smithi047:Node is ready 2024-03-24T10:23:40.783 DEBUG:teuthology.orchestra.run.smithi047:> hostname 2024-03-24T10:23:40.798 INFO:teuthology.orchestra.run.smithi047.stdout:smithi047.front.sepia.ceph.com 2024-03-24T10:23:40.798 DEBUG:teuthology.orchestra.run.smithi047:> grep smithi047.front.sepia.ceph.com /etc/hosts 2024-03-24T10:23:40.854 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47 smithi047.front.sepia.ceph.com smithi047 2024-03-24T10:23:40.854 DEBUG:teuthology.orchestra.run.smithi047:> sudo hostname smithi047 2024-03-24T10:23:40.901 INFO:teuthology.provision.fog.smithi045:Node is ready 2024-03-24T10:23:40.901 DEBUG:teuthology.orchestra.run.smithi045:> hostname 2024-03-24T10:23:40.916 INFO:teuthology.orchestra.run.smithi045.stdout:smithi045.front.sepia.ceph.com 2024-03-24T10:23:40.916 DEBUG:teuthology.orchestra.run.smithi045:> grep smithi045.front.sepia.ceph.com /etc/hosts 2024-03-24T10:23:40.958 DEBUG:teuthology.orchestra.run.smithi047:> sudo sed -i -e 's/smithi047.front.sepia.ceph.com/smithi047/g' /etc/hosts 2024-03-24T10:23:40.974 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45 smithi045.front.sepia.ceph.com smithi045 2024-03-24T10:23:40.974 DEBUG:teuthology.orchestra.run.smithi045:> sudo hostname smithi045 2024-03-24T10:23:40.989 DEBUG:teuthology.orchestra.run.smithi047:> sudo sed -i -e 's/172.21.15.47/172.21.15.47/g' /etc/hosts 2024-03-24T10:23:41.060 DEBUG:teuthology.orchestra.run.smithi047:> sudo sed -i -e 's/smithi047.front.sepia.ceph.com/smithi047/g' /etc/hostname 2024-03-24T10:23:41.089 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i -e 's/smithi045.front.sepia.ceph.com/smithi045/g' /etc/hosts 2024-03-24T10:23:41.121 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i -e 's/172.21.15.45/172.21.15.45/g' /etc/hosts 2024-03-24T10:23:41.131 DEBUG:teuthology.orchestra.run.smithi047:> sudo hostname smithi047 2024-03-24T10:23:41.192 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i -e 's/smithi045.front.sepia.ceph.com/smithi045/g' /etc/hostname 2024-03-24T10:23:41.201 DEBUG:teuthology.orchestra.run.smithi047:> cat /etc/os-release 2024-03-24T10:23:41.256 INFO:teuthology.orchestra.run.smithi047.stdout:NAME="CentOS Stream" 2024-03-24T10:23:41.256 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION="9" 2024-03-24T10:23:41.256 INFO:teuthology.orchestra.run.smithi047.stdout:ID="centos" 2024-03-24T10:23:41.256 INFO:teuthology.orchestra.run.smithi047.stdout:ID_LIKE="rhel fedora" 2024-03-24T10:23:41.256 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_ID="9" 2024-03-24T10:23:41.256 INFO:teuthology.orchestra.run.smithi047.stdout:PLATFORM_ID="platform:el9" 2024-03-24T10:23:41.256 INFO:teuthology.orchestra.run.smithi047.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-24T10:23:41.257 INFO:teuthology.orchestra.run.smithi047.stdout:ANSI_COLOR="0;31" 2024-03-24T10:23:41.257 INFO:teuthology.orchestra.run.smithi047.stdout:LOGO="fedora-logo-icon" 2024-03-24T10:23:41.257 INFO:teuthology.orchestra.run.smithi047.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-24T10:23:41.257 INFO:teuthology.orchestra.run.smithi047.stdout:HOME_URL="https://centos.org/" 2024-03-24T10:23:41.257 INFO:teuthology.orchestra.run.smithi047.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-24T10:23:41.257 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-24T10:23:41.257 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-24T10:23:41.258 INFO:teuthology.provision.fog.smithi047:Deploy complete! 2024-03-24T10:23:41.259 DEBUG:teuthology.parallel:result is None 2024-03-24T10:23:41.262 DEBUG:teuthology.orchestra.run.smithi045:> sudo hostname smithi045 2024-03-24T10:23:41.333 DEBUG:teuthology.orchestra.run.smithi045:> cat /etc/os-release 2024-03-24T10:23:41.388 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="CentOS Stream" 2024-03-24T10:23:41.388 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="9" 2024-03-24T10:23:41.388 INFO:teuthology.orchestra.run.smithi045.stdout:ID="centos" 2024-03-24T10:23:41.388 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE="rhel fedora" 2024-03-24T10:23:41.388 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="9" 2024-03-24T10:23:41.388 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM_ID="platform:el9" 2024-03-24T10:23:41.388 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-24T10:23:41.388 INFO:teuthology.orchestra.run.smithi045.stdout:ANSI_COLOR="0;31" 2024-03-24T10:23:41.388 INFO:teuthology.orchestra.run.smithi045.stdout:LOGO="fedora-logo-icon" 2024-03-24T10:23:41.388 INFO:teuthology.orchestra.run.smithi045.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-24T10:23:41.388 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://centos.org/" 2024-03-24T10:23:41.389 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-24T10:23:41.389 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-24T10:23:41.389 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-24T10:23:41.389 INFO:teuthology.provision.fog.smithi045:Deploy complete! 2024-03-24T10:23:41.389 DEBUG:teuthology.parallel:result is None 2024-03-24T10:23:46.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:23:46.702 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-24T10:23:46.702 DEBUG:teuthology.orchestra.run.smithi052:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-24T10:23:47.034 INFO:teuthology.provision.fog.smithi052:Node is ready 2024-03-24T10:23:47.034 DEBUG:teuthology.orchestra.run.smithi052:> hostname 2024-03-24T10:23:47.048 INFO:teuthology.orchestra.run.smithi052.stdout:smithi052.front.sepia.ceph.com 2024-03-24T10:23:47.048 DEBUG:teuthology.orchestra.run.smithi052:> grep smithi052.front.sepia.ceph.com /etc/hosts 2024-03-24T10:23:47.105 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52 smithi052.front.sepia.ceph.com smithi052 2024-03-24T10:23:47.106 DEBUG:teuthology.orchestra.run.smithi052:> sudo hostname smithi052 2024-03-24T10:23:47.215 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i -e 's/smithi052.front.sepia.ceph.com/smithi052/g' /etc/hosts 2024-03-24T10:23:47.246 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i -e 's/172.21.15.52/172.21.15.52/g' /etc/hosts 2024-03-24T10:23:47.317 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i -e 's/smithi052.front.sepia.ceph.com/smithi052/g' /etc/hostname 2024-03-24T10:23:47.388 DEBUG:teuthology.orchestra.run.smithi052:> sudo hostname smithi052 2024-03-24T10:23:47.457 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release 2024-03-24T10:23:47.512 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="CentOS Stream" 2024-03-24T10:23:47.512 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="9" 2024-03-24T10:23:47.513 INFO:teuthology.orchestra.run.smithi052.stdout:ID="centos" 2024-03-24T10:23:47.513 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE="rhel fedora" 2024-03-24T10:23:47.513 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="9" 2024-03-24T10:23:47.513 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM_ID="platform:el9" 2024-03-24T10:23:47.513 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-24T10:23:47.513 INFO:teuthology.orchestra.run.smithi052.stdout:ANSI_COLOR="0;31" 2024-03-24T10:23:47.513 INFO:teuthology.orchestra.run.smithi052.stdout:LOGO="fedora-logo-icon" 2024-03-24T10:23:47.513 INFO:teuthology.orchestra.run.smithi052.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-24T10:23:47.513 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://centos.org/" 2024-03-24T10:23:47.513 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-24T10:23:47.513 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-24T10:23:47.513 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-24T10:23:47.514 INFO:teuthology.provision.fog.smithi052:Deploy complete! 2024-03-24T10:23:47.514 DEBUG:teuthology.parallel:result is None 2024-03-24T10:23:47.734 INFO:teuthology.lock.ops:Checking smithi045.front.sepia.ceph.com 2024-03-24T10:23:47.734 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-24T10:23:47.756 INFO:teuthology.lock.ops:Checking smithi047.front.sepia.ceph.com 2024-03-24T10:23:47.756 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-24T10:23:47.772 INFO:teuthology.lock.ops:Checking smithi052.front.sepia.ceph.com 2024-03-24T10:23:47.772 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-24T10:23:47.798 INFO:teuthology.lock.ops:Updating [smithi045.front.sepia.ceph.com]: set os type and version on server 2024-03-24T10:23:47.798 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2024-03-24T10:23:47.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:23:47.904 DEBUG:teuthology.orchestra.run.smithi045:> true 2024-03-24T10:23:47.975 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi045.front.sepia.ceph.com' 2024-03-24T10:23:47.976 DEBUG:teuthology.orchestra.run.smithi045:> uname -m 2024-03-24T10:23:48.033 INFO:teuthology.orchestra.run.smithi045.stdout:x86_64 2024-03-24T10:23:48.034 DEBUG:teuthology.orchestra.run.smithi045:> cat /etc/os-release 2024-03-24T10:23:48.091 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="CentOS Stream" 2024-03-24T10:23:48.091 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="9" 2024-03-24T10:23:48.091 INFO:teuthology.orchestra.run.smithi045.stdout:ID="centos" 2024-03-24T10:23:48.092 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE="rhel fedora" 2024-03-24T10:23:48.092 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="9" 2024-03-24T10:23:48.092 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM_ID="platform:el9" 2024-03-24T10:23:48.092 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-24T10:23:48.092 INFO:teuthology.orchestra.run.smithi045.stdout:ANSI_COLOR="0;31" 2024-03-24T10:23:48.092 INFO:teuthology.orchestra.run.smithi045.stdout:LOGO="fedora-logo-icon" 2024-03-24T10:23:48.092 INFO:teuthology.orchestra.run.smithi045.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-24T10:23:48.092 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://centos.org/" 2024-03-24T10:23:48.092 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-24T10:23:48.092 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-24T10:23:48.092 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-24T10:23:48.093 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server 2024-03-24T10:23:48.114 INFO:teuthology.lock.ops:Updating [smithi047.front.sepia.ceph.com]: set os type and version on server 2024-03-24T10:23:48.115 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-03-24T10:23:48.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:23:48.217 DEBUG:teuthology.orchestra.run.smithi047:> true 2024-03-24T10:23:48.286 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-03-24T10:23:48.287 DEBUG:teuthology.orchestra.run.smithi047:> uname -m 2024-03-24T10:23:48.347 INFO:teuthology.orchestra.run.smithi047.stdout:x86_64 2024-03-24T10:23:48.347 DEBUG:teuthology.orchestra.run.smithi047:> cat /etc/os-release 2024-03-24T10:23:48.406 INFO:teuthology.orchestra.run.smithi047.stdout:NAME="CentOS Stream" 2024-03-24T10:23:48.406 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION="9" 2024-03-24T10:23:48.406 INFO:teuthology.orchestra.run.smithi047.stdout:ID="centos" 2024-03-24T10:23:48.406 INFO:teuthology.orchestra.run.smithi047.stdout:ID_LIKE="rhel fedora" 2024-03-24T10:23:48.406 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_ID="9" 2024-03-24T10:23:48.406 INFO:teuthology.orchestra.run.smithi047.stdout:PLATFORM_ID="platform:el9" 2024-03-24T10:23:48.406 INFO:teuthology.orchestra.run.smithi047.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-24T10:23:48.406 INFO:teuthology.orchestra.run.smithi047.stdout:ANSI_COLOR="0;31" 2024-03-24T10:23:48.407 INFO:teuthology.orchestra.run.smithi047.stdout:LOGO="fedora-logo-icon" 2024-03-24T10:23:48.407 INFO:teuthology.orchestra.run.smithi047.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-24T10:23:48.407 INFO:teuthology.orchestra.run.smithi047.stdout:HOME_URL="https://centos.org/" 2024-03-24T10:23:48.407 INFO:teuthology.orchestra.run.smithi047.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-24T10:23:48.407 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-24T10:23:48.407 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-24T10:23:48.407 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server 2024-03-24T10:23:48.430 INFO:teuthology.lock.ops:Updating [smithi052.front.sepia.ceph.com]: set os type and version on server 2024-03-24T10:23:48.430 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-03-24T10:23:48.431 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:23:48.529 DEBUG:teuthology.orchestra.run.smithi052:> true 2024-03-24T10:23:48.597 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-03-24T10:23:48.597 DEBUG:teuthology.orchestra.run.smithi052:> uname -m 2024-03-24T10:23:48.652 INFO:teuthology.orchestra.run.smithi052.stdout:x86_64 2024-03-24T10:23:48.652 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release 2024-03-24T10:23:48.707 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="CentOS Stream" 2024-03-24T10:23:48.707 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="9" 2024-03-24T10:23:48.707 INFO:teuthology.orchestra.run.smithi052.stdout:ID="centos" 2024-03-24T10:23:48.707 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE="rhel fedora" 2024-03-24T10:23:48.707 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="9" 2024-03-24T10:23:48.707 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM_ID="platform:el9" 2024-03-24T10:23:48.707 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-24T10:23:48.707 INFO:teuthology.orchestra.run.smithi052.stdout:ANSI_COLOR="0;31" 2024-03-24T10:23:48.707 INFO:teuthology.orchestra.run.smithi052.stdout:LOGO="fedora-logo-icon" 2024-03-24T10:23:48.707 INFO:teuthology.orchestra.run.smithi052.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-24T10:23:48.707 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://centos.org/" 2024-03-24T10:23:48.708 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-24T10:23:48.708 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-24T10:23:48.708 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-24T10:23:48.708 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server 2024-03-24T10:23:48.730 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T10:23:48.819 INFO:teuthology.dispatcher.supervisor:Running job 7619058 2024-03-24T10:23:48.820 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-03-24_04:56:01-fs-wip-batrick-testing-20240323.003144-squid-distro-default-smithi/7619058 --name pdonnell-2024-03-24_04:56:01-fs-wip-batrick-testing-20240323.003144-squid-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/suites/fsx}} -- /home/teuthworker/archive/pdonnell-2024-03-24_04:56:01-fs-wip-batrick-testing-20240323.003144-squid-distro-default-smithi/7619058/orig.config.yaml 2024-03-24T10:23:48.822 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-03-24_04:56:01-fs-wip-batrick-testing-20240323.003144-squid-distro-default-smithi/7619058 2024-03-24T10:23:48.822 INFO:teuthology.dispatcher.supervisor:Job PID: 3726911 2024-03-24T10:23:48.822 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-24T10:25:48.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T10:27:49.087 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T10:29:49.259 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T10:31:49.435 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T10:33:49.616 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T10:35:49.793 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T10:37:49.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T10:39:50.147 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T10:41:50.325 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T10:43:50.497 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T10:45:50.676 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T10:47:50.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T10:49:51.016 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T10:51:51.187 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T10:53:51.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T10:55:51.591 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T10:57:51.763 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T10:57:51.928 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1