2024-03-21T17:01:13.518 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-21T17:01:13.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:01:13.708 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f76f8502c10>, signals=[15]) 2024-03-21T17:01:13.709 INFO:teuthology.lock.ops:Start node 'smithi005.front.sepia.ceph.com' reimaging 2024-03-21T17:01:13.709 INFO:teuthology.lock.ops:Updating [smithi005.front.sepia.ceph.com]: reset os type and version on server 2024-03-21T17:01:13.709 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2024-03-21T17:01:13.731 INFO:teuthology.lock.ops:Start node 'smithi057.front.sepia.ceph.com' reimaging 2024-03-21T17:01:13.731 INFO:teuthology.lock.ops:Updating [smithi057.front.sepia.ceph.com]: reset os type and version on server 2024-03-21T17:01:13.731 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2024-03-21T17:01:13.755 INFO:teuthology.lock.ops:Start node 'smithi115.front.sepia.ceph.com' reimaging 2024-03-21T17:01:13.755 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: reset os type and version on server 2024-03-21T17:01:13.755 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2024-03-21T17:01:13.849 DEBUG:teuthology.provision.fog.smithi005:Requesting image smithi_centos_9.stream (ID 10) 2024-03-21T17:01:13.862 DEBUG:teuthology.provision.fog.smithi057:Requesting image smithi_centos_9.stream (ID 10) 2024-03-21T17:01:13.897 DEBUG:teuthology.provision.fog.smithi115:Requesting image smithi_centos_9.stream (ID 10) 2024-03-21T17:01:13.905 INFO:teuthology.provision.fog.smithi005:Scheduling deploy of centos 9.stream 2024-03-21T17:01:13.918 INFO:teuthology.provision.fog.smithi057:Scheduling deploy of centos 9.stream 2024-03-21T17:01:13.936 INFO:teuthology.provision.fog.smithi115:Scheduling deploy of centos 9.stream 2024-03-21T17:01:14.116 INFO:teuthology.orchestra.console.smithi005:Power off 2024-03-21T17:01:14.116 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-21T17:01:14.132 INFO:teuthology.orchestra.console.smithi057:Power off 2024-03-21T17:01:14.133 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-21T17:01:14.143 DEBUG:teuthology.orchestra.console.smithi005:power off output: Chassis Power Control: Down/Off 2024-03-21T17:01:14.143 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T17:01:14.154 DEBUG:teuthology.orchestra.console.smithi057:power off output: Chassis Power Control: Down/Off 2024-03-21T17:01:14.154 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T17:01:14.169 INFO:teuthology.orchestra.console.smithi115:Power off 2024-03-21T17:01:14.169 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-21T17:01:14.177 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on 2024-03-21T17:01:14.180 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on 2024-03-21T17:01:14.189 DEBUG:teuthology.orchestra.console.smithi115:power off output: Chassis Power Control: Down/Off 2024-03-21T17:01:14.189 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T17:01:14.212 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off 2024-03-21T17:01:14.313 INFO:teuthology.orchestra.console.smithi115:Power off completed 2024-03-21T17:01:14.413 INFO:teuthology.orchestra.console.smithi115:Power on 2024-03-21T17:01:14.414 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-21T17:01:14.439 DEBUG:teuthology.orchestra.console.smithi115:power on output: Chassis Power Control: Up/On 2024-03-21T17:01:14.440 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T17:01:14.466 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off 2024-03-21T17:01:18.178 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T17:01:18.187 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T17:01:18.289 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on 2024-03-21T17:01:18.295 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on 2024-03-21T17:01:18.468 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T17:01:18.577 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on 2024-03-21T17:01:18.678 INFO:teuthology.orchestra.console.smithi115:Power on completed 2024-03-21T17:01:18.778 INFO:teuthology.provision.fog.smithi115:Waiting for deploy to finish 2024-03-21T17:01:22.294 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T17:01:22.301 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T17:01:22.404 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is off 2024-03-21T17:01:22.413 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off 2024-03-21T17:01:22.505 INFO:teuthology.orchestra.console.smithi005:Power off completed 2024-03-21T17:01:22.514 INFO:teuthology.orchestra.console.smithi057:Power off completed 2024-03-21T17:01:22.606 INFO:teuthology.orchestra.console.smithi005:Power on 2024-03-21T17:01:22.606 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-21T17:01:22.615 INFO:teuthology.orchestra.console.smithi057:Power on 2024-03-21T17:01:22.616 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-21T17:01:22.630 DEBUG:teuthology.orchestra.console.smithi005:power on output: Chassis Power Control: Up/On 2024-03-21T17:01:22.631 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T17:01:22.643 DEBUG:teuthology.orchestra.console.smithi057:power on output: Chassis Power Control: Up/On 2024-03-21T17:01:22.644 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T17:01:22.655 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is off 2024-03-21T17:01:22.667 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off 2024-03-21T17:01:26.658 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T17:01:26.668 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T17:01:26.767 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is off 2024-03-21T17:01:26.777 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off 2024-03-21T17:01:30.771 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T17:01:30.778 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T17:01:30.880 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on 2024-03-21T17:01:30.887 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on 2024-03-21T17:01:30.981 INFO:teuthology.orchestra.console.smithi005:Power on completed 2024-03-21T17:01:30.988 INFO:teuthology.orchestra.console.smithi057:Power on completed 2024-03-21T17:01:31.082 INFO:teuthology.provision.fog.smithi005:Waiting for deploy to finish 2024-03-21T17:01:31.089 INFO:teuthology.provision.fog.smithi057:Waiting for deploy to finish 2024-03-21T17:04:01.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T17:04:01.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T17:04:04.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T17:04:05.022 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2024-03-21T17:04:05.023 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2024-03-21T17:04:07.678 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-03-21T17:04:11.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T17:04:11.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T17:04:13.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T17:04:14.078 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2024-03-21T17:04:14.110 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2024-03-21T17:04:16.734 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-03-21T17:04:20.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T17:04:20.111 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T17:04:22.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T17:04:23.134 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2024-03-21T17:04:23.166 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2024-03-21T17:04:25.790 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-03-21T17:04:29.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T17:04:29.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T17:04:31.794 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T17:04:32.190 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2024-03-21T17:04:32.222 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2024-03-21T17:04:34.846 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-03-21T17:04:38.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T17:04:38.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T17:04:40.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T17:04:41.246 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2024-03-21T17:04:41.278 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2024-03-21T17:04:43.902 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-03-21T17:04:47.250 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T17:04:47.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T17:04:49.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T17:04:50.302 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2024-03-21T17:04:52.958 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-03-21T17:04:56.305 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T17:04:58.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T17:04:59.358 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2024-03-21T17:05:02.046 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-03-21T17:05:05.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T17:05:08.049 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T17:05:08.414 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2024-03-21T17:05:14.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T17:05:47.306 WARNING:teuthology.provision.fog.smithi005:timed out 2024-03-21T17:05:53.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T17:05:53.563 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-21T17:05:53.564 DEBUG:teuthology.orchestra.run.smithi005:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-21T17:05:53.895 INFO:teuthology.provision.fog.smithi005:Node is ready 2024-03-21T17:05:53.895 DEBUG:teuthology.orchestra.run.smithi005:> hostname 2024-03-21T17:05:53.910 INFO:teuthology.orchestra.run.smithi005.stdout:smithi005.front.sepia.ceph.com 2024-03-21T17:05:53.910 DEBUG:teuthology.orchestra.run.smithi005:> grep smithi005.front.sepia.ceph.com /etc/hosts 2024-03-21T17:05:53.967 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5 smithi005.front.sepia.ceph.com smithi005 2024-03-21T17:05:53.967 DEBUG:teuthology.orchestra.run.smithi005:> sudo hostname smithi005 2024-03-21T17:05:54.089 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i -e 's/smithi005.front.sepia.ceph.com/smithi005/g' /etc/hosts 2024-03-21T17:05:54.121 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i -e 's/172.21.15.5/172.21.15.5/g' /etc/hosts 2024-03-21T17:05:54.193 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i -e 's/smithi005.front.sepia.ceph.com/smithi005/g' /etc/hostname 2024-03-21T17:05:54.264 DEBUG:teuthology.orchestra.run.smithi005:> sudo hostname smithi005 2024-03-21T17:05:54.334 DEBUG:teuthology.orchestra.run.smithi005:> cat /etc/os-release 2024-03-21T17:05:54.389 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="CentOS Stream" 2024-03-21T17:05:54.389 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="9" 2024-03-21T17:05:54.389 INFO:teuthology.orchestra.run.smithi005.stdout:ID="centos" 2024-03-21T17:05:54.389 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE="rhel fedora" 2024-03-21T17:05:54.389 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="9" 2024-03-21T17:05:54.389 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM_ID="platform:el9" 2024-03-21T17:05:54.389 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-21T17:05:54.389 INFO:teuthology.orchestra.run.smithi005.stdout:ANSI_COLOR="0;31" 2024-03-21T17:05:54.389 INFO:teuthology.orchestra.run.smithi005.stdout:LOGO="fedora-logo-icon" 2024-03-21T17:05:54.389 INFO:teuthology.orchestra.run.smithi005.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-21T17:05:54.389 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://centos.org/" 2024-03-21T17:05:54.389 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-21T17:05:54.389 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-21T17:05:54.390 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-21T17:05:54.390 INFO:teuthology.provision.fog.smithi005:Deploy complete! 2024-03-21T17:05:54.392 DEBUG:teuthology.parallel:result is None 2024-03-21T17:06:08.062 WARNING:teuthology.provision.fog.smithi115:timed out 2024-03-21T17:06:14.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T17:06:14.422 WARNING:teuthology.provision.fog.smithi057:timed out 2024-03-21T17:06:14.470 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-21T17:06:14.470 DEBUG:teuthology.orchestra.run.smithi115:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-21T17:06:14.804 INFO:teuthology.provision.fog.smithi115:Node is ready 2024-03-21T17:06:14.804 DEBUG:teuthology.orchestra.run.smithi115:> hostname 2024-03-21T17:06:14.818 INFO:teuthology.orchestra.run.smithi115.stdout:smithi115.front.sepia.ceph.com 2024-03-21T17:06:14.819 DEBUG:teuthology.orchestra.run.smithi115:> grep smithi115.front.sepia.ceph.com /etc/hosts 2024-03-21T17:06:14.875 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115 smithi115.front.sepia.ceph.com smithi115 2024-03-21T17:06:14.875 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname smithi115 2024-03-21T17:06:15.005 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/smithi115.front.sepia.ceph.com/smithi115/g' /etc/hosts 2024-03-21T17:06:15.033 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/172.21.15.115/172.21.15.115/g' /etc/hosts 2024-03-21T17:06:15.118 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/smithi115.front.sepia.ceph.com/smithi115/g' /etc/hostname 2024-03-21T17:06:15.187 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname smithi115 2024-03-21T17:06:15.254 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release 2024-03-21T17:06:15.312 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Stream" 2024-03-21T17:06:15.313 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="9" 2024-03-21T17:06:15.313 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos" 2024-03-21T17:06:15.313 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora" 2024-03-21T17:06:15.313 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="9" 2024-03-21T17:06:15.313 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el9" 2024-03-21T17:06:15.313 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-21T17:06:15.313 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31" 2024-03-21T17:06:15.313 INFO:teuthology.orchestra.run.smithi115.stdout:LOGO="fedora-logo-icon" 2024-03-21T17:06:15.313 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-21T17:06:15.313 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://centos.org/" 2024-03-21T17:06:15.313 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-21T17:06:15.313 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-21T17:06:15.313 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-21T17:06:15.314 INFO:teuthology.provision.fog.smithi115:Deploy complete! 2024-03-21T17:06:15.315 DEBUG:teuthology.parallel:result is None 2024-03-21T17:06:20.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T17:06:20.699 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-21T17:06:20.699 DEBUG:teuthology.orchestra.run.smithi057:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-21T17:06:21.010 INFO:teuthology.provision.fog.smithi057:Node is ready 2024-03-21T17:06:21.010 DEBUG:teuthology.orchestra.run.smithi057:> hostname 2024-03-21T17:06:21.025 INFO:teuthology.orchestra.run.smithi057.stdout:smithi057.front.sepia.ceph.com 2024-03-21T17:06:21.026 DEBUG:teuthology.orchestra.run.smithi057:> grep smithi057.front.sepia.ceph.com /etc/hosts 2024-03-21T17:06:21.082 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57 smithi057.front.sepia.ceph.com smithi057 2024-03-21T17:06:21.082 DEBUG:teuthology.orchestra.run.smithi057:> sudo hostname smithi057 2024-03-21T17:06:21.181 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/smithi057.front.sepia.ceph.com/smithi057/g' /etc/hosts 2024-03-21T17:06:21.213 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/172.21.15.57/172.21.15.57/g' /etc/hosts 2024-03-21T17:06:21.284 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/smithi057.front.sepia.ceph.com/smithi057/g' /etc/hostname 2024-03-21T17:06:21.356 DEBUG:teuthology.orchestra.run.smithi057:> sudo hostname smithi057 2024-03-21T17:06:21.427 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2024-03-21T17:06:21.482 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="CentOS Stream" 2024-03-21T17:06:21.482 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="9" 2024-03-21T17:06:21.482 INFO:teuthology.orchestra.run.smithi057.stdout:ID="centos" 2024-03-21T17:06:21.482 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="rhel fedora" 2024-03-21T17:06:21.483 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="9" 2024-03-21T17:06:21.483 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el9" 2024-03-21T17:06:21.483 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-21T17:06:21.483 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31" 2024-03-21T17:06:21.483 INFO:teuthology.orchestra.run.smithi057.stdout:LOGO="fedora-logo-icon" 2024-03-21T17:06:21.483 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-21T17:06:21.483 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://centos.org/" 2024-03-21T17:06:21.484 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-21T17:06:21.484 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-21T17:06:21.484 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-21T17:06:21.484 INFO:teuthology.provision.fog.smithi057:Deploy complete! 2024-03-21T17:06:21.485 DEBUG:teuthology.parallel:result is None 2024-03-21T17:06:21.713 INFO:teuthology.lock.ops:Checking smithi005.front.sepia.ceph.com 2024-03-21T17:06:21.714 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-21T17:06:21.736 INFO:teuthology.lock.ops:Checking smithi057.front.sepia.ceph.com 2024-03-21T17:06:21.737 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-21T17:06:21.761 INFO:teuthology.lock.ops:Checking smithi115.front.sepia.ceph.com 2024-03-21T17:06:21.761 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-21T17:06:21.779 INFO:teuthology.lock.ops:Updating [smithi005.front.sepia.ceph.com]: set os type and version on server 2024-03-21T17:06:21.779 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-03-21T17:06:21.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T17:06:21.883 DEBUG:teuthology.orchestra.run.smithi005:> true 2024-03-21T17:06:22.065 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-03-21T17:06:22.066 DEBUG:teuthology.orchestra.run.smithi005:> uname -m 2024-03-21T17:06:22.122 INFO:teuthology.orchestra.run.smithi005.stdout:x86_64 2024-03-21T17:06:22.122 DEBUG:teuthology.orchestra.run.smithi005:> cat /etc/os-release 2024-03-21T17:06:22.177 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="CentOS Stream" 2024-03-21T17:06:22.177 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="9" 2024-03-21T17:06:22.177 INFO:teuthology.orchestra.run.smithi005.stdout:ID="centos" 2024-03-21T17:06:22.177 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE="rhel fedora" 2024-03-21T17:06:22.177 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="9" 2024-03-21T17:06:22.177 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM_ID="platform:el9" 2024-03-21T17:06:22.178 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-21T17:06:22.178 INFO:teuthology.orchestra.run.smithi005.stdout:ANSI_COLOR="0;31" 2024-03-21T17:06:22.178 INFO:teuthology.orchestra.run.smithi005.stdout:LOGO="fedora-logo-icon" 2024-03-21T17:06:22.178 INFO:teuthology.orchestra.run.smithi005.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-21T17:06:22.178 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://centos.org/" 2024-03-21T17:06:22.178 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-21T17:06:22.178 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-21T17:06:22.178 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-21T17:06:22.179 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2024-03-21T17:06:22.212 INFO:teuthology.lock.ops:Updating [smithi057.front.sepia.ceph.com]: set os type and version on server 2024-03-21T17:06:22.212 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-03-21T17:06:22.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T17:06:22.314 DEBUG:teuthology.orchestra.run.smithi057:> true 2024-03-21T17:06:22.382 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-03-21T17:06:22.382 DEBUG:teuthology.orchestra.run.smithi057:> uname -m 2024-03-21T17:06:22.438 INFO:teuthology.orchestra.run.smithi057.stdout:x86_64 2024-03-21T17:06:22.438 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2024-03-21T17:06:22.494 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="CentOS Stream" 2024-03-21T17:06:22.494 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="9" 2024-03-21T17:06:22.494 INFO:teuthology.orchestra.run.smithi057.stdout:ID="centos" 2024-03-21T17:06:22.494 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="rhel fedora" 2024-03-21T17:06:22.494 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="9" 2024-03-21T17:06:22.494 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el9" 2024-03-21T17:06:22.494 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-21T17:06:22.494 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31" 2024-03-21T17:06:22.495 INFO:teuthology.orchestra.run.smithi057.stdout:LOGO="fedora-logo-icon" 2024-03-21T17:06:22.495 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-21T17:06:22.495 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://centos.org/" 2024-03-21T17:06:22.495 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-21T17:06:22.495 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-21T17:06:22.495 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-21T17:06:22.495 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2024-03-21T17:06:22.520 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: set os type and version on server 2024-03-21T17:06:22.520 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-03-21T17:06:22.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T17:06:22.609 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-03-21T17:06:22.678 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-03-21T17:06:22.679 DEBUG:teuthology.orchestra.run.smithi115:> uname -m 2024-03-21T17:06:22.735 INFO:teuthology.orchestra.run.smithi115.stdout:x86_64 2024-03-21T17:06:22.735 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release 2024-03-21T17:06:22.792 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Stream" 2024-03-21T17:06:22.792 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="9" 2024-03-21T17:06:22.792 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos" 2024-03-21T17:06:22.792 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora" 2024-03-21T17:06:22.792 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="9" 2024-03-21T17:06:22.792 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el9" 2024-03-21T17:06:22.792 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-21T17:06:22.792 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31" 2024-03-21T17:06:22.792 INFO:teuthology.orchestra.run.smithi115.stdout:LOGO="fedora-logo-icon" 2024-03-21T17:06:22.792 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-21T17:06:22.792 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://centos.org/" 2024-03-21T17:06:22.793 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-21T17:06:22.793 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-21T17:06:22.793 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-21T17:06:22.793 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2024-03-21T17:06:22.820 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:06:22.928 INFO:teuthology.dispatcher.supervisor:Running job 7613956 2024-03-21T17:06:22.928 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-03-20_21:24:03-fs-squid-distro-default-smithi/7613956 --name teuthology-2024-03-20_21:24:03-fs-squid-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-workunit/postgres}} -- /home/teuthworker/archive/teuthology-2024-03-20_21:24:03-fs-squid-distro-default-smithi/7613956/orig.config.yaml 2024-03-21T17:06:22.931 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-03-20_21:24:03-fs-squid-distro-default-smithi/7613956 2024-03-21T17:06:22.931 INFO:teuthology.dispatcher.supervisor:Job PID: 2135207 2024-03-21T17:06:22.931 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-21T17:08:23.029 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:10:23.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:12:23.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:14:23.554 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:16:23.736 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:18:23.914 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:20:24.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:22:24.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:24:24.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:26:24.580 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:28:24.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:30:24.908 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:32:25.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:34:25.251 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:36:25.459 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:38:25.653 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:40:25.734 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:42:25.897 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:44:26.074 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:46:26.249 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:48:26.429 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:50:26.599 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:52:26.764 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:54:26.936 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:56:27.112 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:58:27.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T18:00:27.446 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T18:02:27.616 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T18:04:27.778 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T18:06:27.952 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T18:08:28.123 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T18:10:28.296 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T18:12:28.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T18:14:28.643 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T18:14:28.709 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1