2024-03-07T11:45:03.560 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-07T11:45:03.560 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-07T11:45:03.744 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8d9baf2c10>, signals=[15]) 2024-03-07T11:45:03.745 INFO:teuthology.lock.ops:Start node 'smithi110.front.sepia.ceph.com' reimaging 2024-03-07T11:45:03.745 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: reset os type and version on server 2024-03-07T11:45:03.745 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2024-03-07T11:45:03.793 INFO:teuthology.lock.ops:Start node 'smithi170.front.sepia.ceph.com' reimaging 2024-03-07T11:45:03.793 INFO:teuthology.lock.ops:Updating [smithi170.front.sepia.ceph.com]: reset os type and version on server 2024-03-07T11:45:03.793 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2024-03-07T11:45:03.844 INFO:teuthology.lock.ops:Start node 'smithi196.front.sepia.ceph.com' reimaging 2024-03-07T11:45:03.844 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: reset os type and version on server 2024-03-07T11:45:03.845 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server 2024-03-07T11:45:03.912 DEBUG:teuthology.provision.fog.smithi110:Requesting image smithi_centos_9.stream (ID 10) 2024-03-07T11:45:03.960 DEBUG:teuthology.provision.fog.smithi170:Requesting image smithi_centos_9.stream (ID 10) 2024-03-07T11:45:03.964 INFO:teuthology.provision.fog.smithi110:Scheduling deploy of centos 9.stream 2024-03-07T11:45:03.998 DEBUG:teuthology.provision.fog.smithi196:Requesting image smithi_centos_9.stream (ID 10) 2024-03-07T11:45:04.002 INFO:teuthology.provision.fog.smithi170:Scheduling deploy of centos 9.stream 2024-03-07T11:45:04.046 INFO:teuthology.provision.fog.smithi196:Scheduling deploy of centos 9.stream 2024-03-07T11:45:04.191 INFO:teuthology.orchestra.console.smithi110:Power off 2024-03-07T11:45:04.191 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-07T11:45:04.214 DEBUG:teuthology.orchestra.console.smithi110:power off output: Chassis Power Control: Down/Off 2024-03-07T11:45:04.214 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-07T11:45:04.239 INFO:teuthology.orchestra.console.smithi170:Power off 2024-03-07T11:45:04.239 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-07T11:45:04.248 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on 2024-03-07T11:45:04.262 DEBUG:teuthology.orchestra.console.smithi170:power off output: Chassis Power Control: Down/Off 2024-03-07T11:45:04.262 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-07T11:45:04.275 INFO:teuthology.orchestra.console.smithi196:Power off 2024-03-07T11:45:04.276 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-07T11:45:04.283 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is on 2024-03-07T11:45:04.296 DEBUG:teuthology.orchestra.console.smithi196:power off output: Chassis Power Control: Down/Off 2024-03-07T11:45:04.296 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-07T11:45:04.321 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2024-03-07T11:45:08.252 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-07T11:45:08.284 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-07T11:45:08.321 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-07T11:45:08.362 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on 2024-03-07T11:45:08.395 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is on 2024-03-07T11:45:08.431 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2024-03-07T11:45:12.364 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-07T11:45:12.396 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-07T11:45:12.432 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-07T11:45:12.474 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off 2024-03-07T11:45:12.505 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off 2024-03-07T11:45:12.541 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off 2024-03-07T11:45:12.576 INFO:teuthology.orchestra.console.smithi110:Power off completed 2024-03-07T11:45:12.606 INFO:teuthology.orchestra.console.smithi170:Power off completed 2024-03-07T11:45:12.642 INFO:teuthology.orchestra.console.smithi196:Power off completed 2024-03-07T11:45:12.676 INFO:teuthology.orchestra.console.smithi110:Power on 2024-03-07T11:45:12.676 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-07T11:45:12.700 DEBUG:teuthology.orchestra.console.smithi110:power on output: Chassis Power Control: Up/On 2024-03-07T11:45:12.701 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-07T11:45:12.708 INFO:teuthology.orchestra.console.smithi170:Power on 2024-03-07T11:45:12.708 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-07T11:45:12.722 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off 2024-03-07T11:45:12.729 DEBUG:teuthology.orchestra.console.smithi170:power on output: Chassis Power Control: Up/On 2024-03-07T11:45:12.729 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-07T11:45:12.743 INFO:teuthology.orchestra.console.smithi196:Power on 2024-03-07T11:45:12.743 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-07T11:45:12.751 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off 2024-03-07T11:45:12.765 DEBUG:teuthology.orchestra.console.smithi196:power on output: Chassis Power Control: Up/On 2024-03-07T11:45:12.765 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-07T11:45:12.787 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off 2024-03-07T11:45:16.724 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-07T11:45:16.752 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-07T11:45:16.789 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-07T11:45:16.834 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off 2024-03-07T11:45:16.861 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off 2024-03-07T11:45:16.900 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off 2024-03-07T11:45:20.837 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-07T11:45:20.861 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-07T11:45:20.901 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-07T11:45:20.946 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on 2024-03-07T11:45:21.001 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is on 2024-03-07T11:45:21.011 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2024-03-07T11:45:21.048 INFO:teuthology.orchestra.console.smithi110:Power on completed 2024-03-07T11:45:21.102 INFO:teuthology.orchestra.console.smithi170:Power on completed 2024-03-07T11:45:21.112 INFO:teuthology.orchestra.console.smithi196:Power on completed 2024-03-07T11:45:21.149 INFO:teuthology.provision.fog.smithi110:Waiting for deploy to finish 2024-03-07T11:45:21.203 INFO:teuthology.provision.fog.smithi170:Waiting for deploy to finish 2024-03-07T11:45:21.213 INFO:teuthology.provision.fog.smithi196:Waiting for deploy to finish 2024-03-07T11:47:52.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-07T11:47:52.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-07T11:47:52.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-07T11:47:52.169 ERROR:teuthology.orchestra.connection:Error authenticating with smithi110.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-03-07T11:47:55.104 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2024-03-07T11:47:55.104 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-03-07T11:48:01.105 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-07T11:48:01.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-07T11:48:04.160 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2024-03-07T11:48:04.188 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-03-07T11:48:10.161 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-07T11:48:10.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-07T11:48:13.212 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2024-03-07T11:48:13.244 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-03-07T11:48:19.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-07T11:48:19.245 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-07T11:48:22.272 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2024-03-07T11:48:22.304 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-03-07T11:48:28.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-07T11:48:28.305 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-07T11:48:31.324 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2024-03-07T11:48:31.356 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-03-07T11:48:37.325 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-07T11:48:37.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-07T11:48:40.384 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2024-03-07T11:48:40.412 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-03-07T11:48:46.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-07T11:48:46.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-07T11:48:56.175 WARNING:teuthology.provision.fog.smithi110:timed out 2024-03-07T11:49:02.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-07T11:49:04.956 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-03-07T11:49:05.244 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-03-07T11:49:10.957 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-07T11:49:11.245 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-07T11:49:14.012 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-03-07T11:49:14.300 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-03-07T11:49:20.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-07T11:49:20.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-07T11:49:23.068 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-03-07T11:49:23.360 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-03-07T11:49:29.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-07T11:49:29.312 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-07T11:49:29.313 DEBUG:teuthology.orchestra.run.smithi196:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-07T11:49:29.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-07T11:49:32.416 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-03-07T11:49:38.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-07T11:49:38.690 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-07T11:49:38.690 DEBUG:teuthology.orchestra.run.smithi110:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-07T11:49:44.629 INFO:teuthology.provision.fog.smithi196:Node is ready 2024-03-07T11:49:44.629 DEBUG:teuthology.orchestra.run.smithi196:> hostname 2024-03-07T11:49:44.646 INFO:teuthology.orchestra.run.smithi196.stdout:smithi046 2024-03-07T11:49:44.647 DEBUG:teuthology.orchestra.run.smithi196:> grep smithi046 /etc/hosts 2024-03-07T11:49:44.705 INFO:teuthology.orchestra.run.smithi196.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2024-03-07T11:49:44.705 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname smithi196 2024-03-07T11:49:44.858 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/smithi046/smithi196/g' /etc/hosts 2024-03-07T11:49:44.890 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/172.21.15.46/172.21.15.196/g' /etc/hosts 2024-03-07T11:49:44.959 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/smithi046/smithi196/g' /etc/hostname 2024-03-07T11:49:45.029 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname smithi196 2024-03-07T11:49:45.098 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release 2024-03-07T11:49:45.154 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="CentOS Stream" 2024-03-07T11:49:45.154 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="9" 2024-03-07T11:49:45.154 INFO:teuthology.orchestra.run.smithi196.stdout:ID="centos" 2024-03-07T11:49:45.154 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="rhel fedora" 2024-03-07T11:49:45.154 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="9" 2024-03-07T11:49:45.154 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el9" 2024-03-07T11:49:45.155 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-07T11:49:45.155 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31" 2024-03-07T11:49:45.155 INFO:teuthology.orchestra.run.smithi196.stdout:LOGO="fedora-logo-icon" 2024-03-07T11:49:45.155 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-07T11:49:45.155 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://centos.org/" 2024-03-07T11:49:45.155 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-07T11:49:45.155 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-07T11:49:45.155 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-07T11:49:45.156 INFO:teuthology.provision.fog.smithi196:Deploy complete! 2024-03-07T11:49:45.157 DEBUG:teuthology.parallel:result is None 2024-03-07T11:49:46.387 WARNING:teuthology.provision.fog.smithi170:timed out 2024-03-07T11:49:52.389 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-07T11:49:52.657 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-07T11:49:52.658 DEBUG:teuthology.orchestra.run.smithi170:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-07T11:49:52.979 INFO:teuthology.provision.fog.smithi170:Node is ready 2024-03-07T11:49:52.980 DEBUG:teuthology.orchestra.run.smithi170:> hostname 2024-03-07T11:49:52.994 INFO:teuthology.orchestra.run.smithi170.stdout:smithi170.front.sepia.ceph.com 2024-03-07T11:49:52.995 DEBUG:teuthology.orchestra.run.smithi170:> grep smithi170.front.sepia.ceph.com /etc/hosts 2024-03-07T11:49:53.050 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170 smithi170.front.sepia.ceph.com smithi170 2024-03-07T11:49:53.050 DEBUG:teuthology.orchestra.run.smithi170:> sudo hostname smithi170 2024-03-07T11:49:53.154 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i -e 's/smithi170.front.sepia.ceph.com/smithi170/g' /etc/hosts 2024-03-07T11:49:53.182 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i -e 's/172.21.15.170/172.21.15.170/g' /etc/hosts 2024-03-07T11:49:53.250 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i -e 's/smithi170.front.sepia.ceph.com/smithi170/g' /etc/hostname 2024-03-07T11:49:53.318 DEBUG:teuthology.orchestra.run.smithi170:> sudo hostname smithi170 2024-03-07T11:49:53.385 DEBUG:teuthology.orchestra.run.smithi170:> cat /etc/os-release 2024-03-07T11:49:53.440 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="CentOS Stream" 2024-03-07T11:49:53.440 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="9" 2024-03-07T11:49:53.440 INFO:teuthology.orchestra.run.smithi170.stdout:ID="centos" 2024-03-07T11:49:53.440 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="rhel fedora" 2024-03-07T11:49:53.440 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="9" 2024-03-07T11:49:53.440 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el9" 2024-03-07T11:49:53.440 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-07T11:49:53.440 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31" 2024-03-07T11:49:53.441 INFO:teuthology.orchestra.run.smithi170.stdout:LOGO="fedora-logo-icon" 2024-03-07T11:49:53.441 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-07T11:49:53.441 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://centos.org/" 2024-03-07T11:49:53.441 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-07T11:49:53.441 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-07T11:49:53.441 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-07T11:49:53.441 INFO:teuthology.provision.fog.smithi170:Deploy complete! 2024-03-07T11:49:53.442 DEBUG:teuthology.parallel:result is None 2024-03-07T11:49:54.137 INFO:teuthology.provision.fog.smithi110:Node is ready 2024-03-07T11:49:54.137 DEBUG:teuthology.orchestra.run.smithi110:> hostname 2024-03-07T11:49:54.154 INFO:teuthology.orchestra.run.smithi110.stdout:smithi110.front.sepia.ceph.com 2024-03-07T11:49:54.154 DEBUG:teuthology.orchestra.run.smithi110:> grep smithi110.front.sepia.ceph.com /etc/hosts 2024-03-07T11:49:54.209 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110 smithi110.front.sepia.ceph.com smithi110 2024-03-07T11:49:54.210 DEBUG:teuthology.orchestra.run.smithi110:> sudo hostname smithi110 2024-03-07T11:49:54.324 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/smithi110.front.sepia.ceph.com/smithi110/g' /etc/hosts 2024-03-07T11:49:54.353 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/172.21.15.110/172.21.15.110/g' /etc/hosts 2024-03-07T11:49:54.420 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/smithi110.front.sepia.ceph.com/smithi110/g' /etc/hostname 2024-03-07T11:49:54.487 DEBUG:teuthology.orchestra.run.smithi110:> sudo hostname smithi110 2024-03-07T11:49:54.554 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2024-03-07T11:49:54.609 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="CentOS Stream" 2024-03-07T11:49:54.609 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="9" 2024-03-07T11:49:54.609 INFO:teuthology.orchestra.run.smithi110.stdout:ID="centos" 2024-03-07T11:49:54.609 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="rhel fedora" 2024-03-07T11:49:54.609 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="9" 2024-03-07T11:49:54.609 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el9" 2024-03-07T11:49:54.609 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-07T11:49:54.610 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31" 2024-03-07T11:49:54.610 INFO:teuthology.orchestra.run.smithi110.stdout:LOGO="fedora-logo-icon" 2024-03-07T11:49:54.610 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-07T11:49:54.610 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://centos.org/" 2024-03-07T11:49:54.610 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-07T11:49:54.610 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-07T11:49:54.610 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-07T11:49:54.610 INFO:teuthology.provision.fog.smithi110:Deploy complete! 2024-03-07T11:49:54.610 DEBUG:teuthology.parallel:result is None 2024-03-07T11:49:54.827 INFO:teuthology.lock.ops:Checking smithi110.front.sepia.ceph.com 2024-03-07T11:49:54.828 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-07T11:49:54.852 INFO:teuthology.lock.ops:Checking smithi170.front.sepia.ceph.com 2024-03-07T11:49:54.852 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-07T11:49:54.876 INFO:teuthology.lock.ops:Checking smithi196.front.sepia.ceph.com 2024-03-07T11:49:54.877 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-07T11:49:54.903 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: set os type and version on server 2024-03-07T11:49:54.903 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-03-07T11:49:54.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-07T11:49:55.034 DEBUG:teuthology.orchestra.run.smithi110:> true 2024-03-07T11:49:55.102 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-03-07T11:49:55.102 DEBUG:teuthology.orchestra.run.smithi110:> uname -m 2024-03-07T11:49:55.156 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64 2024-03-07T11:49:55.157 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2024-03-07T11:49:55.211 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="CentOS Stream" 2024-03-07T11:49:55.211 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="9" 2024-03-07T11:49:55.211 INFO:teuthology.orchestra.run.smithi110.stdout:ID="centos" 2024-03-07T11:49:55.211 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="rhel fedora" 2024-03-07T11:49:55.211 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="9" 2024-03-07T11:49:55.211 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el9" 2024-03-07T11:49:55.211 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-07T11:49:55.211 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31" 2024-03-07T11:49:55.211 INFO:teuthology.orchestra.run.smithi110.stdout:LOGO="fedora-logo-icon" 2024-03-07T11:49:55.211 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-07T11:49:55.211 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://centos.org/" 2024-03-07T11:49:55.211 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-07T11:49:55.212 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-07T11:49:55.212 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-07T11:49:55.212 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2024-03-07T11:49:55.235 INFO:teuthology.lock.ops:Updating [smithi170.front.sepia.ceph.com]: set os type and version on server 2024-03-07T11:49:55.235 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-03-07T11:49:55.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-07T11:49:55.326 DEBUG:teuthology.orchestra.run.smithi170:> true 2024-03-07T11:49:55.397 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-03-07T11:49:55.397 DEBUG:teuthology.orchestra.run.smithi170:> uname -m 2024-03-07T11:49:55.454 INFO:teuthology.orchestra.run.smithi170.stdout:x86_64 2024-03-07T11:49:55.454 DEBUG:teuthology.orchestra.run.smithi170:> cat /etc/os-release 2024-03-07T11:49:55.512 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="CentOS Stream" 2024-03-07T11:49:55.512 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="9" 2024-03-07T11:49:55.512 INFO:teuthology.orchestra.run.smithi170.stdout:ID="centos" 2024-03-07T11:49:55.512 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="rhel fedora" 2024-03-07T11:49:55.512 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="9" 2024-03-07T11:49:55.512 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el9" 2024-03-07T11:49:55.512 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-07T11:49:55.512 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31" 2024-03-07T11:49:55.512 INFO:teuthology.orchestra.run.smithi170.stdout:LOGO="fedora-logo-icon" 2024-03-07T11:49:55.513 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-07T11:49:55.513 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://centos.org/" 2024-03-07T11:49:55.513 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-07T11:49:55.513 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-07T11:49:55.513 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-07T11:49:55.513 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2024-03-07T11:49:55.535 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: set os type and version on server 2024-03-07T11:49:55.535 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-03-07T11:49:55.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-07T11:49:55.627 DEBUG:teuthology.orchestra.run.smithi196:> true 2024-03-07T11:49:55.798 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-03-07T11:49:55.798 DEBUG:teuthology.orchestra.run.smithi196:> uname -m 2024-03-07T11:49:55.854 INFO:teuthology.orchestra.run.smithi196.stdout:x86_64 2024-03-07T11:49:55.854 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release 2024-03-07T11:49:55.908 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="CentOS Stream" 2024-03-07T11:49:55.908 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="9" 2024-03-07T11:49:55.908 INFO:teuthology.orchestra.run.smithi196.stdout:ID="centos" 2024-03-07T11:49:55.908 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="rhel fedora" 2024-03-07T11:49:55.908 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="9" 2024-03-07T11:49:55.909 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el9" 2024-03-07T11:49:55.909 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-07T11:49:55.909 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31" 2024-03-07T11:49:55.909 INFO:teuthology.orchestra.run.smithi196.stdout:LOGO="fedora-logo-icon" 2024-03-07T11:49:55.909 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-07T11:49:55.909 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://centos.org/" 2024-03-07T11:49:55.909 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-07T11:49:55.909 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-07T11:49:55.909 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-07T11:49:55.909 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server 2024-03-07T11:49:55.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-07T11:49:56.027 INFO:teuthology.dispatcher.supervisor:Running job 7584360 2024-03-07T11:49:56.027 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-03-07_10:36:38-fs-wip-vshankar-testing-20240307.013758-testing-default-smithi/7584360 --name vshankar-2024-03-07_10:36:38-fs-wip-vshankar-testing-20240307.013758-testing-default-smithi --description fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down osd pg-warn} tasks/{0-client 1-tests/fscrypt-common}} -- /home/teuthworker/archive/vshankar-2024-03-07_10:36:38-fs-wip-vshankar-testing-20240307.013758-testing-default-smithi/7584360/orig.config.yaml 2024-03-07T11:49:56.030 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-03-07_10:36:38-fs-wip-vshankar-testing-20240307.013758-testing-default-smithi/7584360 2024-03-07T11:49:56.030 INFO:teuthology.dispatcher.supervisor:Job PID: 127316 2024-03-07T11:49:56.030 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-07T11:51:56.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-07T11:53:56.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-07T11:55:56.179 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-07T11:57:56.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-07T11:59:56.338 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-07T12:01:56.405 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-07T12:03:56.480 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-07T12:03:56.548 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1