2024-03-17T09:56:00.233 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-17T09:56:00.234 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T09:56:00.416 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2224347c10>, signals=[15]) 2024-03-17T09:56:00.417 INFO:teuthology.lock.ops:Start node 'smithi001.front.sepia.ceph.com' reimaging 2024-03-17T09:56:00.417 INFO:teuthology.lock.ops:Updating [smithi001.front.sepia.ceph.com]: reset os type and version on server 2024-03-17T09:56:00.417 INFO:teuthology.lock.ops:Updating smithi001.front.sepia.ceph.com on lock server 2024-03-17T09:56:00.436 INFO:teuthology.lock.ops:Start node 'smithi082.front.sepia.ceph.com' reimaging 2024-03-17T09:56:00.436 INFO:teuthology.lock.ops:Updating [smithi082.front.sepia.ceph.com]: reset os type and version on server 2024-03-17T09:56:00.436 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2024-03-17T09:56:00.461 INFO:teuthology.lock.ops:Start node 'smithi149.front.sepia.ceph.com' reimaging 2024-03-17T09:56:00.461 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: reset os type and version on server 2024-03-17T09:56:00.461 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2024-03-17T09:56:00.555 DEBUG:teuthology.provision.fog.smithi001:Requesting image smithi_centos_8.stream (ID 3) 2024-03-17T09:56:00.573 DEBUG:teuthology.provision.fog.smithi082:Requesting image smithi_centos_8.stream (ID 3) 2024-03-17T09:56:00.593 DEBUG:teuthology.provision.fog.smithi149:Requesting image smithi_centos_8.stream (ID 3) 2024-03-17T09:56:00.603 INFO:teuthology.provision.fog.smithi001:Scheduling deploy of centos 8.stream 2024-03-17T09:56:00.610 INFO:teuthology.provision.fog.smithi082:Scheduling deploy of centos 8.stream 2024-03-17T09:56:00.639 INFO:teuthology.provision.fog.smithi149:Scheduling deploy of centos 8.stream 2024-03-17T09:56:00.827 INFO:teuthology.orchestra.console.smithi082:Power off 2024-03-17T09:56:00.827 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-17T09:56:00.841 INFO:teuthology.orchestra.console.smithi001:Power off 2024-03-17T09:56:00.841 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-17T09:56:00.854 DEBUG:teuthology.orchestra.console.smithi082:power off output: Chassis Power Control: Down/Off 2024-03-17T09:56:00.854 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-17T09:56:00.863 DEBUG:teuthology.orchestra.console.smithi001:power off output: Chassis Power Control: Down/Off 2024-03-17T09:56:00.863 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-17T09:56:00.881 INFO:teuthology.orchestra.console.smithi149:Power off 2024-03-17T09:56:00.881 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-17T09:56:00.888 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is on 2024-03-17T09:56:00.889 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is on 2024-03-17T09:56:00.902 DEBUG:teuthology.orchestra.console.smithi149:power off output: Chassis Power Control: Down/Off 2024-03-17T09:56:00.902 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-17T09:56:00.924 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on 2024-03-17T09:56:04.893 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-17T09:56:04.900 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-17T09:56:04.925 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-17T09:56:05.002 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is on 2024-03-17T09:56:05.009 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is on 2024-03-17T09:56:05.035 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on 2024-03-17T09:56:09.006 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-17T09:56:09.014 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-17T09:56:09.036 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-17T09:56:09.116 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is on 2024-03-17T09:56:09.122 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is off 2024-03-17T09:56:09.146 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on 2024-03-17T09:56:09.223 INFO:teuthology.orchestra.console.smithi001:Power off completed 2024-03-17T09:56:09.324 INFO:teuthology.orchestra.console.smithi001:Power on 2024-03-17T09:56:09.324 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-17T09:56:09.346 DEBUG:teuthology.orchestra.console.smithi001:power on output: Chassis Power Control: Up/On 2024-03-17T09:56:09.346 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-17T09:56:09.369 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is off 2024-03-17T09:56:13.121 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-17T09:56:13.146 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-17T09:56:13.230 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is off 2024-03-17T09:56:13.255 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off 2024-03-17T09:56:13.332 INFO:teuthology.orchestra.console.smithi082:Power off completed 2024-03-17T09:56:13.356 INFO:teuthology.orchestra.console.smithi149:Power off completed 2024-03-17T09:56:13.370 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-17T09:56:13.433 INFO:teuthology.orchestra.console.smithi082:Power on 2024-03-17T09:56:13.433 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-17T09:56:13.454 DEBUG:teuthology.orchestra.console.smithi082:power on output: Chassis Power Control: Up/On 2024-03-17T09:56:13.455 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-17T09:56:13.462 INFO:teuthology.orchestra.console.smithi149:Power on 2024-03-17T09:56:13.463 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-17T09:56:13.477 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is off 2024-03-17T09:56:13.479 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is off 2024-03-17T09:56:13.482 DEBUG:teuthology.orchestra.console.smithi149:power on output: Chassis Power Control: Up/On 2024-03-17T09:56:13.482 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-17T09:56:13.504 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off 2024-03-17T09:56:17.479 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-17T09:56:17.486 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-17T09:56:17.505 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-17T09:56:17.589 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is off 2024-03-17T09:56:17.594 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is on 2024-03-17T09:56:17.614 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off 2024-03-17T09:56:17.696 INFO:teuthology.orchestra.console.smithi001:Power on completed 2024-03-17T09:56:17.796 INFO:teuthology.provision.fog.smithi001:Waiting for deploy to finish 2024-03-17T09:56:21.594 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-17T09:56:21.615 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-17T09:56:21.703 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is on 2024-03-17T09:56:21.723 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on 2024-03-17T09:56:21.805 INFO:teuthology.orchestra.console.smithi082:Power on completed 2024-03-17T09:56:21.824 INFO:teuthology.orchestra.console.smithi149:Power on completed 2024-03-17T09:56:21.906 INFO:teuthology.provision.fog.smithi082:Waiting for deploy to finish 2024-03-17T09:56:21.925 INFO:teuthology.provision.fog.smithi149:Waiting for deploy to finish 2024-03-17T09:58:48.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T09:58:52.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T09:59:07.039 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1 2024-03-17T09:59:07.639 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T09:59:11.134 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-03-17T09:59:13.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T09:59:16.094 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1 2024-03-17T09:59:17.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T09:59:20.190 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-03-17T09:59:22.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T09:59:25.150 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1 2024-03-17T09:59:25.982 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-03-17T09:59:26.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T09:59:29.246 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-03-17T09:59:31.153 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T09:59:31.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T09:59:35.038 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-03-17T09:59:35.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T09:59:38.302 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-03-17T09:59:41.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T09:59:44.094 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-03-17T09:59:44.303 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T09:59:47.358 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-03-17T09:59:50.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T09:59:53.150 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-03-17T09:59:53.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T09:59:59.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T10:00:02.206 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-03-17T10:00:08.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T10:00:31.178 WARNING:teuthology.provision.fog.smithi001:timed out 2024-03-17T10:00:37.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T10:00:37.455 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-17T10:00:37.455 DEBUG:teuthology.orchestra.run.smithi001:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-17T10:00:37.719 INFO:teuthology.provision.fog.smithi001:Node is ready 2024-03-17T10:00:37.720 DEBUG:teuthology.orchestra.run.smithi001:> hostname 2024-03-17T10:00:37.742 INFO:teuthology.orchestra.run.smithi001.stdout:smithi001.front.sepia.ceph.com 2024-03-17T10:00:37.742 DEBUG:teuthology.orchestra.run.smithi001:> grep smithi001.front.sepia.ceph.com /etc/hosts 2024-03-17T10:00:37.807 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1 smithi001.front.sepia.ceph.com smithi001 2024-03-17T10:00:37.807 DEBUG:teuthology.orchestra.run.smithi001:> sudo hostname smithi001 2024-03-17T10:00:37.939 DEBUG:teuthology.orchestra.run.smithi001:> sudo sed -i -e 's/smithi001.front.sepia.ceph.com/smithi001/g' /etc/hosts 2024-03-17T10:00:37.974 DEBUG:teuthology.orchestra.run.smithi001:> sudo sed -i -e 's/172.21.15.1/172.21.15.1/g' /etc/hosts 2024-03-17T10:00:38.047 DEBUG:teuthology.orchestra.run.smithi001:> sudo sed -i -e 's/smithi001.front.sepia.ceph.com/smithi001/g' /etc/hostname 2024-03-17T10:00:38.118 DEBUG:teuthology.orchestra.run.smithi001:> sudo hostname smithi001 2024-03-17T10:00:38.190 DEBUG:teuthology.orchestra.run.smithi001:> cat /etc/os-release 2024-03-17T10:00:38.249 INFO:teuthology.orchestra.run.smithi001.stdout:NAME="CentOS Stream" 2024-03-17T10:00:38.249 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION="8" 2024-03-17T10:00:38.249 INFO:teuthology.orchestra.run.smithi001.stdout:ID="centos" 2024-03-17T10:00:38.249 INFO:teuthology.orchestra.run.smithi001.stdout:ID_LIKE="rhel fedora" 2024-03-17T10:00:38.250 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION_ID="8" 2024-03-17T10:00:38.250 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM_ID="platform:el8" 2024-03-17T10:00:38.250 INFO:teuthology.orchestra.run.smithi001.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-17T10:00:38.250 INFO:teuthology.orchestra.run.smithi001.stdout:ANSI_COLOR="0;31" 2024-03-17T10:00:38.250 INFO:teuthology.orchestra.run.smithi001.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-17T10:00:38.250 INFO:teuthology.orchestra.run.smithi001.stdout:HOME_URL="https://centos.org/" 2024-03-17T10:00:38.250 INFO:teuthology.orchestra.run.smithi001.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-17T10:00:38.250 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-17T10:00:38.250 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-17T10:00:38.251 INFO:teuthology.provision.fog.smithi001:Deploy complete! 2024-03-17T10:00:38.252 DEBUG:teuthology.parallel:result is None 2024-03-17T10:00:39.963 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-17T10:00:39.964 DEBUG:teuthology.orchestra.run.smithi149:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-17T10:00:53.361 WARNING:teuthology.provision.fog.smithi082:timed out 2024-03-17T10:00:59.363 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T10:00:59.665 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-17T10:00:59.665 DEBUG:teuthology.orchestra.run.smithi082:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-17T10:00:59.934 INFO:teuthology.provision.fog.smithi082:Node is ready 2024-03-17T10:00:59.934 DEBUG:teuthology.orchestra.run.smithi082:> hostname 2024-03-17T10:00:59.954 INFO:teuthology.orchestra.run.smithi082.stdout:smithi082.front.sepia.ceph.com 2024-03-17T10:00:59.954 DEBUG:teuthology.orchestra.run.smithi082:> grep smithi082.front.sepia.ceph.com /etc/hosts 2024-03-17T10:01:00.014 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82 smithi082.front.sepia.ceph.com smithi082 2024-03-17T10:01:00.014 DEBUG:teuthology.orchestra.run.smithi082:> sudo hostname smithi082 2024-03-17T10:01:00.104 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i -e 's/smithi082.front.sepia.ceph.com/smithi082/g' /etc/hosts 2024-03-17T10:01:00.134 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i -e 's/172.21.15.82/172.21.15.82/g' /etc/hosts 2024-03-17T10:01:00.203 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i -e 's/smithi082.front.sepia.ceph.com/smithi082/g' /etc/hostname 2024-03-17T10:01:00.272 DEBUG:teuthology.orchestra.run.smithi082:> sudo hostname smithi082 2024-03-17T10:01:00.340 DEBUG:teuthology.orchestra.run.smithi082:> cat /etc/os-release 2024-03-17T10:01:00.399 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="CentOS Stream" 2024-03-17T10:01:00.399 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="8" 2024-03-17T10:01:00.399 INFO:teuthology.orchestra.run.smithi082.stdout:ID="centos" 2024-03-17T10:01:00.399 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE="rhel fedora" 2024-03-17T10:01:00.399 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="8" 2024-03-17T10:01:00.399 INFO:teuthology.orchestra.run.smithi082.stdout:PLATFORM_ID="platform:el8" 2024-03-17T10:01:00.399 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-17T10:01:00.399 INFO:teuthology.orchestra.run.smithi082.stdout:ANSI_COLOR="0;31" 2024-03-17T10:01:00.399 INFO:teuthology.orchestra.run.smithi082.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-17T10:01:00.399 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://centos.org/" 2024-03-17T10:01:00.400 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-17T10:01:00.400 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-17T10:01:00.400 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-17T10:01:00.400 INFO:teuthology.provision.fog.smithi082:Deploy complete! 2024-03-17T10:01:00.400 DEBUG:teuthology.parallel:result is None 2024-03-17T10:01:05.377 INFO:teuthology.provision.fog.smithi149:Node is ready 2024-03-17T10:01:05.377 DEBUG:teuthology.orchestra.run.smithi149:> hostname 2024-03-17T10:01:05.400 INFO:teuthology.orchestra.run.smithi149.stdout:smithi149.front.sepia.ceph.com 2024-03-17T10:01:05.401 DEBUG:teuthology.orchestra.run.smithi149:> grep smithi149.front.sepia.ceph.com /etc/hosts 2024-03-17T10:01:05.460 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.15.149 smithi149.front.sepia.ceph.com smithi149 2024-03-17T10:01:05.460 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname smithi149 2024-03-17T10:01:05.588 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/smithi149.front.sepia.ceph.com/smithi149/g' /etc/hosts 2024-03-17T10:01:05.619 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/172.21.15.149/172.21.15.149/g' /etc/hosts 2024-03-17T10:01:05.689 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/smithi149.front.sepia.ceph.com/smithi149/g' /etc/hostname 2024-03-17T10:01:05.758 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname smithi149 2024-03-17T10:01:05.826 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2024-03-17T10:01:05.885 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="CentOS Stream" 2024-03-17T10:01:05.885 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="8" 2024-03-17T10:01:05.885 INFO:teuthology.orchestra.run.smithi149.stdout:ID="centos" 2024-03-17T10:01:05.885 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="rhel fedora" 2024-03-17T10:01:05.886 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="8" 2024-03-17T10:01:05.886 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el8" 2024-03-17T10:01:05.886 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-17T10:01:05.886 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31" 2024-03-17T10:01:05.886 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-17T10:01:05.886 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://centos.org/" 2024-03-17T10:01:05.886 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-17T10:01:05.886 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-17T10:01:05.886 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-17T10:01:05.886 INFO:teuthology.provision.fog.smithi149:Deploy complete! 2024-03-17T10:01:05.887 DEBUG:teuthology.parallel:result is None 2024-03-17T10:01:06.093 INFO:teuthology.lock.ops:Checking smithi001.front.sepia.ceph.com 2024-03-17T10:01:06.093 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-17T10:01:06.131 INFO:teuthology.lock.ops:Checking smithi082.front.sepia.ceph.com 2024-03-17T10:01:06.131 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-17T10:01:06.155 INFO:teuthology.lock.ops:Checking smithi149.front.sepia.ceph.com 2024-03-17T10:01:06.155 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-17T10:01:06.172 INFO:teuthology.lock.ops:Updating [smithi001.front.sepia.ceph.com]: set os type and version on server 2024-03-17T10:01:06.173 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-03-17T10:01:06.173 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T10:01:06.247 DEBUG:teuthology.orchestra.run.smithi001:> true 2024-03-17T10:01:06.385 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-03-17T10:01:06.386 DEBUG:teuthology.orchestra.run.smithi001:> uname -m 2024-03-17T10:01:06.446 INFO:teuthology.orchestra.run.smithi001.stdout:x86_64 2024-03-17T10:01:06.447 DEBUG:teuthology.orchestra.run.smithi001:> cat /etc/os-release 2024-03-17T10:01:06.505 INFO:teuthology.orchestra.run.smithi001.stdout:NAME="CentOS Stream" 2024-03-17T10:01:06.505 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION="8" 2024-03-17T10:01:06.505 INFO:teuthology.orchestra.run.smithi001.stdout:ID="centos" 2024-03-17T10:01:06.505 INFO:teuthology.orchestra.run.smithi001.stdout:ID_LIKE="rhel fedora" 2024-03-17T10:01:06.505 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION_ID="8" 2024-03-17T10:01:06.505 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM_ID="platform:el8" 2024-03-17T10:01:06.506 INFO:teuthology.orchestra.run.smithi001.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-17T10:01:06.506 INFO:teuthology.orchestra.run.smithi001.stdout:ANSI_COLOR="0;31" 2024-03-17T10:01:06.506 INFO:teuthology.orchestra.run.smithi001.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-17T10:01:06.506 INFO:teuthology.orchestra.run.smithi001.stdout:HOME_URL="https://centos.org/" 2024-03-17T10:01:06.506 INFO:teuthology.orchestra.run.smithi001.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-17T10:01:06.506 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-17T10:01:06.506 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-17T10:01:06.507 INFO:teuthology.lock.ops:Updating smithi001.front.sepia.ceph.com on lock server 2024-03-17T10:01:06.531 INFO:teuthology.lock.ops:Updating [smithi082.front.sepia.ceph.com]: set os type and version on server 2024-03-17T10:01:06.531 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-03-17T10:01:06.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T10:01:06.602 DEBUG:teuthology.orchestra.run.smithi082:> true 2024-03-17T10:01:06.676 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-03-17T10:01:06.676 DEBUG:teuthology.orchestra.run.smithi082:> uname -m 2024-03-17T10:01:06.737 INFO:teuthology.orchestra.run.smithi082.stdout:x86_64 2024-03-17T10:01:06.737 DEBUG:teuthology.orchestra.run.smithi082:> cat /etc/os-release 2024-03-17T10:01:06.798 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="CentOS Stream" 2024-03-17T10:01:06.798 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="8" 2024-03-17T10:01:06.799 INFO:teuthology.orchestra.run.smithi082.stdout:ID="centos" 2024-03-17T10:01:06.799 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE="rhel fedora" 2024-03-17T10:01:06.799 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="8" 2024-03-17T10:01:06.799 INFO:teuthology.orchestra.run.smithi082.stdout:PLATFORM_ID="platform:el8" 2024-03-17T10:01:06.799 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-17T10:01:06.799 INFO:teuthology.orchestra.run.smithi082.stdout:ANSI_COLOR="0;31" 2024-03-17T10:01:06.799 INFO:teuthology.orchestra.run.smithi082.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-17T10:01:06.799 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://centos.org/" 2024-03-17T10:01:06.799 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-17T10:01:06.799 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-17T10:01:06.799 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-17T10:01:06.800 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2024-03-17T10:01:06.822 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: set os type and version on server 2024-03-17T10:01:06.823 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-03-17T10:01:06.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T10:01:06.895 DEBUG:teuthology.orchestra.run.smithi149:> true 2024-03-17T10:01:06.971 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-03-17T10:01:06.971 DEBUG:teuthology.orchestra.run.smithi149:> uname -m 2024-03-17T10:01:07.031 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64 2024-03-17T10:01:07.032 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2024-03-17T10:01:07.091 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="CentOS Stream" 2024-03-17T10:01:07.091 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="8" 2024-03-17T10:01:07.091 INFO:teuthology.orchestra.run.smithi149.stdout:ID="centos" 2024-03-17T10:01:07.091 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="rhel fedora" 2024-03-17T10:01:07.091 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="8" 2024-03-17T10:01:07.091 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el8" 2024-03-17T10:01:07.091 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-17T10:01:07.091 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31" 2024-03-17T10:01:07.091 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-17T10:01:07.092 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://centos.org/" 2024-03-17T10:01:07.092 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-17T10:01:07.092 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-17T10:01:07.092 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-17T10:01:07.092 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2024-03-17T10:01:07.122 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:01:07.222 INFO:teuthology.dispatcher.supervisor:Running job 7599333 2024-03-17T10:01:07.222 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-03-13_21:24:03-fs-squid-distro-default-smithi/7599333 --name teuthology-2024-03-13_21:24:03-fs-squid-distro-default-smithi --description fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} -- /home/teuthworker/archive/teuthology-2024-03-13_21:24:03-fs-squid-distro-default-smithi/7599333/orig.config.yaml 2024-03-17T10:01:07.225 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-03-13_21:24:03-fs-squid-distro-default-smithi/7599333 2024-03-17T10:01:07.225 INFO:teuthology.dispatcher.supervisor:Job PID: 2359614 2024-03-17T10:01:07.225 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-17T10:03:07.323 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:05:07.517 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:07:07.680 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:09:07.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:11:07.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:13:08.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:15:08.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:17:08.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:19:08.650 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:21:08.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:23:08.950 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:25:09.119 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:27:09.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:29:09.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:31:09.629 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:33:09.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:35:09.922 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:37:10.108 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:39:10.274 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:41:10.419 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:43:10.599 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:45:10.733 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:47:10.930 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:49:11.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:51:11.342 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:53:11.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:55:11.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:57:11.870 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:59:12.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T11:01:12.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T11:03:12.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T11:05:12.528 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T11:07:12.693 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T11:09:12.858 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T11:11:13.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T11:13:13.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T11:15:13.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T11:17:13.530 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T11:19:13.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T11:19:13.756 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-03-17T11:19:13.969 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi001 but it was locked by another job: /home/teuthworker/archive/teuthology-2024-03-13_21:48:02-krbd-squid-testing-default-smithi/7599383 2024-03-17T11:19:13.969 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi149 but it was locked by another job: /home/teuthworker/archive/teuthology-2024-03-13_21:48:02-krbd-squid-testing-default-smithi/7599382