2024-04-15T15:36:00.679 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-15T15:36:00.680 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T15:36:00.844 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fcffbec9c10>, signals=[15]) 2024-04-15T15:36:00.845 INFO:teuthology.lock.ops:Start node 'smithi055.front.sepia.ceph.com' reimaging 2024-04-15T15:36:00.845 INFO:teuthology.lock.ops:Updating [smithi055.front.sepia.ceph.com]: reset os type and version on server 2024-04-15T15:36:00.845 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2024-04-15T15:36:00.864 INFO:teuthology.lock.ops:Start node 'smithi110.front.sepia.ceph.com' reimaging 2024-04-15T15:36:00.864 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: reset os type and version on server 2024-04-15T15:36:00.864 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2024-04-15T15:36:00.888 INFO:teuthology.lock.ops:Start node 'smithi152.front.sepia.ceph.com' reimaging 2024-04-15T15:36:00.888 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: reset os type and version on server 2024-04-15T15:36:00.889 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2024-04-15T15:36:00.976 DEBUG:teuthology.provision.fog.smithi055:Requesting image smithi_centos_8.stream (ID 3) 2024-04-15T15:36:01.006 DEBUG:teuthology.provision.fog.smithi110:Requesting image smithi_centos_8.stream (ID 3) 2024-04-15T15:36:01.030 INFO:teuthology.provision.fog.smithi055:Scheduling deploy of centos 8.stream 2024-04-15T15:36:01.034 DEBUG:teuthology.provision.fog.smithi152:Requesting image smithi_centos_8.stream (ID 3) 2024-04-15T15:36:01.059 INFO:teuthology.provision.fog.smithi110:Scheduling deploy of centos 8.stream 2024-04-15T15:36:01.086 INFO:teuthology.provision.fog.smithi152:Scheduling deploy of centos 8.stream 2024-04-15T15:36:01.571 INFO:teuthology.orchestra.console.smithi110:Power off 2024-04-15T15:36:01.572 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-15T15:36:01.586 INFO:teuthology.orchestra.console.smithi055:Power off 2024-04-15T15:36:01.586 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-15T15:36:01.595 DEBUG:teuthology.orchestra.console.smithi110:power off output: Chassis Power Control: Down/Off 2024-04-15T15:36:01.596 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T15:36:01.609 DEBUG:teuthology.orchestra.console.smithi055:power off output: Chassis Power Control: Down/Off 2024-04-15T15:36:01.609 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T15:36:01.620 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off 2024-04-15T15:36:01.631 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is off 2024-04-15T15:36:01.672 INFO:teuthology.orchestra.console.smithi152:Power off 2024-04-15T15:36:01.672 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-15T15:36:01.697 DEBUG:teuthology.orchestra.console.smithi152:power off output: Chassis Power Control: Down/Off 2024-04-15T15:36:01.698 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T15:36:01.718 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2024-04-15T15:36:01.721 INFO:teuthology.orchestra.console.smithi110:Power off completed 2024-04-15T15:36:01.732 INFO:teuthology.orchestra.console.smithi055:Power off completed 2024-04-15T15:36:01.820 INFO:teuthology.orchestra.console.smithi152:Power off completed 2024-04-15T15:36:01.822 INFO:teuthology.orchestra.console.smithi110:Power on 2024-04-15T15:36:01.822 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-15T15:36:01.833 INFO:teuthology.orchestra.console.smithi055:Power on 2024-04-15T15:36:01.833 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-15T15:36:01.847 DEBUG:teuthology.orchestra.console.smithi110:power on output: Chassis Power Control: Up/On 2024-04-15T15:36:01.847 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T15:36:01.861 DEBUG:teuthology.orchestra.console.smithi055:power on output: Chassis Power Control: Up/On 2024-04-15T15:36:01.861 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T15:36:01.871 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off 2024-04-15T15:36:01.886 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is off 2024-04-15T15:36:01.921 INFO:teuthology.orchestra.console.smithi152:Power on 2024-04-15T15:36:01.921 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-15T15:36:01.945 DEBUG:teuthology.orchestra.console.smithi152:power on output: Chassis Power Control: Up/On 2024-04-15T15:36:01.946 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T15:36:01.967 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2024-04-15T15:36:05.874 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T15:36:05.887 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T15:36:05.968 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T15:36:05.984 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off 2024-04-15T15:36:05.995 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is on 2024-04-15T15:36:06.079 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2024-04-15T15:36:06.096 INFO:teuthology.orchestra.console.smithi055:Power on completed 2024-04-15T15:36:06.180 INFO:teuthology.orchestra.console.smithi152:Power on completed 2024-04-15T15:36:06.197 INFO:teuthology.provision.fog.smithi055:Waiting for deploy to finish 2024-04-15T15:36:06.282 INFO:teuthology.provision.fog.smithi152:Waiting for deploy to finish 2024-04-15T15:36:09.986 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T15:36:10.132 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on 2024-04-15T15:36:10.232 INFO:teuthology.orchestra.console.smithi110:Power on completed 2024-04-15T15:36:10.333 INFO:teuthology.provision.fog.smithi110:Waiting for deploy to finish 2024-04-15T15:38:38.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T15:38:41.182 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2024-04-15T15:38:47.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T15:38:50.238 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2024-04-15T15:38:56.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T15:38:59.294 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2024-04-15T15:39:05.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T15:39:08.350 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2024-04-15T15:39:14.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T15:39:17.406 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2024-04-15T15:39:23.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T15:39:23.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T15:39:26.655 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2024-04-15T15:39:32.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T15:39:35.742 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2024-04-15T15:39:41.745 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T15:39:41.982 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2024-04-15T15:39:42.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T15:39:44.798 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2024-04-15T15:39:45.982 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-04-15T15:39:47.985 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T15:39:50.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T15:39:51.038 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2024-04-15T15:39:51.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T15:39:53.854 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2024-04-15T15:39:55.038 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-04-15T15:39:57.041 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T15:39:59.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T15:40:00.011 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-15T15:40:00.011 DEBUG:teuthology.orchestra.run.smithi055:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-15T15:40:01.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T15:40:02.910 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2024-04-15T15:40:04.094 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-04-15T15:40:08.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T15:40:10.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T15:40:11.966 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2024-04-15T15:40:13.150 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-04-15T15:40:15.263 INFO:teuthology.provision.fog.smithi055:Node is ready 2024-04-15T15:40:15.263 DEBUG:teuthology.orchestra.run.smithi055:> hostname 2024-04-15T15:40:15.328 INFO:teuthology.orchestra.run.smithi055.stdout:smithi193 2024-04-15T15:40:15.328 DEBUG:teuthology.orchestra.run.smithi055:> grep smithi193 /etc/hosts 2024-04-15T15:40:15.389 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.193 smithi193.front.sepia.ceph.com smithi193 2024-04-15T15:40:15.390 DEBUG:teuthology.orchestra.run.smithi055:> sudo hostname smithi055 2024-04-15T15:40:15.532 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i -e 's/smithi193/smithi055/g' /etc/hosts 2024-04-15T15:40:15.564 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i -e 's/172.21.15.193/172.21.15.55/g' /etc/hosts 2024-04-15T15:40:15.635 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i -e 's/smithi193/smithi055/g' /etc/hostname 2024-04-15T15:40:15.706 DEBUG:teuthology.orchestra.run.smithi055:> sudo hostname smithi055 2024-04-15T15:40:15.779 DEBUG:teuthology.orchestra.run.smithi055:> cat /etc/os-release 2024-04-15T15:40:15.843 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="CentOS Stream" 2024-04-15T15:40:15.843 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="8" 2024-04-15T15:40:15.843 INFO:teuthology.orchestra.run.smithi055.stdout:ID="centos" 2024-04-15T15:40:15.843 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE="rhel fedora" 2024-04-15T15:40:15.843 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="8" 2024-04-15T15:40:15.844 INFO:teuthology.orchestra.run.smithi055.stdout:PLATFORM_ID="platform:el8" 2024-04-15T15:40:15.844 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-15T15:40:15.844 INFO:teuthology.orchestra.run.smithi055.stdout:ANSI_COLOR="0;31" 2024-04-15T15:40:15.844 INFO:teuthology.orchestra.run.smithi055.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-15T15:40:15.844 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://centos.org/" 2024-04-15T15:40:15.844 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-15T15:40:15.844 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-15T15:40:15.844 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-15T15:40:15.845 INFO:teuthology.provision.fog.smithi055:Deploy complete! 2024-04-15T15:40:15.846 DEBUG:teuthology.parallel:result is None 2024-04-15T15:40:17.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T15:40:19.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T15:40:21.022 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2024-04-15T15:40:22.206 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-04-15T15:40:27.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T15:40:28.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T15:41:27.083 WARNING:teuthology.provision.fog.smithi152:timed out 2024-04-15T15:41:28.213 WARNING:teuthology.provision.fog.smithi110:timed out 2024-04-15T15:41:33.087 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T15:41:33.370 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-15T15:41:33.370 DEBUG:teuthology.orchestra.run.smithi152:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-15T15:41:33.677 INFO:teuthology.provision.fog.smithi152:Node is ready 2024-04-15T15:41:33.677 DEBUG:teuthology.orchestra.run.smithi152:> hostname 2024-04-15T15:41:33.697 INFO:teuthology.orchestra.run.smithi152.stdout:smithi152.front.sepia.ceph.com 2024-04-15T15:41:33.697 DEBUG:teuthology.orchestra.run.smithi152:> grep smithi152.front.sepia.ceph.com /etc/hosts 2024-04-15T15:41:33.757 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152 smithi152.front.sepia.ceph.com smithi152 2024-04-15T15:41:33.757 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname smithi152 2024-04-15T15:41:33.873 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/smithi152.front.sepia.ceph.com/smithi152/g' /etc/hosts 2024-04-15T15:41:33.906 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/172.21.15.152/172.21.15.152/g' /etc/hosts 2024-04-15T15:41:33.977 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/smithi152.front.sepia.ceph.com/smithi152/g' /etc/hostname 2024-04-15T15:41:34.046 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname smithi152 2024-04-15T15:41:34.114 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2024-04-15T15:41:34.172 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="CentOS Stream" 2024-04-15T15:41:34.172 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="8" 2024-04-15T15:41:34.173 INFO:teuthology.orchestra.run.smithi152.stdout:ID="centos" 2024-04-15T15:41:34.173 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="rhel fedora" 2024-04-15T15:41:34.173 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="8" 2024-04-15T15:41:34.173 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el8" 2024-04-15T15:41:34.173 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-15T15:41:34.173 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2024-04-15T15:41:34.173 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-15T15:41:34.173 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://centos.org/" 2024-04-15T15:41:34.173 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-15T15:41:34.173 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-15T15:41:34.173 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-15T15:41:34.173 INFO:teuthology.provision.fog.smithi152:Deploy complete! 2024-04-15T15:41:34.174 DEBUG:teuthology.parallel:result is None 2024-04-15T15:41:34.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T15:41:34.532 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-15T15:41:34.532 DEBUG:teuthology.orchestra.run.smithi110:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-15T15:41:34.784 INFO:teuthology.provision.fog.smithi110:Node is ready 2024-04-15T15:41:34.784 DEBUG:teuthology.orchestra.run.smithi110:> hostname 2024-04-15T15:41:34.803 INFO:teuthology.orchestra.run.smithi110.stdout:smithi110.front.sepia.ceph.com 2024-04-15T15:41:34.803 DEBUG:teuthology.orchestra.run.smithi110:> grep smithi110.front.sepia.ceph.com /etc/hosts 2024-04-15T15:41:34.863 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110 smithi110.front.sepia.ceph.com smithi110 2024-04-15T15:41:34.864 DEBUG:teuthology.orchestra.run.smithi110:> sudo hostname smithi110 2024-04-15T15:41:34.959 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/smithi110.front.sepia.ceph.com/smithi110/g' /etc/hosts 2024-04-15T15:41:34.989 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/172.21.15.110/172.21.15.110/g' /etc/hosts 2024-04-15T15:41:35.058 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/smithi110.front.sepia.ceph.com/smithi110/g' /etc/hostname 2024-04-15T15:41:35.128 DEBUG:teuthology.orchestra.run.smithi110:> sudo hostname smithi110 2024-04-15T15:41:35.196 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2024-04-15T15:41:35.254 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="CentOS Stream" 2024-04-15T15:41:35.254 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="8" 2024-04-15T15:41:35.254 INFO:teuthology.orchestra.run.smithi110.stdout:ID="centos" 2024-04-15T15:41:35.254 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="rhel fedora" 2024-04-15T15:41:35.254 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="8" 2024-04-15T15:41:35.254 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el8" 2024-04-15T15:41:35.255 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-15T15:41:35.255 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31" 2024-04-15T15:41:35.255 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-15T15:41:35.255 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://centos.org/" 2024-04-15T15:41:35.255 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-15T15:41:35.255 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-15T15:41:35.255 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-15T15:41:35.255 INFO:teuthology.provision.fog.smithi110:Deploy complete! 2024-04-15T15:41:35.256 DEBUG:teuthology.parallel:result is None 2024-04-15T15:41:35.445 INFO:teuthology.lock.ops:Checking smithi055.front.sepia.ceph.com 2024-04-15T15:41:35.445 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-15T15:41:35.485 INFO:teuthology.lock.ops:Checking smithi110.front.sepia.ceph.com 2024-04-15T15:41:35.485 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-15T15:41:35.508 INFO:teuthology.lock.ops:Checking smithi152.front.sepia.ceph.com 2024-04-15T15:41:35.508 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-15T15:41:35.526 INFO:teuthology.lock.ops:Updating [smithi055.front.sepia.ceph.com]: set os type and version on server 2024-04-15T15:41:35.526 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2024-04-15T15:41:35.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T15:41:35.599 DEBUG:teuthology.orchestra.run.smithi055:> true 2024-04-15T15:41:35.746 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi055.front.sepia.ceph.com' 2024-04-15T15:41:35.746 DEBUG:teuthology.orchestra.run.smithi055:> uname -m 2024-04-15T15:41:35.805 INFO:teuthology.orchestra.run.smithi055.stdout:x86_64 2024-04-15T15:41:35.806 DEBUG:teuthology.orchestra.run.smithi055:> cat /etc/os-release 2024-04-15T15:41:35.864 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="CentOS Stream" 2024-04-15T15:41:35.865 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="8" 2024-04-15T15:41:35.865 INFO:teuthology.orchestra.run.smithi055.stdout:ID="centos" 2024-04-15T15:41:35.865 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE="rhel fedora" 2024-04-15T15:41:35.865 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="8" 2024-04-15T15:41:35.865 INFO:teuthology.orchestra.run.smithi055.stdout:PLATFORM_ID="platform:el8" 2024-04-15T15:41:35.865 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-15T15:41:35.865 INFO:teuthology.orchestra.run.smithi055.stdout:ANSI_COLOR="0;31" 2024-04-15T15:41:35.865 INFO:teuthology.orchestra.run.smithi055.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-15T15:41:35.865 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://centos.org/" 2024-04-15T15:41:35.865 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-15T15:41:35.865 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-15T15:41:35.865 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-15T15:41:35.866 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2024-04-15T15:41:35.892 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: set os type and version on server 2024-04-15T15:41:35.892 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-04-15T15:41:35.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T15:41:35.961 DEBUG:teuthology.orchestra.run.smithi110:> true 2024-04-15T15:41:36.028 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-04-15T15:41:36.028 DEBUG:teuthology.orchestra.run.smithi110:> uname -m 2024-04-15T15:41:36.086 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64 2024-04-15T15:41:36.086 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2024-04-15T15:41:36.144 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="CentOS Stream" 2024-04-15T15:41:36.144 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="8" 2024-04-15T15:41:36.144 INFO:teuthology.orchestra.run.smithi110.stdout:ID="centos" 2024-04-15T15:41:36.144 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="rhel fedora" 2024-04-15T15:41:36.144 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="8" 2024-04-15T15:41:36.144 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el8" 2024-04-15T15:41:36.144 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-15T15:41:36.144 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31" 2024-04-15T15:41:36.144 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-15T15:41:36.144 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://centos.org/" 2024-04-15T15:41:36.144 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-15T15:41:36.144 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-15T15:41:36.145 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-15T15:41:36.145 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2024-04-15T15:41:36.167 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: set os type and version on server 2024-04-15T15:41:36.167 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-04-15T15:41:36.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T15:41:36.238 DEBUG:teuthology.orchestra.run.smithi152:> true 2024-04-15T15:41:36.312 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-04-15T15:41:36.312 DEBUG:teuthology.orchestra.run.smithi152:> uname -m 2024-04-15T15:41:36.373 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64 2024-04-15T15:41:36.374 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2024-04-15T15:41:36.433 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="CentOS Stream" 2024-04-15T15:41:36.433 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="8" 2024-04-15T15:41:36.433 INFO:teuthology.orchestra.run.smithi152.stdout:ID="centos" 2024-04-15T15:41:36.433 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="rhel fedora" 2024-04-15T15:41:36.434 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="8" 2024-04-15T15:41:36.434 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el8" 2024-04-15T15:41:36.434 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-15T15:41:36.434 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2024-04-15T15:41:36.434 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-15T15:41:36.434 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://centos.org/" 2024-04-15T15:41:36.434 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-15T15:41:36.434 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-15T15:41:36.434 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-15T15:41:36.435 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2024-04-15T15:41:36.459 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T15:41:36.538 INFO:teuthology.dispatcher.supervisor:Running job 7655904 2024-04-15T15:41:36.538 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-14_20:00:15-rados-main-distro-default-smithi/7655904 --name teuthology-2024-04-14_20:00:15-rados-main-distro-default-smithi --description rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/snaps-few-objects} -- /home/teuthworker/archive/teuthology-2024-04-14_20:00:15-rados-main-distro-default-smithi/7655904/orig.config.yaml 2024-04-15T15:41:36.542 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-04-14_20:00:15-rados-main-distro-default-smithi/7655904 2024-04-15T15:41:36.542 INFO:teuthology.dispatcher.supervisor:Job PID: 3355591 2024-04-15T15:41:36.542 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-15T15:43:36.643 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T15:45:36.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T15:47:36.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T15:49:37.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T15:51:37.576 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T15:53:37.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T15:55:37.923 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T15:57:38.098 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T15:59:38.240 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T16:01:38.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T16:03:38.578 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T16:05:38.760 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T16:07:38.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T16:09:39.105 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T16:11:39.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T16:13:39.451 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T16:15:39.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T16:17:39.813 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T16:19:39.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T16:21:40.157 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T16:23:40.342 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T16:25:40.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T16:27:40.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T16:27:40.759 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1