2024-02-08T10:01:47.821 INFO:root:teuthology version: 0.0.1.dev256+gd9fdb22 2024-02-08T10:01:47.822 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-08T10:01:48.009 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fcb6e0c4c10>, signals=[15]) 2024-02-08T10:01:48.009 INFO:teuthology.lock.ops:Start node 'smithi103.front.sepia.ceph.com' reimaging 2024-02-08T10:01:48.010 INFO:teuthology.lock.ops:Updating [smithi103.front.sepia.ceph.com]: reset os type and version on server 2024-02-08T10:01:48.010 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2024-02-08T10:01:48.030 INFO:teuthology.lock.ops:Start node 'smithi113.front.sepia.ceph.com' reimaging 2024-02-08T10:01:48.031 INFO:teuthology.lock.ops:Updating [smithi113.front.sepia.ceph.com]: reset os type and version on server 2024-02-08T10:01:48.031 INFO:teuthology.lock.ops:Updating smithi113.front.sepia.ceph.com on lock server 2024-02-08T10:01:48.055 INFO:teuthology.lock.ops:Start node 'smithi158.front.sepia.ceph.com' reimaging 2024-02-08T10:01:48.056 INFO:teuthology.lock.ops:Updating [smithi158.front.sepia.ceph.com]: reset os type and version on server 2024-02-08T10:01:48.056 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server 2024-02-08T10:01:48.151 DEBUG:teuthology.provision.fog.smithi103:Requesting image smithi_centos_8.stream (ID 3) 2024-02-08T10:01:48.173 DEBUG:teuthology.provision.fog.smithi113:Requesting image smithi_centos_8.stream (ID 3) 2024-02-08T10:01:48.197 INFO:teuthology.provision.fog.smithi103:Scheduling deploy of centos 8.stream 2024-02-08T10:01:48.213 DEBUG:teuthology.provision.fog.smithi158:Requesting image smithi_centos_8.stream (ID 3) 2024-02-08T10:01:48.227 INFO:teuthology.provision.fog.smithi113:Scheduling deploy of centos 8.stream 2024-02-08T10:01:48.265 INFO:teuthology.provision.fog.smithi158:Scheduling deploy of centos 8.stream 2024-02-08T10:01:48.666 INFO:teuthology.orchestra.console.smithi113:Power off 2024-02-08T10:01:48.666 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-08T10:01:48.681 INFO:teuthology.orchestra.console.smithi103:Power off 2024-02-08T10:01:48.682 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-08T10:01:48.692 DEBUG:teuthology.orchestra.console.smithi113:power off output: Chassis Power Control: Down/Off 2024-02-08T10:01:48.692 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-08T10:01:48.705 DEBUG:teuthology.orchestra.console.smithi103:power off output: Chassis Power Control: Down/Off 2024-02-08T10:01:48.705 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-08T10:01:48.715 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on 2024-02-08T10:01:48.723 INFO:teuthology.orchestra.console.smithi158:Power off 2024-02-08T10:01:48.723 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-08T10:01:48.732 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2024-02-08T10:01:48.745 DEBUG:teuthology.orchestra.console.smithi158:power off output: Chassis Power Control: Down/Off 2024-02-08T10:01:48.745 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-08T10:01:48.770 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is on 2024-02-08T10:01:52.720 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-08T10:01:52.733 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-08T10:01:52.771 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-08T10:01:52.830 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on 2024-02-08T10:01:52.842 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2024-02-08T10:01:52.885 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is on 2024-02-08T10:01:56.832 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-08T10:01:56.843 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-08T10:01:56.886 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-08T10:01:56.941 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off 2024-02-08T10:01:56.951 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2024-02-08T10:01:56.994 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is off 2024-02-08T10:01:57.043 INFO:teuthology.orchestra.console.smithi113:Power off completed 2024-02-08T10:01:57.095 INFO:teuthology.orchestra.console.smithi158:Power off completed 2024-02-08T10:01:57.144 INFO:teuthology.orchestra.console.smithi113:Power on 2024-02-08T10:01:57.144 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-08T10:01:57.168 DEBUG:teuthology.orchestra.console.smithi113:power on output: Chassis Power Control: Up/On 2024-02-08T10:01:57.169 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-08T10:01:57.192 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off 2024-02-08T10:01:57.196 INFO:teuthology.orchestra.console.smithi158:Power on 2024-02-08T10:01:57.197 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-08T10:01:57.218 DEBUG:teuthology.orchestra.console.smithi158:power on output: Chassis Power Control: Up/On 2024-02-08T10:01:57.219 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-08T10:01:57.240 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is off 2024-02-08T10:02:00.956 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-08T10:02:01.065 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2024-02-08T10:02:01.166 INFO:teuthology.orchestra.console.smithi103:Power off completed 2024-02-08T10:02:01.193 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-08T10:02:01.242 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-08T10:02:01.267 INFO:teuthology.orchestra.console.smithi103:Power on 2024-02-08T10:02:01.268 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-08T10:02:01.290 DEBUG:teuthology.orchestra.console.smithi103:power on output: Chassis Power Control: Up/On 2024-02-08T10:02:01.290 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-08T10:02:01.302 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off 2024-02-08T10:02:01.311 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2024-02-08T10:02:01.351 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is off 2024-02-08T10:02:05.306 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-08T10:02:05.314 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-08T10:02:05.353 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-08T10:02:05.417 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on 2024-02-08T10:02:05.424 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2024-02-08T10:02:05.463 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is on 2024-02-08T10:02:05.518 INFO:teuthology.orchestra.console.smithi113:Power on completed 2024-02-08T10:02:05.564 INFO:teuthology.orchestra.console.smithi158:Power on completed 2024-02-08T10:02:05.620 INFO:teuthology.provision.fog.smithi113:Waiting for deploy to finish 2024-02-08T10:02:05.665 INFO:teuthology.provision.fog.smithi158:Waiting for deploy to finish 2024-02-08T10:02:09.428 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-08T10:02:09.538 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2024-02-08T10:02:09.638 INFO:teuthology.orchestra.console.smithi103:Power on completed 2024-02-08T10:02:09.739 INFO:teuthology.provision.fog.smithi103:Waiting for deploy to finish 2024-02-08T10:05:06.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T10:05:06.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T10:05:09.852 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2024-02-08T10:05:09.856 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2024-02-08T10:05:10.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T10:05:13.916 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-02-08T10:05:15.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T10:05:15.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T10:05:18.908 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2024-02-08T10:05:18.908 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2024-02-08T10:05:19.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T10:05:22.972 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-02-08T10:05:24.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T10:05:24.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T10:05:27.964 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2024-02-08T10:05:27.964 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2024-02-08T10:05:28.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T10:05:32.028 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-02-08T10:05:33.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T10:05:33.969 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T10:05:37.024 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2024-02-08T10:05:37.025 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2024-02-08T10:05:38.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T10:05:41.084 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-02-08T10:05:43.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T10:05:43.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T10:05:46.108 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2024-02-08T10:05:46.108 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2024-02-08T10:05:47.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T10:05:50.140 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-02-08T10:05:52.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T10:05:52.114 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T10:05:55.164 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2024-02-08T10:05:55.164 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2024-02-08T10:05:56.145 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T10:05:59.200 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-02-08T10:06:01.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T10:06:01.169 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T10:06:04.220 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2024-02-08T10:06:04.220 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2024-02-08T10:06:05.202 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T10:06:08.256 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-02-08T10:06:10.221 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T10:06:10.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T10:06:13.280 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2024-02-08T10:06:13.280 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2024-02-08T10:06:14.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T10:06:19.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T10:06:19.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T10:06:22.364 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2024-02-08T10:06:28.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T10:07:14.305 WARNING:teuthology.provision.fog.smithi103:timed out 2024-02-08T10:07:19.290 WARNING:teuthology.provision.fog.smithi113:timed out 2024-02-08T10:07:20.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T10:07:20.535 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-08T10:07:20.535 DEBUG:teuthology.orchestra.run.smithi103:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-08T10:07:20.796 INFO:teuthology.provision.fog.smithi103:Node is ready 2024-02-08T10:07:20.796 DEBUG:teuthology.orchestra.run.smithi103:> hostname 2024-02-08T10:07:20.816 INFO:teuthology.orchestra.run.smithi103.stdout:smithi103.front.sepia.ceph.com 2024-02-08T10:07:20.816 DEBUG:teuthology.orchestra.run.smithi103:> grep smithi103.front.sepia.ceph.com /etc/hosts 2024-02-08T10:07:20.875 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103 smithi103.front.sepia.ceph.com smithi103 2024-02-08T10:07:20.876 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname smithi103 2024-02-08T10:07:20.992 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/smithi103.front.sepia.ceph.com/smithi103/g' /etc/hosts 2024-02-08T10:07:21.022 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/172.21.15.103/172.21.15.103/g' /etc/hosts 2024-02-08T10:07:21.091 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/smithi103.front.sepia.ceph.com/smithi103/g' /etc/hostname 2024-02-08T10:07:21.160 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname smithi103 2024-02-08T10:07:21.228 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2024-02-08T10:07:21.286 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="CentOS Stream" 2024-02-08T10:07:21.287 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="8" 2024-02-08T10:07:21.287 INFO:teuthology.orchestra.run.smithi103.stdout:ID="centos" 2024-02-08T10:07:21.287 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="rhel fedora" 2024-02-08T10:07:21.287 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="8" 2024-02-08T10:07:21.287 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el8" 2024-02-08T10:07:21.287 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-08T10:07:21.287 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31" 2024-02-08T10:07:21.287 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-08T10:07:21.287 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://centos.org/" 2024-02-08T10:07:21.287 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-08T10:07:21.287 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-08T10:07:21.287 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-08T10:07:21.288 INFO:teuthology.provision.fog.smithi103:Deploy complete! 2024-02-08T10:07:21.289 DEBUG:teuthology.parallel:result is None 2024-02-08T10:07:25.292 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T10:07:25.517 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-08T10:07:25.517 DEBUG:teuthology.orchestra.run.smithi113:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-08T10:07:25.792 INFO:teuthology.provision.fog.smithi113:Node is ready 2024-02-08T10:07:25.792 DEBUG:teuthology.orchestra.run.smithi113:> hostname 2024-02-08T10:07:25.811 INFO:teuthology.orchestra.run.smithi113.stdout:smithi113.front.sepia.ceph.com 2024-02-08T10:07:25.811 DEBUG:teuthology.orchestra.run.smithi113:> grep smithi113.front.sepia.ceph.com /etc/hosts 2024-02-08T10:07:25.871 INFO:teuthology.orchestra.run.smithi113.stdout:172.21.15.113 smithi113.front.sepia.ceph.com smithi113 2024-02-08T10:07:25.871 DEBUG:teuthology.orchestra.run.smithi113:> sudo hostname smithi113 2024-02-08T10:07:25.972 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i -e 's/smithi113.front.sepia.ceph.com/smithi113/g' /etc/hosts 2024-02-08T10:07:26.002 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i -e 's/172.21.15.113/172.21.15.113/g' /etc/hosts 2024-02-08T10:07:26.071 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i -e 's/smithi113.front.sepia.ceph.com/smithi113/g' /etc/hostname 2024-02-08T10:07:26.141 DEBUG:teuthology.orchestra.run.smithi113:> sudo hostname smithi113 2024-02-08T10:07:26.208 DEBUG:teuthology.orchestra.run.smithi113:> cat /etc/os-release 2024-02-08T10:07:26.265 INFO:teuthology.orchestra.run.smithi113.stdout:NAME="CentOS Stream" 2024-02-08T10:07:26.265 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION="8" 2024-02-08T10:07:26.265 INFO:teuthology.orchestra.run.smithi113.stdout:ID="centos" 2024-02-08T10:07:26.265 INFO:teuthology.orchestra.run.smithi113.stdout:ID_LIKE="rhel fedora" 2024-02-08T10:07:26.266 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION_ID="8" 2024-02-08T10:07:26.266 INFO:teuthology.orchestra.run.smithi113.stdout:PLATFORM_ID="platform:el8" 2024-02-08T10:07:26.266 INFO:teuthology.orchestra.run.smithi113.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-08T10:07:26.266 INFO:teuthology.orchestra.run.smithi113.stdout:ANSI_COLOR="0;31" 2024-02-08T10:07:26.266 INFO:teuthology.orchestra.run.smithi113.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-08T10:07:26.266 INFO:teuthology.orchestra.run.smithi113.stdout:HOME_URL="https://centos.org/" 2024-02-08T10:07:26.266 INFO:teuthology.orchestra.run.smithi113.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-08T10:07:26.266 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-08T10:07:26.266 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-08T10:07:26.266 INFO:teuthology.provision.fog.smithi113:Deploy complete! 2024-02-08T10:07:26.267 DEBUG:teuthology.parallel:result is None 2024-02-08T10:07:28.375 WARNING:teuthology.provision.fog.smithi158:timed out 2024-02-08T10:07:34.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T10:07:34.694 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-08T10:07:34.694 DEBUG:teuthology.orchestra.run.smithi158:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-08T10:07:34.953 INFO:teuthology.provision.fog.smithi158:Node is ready 2024-02-08T10:07:34.953 DEBUG:teuthology.orchestra.run.smithi158:> hostname 2024-02-08T10:07:34.973 INFO:teuthology.orchestra.run.smithi158.stdout:smithi158.front.sepia.ceph.com 2024-02-08T10:07:34.973 DEBUG:teuthology.orchestra.run.smithi158:> grep smithi158.front.sepia.ceph.com /etc/hosts 2024-02-08T10:07:35.033 INFO:teuthology.orchestra.run.smithi158.stdout:172.21.15.158 smithi158.front.sepia.ceph.com smithi158 2024-02-08T10:07:35.033 DEBUG:teuthology.orchestra.run.smithi158:> sudo hostname smithi158 2024-02-08T10:07:35.126 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/smithi158.front.sepia.ceph.com/smithi158/g' /etc/hosts 2024-02-08T10:07:35.156 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/172.21.15.158/172.21.15.158/g' /etc/hosts 2024-02-08T10:07:35.227 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/smithi158.front.sepia.ceph.com/smithi158/g' /etc/hostname 2024-02-08T10:07:35.296 DEBUG:teuthology.orchestra.run.smithi158:> sudo hostname smithi158 2024-02-08T10:07:35.364 DEBUG:teuthology.orchestra.run.smithi158:> cat /etc/os-release 2024-02-08T10:07:35.423 INFO:teuthology.orchestra.run.smithi158.stdout:NAME="CentOS Stream" 2024-02-08T10:07:35.423 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION="8" 2024-02-08T10:07:35.423 INFO:teuthology.orchestra.run.smithi158.stdout:ID="centos" 2024-02-08T10:07:35.423 INFO:teuthology.orchestra.run.smithi158.stdout:ID_LIKE="rhel fedora" 2024-02-08T10:07:35.423 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_ID="8" 2024-02-08T10:07:35.423 INFO:teuthology.orchestra.run.smithi158.stdout:PLATFORM_ID="platform:el8" 2024-02-08T10:07:35.423 INFO:teuthology.orchestra.run.smithi158.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-08T10:07:35.424 INFO:teuthology.orchestra.run.smithi158.stdout:ANSI_COLOR="0;31" 2024-02-08T10:07:35.424 INFO:teuthology.orchestra.run.smithi158.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-08T10:07:35.424 INFO:teuthology.orchestra.run.smithi158.stdout:HOME_URL="https://centos.org/" 2024-02-08T10:07:35.424 INFO:teuthology.orchestra.run.smithi158.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-08T10:07:35.424 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-08T10:07:35.424 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-08T10:07:35.424 INFO:teuthology.provision.fog.smithi158:Deploy complete! 2024-02-08T10:07:35.425 DEBUG:teuthology.parallel:result is None 2024-02-08T10:07:35.644 INFO:teuthology.lock.ops:Checking smithi103.front.sepia.ceph.com 2024-02-08T10:07:35.644 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-08T10:07:35.675 INFO:teuthology.lock.ops:Checking smithi113.front.sepia.ceph.com 2024-02-08T10:07:35.676 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-08T10:07:35.700 INFO:teuthology.lock.ops:Checking smithi158.front.sepia.ceph.com 2024-02-08T10:07:35.700 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-08T10:07:35.718 INFO:teuthology.lock.ops:Updating [smithi103.front.sepia.ceph.com]: set os type and version on server 2024-02-08T10:07:35.718 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-02-08T10:07:35.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T10:07:35.791 DEBUG:teuthology.orchestra.run.smithi103:> true 2024-02-08T10:07:35.926 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-02-08T10:07:35.927 DEBUG:teuthology.orchestra.run.smithi103:> uname -m 2024-02-08T10:07:35.986 INFO:teuthology.orchestra.run.smithi103.stdout:x86_64 2024-02-08T10:07:35.986 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2024-02-08T10:07:36.045 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="CentOS Stream" 2024-02-08T10:07:36.045 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="8" 2024-02-08T10:07:36.045 INFO:teuthology.orchestra.run.smithi103.stdout:ID="centos" 2024-02-08T10:07:36.045 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="rhel fedora" 2024-02-08T10:07:36.045 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="8" 2024-02-08T10:07:36.045 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el8" 2024-02-08T10:07:36.046 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-08T10:07:36.046 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31" 2024-02-08T10:07:36.046 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-08T10:07:36.046 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://centos.org/" 2024-02-08T10:07:36.046 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-08T10:07:36.046 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-08T10:07:36.046 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-08T10:07:36.047 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2024-02-08T10:07:36.067 INFO:teuthology.lock.ops:Updating [smithi113.front.sepia.ceph.com]: set os type and version on server 2024-02-08T10:07:36.067 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi113.front.sepia.ceph.com' 2024-02-08T10:07:36.068 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T10:07:36.139 DEBUG:teuthology.orchestra.run.smithi113:> true 2024-02-08T10:07:36.214 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi113.front.sepia.ceph.com' 2024-02-08T10:07:36.214 DEBUG:teuthology.orchestra.run.smithi113:> uname -m 2024-02-08T10:07:36.275 INFO:teuthology.orchestra.run.smithi113.stdout:x86_64 2024-02-08T10:07:36.275 DEBUG:teuthology.orchestra.run.smithi113:> cat /etc/os-release 2024-02-08T10:07:36.336 INFO:teuthology.orchestra.run.smithi113.stdout:NAME="CentOS Stream" 2024-02-08T10:07:36.337 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION="8" 2024-02-08T10:07:36.337 INFO:teuthology.orchestra.run.smithi113.stdout:ID="centos" 2024-02-08T10:07:36.337 INFO:teuthology.orchestra.run.smithi113.stdout:ID_LIKE="rhel fedora" 2024-02-08T10:07:36.337 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION_ID="8" 2024-02-08T10:07:36.337 INFO:teuthology.orchestra.run.smithi113.stdout:PLATFORM_ID="platform:el8" 2024-02-08T10:07:36.337 INFO:teuthology.orchestra.run.smithi113.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-08T10:07:36.337 INFO:teuthology.orchestra.run.smithi113.stdout:ANSI_COLOR="0;31" 2024-02-08T10:07:36.337 INFO:teuthology.orchestra.run.smithi113.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-08T10:07:36.337 INFO:teuthology.orchestra.run.smithi113.stdout:HOME_URL="https://centos.org/" 2024-02-08T10:07:36.338 INFO:teuthology.orchestra.run.smithi113.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-08T10:07:36.338 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-08T10:07:36.338 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-08T10:07:36.338 INFO:teuthology.lock.ops:Updating smithi113.front.sepia.ceph.com on lock server 2024-02-08T10:07:36.359 INFO:teuthology.lock.ops:Updating [smithi158.front.sepia.ceph.com]: set os type and version on server 2024-02-08T10:07:36.359 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2024-02-08T10:07:36.360 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-08T10:07:36.430 DEBUG:teuthology.orchestra.run.smithi158:> true 2024-02-08T10:07:36.506 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi158.front.sepia.ceph.com' 2024-02-08T10:07:36.506 DEBUG:teuthology.orchestra.run.smithi158:> uname -m 2024-02-08T10:07:36.567 INFO:teuthology.orchestra.run.smithi158.stdout:x86_64 2024-02-08T10:07:36.567 DEBUG:teuthology.orchestra.run.smithi158:> cat /etc/os-release 2024-02-08T10:07:36.627 INFO:teuthology.orchestra.run.smithi158.stdout:NAME="CentOS Stream" 2024-02-08T10:07:36.627 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION="8" 2024-02-08T10:07:36.627 INFO:teuthology.orchestra.run.smithi158.stdout:ID="centos" 2024-02-08T10:07:36.627 INFO:teuthology.orchestra.run.smithi158.stdout:ID_LIKE="rhel fedora" 2024-02-08T10:07:36.627 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_ID="8" 2024-02-08T10:07:36.627 INFO:teuthology.orchestra.run.smithi158.stdout:PLATFORM_ID="platform:el8" 2024-02-08T10:07:36.628 INFO:teuthology.orchestra.run.smithi158.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-08T10:07:36.628 INFO:teuthology.orchestra.run.smithi158.stdout:ANSI_COLOR="0;31" 2024-02-08T10:07:36.628 INFO:teuthology.orchestra.run.smithi158.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-08T10:07:36.628 INFO:teuthology.orchestra.run.smithi158.stdout:HOME_URL="https://centos.org/" 2024-02-08T10:07:36.628 INFO:teuthology.orchestra.run.smithi158.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-08T10:07:36.628 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-08T10:07:36.628 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-08T10:07:36.628 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server 2024-02-08T10:07:36.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-08T10:07:36.758 INFO:teuthology.dispatcher.supervisor:Running job 7550864 2024-02-08T10:07:36.758 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-02-07_22:15:19-rados-wip-yuri6-testing-2024-02-07-1000-distro-default-smithi/7550864 --name yuriw-2024-02-07_22:15:19-rados-wip-yuri6-testing-2024-02-07-1000-distro-default-smithi --description rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/radosbench} -- /home/teuthworker/archive/yuriw-2024-02-07_22:15:19-rados-wip-yuri6-testing-2024-02-07-1000-distro-default-smithi/7550864/orig.config.yaml 2024-02-08T10:07:36.761 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-02-07_22:15:19-rados-wip-yuri6-testing-2024-02-07-1000-distro-default-smithi/7550864 2024-02-08T10:07:36.761 INFO:teuthology.dispatcher.supervisor:Job PID: 3751488 2024-02-08T10:07:36.761 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-08T10:09:36.861 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-08T10:11:37.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-08T10:13:37.197 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-08T10:15:37.377 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-08T10:17:37.540 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-08T10:19:37.721 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-08T10:21:37.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-08T10:23:38.068 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-08T10:25:38.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-08T10:27:38.407 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-08T10:29:38.574 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-08T10:29:38.640 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1