2024-02-03T00:59:34.557 INFO:root:teuthology version: 0.0.1.dev256+gd9fdb22 2024-02-03T00:59:34.558 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-03T00:59:34.727 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9ebc642c10>, signals=[15]) 2024-02-03T00:59:34.728 INFO:teuthology.lock.ops:Start node 'smithi005.front.sepia.ceph.com' reimaging 2024-02-03T00:59:34.729 INFO:teuthology.lock.ops:Updating [smithi005.front.sepia.ceph.com]: reset os type and version on server 2024-02-03T00:59:34.729 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2024-02-03T00:59:34.746 INFO:teuthology.lock.ops:Start node 'smithi107.front.sepia.ceph.com' reimaging 2024-02-03T00:59:34.747 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: reset os type and version on server 2024-02-03T00:59:34.747 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2024-02-03T00:59:34.771 INFO:teuthology.lock.ops:Start node 'smithi133.front.sepia.ceph.com' reimaging 2024-02-03T00:59:34.771 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: reset os type and version on server 2024-02-03T00:59:34.771 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2024-02-03T00:59:34.860 DEBUG:teuthology.provision.fog.smithi005:Requesting image smithi_centos_8.stream (ID 3) 2024-02-03T00:59:34.894 DEBUG:teuthology.provision.fog.smithi107:Requesting image smithi_centos_8.stream (ID 3) 2024-02-03T00:59:34.906 INFO:teuthology.provision.fog.smithi005:Scheduling deploy of centos 8.stream 2024-02-03T00:59:34.909 DEBUG:teuthology.provision.fog.smithi133:Requesting image smithi_centos_8.stream (ID 3) 2024-02-03T00:59:34.935 INFO:teuthology.provision.fog.smithi107:Scheduling deploy of centos 8.stream 2024-02-03T00:59:34.959 INFO:teuthology.provision.fog.smithi133:Scheduling deploy of centos 8.stream 2024-02-03T00:59:35.149 INFO:teuthology.orchestra.console.smithi107:Power off 2024-02-03T00:59:35.150 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-03T00:59:35.162 INFO:teuthology.orchestra.console.smithi005:Power off 2024-02-03T00:59:35.163 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-03T00:59:35.176 DEBUG:teuthology.orchestra.console.smithi107:power off output: Chassis Power Control: Down/Off 2024-02-03T00:59:35.176 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-03T00:59:35.192 DEBUG:teuthology.orchestra.console.smithi005:power off output: Chassis Power Control: Down/Off 2024-02-03T00:59:35.193 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-03T00:59:35.206 INFO:teuthology.orchestra.console.smithi133:Power off 2024-02-03T00:59:35.206 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-03T00:59:35.214 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2024-02-03T00:59:35.216 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on 2024-02-03T00:59:35.228 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off 2024-02-03T00:59:35.228 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-03T00:59:35.251 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2024-02-03T00:59:39.218 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-03T00:59:39.225 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-03T00:59:39.253 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-03T00:59:39.327 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2024-02-03T00:59:39.333 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on 2024-02-03T00:59:39.362 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2024-02-03T00:59:43.332 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-03T00:59:43.339 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-03T00:59:43.363 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-03T00:59:43.441 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2024-02-03T00:59:43.447 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is off 2024-02-03T00:59:43.471 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2024-02-03T00:59:43.548 INFO:teuthology.orchestra.console.smithi005:Power off completed 2024-02-03T00:59:43.572 INFO:teuthology.orchestra.console.smithi133:Power off completed 2024-02-03T00:59:43.649 INFO:teuthology.orchestra.console.smithi005:Power on 2024-02-03T00:59:43.650 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-03T00:59:43.671 DEBUG:teuthology.orchestra.console.smithi005:power on output: Chassis Power Control: Up/On 2024-02-03T00:59:43.671 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-03T00:59:43.678 INFO:teuthology.orchestra.console.smithi133:Power on 2024-02-03T00:59:43.678 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-03T00:59:43.694 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is off 2024-02-03T00:59:43.697 DEBUG:teuthology.orchestra.console.smithi133:power on output: Chassis Power Control: Up/On 2024-02-03T00:59:43.697 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-03T00:59:43.719 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2024-02-03T00:59:47.444 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-03T00:59:47.553 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2024-02-03T00:59:47.654 INFO:teuthology.orchestra.console.smithi107:Power off completed 2024-02-03T00:59:47.694 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-03T00:59:47.720 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-03T00:59:47.755 INFO:teuthology.orchestra.console.smithi107:Power on 2024-02-03T00:59:47.756 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-03T00:59:47.779 DEBUG:teuthology.orchestra.console.smithi107:power on output: Chassis Power Control: Up/On 2024-02-03T00:59:47.779 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-03T00:59:47.800 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2024-02-03T00:59:47.803 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is off 2024-02-03T00:59:47.829 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2024-02-03T00:59:51.805 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-03T00:59:51.812 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-03T00:59:51.830 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-03T00:59:51.914 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2024-02-03T00:59:51.920 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on 2024-02-03T00:59:51.939 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2024-02-03T00:59:52.021 INFO:teuthology.orchestra.console.smithi005:Power on completed 2024-02-03T00:59:52.040 INFO:teuthology.orchestra.console.smithi133:Power on completed 2024-02-03T00:59:52.122 INFO:teuthology.provision.fog.smithi005:Waiting for deploy to finish 2024-02-03T00:59:52.140 INFO:teuthology.provision.fog.smithi133:Waiting for deploy to finish 2024-02-03T00:59:55.916 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-03T00:59:56.026 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2024-02-03T00:59:56.127 INFO:teuthology.orchestra.console.smithi107:Power on completed 2024-02-03T00:59:56.227 INFO:teuthology.provision.fog.smithi107:Waiting for deploy to finish 2024-02-03T01:02:22.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-03T01:02:26.044 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2024-02-03T01:02:32.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-03T01:02:35.104 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2024-02-03T01:02:38.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-03T01:02:41.084 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-02-03T01:02:41.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-03T01:02:42.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-03T01:02:44.156 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2024-02-03T01:02:45.148 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-02-03T01:02:47.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-03T01:02:50.140 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-02-03T01:02:50.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-03T01:02:51.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-03T01:02:53.216 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2024-02-03T01:02:54.204 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-02-03T01:02:56.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-03T01:02:59.196 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-02-03T01:02:59.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-03T01:03:00.206 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-03T01:03:02.268 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2024-02-03T01:03:03.264 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-02-03T01:03:05.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-03T01:03:08.252 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-02-03T01:03:08.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-03T01:03:09.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-03T01:03:11.328 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2024-02-03T01:03:12.316 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-02-03T01:03:14.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-03T01:03:17.308 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-02-03T01:03:17.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-03T01:03:18.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-03T01:03:21.372 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-02-03T01:03:23.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-03T01:03:27.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-03T01:03:30.428 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-02-03T01:03:36.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-03T01:04:17.370 WARNING:teuthology.provision.fog.smithi005:timed out 2024-02-03T01:04:23.321 WARNING:teuthology.provision.fog.smithi133:timed out 2024-02-03T01:04:23.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-03T01:04:23.729 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-03T01:04:23.729 DEBUG:teuthology.orchestra.run.smithi005:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-03T01:04:24.021 INFO:teuthology.provision.fog.smithi005:Node is ready 2024-02-03T01:04:24.022 DEBUG:teuthology.orchestra.run.smithi005:> hostname 2024-02-03T01:04:24.096 INFO:teuthology.orchestra.run.smithi005.stdout:smithi005.front.sepia.ceph.com 2024-02-03T01:04:24.096 DEBUG:teuthology.orchestra.run.smithi005:> grep smithi005.front.sepia.ceph.com /etc/hosts 2024-02-03T01:04:24.172 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5 smithi005.front.sepia.ceph.com smithi005 2024-02-03T01:04:24.173 DEBUG:teuthology.orchestra.run.smithi005:> sudo hostname smithi005 2024-02-03T01:04:24.287 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i -e 's/smithi005.front.sepia.ceph.com/smithi005/g' /etc/hosts 2024-02-03T01:04:24.325 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i -e 's/172.21.15.5/172.21.15.5/g' /etc/hosts 2024-02-03T01:04:24.401 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i -e 's/smithi005.front.sepia.ceph.com/smithi005/g' /etc/hostname 2024-02-03T01:04:24.478 DEBUG:teuthology.orchestra.run.smithi005:> sudo hostname smithi005 2024-02-03T01:04:24.550 DEBUG:teuthology.orchestra.run.smithi005:> cat /etc/os-release 2024-02-03T01:04:24.613 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="CentOS Stream" 2024-02-03T01:04:24.613 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="8" 2024-02-03T01:04:24.613 INFO:teuthology.orchestra.run.smithi005.stdout:ID="centos" 2024-02-03T01:04:24.614 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE="rhel fedora" 2024-02-03T01:04:24.614 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="8" 2024-02-03T01:04:24.614 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM_ID="platform:el8" 2024-02-03T01:04:24.614 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-03T01:04:24.614 INFO:teuthology.orchestra.run.smithi005.stdout:ANSI_COLOR="0;31" 2024-02-03T01:04:24.614 INFO:teuthology.orchestra.run.smithi005.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-03T01:04:24.614 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://centos.org/" 2024-02-03T01:04:24.614 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-03T01:04:24.614 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-03T01:04:24.614 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-03T01:04:24.615 INFO:teuthology.provision.fog.smithi005:Deploy complete! 2024-02-03T01:04:24.616 DEBUG:teuthology.parallel:result is None 2024-02-03T01:04:29.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-03T01:04:29.624 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-03T01:04:29.624 DEBUG:teuthology.orchestra.run.smithi133:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-03T01:04:29.885 INFO:teuthology.provision.fog.smithi133:Node is ready 2024-02-03T01:04:29.885 DEBUG:teuthology.orchestra.run.smithi133:> hostname 2024-02-03T01:04:29.905 INFO:teuthology.orchestra.run.smithi133.stdout:smithi133.front.sepia.ceph.com 2024-02-03T01:04:29.906 DEBUG:teuthology.orchestra.run.smithi133:> grep smithi133.front.sepia.ceph.com /etc/hosts 2024-02-03T01:04:29.965 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.15.133 smithi133.front.sepia.ceph.com smithi133 2024-02-03T01:04:29.965 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname smithi133 2024-02-03T01:04:30.069 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi133.front.sepia.ceph.com/smithi133/g' /etc/hosts 2024-02-03T01:04:30.100 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/172.21.15.133/172.21.15.133/g' /etc/hosts 2024-02-03T01:04:30.170 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi133.front.sepia.ceph.com/smithi133/g' /etc/hostname 2024-02-03T01:04:30.239 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname smithi133 2024-02-03T01:04:30.306 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2024-02-03T01:04:30.364 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="CentOS Stream" 2024-02-03T01:04:30.364 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="8" 2024-02-03T01:04:30.365 INFO:teuthology.orchestra.run.smithi133.stdout:ID="centos" 2024-02-03T01:04:30.365 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="rhel fedora" 2024-02-03T01:04:30.365 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="8" 2024-02-03T01:04:30.365 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el8" 2024-02-03T01:04:30.365 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-03T01:04:30.365 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31" 2024-02-03T01:04:30.365 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-03T01:04:30.365 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://centos.org/" 2024-02-03T01:04:30.365 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-03T01:04:30.365 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-03T01:04:30.365 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-03T01:04:30.365 INFO:teuthology.provision.fog.smithi133:Deploy complete! 2024-02-03T01:04:30.366 DEBUG:teuthology.parallel:result is None 2024-02-03T01:04:36.441 WARNING:teuthology.provision.fog.smithi107:timed out 2024-02-03T01:04:42.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-03T01:04:42.686 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-03T01:04:42.686 DEBUG:teuthology.orchestra.run.smithi107:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-03T01:04:42.940 INFO:teuthology.provision.fog.smithi107:Node is ready 2024-02-03T01:04:42.940 DEBUG:teuthology.orchestra.run.smithi107:> hostname 2024-02-03T01:04:42.959 INFO:teuthology.orchestra.run.smithi107.stdout:smithi107.front.sepia.ceph.com 2024-02-03T01:04:42.959 DEBUG:teuthology.orchestra.run.smithi107:> grep smithi107.front.sepia.ceph.com /etc/hosts 2024-02-03T01:04:43.019 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107 smithi107.front.sepia.ceph.com smithi107 2024-02-03T01:04:43.019 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107 2024-02-03T01:04:43.118 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi107.front.sepia.ceph.com/smithi107/g' /etc/hosts 2024-02-03T01:04:43.148 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/172.21.15.107/172.21.15.107/g' /etc/hosts 2024-02-03T01:04:43.217 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi107.front.sepia.ceph.com/smithi107/g' /etc/hostname 2024-02-03T01:04:43.286 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107 2024-02-03T01:04:43.353 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2024-02-03T01:04:43.411 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="CentOS Stream" 2024-02-03T01:04:43.412 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="8" 2024-02-03T01:04:43.412 INFO:teuthology.orchestra.run.smithi107.stdout:ID="centos" 2024-02-03T01:04:43.412 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="rhel fedora" 2024-02-03T01:04:43.412 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="8" 2024-02-03T01:04:43.412 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el8" 2024-02-03T01:04:43.412 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-03T01:04:43.412 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2024-02-03T01:04:43.412 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-03T01:04:43.412 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://centos.org/" 2024-02-03T01:04:43.412 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-03T01:04:43.412 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-03T01:04:43.412 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-03T01:04:43.412 INFO:teuthology.provision.fog.smithi107:Deploy complete! 2024-02-03T01:04:43.413 DEBUG:teuthology.parallel:result is None 2024-02-03T01:04:43.600 INFO:teuthology.lock.ops:Checking smithi005.front.sepia.ceph.com 2024-02-03T01:04:43.600 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-03T01:04:43.625 INFO:teuthology.lock.ops:Checking smithi107.front.sepia.ceph.com 2024-02-03T01:04:43.625 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-03T01:04:43.641 INFO:teuthology.lock.ops:Checking smithi133.front.sepia.ceph.com 2024-02-03T01:04:43.641 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-03T01:04:43.668 INFO:teuthology.lock.ops:Updating [smithi005.front.sepia.ceph.com]: set os type and version on server 2024-02-03T01:04:43.668 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-02-03T01:04:43.669 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-03T01:04:43.745 DEBUG:teuthology.orchestra.run.smithi005:> true 2024-02-03T01:04:43.888 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-02-03T01:04:43.888 DEBUG:teuthology.orchestra.run.smithi005:> uname -m 2024-02-03T01:04:43.948 INFO:teuthology.orchestra.run.smithi005.stdout:x86_64 2024-02-03T01:04:43.949 DEBUG:teuthology.orchestra.run.smithi005:> cat /etc/os-release 2024-02-03T01:04:44.008 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="CentOS Stream" 2024-02-03T01:04:44.008 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="8" 2024-02-03T01:04:44.009 INFO:teuthology.orchestra.run.smithi005.stdout:ID="centos" 2024-02-03T01:04:44.009 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE="rhel fedora" 2024-02-03T01:04:44.009 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="8" 2024-02-03T01:04:44.009 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM_ID="platform:el8" 2024-02-03T01:04:44.009 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-03T01:04:44.009 INFO:teuthology.orchestra.run.smithi005.stdout:ANSI_COLOR="0;31" 2024-02-03T01:04:44.009 INFO:teuthology.orchestra.run.smithi005.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-03T01:04:44.009 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://centos.org/" 2024-02-03T01:04:44.009 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-03T01:04:44.009 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-03T01:04:44.009 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-03T01:04:44.010 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2024-02-03T01:04:44.034 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: set os type and version on server 2024-02-03T01:04:44.034 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-02-03T01:04:44.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-03T01:04:44.109 DEBUG:teuthology.orchestra.run.smithi107:> true 2024-02-03T01:04:44.185 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-02-03T01:04:44.185 DEBUG:teuthology.orchestra.run.smithi107:> uname -m 2024-02-03T01:04:44.246 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2024-02-03T01:04:44.247 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2024-02-03T01:04:44.307 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="CentOS Stream" 2024-02-03T01:04:44.307 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="8" 2024-02-03T01:04:44.307 INFO:teuthology.orchestra.run.smithi107.stdout:ID="centos" 2024-02-03T01:04:44.307 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="rhel fedora" 2024-02-03T01:04:44.307 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="8" 2024-02-03T01:04:44.307 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el8" 2024-02-03T01:04:44.307 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-03T01:04:44.307 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2024-02-03T01:04:44.307 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-03T01:04:44.307 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://centos.org/" 2024-02-03T01:04:44.307 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-03T01:04:44.307 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-03T01:04:44.308 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-03T01:04:44.308 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2024-02-03T01:04:44.333 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: set os type and version on server 2024-02-03T01:04:44.333 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-02-03T01:04:44.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-03T01:04:44.410 DEBUG:teuthology.orchestra.run.smithi133:> true 2024-02-03T01:04:44.542 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-02-03T01:04:44.543 DEBUG:teuthology.orchestra.run.smithi133:> uname -m 2024-02-03T01:04:44.602 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64 2024-02-03T01:04:44.602 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2024-02-03T01:04:44.661 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="CentOS Stream" 2024-02-03T01:04:44.662 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="8" 2024-02-03T01:04:44.662 INFO:teuthology.orchestra.run.smithi133.stdout:ID="centos" 2024-02-03T01:04:44.662 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="rhel fedora" 2024-02-03T01:04:44.662 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="8" 2024-02-03T01:04:44.662 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el8" 2024-02-03T01:04:44.662 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-03T01:04:44.662 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31" 2024-02-03T01:04:44.662 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-03T01:04:44.662 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://centos.org/" 2024-02-03T01:04:44.662 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-03T01:04:44.663 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-03T01:04:44.663 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-03T01:04:44.663 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2024-02-03T01:04:44.684 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-03T01:04:44.791 INFO:teuthology.dispatcher.supervisor:Running job 7544086 2024-02-03T01:04:44.791 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-02-02_17:00:07-fs-main-distro-default-smithi/7544086 --name yuriw-2024-02-02_17:00:07-fs-main-distro-default-smithi --description fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} -- /home/teuthworker/archive/yuriw-2024-02-02_17:00:07-fs-main-distro-default-smithi/7544086/orig.config.yaml 2024-02-03T01:04:44.795 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-02-02_17:00:07-fs-main-distro-default-smithi/7544086 2024-02-03T01:04:44.795 INFO:teuthology.dispatcher.supervisor:Job PID: 1543067 2024-02-03T01:04:44.795 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-03T01:06:44.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-03T01:08:45.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-03T01:10:45.360 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-03T01:12:45.536 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-03T01:14:45.717 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-03T01:16:45.880 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-03T01:18:46.052 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-03T01:20:46.220 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-03T01:22:46.384 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-03T01:24:46.564 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-03T01:26:46.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-03T01:28:46.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-03T01:30:47.089 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-03T01:30:47.189 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1