2024-02-07T09:35:32.686 INFO:root:teuthology version: 0.0.1.dev256+gd9fdb22 2024-02-07T09:35:32.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T09:35:32.860 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6a60ac6c10>, signals=[15]) 2024-02-07T09:35:32.860 INFO:teuthology.lock.ops:Start node 'smithi076.front.sepia.ceph.com' reimaging 2024-02-07T09:35:32.860 INFO:teuthology.lock.ops:Updating [smithi076.front.sepia.ceph.com]: reset os type and version on server 2024-02-07T09:35:32.860 INFO:teuthology.lock.ops:Updating smithi076.front.sepia.ceph.com on lock server 2024-02-07T09:35:32.889 INFO:teuthology.lock.ops:Start node 'smithi099.front.sepia.ceph.com' reimaging 2024-02-07T09:35:32.889 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: reset os type and version on server 2024-02-07T09:35:32.889 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2024-02-07T09:35:32.912 INFO:teuthology.lock.ops:Start node 'smithi105.front.sepia.ceph.com' reimaging 2024-02-07T09:35:32.913 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: reset os type and version on server 2024-02-07T09:35:32.913 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2024-02-07T09:35:33.013 DEBUG:teuthology.provision.fog.smithi076:Requesting image smithi_centos_8.stream (ID 3) 2024-02-07T09:35:33.032 DEBUG:teuthology.provision.fog.smithi099:Requesting image smithi_centos_8.stream (ID 3) 2024-02-07T09:35:33.061 INFO:teuthology.provision.fog.smithi076:Scheduling deploy of centos 8.stream 2024-02-07T09:35:33.064 DEBUG:teuthology.provision.fog.smithi105:Requesting image smithi_centos_8.stream (ID 3) 2024-02-07T09:35:33.083 INFO:teuthology.provision.fog.smithi099:Scheduling deploy of centos 8.stream 2024-02-07T09:35:33.110 INFO:teuthology.provision.fog.smithi105:Scheduling deploy of centos 8.stream 2024-02-07T09:35:33.304 INFO:teuthology.orchestra.console.smithi076:Power off 2024-02-07T09:35:33.304 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-07T09:35:33.327 DEBUG:teuthology.orchestra.console.smithi076:power off output: Chassis Power Control: Down/Off 2024-02-07T09:35:33.327 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-07T09:35:33.347 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is on 2024-02-07T09:35:33.354 INFO:teuthology.orchestra.console.smithi099:Power off 2024-02-07T09:35:33.354 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-07T09:35:33.366 INFO:teuthology.orchestra.console.smithi105:Power off 2024-02-07T09:35:33.367 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-07T09:35:33.375 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off 2024-02-07T09:35:33.375 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-07T09:35:33.389 DEBUG:teuthology.orchestra.console.smithi105:power off output: Chassis Power Control: Down/Off 2024-02-07T09:35:33.389 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-07T09:35:33.397 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2024-02-07T09:35:33.410 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2024-02-07T09:35:37.352 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-07T09:35:37.398 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-07T09:35:37.411 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-07T09:35:37.461 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is on 2024-02-07T09:35:37.507 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2024-02-07T09:35:37.519 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2024-02-07T09:35:41.464 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-07T09:35:41.508 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-07T09:35:41.520 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-07T09:35:41.573 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is on 2024-02-07T09:35:41.618 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2024-02-07T09:35:41.629 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2024-02-07T09:35:45.576 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-07T09:35:45.619 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-07T09:35:45.629 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-07T09:35:45.685 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is off 2024-02-07T09:35:45.728 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2024-02-07T09:35:45.737 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2024-02-07T09:35:45.786 INFO:teuthology.orchestra.console.smithi076:Power off completed 2024-02-07T09:35:45.828 INFO:teuthology.orchestra.console.smithi099:Power off completed 2024-02-07T09:35:45.838 INFO:teuthology.orchestra.console.smithi105:Power off completed 2024-02-07T09:35:45.887 INFO:teuthology.orchestra.console.smithi076:Power on 2024-02-07T09:35:45.888 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-07T09:35:45.910 DEBUG:teuthology.orchestra.console.smithi076:power on output: Chassis Power Control: Up/On 2024-02-07T09:35:45.910 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-07T09:35:45.929 INFO:teuthology.orchestra.console.smithi099:Power on 2024-02-07T09:35:45.930 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-07T09:35:45.937 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is off 2024-02-07T09:35:45.939 INFO:teuthology.orchestra.console.smithi105:Power on 2024-02-07T09:35:45.939 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-07T09:35:45.950 DEBUG:teuthology.orchestra.console.smithi099:power on output: Chassis Power Control: Up/On 2024-02-07T09:35:45.951 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-07T09:35:45.961 DEBUG:teuthology.orchestra.console.smithi105:power on output: Chassis Power Control: Up/On 2024-02-07T09:35:45.962 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-07T09:35:45.973 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2024-02-07T09:35:45.982 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2024-02-07T09:35:49.940 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-07T09:35:49.974 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-07T09:35:49.983 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-07T09:35:50.051 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is on 2024-02-07T09:35:50.083 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2024-02-07T09:35:50.091 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2024-02-07T09:35:50.152 INFO:teuthology.orchestra.console.smithi076:Power on completed 2024-02-07T09:35:50.183 INFO:teuthology.orchestra.console.smithi099:Power on completed 2024-02-07T09:35:50.253 INFO:teuthology.provision.fog.smithi076:Waiting for deploy to finish 2024-02-07T09:35:50.284 INFO:teuthology.provision.fog.smithi099:Waiting for deploy to finish 2024-02-07T09:35:54.096 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-07T09:35:54.205 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2024-02-07T09:35:54.306 INFO:teuthology.orchestra.console.smithi105:Power on completed 2024-02-07T09:35:54.406 INFO:teuthology.provision.fog.smithi105:Waiting for deploy to finish 2024-02-07T09:38:36.097 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T09:38:39.168 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-02-07T09:38:40.169 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T09:38:43.232 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-02-07T09:38:45.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T09:38:48.252 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-02-07T09:38:49.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T09:38:51.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T09:38:52.316 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-02-07T09:38:54.236 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2024-02-07T09:38:54.253 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T09:38:57.308 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-02-07T09:38:58.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T09:39:00.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T09:39:01.372 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-02-07T09:39:03.292 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2024-02-07T09:39:03.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T09:39:06.364 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-02-07T09:39:07.375 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T09:39:09.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T09:39:10.428 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-02-07T09:39:12.352 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2024-02-07T09:39:12.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T09:39:15.424 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-02-07T09:39:16.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T09:39:18.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T09:39:19.488 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-02-07T09:39:21.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T09:39:21.436 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2024-02-07T09:39:25.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T09:39:27.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T09:39:28.576 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-02-07T09:39:30.492 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2024-02-07T09:39:34.580 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T09:39:36.495 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T09:39:39.552 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2024-02-07T09:39:45.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T09:39:48.636 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2024-02-07T09:39:54.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T09:40:21.456 WARNING:teuthology.provision.fog.smithi099:timed out 2024-02-07T09:40:27.463 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T09:40:27.741 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-07T09:40:27.742 DEBUG:teuthology.orchestra.run.smithi099:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-07T09:40:27.975 INFO:teuthology.provision.fog.smithi099:Node is ready 2024-02-07T09:40:27.975 DEBUG:teuthology.orchestra.run.smithi099:> hostname 2024-02-07T09:40:27.994 INFO:teuthology.orchestra.run.smithi099.stdout:smithi099.front.sepia.ceph.com 2024-02-07T09:40:27.994 DEBUG:teuthology.orchestra.run.smithi099:> grep smithi099.front.sepia.ceph.com /etc/hosts 2024-02-07T09:40:28.053 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99 smithi099.front.sepia.ceph.com smithi099 2024-02-07T09:40:28.053 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099 2024-02-07T09:40:28.144 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hosts 2024-02-07T09:40:28.174 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/172.21.15.99/172.21.15.99/g' /etc/hosts 2024-02-07T09:40:28.242 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hostname 2024-02-07T09:40:28.309 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099 2024-02-07T09:40:28.376 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2024-02-07T09:40:28.434 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream" 2024-02-07T09:40:28.434 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="8" 2024-02-07T09:40:28.434 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos" 2024-02-07T09:40:28.434 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora" 2024-02-07T09:40:28.434 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="8" 2024-02-07T09:40:28.434 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el8" 2024-02-07T09:40:28.434 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-07T09:40:28.434 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2024-02-07T09:40:28.434 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-07T09:40:28.434 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/" 2024-02-07T09:40:28.435 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-07T09:40:28.435 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-07T09:40:28.435 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-07T09:40:28.435 INFO:teuthology.provision.fog.smithi099:Deploy complete! 2024-02-07T09:40:28.436 DEBUG:teuthology.parallel:result is None 2024-02-07T09:40:34.588 WARNING:teuthology.provision.fog.smithi105:timed out 2024-02-07T09:40:40.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T09:40:40.841 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-07T09:40:40.842 DEBUG:teuthology.orchestra.run.smithi105:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-07T09:40:41.086 INFO:teuthology.provision.fog.smithi105:Node is ready 2024-02-07T09:40:41.086 DEBUG:teuthology.orchestra.run.smithi105:> hostname 2024-02-07T09:40:41.105 INFO:teuthology.orchestra.run.smithi105.stdout:smithi105.front.sepia.ceph.com 2024-02-07T09:40:41.105 DEBUG:teuthology.orchestra.run.smithi105:> grep smithi105.front.sepia.ceph.com /etc/hosts 2024-02-07T09:40:41.163 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.15.105 smithi105.front.sepia.ceph.com smithi105 2024-02-07T09:40:41.164 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105 2024-02-07T09:40:41.288 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105.front.sepia.ceph.com/smithi105/g' /etc/hosts 2024-02-07T09:40:41.318 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/172.21.15.105/172.21.15.105/g' /etc/hosts 2024-02-07T09:40:41.387 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105.front.sepia.ceph.com/smithi105/g' /etc/hostname 2024-02-07T09:40:41.455 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105 2024-02-07T09:40:41.522 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release 2024-02-07T09:40:41.580 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Stream" 2024-02-07T09:40:41.580 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="8" 2024-02-07T09:40:41.580 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos" 2024-02-07T09:40:41.580 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora" 2024-02-07T09:40:41.580 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="8" 2024-02-07T09:40:41.580 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el8" 2024-02-07T09:40:41.580 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-07T09:40:41.580 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31" 2024-02-07T09:40:41.580 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-07T09:40:41.580 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://centos.org/" 2024-02-07T09:40:41.580 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-07T09:40:41.580 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-07T09:40:41.581 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-07T09:40:41.581 INFO:teuthology.provision.fog.smithi105:Deploy complete! 2024-02-07T09:40:41.581 DEBUG:teuthology.parallel:result is None 2024-02-07T09:40:54.652 WARNING:teuthology.provision.fog.smithi076:timed out 2024-02-07T09:41:00.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T09:41:00.926 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-07T09:41:00.926 DEBUG:teuthology.orchestra.run.smithi076:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-07T09:41:01.207 INFO:teuthology.provision.fog.smithi076:Node is ready 2024-02-07T09:41:01.207 DEBUG:teuthology.orchestra.run.smithi076:> hostname 2024-02-07T09:41:01.270 INFO:teuthology.orchestra.run.smithi076.stdout:smithi076.front.sepia.ceph.com 2024-02-07T09:41:01.270 DEBUG:teuthology.orchestra.run.smithi076:> grep smithi076.front.sepia.ceph.com /etc/hosts 2024-02-07T09:41:01.331 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76 smithi076.front.sepia.ceph.com smithi076 2024-02-07T09:41:01.332 DEBUG:teuthology.orchestra.run.smithi076:> sudo hostname smithi076 2024-02-07T09:41:01.449 DEBUG:teuthology.orchestra.run.smithi076:> sudo sed -i -e 's/smithi076.front.sepia.ceph.com/smithi076/g' /etc/hosts 2024-02-07T09:41:01.482 DEBUG:teuthology.orchestra.run.smithi076:> sudo sed -i -e 's/172.21.15.76/172.21.15.76/g' /etc/hosts 2024-02-07T09:41:01.556 DEBUG:teuthology.orchestra.run.smithi076:> sudo sed -i -e 's/smithi076.front.sepia.ceph.com/smithi076/g' /etc/hostname 2024-02-07T09:41:01.631 DEBUG:teuthology.orchestra.run.smithi076:> sudo hostname smithi076 2024-02-07T09:41:01.703 DEBUG:teuthology.orchestra.run.smithi076:> cat /etc/os-release 2024-02-07T09:41:01.763 INFO:teuthology.orchestra.run.smithi076.stdout:NAME="CentOS Stream" 2024-02-07T09:41:01.763 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION="8" 2024-02-07T09:41:01.763 INFO:teuthology.orchestra.run.smithi076.stdout:ID="centos" 2024-02-07T09:41:01.763 INFO:teuthology.orchestra.run.smithi076.stdout:ID_LIKE="rhel fedora" 2024-02-07T09:41:01.763 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION_ID="8" 2024-02-07T09:41:01.763 INFO:teuthology.orchestra.run.smithi076.stdout:PLATFORM_ID="platform:el8" 2024-02-07T09:41:01.763 INFO:teuthology.orchestra.run.smithi076.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-07T09:41:01.764 INFO:teuthology.orchestra.run.smithi076.stdout:ANSI_COLOR="0;31" 2024-02-07T09:41:01.764 INFO:teuthology.orchestra.run.smithi076.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-07T09:41:01.764 INFO:teuthology.orchestra.run.smithi076.stdout:HOME_URL="https://centos.org/" 2024-02-07T09:41:01.764 INFO:teuthology.orchestra.run.smithi076.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-07T09:41:01.764 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-07T09:41:01.764 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-07T09:41:01.764 INFO:teuthology.provision.fog.smithi076:Deploy complete! 2024-02-07T09:41:01.765 DEBUG:teuthology.parallel:result is None 2024-02-07T09:41:01.965 INFO:teuthology.lock.ops:Checking smithi076.front.sepia.ceph.com 2024-02-07T09:41:01.965 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-07T09:41:01.988 INFO:teuthology.lock.ops:Checking smithi099.front.sepia.ceph.com 2024-02-07T09:41:01.988 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-07T09:41:02.004 INFO:teuthology.lock.ops:Checking smithi105.front.sepia.ceph.com 2024-02-07T09:41:02.004 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-07T09:41:02.022 INFO:teuthology.lock.ops:Updating [smithi076.front.sepia.ceph.com]: set os type and version on server 2024-02-07T09:41:02.022 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi076.front.sepia.ceph.com' 2024-02-07T09:41:02.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T09:41:02.099 DEBUG:teuthology.orchestra.run.smithi076:> true 2024-02-07T09:41:02.172 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi076.front.sepia.ceph.com' 2024-02-07T09:41:02.172 DEBUG:teuthology.orchestra.run.smithi076:> uname -m 2024-02-07T09:41:02.232 INFO:teuthology.orchestra.run.smithi076.stdout:x86_64 2024-02-07T09:41:02.232 DEBUG:teuthology.orchestra.run.smithi076:> cat /etc/os-release 2024-02-07T09:41:02.291 INFO:teuthology.orchestra.run.smithi076.stdout:NAME="CentOS Stream" 2024-02-07T09:41:02.291 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION="8" 2024-02-07T09:41:02.291 INFO:teuthology.orchestra.run.smithi076.stdout:ID="centos" 2024-02-07T09:41:02.291 INFO:teuthology.orchestra.run.smithi076.stdout:ID_LIKE="rhel fedora" 2024-02-07T09:41:02.291 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION_ID="8" 2024-02-07T09:41:02.292 INFO:teuthology.orchestra.run.smithi076.stdout:PLATFORM_ID="platform:el8" 2024-02-07T09:41:02.292 INFO:teuthology.orchestra.run.smithi076.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-07T09:41:02.292 INFO:teuthology.orchestra.run.smithi076.stdout:ANSI_COLOR="0;31" 2024-02-07T09:41:02.292 INFO:teuthology.orchestra.run.smithi076.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-07T09:41:02.292 INFO:teuthology.orchestra.run.smithi076.stdout:HOME_URL="https://centos.org/" 2024-02-07T09:41:02.292 INFO:teuthology.orchestra.run.smithi076.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-07T09:41:02.292 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-07T09:41:02.292 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-07T09:41:02.293 INFO:teuthology.lock.ops:Updating smithi076.front.sepia.ceph.com on lock server 2024-02-07T09:41:02.312 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: set os type and version on server 2024-02-07T09:41:02.313 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-02-07T09:41:02.313 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T09:41:02.388 DEBUG:teuthology.orchestra.run.smithi099:> true 2024-02-07T09:41:02.531 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-02-07T09:41:02.531 DEBUG:teuthology.orchestra.run.smithi099:> uname -m 2024-02-07T09:41:02.590 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64 2024-02-07T09:41:02.590 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2024-02-07T09:41:02.649 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream" 2024-02-07T09:41:02.649 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="8" 2024-02-07T09:41:02.649 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos" 2024-02-07T09:41:02.649 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora" 2024-02-07T09:41:02.649 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="8" 2024-02-07T09:41:02.649 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el8" 2024-02-07T09:41:02.649 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-07T09:41:02.649 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2024-02-07T09:41:02.649 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-07T09:41:02.649 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/" 2024-02-07T09:41:02.649 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-07T09:41:02.650 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-07T09:41:02.650 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-07T09:41:02.650 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2024-02-07T09:41:02.671 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: set os type and version on server 2024-02-07T09:41:02.671 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2024-02-07T09:41:02.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T09:41:02.743 DEBUG:teuthology.orchestra.run.smithi105:> true 2024-02-07T09:41:02.882 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi105.front.sepia.ceph.com' 2024-02-07T09:41:02.882 DEBUG:teuthology.orchestra.run.smithi105:> uname -m 2024-02-07T09:41:02.942 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64 2024-02-07T09:41:02.942 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release 2024-02-07T09:41:03.001 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Stream" 2024-02-07T09:41:03.001 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="8" 2024-02-07T09:41:03.001 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos" 2024-02-07T09:41:03.001 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora" 2024-02-07T09:41:03.001 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="8" 2024-02-07T09:41:03.001 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el8" 2024-02-07T09:41:03.001 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-07T09:41:03.001 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31" 2024-02-07T09:41:03.001 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-07T09:41:03.001 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://centos.org/" 2024-02-07T09:41:03.002 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-07T09:41:03.002 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-07T09:41:03.002 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-07T09:41:03.002 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2024-02-07T09:41:03.021 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T09:41:03.123 INFO:teuthology.dispatcher.supervisor:Running job 7548701 2024-02-07T09:41:03.123 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-02-06_08:10:23-fs-wip-vshankar-testing-20240206.051942-testing-default-smithi/7548701 --name vshankar-2024-02-06_08:10:23-fs-wip-vshankar-testing-20240206.051942-testing-default-smithi --description fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} -- /home/teuthworker/archive/vshankar-2024-02-06_08:10:23-fs-wip-vshankar-testing-20240206.051942-testing-default-smithi/7548701/orig.config.yaml 2024-02-07T09:41:03.126 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-02-06_08:10:23-fs-wip-vshankar-testing-20240206.051942-testing-default-smithi/7548701 2024-02-07T09:41:03.126 INFO:teuthology.dispatcher.supervisor:Job PID: 3136460 2024-02-07T09:41:03.126 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-07T09:43:03.224 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T09:45:03.385 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T09:47:03.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T09:49:03.633 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T09:51:03.810 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T09:53:03.984 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T09:55:04.151 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T09:57:04.321 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T09:59:04.486 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T10:01:04.652 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T10:03:04.798 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T10:05:04.970 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T10:07:05.144 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T10:09:05.316 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T10:11:05.480 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T10:13:05.649 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T10:15:05.820 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T10:17:05.993 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T10:19:06.160 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T10:21:06.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T10:23:06.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T10:25:06.684 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T10:27:06.860 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T10:29:07.080 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T10:31:07.257 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T10:33:07.420 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T10:35:07.576 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T10:37:07.744 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T10:39:07.952 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T10:41:08.120 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T10:43:08.292 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T10:45:08.572 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T10:45:08.648 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1