2024-02-23T10:49:34.734 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-23T10:49:34.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-23T10:49:34.869 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb44739de50>, signals=[15]) 2024-02-23T10:49:34.869 INFO:teuthology.lock.ops:Start node 'smithi032.front.sepia.ceph.com' reimaging 2024-02-23T10:49:34.870 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: reset os type and version on server 2024-02-23T10:49:34.870 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server 2024-02-23T10:49:34.883 INFO:teuthology.lock.ops:Start node 'smithi196.front.sepia.ceph.com' reimaging 2024-02-23T10:49:34.884 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: reset os type and version on server 2024-02-23T10:49:34.884 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server 2024-02-23T10:49:35.014 DEBUG:teuthology.provision.fog.smithi032:Requesting image smithi_centos_9.stream (ID 10) 2024-02-23T10:49:35.021 DEBUG:teuthology.provision.fog.smithi196:Requesting image smithi_centos_9.stream (ID 10) 2024-02-23T10:49:35.054 INFO:teuthology.provision.fog.smithi032:Scheduling deploy of centos 9.stream 2024-02-23T10:49:35.075 INFO:teuthology.provision.fog.smithi196:Scheduling deploy of centos 9.stream 2024-02-23T10:49:35.585 INFO:teuthology.orchestra.console.smithi032:Power off 2024-02-23T10:49:35.585 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-23T10:49:35.606 DEBUG:teuthology.orchestra.console.smithi032:power off output: Chassis Power Control: Down/Off 2024-02-23T10:49:35.606 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-23T10:49:35.632 INFO:teuthology.orchestra.console.smithi196:Power off 2024-02-23T10:49:35.633 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-23T10:49:35.640 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on 2024-02-23T10:49:35.654 DEBUG:teuthology.orchestra.console.smithi196:power off output: Chassis Power Control: Down/Off 2024-02-23T10:49:35.654 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-23T10:49:35.674 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2024-02-23T10:49:39.642 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-23T10:49:39.675 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-23T10:49:39.752 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on 2024-02-23T10:49:39.785 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2024-02-23T10:49:43.756 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-23T10:49:43.786 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-23T10:49:43.866 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off 2024-02-23T10:49:43.895 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off 2024-02-23T10:49:43.968 INFO:teuthology.orchestra.console.smithi032:Power off completed 2024-02-23T10:49:43.996 INFO:teuthology.orchestra.console.smithi196:Power off completed 2024-02-23T10:49:44.069 INFO:teuthology.orchestra.console.smithi032:Power on 2024-02-23T10:49:44.069 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-23T10:49:44.090 DEBUG:teuthology.orchestra.console.smithi032:power on output: Chassis Power Control: Up/On 2024-02-23T10:49:44.090 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-23T10:49:44.097 INFO:teuthology.orchestra.console.smithi196:Power on 2024-02-23T10:49:44.097 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-23T10:49:44.110 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off 2024-02-23T10:49:44.118 DEBUG:teuthology.orchestra.console.smithi196:power on output: Chassis Power Control: Up/On 2024-02-23T10:49:44.118 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-23T10:49:44.139 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off 2024-02-23T10:49:48.115 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-23T10:49:48.140 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-23T10:49:48.224 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off 2024-02-23T10:49:48.246 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off 2024-02-23T10:49:52.229 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-23T10:49:52.247 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-23T10:49:52.337 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on 2024-02-23T10:49:52.354 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2024-02-23T10:49:52.438 INFO:teuthology.orchestra.console.smithi032:Power on completed 2024-02-23T10:49:52.455 INFO:teuthology.orchestra.console.smithi196:Power on completed 2024-02-23T10:49:52.539 INFO:teuthology.provision.fog.smithi032:Waiting for deploy to finish 2024-02-23T10:49:52.556 INFO:teuthology.provision.fog.smithi196:Waiting for deploy to finish 2024-02-23T10:52:11.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-23T10:52:14.396 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2024-02-23T10:52:20.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-23T10:52:23.484 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2024-02-23T10:52:29.489 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-23T10:52:32.540 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2024-02-23T10:52:38.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-23T10:52:41.628 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2024-02-23T10:52:47.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-23T10:52:50.684 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2024-02-23T10:52:56.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-23T10:53:15.196 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2024-02-23T10:53:21.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-23T10:53:24.252 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2024-02-23T10:53:30.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-23T10:53:33.586 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-23T10:53:33.586 DEBUG:teuthology.orchestra.run.smithi032:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-23T10:53:49.675 INFO:teuthology.provision.fog.smithi032:Node is ready 2024-02-23T10:53:49.676 DEBUG:teuthology.orchestra.run.smithi032:> hostname 2024-02-23T10:53:49.695 INFO:teuthology.orchestra.run.smithi032.stdout:smithi046 2024-02-23T10:53:49.696 DEBUG:teuthology.orchestra.run.smithi032:> grep smithi046 /etc/hosts 2024-02-23T10:53:49.755 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2024-02-23T10:53:49.755 DEBUG:teuthology.orchestra.run.smithi032:> sudo hostname smithi032 2024-02-23T10:53:49.920 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/smithi046/smithi032/g' /etc/hosts 2024-02-23T10:53:49.955 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/172.21.15.46/172.21.15.32/g' /etc/hosts 2024-02-23T10:53:50.030 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/smithi046/smithi032/g' /etc/hostname 2024-02-23T10:53:50.103 DEBUG:teuthology.orchestra.run.smithi032:> sudo hostname smithi032 2024-02-23T10:53:50.174 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release 2024-02-23T10:53:50.230 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="CentOS Stream" 2024-02-23T10:53:50.230 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="9" 2024-02-23T10:53:50.230 INFO:teuthology.orchestra.run.smithi032.stdout:ID="centos" 2024-02-23T10:53:50.230 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE="rhel fedora" 2024-02-23T10:53:50.230 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="9" 2024-02-23T10:53:50.230 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM_ID="platform:el9" 2024-02-23T10:53:50.230 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-23T10:53:50.230 INFO:teuthology.orchestra.run.smithi032.stdout:ANSI_COLOR="0;31" 2024-02-23T10:53:50.231 INFO:teuthology.orchestra.run.smithi032.stdout:LOGO="fedora-logo-icon" 2024-02-23T10:53:50.231 INFO:teuthology.orchestra.run.smithi032.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-23T10:53:50.231 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://centos.org/" 2024-02-23T10:53:50.231 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-23T10:53:50.231 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-23T10:53:50.231 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-23T10:53:50.232 INFO:teuthology.provision.fog.smithi032:Deploy complete! 2024-02-23T10:53:50.242 DEBUG:teuthology.parallel:result is None 2024-02-23T10:54:12.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-23T10:54:15.836 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-02-23T10:54:21.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-23T10:54:24.892 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-02-23T10:54:30.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-23T10:54:33.948 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-02-23T10:54:39.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-23T10:54:43.036 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-02-23T10:54:49.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-23T10:54:52.124 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-02-23T10:54:58.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-23T10:55:01.212 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-02-23T10:55:07.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-23T10:55:25.756 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-02-23T10:55:31.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-23T10:55:34.812 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-02-23T10:55:40.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-23T10:55:43.900 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-02-23T10:55:49.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-23T10:55:50.255 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-23T10:55:50.256 DEBUG:teuthology.orchestra.run.smithi196:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-23T10:56:05.682 INFO:teuthology.provision.fog.smithi196:Node is ready 2024-02-23T10:56:05.682 DEBUG:teuthology.orchestra.run.smithi196:> hostname 2024-02-23T10:56:05.740 INFO:teuthology.orchestra.run.smithi196.stdout:smithi046 2024-02-23T10:56:05.740 DEBUG:teuthology.orchestra.run.smithi196:> grep smithi046 /etc/hosts 2024-02-23T10:56:05.797 INFO:teuthology.orchestra.run.smithi196.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2024-02-23T10:56:05.798 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname smithi196 2024-02-23T10:56:05.952 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/smithi046/smithi196/g' /etc/hosts 2024-02-23T10:56:05.984 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/172.21.15.46/172.21.15.196/g' /etc/hosts 2024-02-23T10:56:06.054 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/smithi046/smithi196/g' /etc/hostname 2024-02-23T10:56:06.124 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname smithi196 2024-02-23T10:56:06.192 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release 2024-02-23T10:56:06.247 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="CentOS Stream" 2024-02-23T10:56:06.248 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="9" 2024-02-23T10:56:06.248 INFO:teuthology.orchestra.run.smithi196.stdout:ID="centos" 2024-02-23T10:56:06.248 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="rhel fedora" 2024-02-23T10:56:06.248 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="9" 2024-02-23T10:56:06.248 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el9" 2024-02-23T10:56:06.248 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-23T10:56:06.248 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31" 2024-02-23T10:56:06.248 INFO:teuthology.orchestra.run.smithi196.stdout:LOGO="fedora-logo-icon" 2024-02-23T10:56:06.248 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-23T10:56:06.248 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://centos.org/" 2024-02-23T10:56:06.249 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-23T10:56:06.249 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-23T10:56:06.249 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-23T10:56:06.249 INFO:teuthology.provision.fog.smithi196:Deploy complete! 2024-02-23T10:56:06.250 DEBUG:teuthology.parallel:result is None 2024-02-23T10:56:06.456 INFO:teuthology.lock.ops:Checking smithi032.front.sepia.ceph.com 2024-02-23T10:56:06.456 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-23T10:56:06.483 INFO:teuthology.lock.ops:Checking smithi196.front.sepia.ceph.com 2024-02-23T10:56:06.483 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-23T10:56:06.509 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: set os type and version on server 2024-02-23T10:56:06.510 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-02-23T10:56:06.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-23T10:56:06.613 DEBUG:teuthology.orchestra.run.smithi032:> true 2024-02-23T10:56:06.794 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-02-23T10:56:06.794 DEBUG:teuthology.orchestra.run.smithi032:> uname -m 2024-02-23T10:56:06.849 INFO:teuthology.orchestra.run.smithi032.stdout:x86_64 2024-02-23T10:56:06.849 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release 2024-02-23T10:56:06.904 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="CentOS Stream" 2024-02-23T10:56:06.905 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="9" 2024-02-23T10:56:06.905 INFO:teuthology.orchestra.run.smithi032.stdout:ID="centos" 2024-02-23T10:56:06.905 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE="rhel fedora" 2024-02-23T10:56:06.905 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="9" 2024-02-23T10:56:06.905 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM_ID="platform:el9" 2024-02-23T10:56:06.905 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-23T10:56:06.905 INFO:teuthology.orchestra.run.smithi032.stdout:ANSI_COLOR="0;31" 2024-02-23T10:56:06.905 INFO:teuthology.orchestra.run.smithi032.stdout:LOGO="fedora-logo-icon" 2024-02-23T10:56:06.905 INFO:teuthology.orchestra.run.smithi032.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-23T10:56:06.905 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://centos.org/" 2024-02-23T10:56:06.905 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-23T10:56:06.905 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-23T10:56:06.905 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-23T10:56:06.906 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server 2024-02-23T10:56:06.925 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: set os type and version on server 2024-02-23T10:56:06.925 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-02-23T10:56:06.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-23T10:56:07.010 DEBUG:teuthology.orchestra.run.smithi196:> true 2024-02-23T10:56:07.079 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-02-23T10:56:07.079 DEBUG:teuthology.orchestra.run.smithi196:> uname -m 2024-02-23T10:56:07.134 INFO:teuthology.orchestra.run.smithi196.stdout:x86_64 2024-02-23T10:56:07.134 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release 2024-02-23T10:56:07.189 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="CentOS Stream" 2024-02-23T10:56:07.189 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="9" 2024-02-23T10:56:07.189 INFO:teuthology.orchestra.run.smithi196.stdout:ID="centos" 2024-02-23T10:56:07.189 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="rhel fedora" 2024-02-23T10:56:07.189 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="9" 2024-02-23T10:56:07.189 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el9" 2024-02-23T10:56:07.189 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-23T10:56:07.189 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31" 2024-02-23T10:56:07.189 INFO:teuthology.orchestra.run.smithi196.stdout:LOGO="fedora-logo-icon" 2024-02-23T10:56:07.190 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-23T10:56:07.190 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://centos.org/" 2024-02-23T10:56:07.190 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-23T10:56:07.190 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-23T10:56:07.190 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-23T10:56:07.190 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server 2024-02-23T10:56:07.208 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-23T10:56:07.292 INFO:teuthology.dispatcher.supervisor:Running job 7571877 2024-02-23T10:56:07.292 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-02-23_10:48:16-fs:upgrade-wip-64502-testing-default-smithi/7571877 --name vshankar-2024-02-23_10:48:16-fs:upgrade-wip-64502-testing-default-smithi --description fs:upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/vshankar-2024-02-23_10:48:16-fs:upgrade-wip-64502-testing-default-smithi/7571877/orig.config.yaml 2024-02-23T10:56:07.295 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-02-23_10:48:16-fs:upgrade-wip-64502-testing-default-smithi/7571877 2024-02-23T10:56:07.296 INFO:teuthology.dispatcher.supervisor:Job PID: 1101831 2024-02-23T10:56:07.296 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-23T10:58:07.397 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-23T11:00:07.490 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-23T11:02:07.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-23T11:04:07.805 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-23T11:06:07.989 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-23T11:08:08.161 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-23T11:10:08.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-23T11:12:08.518 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-23T11:14:08.689 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-23T11:16:08.865 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-23T11:18:09.056 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-23T11:20:09.244 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-23T11:22:09.416 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-23T11:24:09.596 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-23T11:26:09.776 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-23T11:28:09.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-23T11:30:10.109 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-23T11:32:10.277 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-23T11:34:10.458 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-23T11:36:10.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-23T11:38:10.802 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-23T11:40:10.976 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-23T11:42:11.157 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-23T11:44:11.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-23T11:46:11.504 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-23T11:48:11.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-23T11:50:11.844 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-23T11:52:12.025 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-23T11:54:12.193 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-23T11:56:12.365 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-23T11:58:12.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-23T12:00:12.716 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-23T12:02:12.886 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-23T12:04:13.073 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-23T12:06:13.245 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-23T12:08:13.421 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-23T12:10:13.569 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-23T12:12:13.741 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-23T12:14:13.882 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-23T12:16:14.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-23T12:18:14.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-23T12:20:14.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-23T12:22:14.560 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-23T12:24:14.696 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-23T12:26:14.844 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-23T12:28:14.941 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-23T12:30:15.116 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-23T12:32:15.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-23T12:34:15.396 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-23T12:36:15.549 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-23T12:36:15.616 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1