2024-02-28T06:41:11.902 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-28T06:41:11.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T06:41:12.035 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff787053c10>, signals=[15]) 2024-02-28T06:41:12.036 INFO:teuthology.lock.ops:Start node 'smithi086.front.sepia.ceph.com' reimaging 2024-02-28T06:41:12.036 INFO:teuthology.lock.ops:Updating [smithi086.front.sepia.ceph.com]: reset os type and version on server 2024-02-28T06:41:12.036 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2024-02-28T06:41:12.057 INFO:teuthology.lock.ops:Start node 'smithi196.front.sepia.ceph.com' reimaging 2024-02-28T06:41:12.057 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: reset os type and version on server 2024-02-28T06:41:12.057 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server 2024-02-28T06:41:12.163 DEBUG:teuthology.provision.fog.smithi086:Requesting image smithi_centos_9.stream (ID 10) 2024-02-28T06:41:12.189 DEBUG:teuthology.provision.fog.smithi196:Requesting image smithi_centos_9.stream (ID 10) 2024-02-28T06:41:12.201 INFO:teuthology.provision.fog.smithi086:Scheduling deploy of centos 9.stream 2024-02-28T06:41:12.243 INFO:teuthology.provision.fog.smithi196:Scheduling deploy of centos 9.stream 2024-02-28T06:41:12.735 INFO:teuthology.orchestra.console.smithi196:Power off 2024-02-28T06:41:12.735 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-28T06:41:12.748 INFO:teuthology.orchestra.console.smithi086:Power off 2024-02-28T06:41:12.749 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-28T06:41:12.756 DEBUG:teuthology.orchestra.console.smithi196:power off output: Chassis Power Control: Down/Off 2024-02-28T06:41:12.757 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T06:41:12.767 DEBUG:teuthology.orchestra.console.smithi086:power off output: Chassis Power Control: Down/Off 2024-02-28T06:41:12.768 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T06:41:12.777 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off 2024-02-28T06:41:12.787 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off 2024-02-28T06:41:12.879 INFO:teuthology.orchestra.console.smithi196:Power off completed 2024-02-28T06:41:12.888 INFO:teuthology.orchestra.console.smithi086:Power off completed 2024-02-28T06:41:12.980 INFO:teuthology.orchestra.console.smithi196:Power on 2024-02-28T06:41:12.980 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-28T06:41:12.989 INFO:teuthology.orchestra.console.smithi086:Power on 2024-02-28T06:41:12.990 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-28T06:41:13.001 DEBUG:teuthology.orchestra.console.smithi196:power on output: Chassis Power Control: Up/On 2024-02-28T06:41:13.001 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T06:41:13.009 DEBUG:teuthology.orchestra.console.smithi086:power on output: Chassis Power Control: Up/On 2024-02-28T06:41:13.010 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T06:41:13.022 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off 2024-02-28T06:41:13.032 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off 2024-02-28T06:41:17.024 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T06:41:17.033 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T06:41:17.133 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off 2024-02-28T06:41:17.141 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off 2024-02-28T06:41:21.136 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T06:41:21.143 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T06:41:21.245 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2024-02-28T06:41:21.302 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on 2024-02-28T06:41:21.346 INFO:teuthology.orchestra.console.smithi196:Power on completed 2024-02-28T06:41:21.403 INFO:teuthology.orchestra.console.smithi086:Power on completed 2024-02-28T06:41:21.447 INFO:teuthology.provision.fog.smithi196:Waiting for deploy to finish 2024-02-28T06:41:21.504 INFO:teuthology.provision.fog.smithi086:Waiting for deploy to finish 2024-02-28T06:44:53.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T06:44:56.892 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-02-28T06:45:02.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T06:45:05.948 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-02-28T06:45:11.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T06:45:15.004 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-02-28T06:45:21.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T06:45:24.060 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-02-28T06:45:30.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T06:45:33.148 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-02-28T06:45:39.149 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T06:45:42.204 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-02-28T06:45:48.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T06:45:51.260 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-02-28T06:45:54.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T06:45:57.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T06:45:57.596 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-02-28T06:46:03.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T06:46:06.652 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-02-28T06:46:07.420 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-02-28T06:46:12.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T06:46:13.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T06:46:15.708 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-02-28T06:46:16.476 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-02-28T06:46:21.713 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T06:46:22.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T06:46:24.764 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-02-28T06:46:25.532 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-02-28T06:46:30.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T06:46:31.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T06:46:33.443 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-28T06:46:33.443 DEBUG:teuthology.orchestra.run.smithi086:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-28T06:46:33.820 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-02-28T06:46:39.821 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T06:46:42.876 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-02-28T06:46:48.877 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T06:46:51.932 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-02-28T06:46:53.775 INFO:teuthology.provision.fog.smithi086:Node is ready 2024-02-28T06:46:53.775 DEBUG:teuthology.orchestra.run.smithi086:> hostname 2024-02-28T06:46:53.793 INFO:teuthology.orchestra.run.smithi086.stdout:smithi086.front.sepia.ceph.com 2024-02-28T06:46:53.793 DEBUG:teuthology.orchestra.run.smithi086:> grep smithi086.front.sepia.ceph.com /etc/hosts 2024-02-28T06:46:53.851 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86 smithi086.front.sepia.ceph.com smithi086 2024-02-28T06:46:53.852 DEBUG:teuthology.orchestra.run.smithi086:> sudo hostname smithi086 2024-02-28T06:46:54.015 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/smithi086.front.sepia.ceph.com/smithi086/g' /etc/hosts 2024-02-28T06:46:54.048 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/172.21.15.86/172.21.15.86/g' /etc/hosts 2024-02-28T06:46:54.118 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/smithi086.front.sepia.ceph.com/smithi086/g' /etc/hostname 2024-02-28T06:46:54.188 DEBUG:teuthology.orchestra.run.smithi086:> sudo hostname smithi086 2024-02-28T06:46:54.256 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release 2024-02-28T06:46:54.311 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="CentOS Stream" 2024-02-28T06:46:54.311 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="9" 2024-02-28T06:46:54.311 INFO:teuthology.orchestra.run.smithi086.stdout:ID="centos" 2024-02-28T06:46:54.312 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="rhel fedora" 2024-02-28T06:46:54.312 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="9" 2024-02-28T06:46:54.312 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el9" 2024-02-28T06:46:54.312 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-28T06:46:54.312 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31" 2024-02-28T06:46:54.312 INFO:teuthology.orchestra.run.smithi086.stdout:LOGO="fedora-logo-icon" 2024-02-28T06:46:54.312 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-28T06:46:54.312 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://centos.org/" 2024-02-28T06:46:54.312 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-28T06:46:54.312 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-28T06:46:54.312 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-28T06:46:54.313 INFO:teuthology.provision.fog.smithi086:Deploy complete! 2024-02-28T06:46:54.314 DEBUG:teuthology.parallel:result is None 2024-02-28T06:46:57.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T06:47:16.284 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-02-28T06:47:22.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T06:47:25.376 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-02-28T06:47:31.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T06:47:34.460 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-02-28T06:47:40.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T06:47:40.756 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-28T06:47:40.756 DEBUG:teuthology.orchestra.run.smithi196:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-28T06:48:01.122 INFO:teuthology.provision.fog.smithi196:Node is ready 2024-02-28T06:48:01.122 DEBUG:teuthology.orchestra.run.smithi196:> hostname 2024-02-28T06:48:01.181 INFO:teuthology.orchestra.run.smithi196.stdout:smithi196.front.sepia.ceph.com 2024-02-28T06:48:01.181 DEBUG:teuthology.orchestra.run.smithi196:> grep smithi196.front.sepia.ceph.com /etc/hosts 2024-02-28T06:48:01.237 INFO:teuthology.orchestra.run.smithi196.stdout:172.21.15.196 smithi196.front.sepia.ceph.com smithi196 2024-02-28T06:48:01.238 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname smithi196 2024-02-28T06:48:01.382 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/smithi196.front.sepia.ceph.com/smithi196/g' /etc/hosts 2024-02-28T06:48:01.412 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/172.21.15.196/172.21.15.196/g' /etc/hosts 2024-02-28T06:48:01.482 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/smithi196.front.sepia.ceph.com/smithi196/g' /etc/hostname 2024-02-28T06:48:01.551 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname smithi196 2024-02-28T06:48:01.619 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release 2024-02-28T06:48:01.673 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="CentOS Stream" 2024-02-28T06:48:01.673 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="9" 2024-02-28T06:48:01.673 INFO:teuthology.orchestra.run.smithi196.stdout:ID="centos" 2024-02-28T06:48:01.673 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="rhel fedora" 2024-02-28T06:48:01.673 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="9" 2024-02-28T06:48:01.673 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el9" 2024-02-28T06:48:01.673 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-28T06:48:01.673 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31" 2024-02-28T06:48:01.674 INFO:teuthology.orchestra.run.smithi196.stdout:LOGO="fedora-logo-icon" 2024-02-28T06:48:01.674 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-28T06:48:01.674 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://centos.org/" 2024-02-28T06:48:01.674 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-28T06:48:01.674 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-28T06:48:01.674 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-28T06:48:01.674 INFO:teuthology.provision.fog.smithi196:Deploy complete! 2024-02-28T06:48:01.674 DEBUG:teuthology.parallel:result is None 2024-02-28T06:48:01.866 INFO:teuthology.lock.ops:Checking smithi086.front.sepia.ceph.com 2024-02-28T06:48:01.867 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-28T06:48:01.898 INFO:teuthology.lock.ops:Checking smithi196.front.sepia.ceph.com 2024-02-28T06:48:01.898 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-28T06:48:01.916 INFO:teuthology.lock.ops:Updating [smithi086.front.sepia.ceph.com]: set os type and version on server 2024-02-28T06:48:01.916 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-02-28T06:48:01.917 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T06:48:02.003 DEBUG:teuthology.orchestra.run.smithi086:> true 2024-02-28T06:48:02.174 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-02-28T06:48:02.174 DEBUG:teuthology.orchestra.run.smithi086:> uname -m 2024-02-28T06:48:02.228 INFO:teuthology.orchestra.run.smithi086.stdout:x86_64 2024-02-28T06:48:02.228 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release 2024-02-28T06:48:02.282 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="CentOS Stream" 2024-02-28T06:48:02.282 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="9" 2024-02-28T06:48:02.282 INFO:teuthology.orchestra.run.smithi086.stdout:ID="centos" 2024-02-28T06:48:02.282 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="rhel fedora" 2024-02-28T06:48:02.282 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="9" 2024-02-28T06:48:02.282 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el9" 2024-02-28T06:48:02.282 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-28T06:48:02.282 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31" 2024-02-28T06:48:02.282 INFO:teuthology.orchestra.run.smithi086.stdout:LOGO="fedora-logo-icon" 2024-02-28T06:48:02.282 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-28T06:48:02.282 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://centos.org/" 2024-02-28T06:48:02.283 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-28T06:48:02.283 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-28T06:48:02.283 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-28T06:48:02.283 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2024-02-28T06:48:02.307 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: set os type and version on server 2024-02-28T06:48:02.307 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-02-28T06:48:02.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T06:48:02.395 DEBUG:teuthology.orchestra.run.smithi196:> true 2024-02-28T06:48:02.462 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-02-28T06:48:02.462 DEBUG:teuthology.orchestra.run.smithi196:> uname -m 2024-02-28T06:48:02.516 INFO:teuthology.orchestra.run.smithi196.stdout:x86_64 2024-02-28T06:48:02.516 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release 2024-02-28T06:48:02.570 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="CentOS Stream" 2024-02-28T06:48:02.571 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="9" 2024-02-28T06:48:02.571 INFO:teuthology.orchestra.run.smithi196.stdout:ID="centos" 2024-02-28T06:48:02.571 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="rhel fedora" 2024-02-28T06:48:02.571 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="9" 2024-02-28T06:48:02.571 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el9" 2024-02-28T06:48:02.571 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-28T06:48:02.571 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31" 2024-02-28T06:48:02.571 INFO:teuthology.orchestra.run.smithi196.stdout:LOGO="fedora-logo-icon" 2024-02-28T06:48:02.571 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-28T06:48:02.571 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://centos.org/" 2024-02-28T06:48:02.571 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-28T06:48:02.571 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-28T06:48:02.571 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-28T06:48:02.572 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server 2024-02-28T06:48:02.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T06:48:02.699 INFO:teuthology.dispatcher.supervisor:Running job 7575111 2024-02-28T06:48:02.699 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-02-28_06:39:32-fs:upgrade-main-testing-default-smithi/7575111 --name vshankar-2024-02-28_06:39:32-fs:upgrade-main-testing-default-smithi --description fs:upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/vshankar-2024-02-28_06:39:32-fs:upgrade-main-testing-default-smithi/7575111/orig.config.yaml 2024-02-28T06:48:02.702 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-02-28_06:39:32-fs:upgrade-main-testing-default-smithi/7575111 2024-02-28T06:48:02.702 INFO:teuthology.dispatcher.supervisor:Job PID: 455881 2024-02-28T06:48:02.702 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-28T06:50:02.798 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T06:52:02.969 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T06:54:03.140 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T06:56:03.293 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T06:58:03.460 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T07:00:03.632 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T07:02:03.796 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T07:04:03.961 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T07:06:04.132 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T07:08:04.310 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T07:10:04.486 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T07:12:04.660 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T07:14:04.821 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T07:14:04.897 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1