2024-02-16T21:54:58.810 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-16T21:54:58.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T21:54:58.948 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f0a40fb3c10>, signals=[15]) 2024-02-16T21:54:58.949 INFO:teuthology.lock.ops:Start node 'smithi089.front.sepia.ceph.com' reimaging 2024-02-16T21:54:58.949 INFO:teuthology.lock.ops:Updating [smithi089.front.sepia.ceph.com]: reset os type and version on server 2024-02-16T21:54:58.949 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2024-02-16T21:54:58.965 INFO:teuthology.lock.ops:Start node 'smithi143.front.sepia.ceph.com' reimaging 2024-02-16T21:54:58.965 INFO:teuthology.lock.ops:Updating [smithi143.front.sepia.ceph.com]: reset os type and version on server 2024-02-16T21:54:58.965 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2024-02-16T21:54:59.073 DEBUG:teuthology.provision.fog.smithi089:Requesting image smithi_centos_9.stream (ID 10) 2024-02-16T21:54:59.106 DEBUG:teuthology.provision.fog.smithi143:Requesting image smithi_centos_9.stream (ID 10) 2024-02-16T21:54:59.123 INFO:teuthology.provision.fog.smithi089:Scheduling deploy of centos 9.stream 2024-02-16T21:54:59.155 INFO:teuthology.provision.fog.smithi143:Scheduling deploy of centos 9.stream 2024-02-16T21:54:59.454 INFO:teuthology.orchestra.console.smithi143:Power off 2024-02-16T21:54:59.454 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-16T21:54:59.467 INFO:teuthology.orchestra.console.smithi089:Power off 2024-02-16T21:54:59.467 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-16T21:54:59.475 DEBUG:teuthology.orchestra.console.smithi143:power off output: Chassis Power Control: Down/Off 2024-02-16T21:54:59.476 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-16T21:54:59.486 DEBUG:teuthology.orchestra.console.smithi089:power off output: Chassis Power Control: Down/Off 2024-02-16T21:54:59.487 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-16T21:54:59.497 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on 2024-02-16T21:54:59.506 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on 2024-02-16T21:55:03.502 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-16T21:55:03.509 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-16T21:55:03.611 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on 2024-02-16T21:55:03.617 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on 2024-02-16T21:55:07.616 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-16T21:55:07.622 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-16T21:55:07.725 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on 2024-02-16T21:55:07.730 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on 2024-02-16T21:55:11.728 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-16T21:55:11.735 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-16T21:55:11.837 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off 2024-02-16T21:55:11.845 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is off 2024-02-16T21:55:11.938 INFO:teuthology.orchestra.console.smithi143:Power off completed 2024-02-16T21:55:11.945 INFO:teuthology.orchestra.console.smithi089:Power off completed 2024-02-16T21:55:12.039 INFO:teuthology.orchestra.console.smithi143:Power on 2024-02-16T21:55:12.039 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-16T21:55:12.047 INFO:teuthology.orchestra.console.smithi089:Power on 2024-02-16T21:55:12.047 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-16T21:55:12.060 DEBUG:teuthology.orchestra.console.smithi143:power on output: Chassis Power Control: Up/On 2024-02-16T21:55:12.060 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-16T21:55:12.069 DEBUG:teuthology.orchestra.console.smithi089:power on output: Chassis Power Control: Up/On 2024-02-16T21:55:12.069 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-16T21:55:12.081 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off 2024-02-16T21:55:12.089 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is off 2024-02-16T21:55:16.083 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-16T21:55:16.090 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-16T21:55:16.192 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on 2024-02-16T21:55:16.197 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is off 2024-02-16T21:55:16.294 INFO:teuthology.orchestra.console.smithi143:Power on completed 2024-02-16T21:55:16.394 INFO:teuthology.provision.fog.smithi143:Waiting for deploy to finish 2024-02-16T21:55:20.202 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-16T21:55:20.311 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on 2024-02-16T21:55:20.412 INFO:teuthology.orchestra.console.smithi089:Power on completed 2024-02-16T21:55:20.513 INFO:teuthology.provision.fog.smithi089:Waiting for deploy to finish 2024-02-16T21:57:47.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T21:57:51.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T21:58:05.888 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2024-02-16T21:58:09.980 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2024-02-16T21:58:11.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T21:58:14.972 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2024-02-16T21:58:15.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T21:58:19.036 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2024-02-16T21:58:20.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T21:58:24.028 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2024-02-16T21:58:25.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T21:58:28.092 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2024-02-16T21:58:30.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T21:58:33.084 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2024-02-16T21:58:34.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T21:58:37.148 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2024-02-16T21:58:39.087 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T21:58:42.144 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2024-02-16T21:58:43.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T21:58:46.204 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2024-02-16T21:58:48.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T21:58:52.210 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T21:59:10.652 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2024-02-16T21:59:16.659 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T21:59:19.740 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2024-02-16T21:59:25.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T21:59:28.800 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2024-02-16T21:59:34.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T21:59:35.082 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-16T21:59:35.083 DEBUG:teuthology.orchestra.run.smithi089:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-16T21:59:48.149 WARNING:teuthology.provision.fog.smithi143:timed out 2024-02-16T21:59:50.506 INFO:teuthology.provision.fog.smithi089:Node is ready 2024-02-16T21:59:50.507 DEBUG:teuthology.orchestra.run.smithi089:> hostname 2024-02-16T21:59:50.563 INFO:teuthology.orchestra.run.smithi089.stdout:smithi089.front.sepia.ceph.com 2024-02-16T21:59:50.563 DEBUG:teuthology.orchestra.run.smithi089:> grep smithi089.front.sepia.ceph.com /etc/hosts 2024-02-16T21:59:50.619 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89 smithi089.front.sepia.ceph.com smithi089 2024-02-16T21:59:50.619 DEBUG:teuthology.orchestra.run.smithi089:> sudo hostname smithi089 2024-02-16T21:59:50.727 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i -e 's/smithi089.front.sepia.ceph.com/smithi089/g' /etc/hosts 2024-02-16T21:59:50.755 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i -e 's/172.21.15.89/172.21.15.89/g' /etc/hosts 2024-02-16T21:59:50.822 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i -e 's/smithi089.front.sepia.ceph.com/smithi089/g' /etc/hostname 2024-02-16T21:59:50.891 DEBUG:teuthology.orchestra.run.smithi089:> sudo hostname smithi089 2024-02-16T21:59:50.958 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release 2024-02-16T21:59:51.013 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="CentOS Stream" 2024-02-16T21:59:51.013 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="9" 2024-02-16T21:59:51.013 INFO:teuthology.orchestra.run.smithi089.stdout:ID="centos" 2024-02-16T21:59:51.013 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE="rhel fedora" 2024-02-16T21:59:51.013 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="9" 2024-02-16T21:59:51.013 INFO:teuthology.orchestra.run.smithi089.stdout:PLATFORM_ID="platform:el9" 2024-02-16T21:59:51.013 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-16T21:59:51.013 INFO:teuthology.orchestra.run.smithi089.stdout:ANSI_COLOR="0;31" 2024-02-16T21:59:51.013 INFO:teuthology.orchestra.run.smithi089.stdout:LOGO="fedora-logo-icon" 2024-02-16T21:59:51.014 INFO:teuthology.orchestra.run.smithi089.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-16T21:59:51.014 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://centos.org/" 2024-02-16T21:59:51.014 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-16T21:59:51.014 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-16T21:59:51.014 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-16T21:59:51.014 INFO:teuthology.provision.fog.smithi089:Deploy complete! 2024-02-16T21:59:51.016 DEBUG:teuthology.parallel:result is None 2024-02-16T21:59:54.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T21:59:54.398 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-16T21:59:54.398 DEBUG:teuthology.orchestra.run.smithi143:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-16T21:59:54.716 INFO:teuthology.provision.fog.smithi143:Node is ready 2024-02-16T21:59:54.716 DEBUG:teuthology.orchestra.run.smithi143:> hostname 2024-02-16T21:59:54.730 INFO:teuthology.orchestra.run.smithi143.stdout:smithi143.front.sepia.ceph.com 2024-02-16T21:59:54.731 DEBUG:teuthology.orchestra.run.smithi143:> grep smithi143.front.sepia.ceph.com /etc/hosts 2024-02-16T21:59:54.786 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.15.143 smithi143.front.sepia.ceph.com smithi143 2024-02-16T21:59:54.787 DEBUG:teuthology.orchestra.run.smithi143:> sudo hostname smithi143 2024-02-16T21:59:54.910 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/smithi143.front.sepia.ceph.com/smithi143/g' /etc/hosts 2024-02-16T21:59:54.938 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/172.21.15.143/172.21.15.143/g' /etc/hosts 2024-02-16T21:59:55.005 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/smithi143.front.sepia.ceph.com/smithi143/g' /etc/hostname 2024-02-16T21:59:55.072 DEBUG:teuthology.orchestra.run.smithi143:> sudo hostname smithi143 2024-02-16T21:59:55.138 DEBUG:teuthology.orchestra.run.smithi143:> cat /etc/os-release 2024-02-16T21:59:55.192 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="CentOS Stream" 2024-02-16T21:59:55.192 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="9" 2024-02-16T21:59:55.192 INFO:teuthology.orchestra.run.smithi143.stdout:ID="centos" 2024-02-16T21:59:55.192 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE="rhel fedora" 2024-02-16T21:59:55.192 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="9" 2024-02-16T21:59:55.192 INFO:teuthology.orchestra.run.smithi143.stdout:PLATFORM_ID="platform:el9" 2024-02-16T21:59:55.193 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-16T21:59:55.193 INFO:teuthology.orchestra.run.smithi143.stdout:ANSI_COLOR="0;31" 2024-02-16T21:59:55.193 INFO:teuthology.orchestra.run.smithi143.stdout:LOGO="fedora-logo-icon" 2024-02-16T21:59:55.193 INFO:teuthology.orchestra.run.smithi143.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-16T21:59:55.193 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://centos.org/" 2024-02-16T21:59:55.193 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-16T21:59:55.193 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-16T21:59:55.193 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-16T21:59:55.193 INFO:teuthology.provision.fog.smithi143:Deploy complete! 2024-02-16T21:59:55.194 DEBUG:teuthology.parallel:result is None 2024-02-16T21:59:55.388 INFO:teuthology.lock.ops:Checking smithi089.front.sepia.ceph.com 2024-02-16T21:59:55.389 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-16T21:59:55.408 INFO:teuthology.lock.ops:Checking smithi143.front.sepia.ceph.com 2024-02-16T21:59:55.408 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-16T21:59:55.425 INFO:teuthology.lock.ops:Updating [smithi089.front.sepia.ceph.com]: set os type and version on server 2024-02-16T21:59:55.425 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-02-16T21:59:55.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T21:59:55.514 DEBUG:teuthology.orchestra.run.smithi089:> true 2024-02-16T21:59:55.583 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-02-16T21:59:55.584 DEBUG:teuthology.orchestra.run.smithi089:> uname -m 2024-02-16T21:59:55.639 INFO:teuthology.orchestra.run.smithi089.stdout:x86_64 2024-02-16T21:59:55.640 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release 2024-02-16T21:59:55.695 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="CentOS Stream" 2024-02-16T21:59:55.695 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="9" 2024-02-16T21:59:55.695 INFO:teuthology.orchestra.run.smithi089.stdout:ID="centos" 2024-02-16T21:59:55.695 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE="rhel fedora" 2024-02-16T21:59:55.695 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="9" 2024-02-16T21:59:55.695 INFO:teuthology.orchestra.run.smithi089.stdout:PLATFORM_ID="platform:el9" 2024-02-16T21:59:55.695 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-16T21:59:55.695 INFO:teuthology.orchestra.run.smithi089.stdout:ANSI_COLOR="0;31" 2024-02-16T21:59:55.695 INFO:teuthology.orchestra.run.smithi089.stdout:LOGO="fedora-logo-icon" 2024-02-16T21:59:55.695 INFO:teuthology.orchestra.run.smithi089.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-16T21:59:55.696 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://centos.org/" 2024-02-16T21:59:55.696 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-16T21:59:55.696 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-16T21:59:55.696 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-16T21:59:55.696 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2024-02-16T21:59:55.715 INFO:teuthology.lock.ops:Updating [smithi143.front.sepia.ceph.com]: set os type and version on server 2024-02-16T21:59:55.716 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2024-02-16T21:59:55.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T21:59:55.801 DEBUG:teuthology.orchestra.run.smithi143:> true 2024-02-16T21:59:55.870 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi143.front.sepia.ceph.com' 2024-02-16T21:59:55.870 DEBUG:teuthology.orchestra.run.smithi143:> uname -m 2024-02-16T21:59:55.924 INFO:teuthology.orchestra.run.smithi143.stdout:x86_64 2024-02-16T21:59:55.924 DEBUG:teuthology.orchestra.run.smithi143:> cat /etc/os-release 2024-02-16T21:59:55.979 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="CentOS Stream" 2024-02-16T21:59:55.979 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="9" 2024-02-16T21:59:55.979 INFO:teuthology.orchestra.run.smithi143.stdout:ID="centos" 2024-02-16T21:59:55.979 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE="rhel fedora" 2024-02-16T21:59:55.980 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="9" 2024-02-16T21:59:55.980 INFO:teuthology.orchestra.run.smithi143.stdout:PLATFORM_ID="platform:el9" 2024-02-16T21:59:55.980 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-16T21:59:55.980 INFO:teuthology.orchestra.run.smithi143.stdout:ANSI_COLOR="0;31" 2024-02-16T21:59:55.980 INFO:teuthology.orchestra.run.smithi143.stdout:LOGO="fedora-logo-icon" 2024-02-16T21:59:55.980 INFO:teuthology.orchestra.run.smithi143.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-16T21:59:55.980 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://centos.org/" 2024-02-16T21:59:55.980 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-16T21:59:55.980 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-16T21:59:55.980 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-16T21:59:55.981 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2024-02-16T21:59:56.150 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T21:59:56.305 INFO:teuthology.dispatcher.supervisor:Running job 7562727 2024-02-16T21:59:56.305 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-02-16_18:26:20-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7562727 --name pdonnell-2024-02-16_18:26:20-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi --description fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 0a 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/pdonnell-2024-02-16_18:26:20-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7562727/orig.config.yaml 2024-02-16T21:59:56.308 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-02-16_18:26:20-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7562727 2024-02-16T21:59:56.308 INFO:teuthology.dispatcher.supervisor:Job PID: 1561779 2024-02-16T21:59:56.308 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-16T22:01:56.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T22:03:56.586 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T22:05:56.761 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T22:07:56.925 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T22:09:57.101 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T22:11:57.264 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T22:13:57.433 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T22:15:57.592 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T22:17:57.733 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T22:19:57.901 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T22:21:58.070 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T22:23:58.172 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T22:25:58.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T22:27:58.509 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T22:29:58.669 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T22:31:58.838 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T22:33:58.990 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T22:35:59.151 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T22:37:59.304 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T22:39:59.472 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T22:41:59.689 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T22:43:59.861 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T22:46:00.024 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T22:48:00.188 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T22:50:00.352 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T22:52:00.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T22:54:00.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T22:56:00.809 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T22:58:00.981 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T23:00:01.157 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T23:02:01.329 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T23:04:01.469 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T23:06:01.640 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T23:08:01.812 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T23:10:01.986 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T23:12:02.160 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T23:14:02.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T23:14:02.409 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1