2024-02-28T06:41:19.128 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-28T06:41:19.129 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T06:41:19.264 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6be810bc10>, signals=[15]) 2024-02-28T06:41:19.265 INFO:teuthology.lock.ops:Start node 'smithi084.front.sepia.ceph.com' reimaging 2024-02-28T06:41:19.265 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: reset os type and version on server 2024-02-28T06:41:19.265 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2024-02-28T06:41:19.285 INFO:teuthology.lock.ops:Start node 'smithi112.front.sepia.ceph.com' reimaging 2024-02-28T06:41:19.285 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: reset os type and version on server 2024-02-28T06:41:19.285 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2024-02-28T06:41:19.394 DEBUG:teuthology.provision.fog.smithi084:Requesting image smithi_centos_9.stream (ID 10) 2024-02-28T06:41:19.425 DEBUG:teuthology.provision.fog.smithi112:Requesting image smithi_centos_9.stream (ID 10) 2024-02-28T06:41:19.440 INFO:teuthology.provision.fog.smithi084:Scheduling deploy of centos 9.stream 2024-02-28T06:41:19.484 INFO:teuthology.provision.fog.smithi112:Scheduling deploy of centos 9.stream 2024-02-28T06:41:20.169 INFO:teuthology.orchestra.console.smithi084:Power off 2024-02-28T06:41:20.170 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-28T06:41:20.183 INFO:teuthology.orchestra.console.smithi112:Power off 2024-02-28T06:41:20.184 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-28T06:41:20.192 DEBUG:teuthology.orchestra.console.smithi084:power off output: Chassis Power Control: Down/Off 2024-02-28T06:41:20.193 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T06:41:20.205 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off 2024-02-28T06:41:20.205 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T06:41:20.214 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2024-02-28T06:41:20.226 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2024-02-28T06:41:24.216 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T06:41:24.227 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T06:41:24.325 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2024-02-28T06:41:24.335 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2024-02-28T06:41:28.330 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T06:41:28.336 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T06:41:28.439 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2024-02-28T06:41:28.443 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2024-02-28T06:41:32.444 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T06:41:32.450 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T06:41:32.552 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2024-02-28T06:41:32.560 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2024-02-28T06:41:32.653 INFO:teuthology.orchestra.console.smithi084:Power off completed 2024-02-28T06:41:32.661 INFO:teuthology.orchestra.console.smithi112:Power off completed 2024-02-28T06:41:32.754 INFO:teuthology.orchestra.console.smithi084:Power on 2024-02-28T06:41:32.754 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-28T06:41:32.762 INFO:teuthology.orchestra.console.smithi112:Power on 2024-02-28T06:41:32.763 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-28T06:41:32.778 DEBUG:teuthology.orchestra.console.smithi084:power on output: Chassis Power Control: Up/On 2024-02-28T06:41:32.778 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T06:41:32.786 DEBUG:teuthology.orchestra.console.smithi112:power on output: Chassis Power Control: Up/On 2024-02-28T06:41:32.786 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T06:41:32.799 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2024-02-28T06:41:32.806 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2024-02-28T06:41:36.803 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T06:41:36.809 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T06:41:36.912 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2024-02-28T06:41:36.916 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2024-02-28T06:41:37.017 INFO:teuthology.orchestra.console.smithi112:Power on completed 2024-02-28T06:41:37.117 INFO:teuthology.provision.fog.smithi112:Waiting for deploy to finish 2024-02-28T06:41:40.916 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T06:41:41.025 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2024-02-28T06:41:41.125 INFO:teuthology.orchestra.console.smithi084:Power on completed 2024-02-28T06:41:41.226 INFO:teuthology.provision.fog.smithi084:Waiting for deploy to finish 2024-02-28T06:45:48.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T06:45:51.196 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-02-28T06:45:57.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T06:46:00.252 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-02-28T06:46:06.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T06:46:09.311 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-02-28T06:46:15.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T06:46:18.364 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-02-28T06:46:24.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T06:46:27.452 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-02-28T06:46:33.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T06:46:51.964 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-02-28T06:46:57.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T06:47:01.052 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-02-28T06:47:07.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T06:47:10.108 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-02-28T06:47:16.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T06:47:16.323 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-28T06:47:16.323 DEBUG:teuthology.orchestra.run.smithi112:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-28T06:47:36.660 INFO:teuthology.provision.fog.smithi112:Node is ready 2024-02-28T06:47:36.660 DEBUG:teuthology.orchestra.run.smithi112:> hostname 2024-02-28T06:47:36.678 INFO:teuthology.orchestra.run.smithi112.stdout:smithi112.front.sepia.ceph.com 2024-02-28T06:47:36.679 DEBUG:teuthology.orchestra.run.smithi112:> grep smithi112.front.sepia.ceph.com /etc/hosts 2024-02-28T06:47:36.736 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112 smithi112.front.sepia.ceph.com smithi112 2024-02-28T06:47:36.736 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112 2024-02-28T06:47:36.857 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hosts 2024-02-28T06:47:36.886 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/172.21.15.112/172.21.15.112/g' /etc/hosts 2024-02-28T06:47:36.956 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hostname 2024-02-28T06:47:37.026 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112 2024-02-28T06:47:37.094 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2024-02-28T06:47:37.150 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="CentOS Stream" 2024-02-28T06:47:37.150 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="9" 2024-02-28T06:47:37.150 INFO:teuthology.orchestra.run.smithi112.stdout:ID="centos" 2024-02-28T06:47:37.150 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="rhel fedora" 2024-02-28T06:47:37.150 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="9" 2024-02-28T06:47:37.150 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el9" 2024-02-28T06:47:37.151 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-28T06:47:37.151 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2024-02-28T06:47:37.151 INFO:teuthology.orchestra.run.smithi112.stdout:LOGO="fedora-logo-icon" 2024-02-28T06:47:37.151 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-28T06:47:37.151 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://centos.org/" 2024-02-28T06:47:37.151 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-28T06:47:37.151 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-28T06:47:37.151 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-28T06:47:37.152 INFO:teuthology.provision.fog.smithi112:Deploy complete! 2024-02-28T06:47:37.153 DEBUG:teuthology.parallel:result is None 2024-02-28T06:48:35.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T06:48:38.364 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-02-28T06:48:44.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T06:48:47.420 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-02-28T06:48:53.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T06:48:56.508 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-02-28T06:49:02.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T06:49:05.600 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-02-28T06:49:11.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T06:49:14.684 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-02-28T06:49:20.691 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T06:49:23.774 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-02-28T06:49:29.778 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T06:49:32.860 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-02-28T06:49:38.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T06:49:57.312 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-02-28T06:50:03.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T06:50:06.364 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-02-28T06:50:12.369 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T06:50:13.102 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-28T06:50:13.102 DEBUG:teuthology.orchestra.run.smithi084:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-28T06:50:38.712 INFO:teuthology.provision.fog.smithi084:Node is ready 2024-02-28T06:50:38.712 DEBUG:teuthology.orchestra.run.smithi084:> hostname 2024-02-28T06:50:38.731 INFO:teuthology.orchestra.run.smithi084.stdout:smithi084.front.sepia.ceph.com 2024-02-28T06:50:38.731 DEBUG:teuthology.orchestra.run.smithi084:> grep smithi084.front.sepia.ceph.com /etc/hosts 2024-02-28T06:50:38.787 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84 smithi084.front.sepia.ceph.com smithi084 2024-02-28T06:50:38.788 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname smithi084 2024-02-28T06:50:38.914 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/smithi084.front.sepia.ceph.com/smithi084/g' /etc/hosts 2024-02-28T06:50:38.944 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/172.21.15.84/172.21.15.84/g' /etc/hosts 2024-02-28T06:50:39.013 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/smithi084.front.sepia.ceph.com/smithi084/g' /etc/hostname 2024-02-28T06:50:39.081 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname smithi084 2024-02-28T06:50:39.148 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2024-02-28T06:50:39.203 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="CentOS Stream" 2024-02-28T06:50:39.203 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="9" 2024-02-28T06:50:39.203 INFO:teuthology.orchestra.run.smithi084.stdout:ID="centos" 2024-02-28T06:50:39.203 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="rhel fedora" 2024-02-28T06:50:39.204 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="9" 2024-02-28T06:50:39.204 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el9" 2024-02-28T06:50:39.204 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-28T06:50:39.204 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2024-02-28T06:50:39.204 INFO:teuthology.orchestra.run.smithi084.stdout:LOGO="fedora-logo-icon" 2024-02-28T06:50:39.204 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-28T06:50:39.204 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://centos.org/" 2024-02-28T06:50:39.204 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-28T06:50:39.204 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-28T06:50:39.204 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-28T06:50:39.205 INFO:teuthology.provision.fog.smithi084:Deploy complete! 2024-02-28T06:50:39.205 DEBUG:teuthology.parallel:result is None 2024-02-28T06:50:39.401 INFO:teuthology.lock.ops:Checking smithi084.front.sepia.ceph.com 2024-02-28T06:50:39.402 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-28T06:50:39.421 INFO:teuthology.lock.ops:Checking smithi112.front.sepia.ceph.com 2024-02-28T06:50:39.421 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-28T06:50:39.438 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: set os type and version on server 2024-02-28T06:50:39.438 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-02-28T06:50:39.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T06:50:39.525 DEBUG:teuthology.orchestra.run.smithi084:> true 2024-02-28T06:50:39.589 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-02-28T06:50:39.589 DEBUG:teuthology.orchestra.run.smithi084:> uname -m 2024-02-28T06:50:39.644 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64 2024-02-28T06:50:39.644 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2024-02-28T06:50:39.699 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="CentOS Stream" 2024-02-28T06:50:39.699 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="9" 2024-02-28T06:50:39.699 INFO:teuthology.orchestra.run.smithi084.stdout:ID="centos" 2024-02-28T06:50:39.699 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="rhel fedora" 2024-02-28T06:50:39.699 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="9" 2024-02-28T06:50:39.699 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el9" 2024-02-28T06:50:39.699 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-28T06:50:39.699 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2024-02-28T06:50:39.699 INFO:teuthology.orchestra.run.smithi084.stdout:LOGO="fedora-logo-icon" 2024-02-28T06:50:39.699 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-28T06:50:39.700 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://centos.org/" 2024-02-28T06:50:39.700 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-28T06:50:39.700 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-28T06:50:39.700 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-28T06:50:39.700 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2024-02-28T06:50:39.721 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: set os type and version on server 2024-02-28T06:50:39.721 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-02-28T06:50:39.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T06:50:39.807 DEBUG:teuthology.orchestra.run.smithi112:> true 2024-02-28T06:50:39.974 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-02-28T06:50:39.974 DEBUG:teuthology.orchestra.run.smithi112:> uname -m 2024-02-28T06:50:40.029 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64 2024-02-28T06:50:40.029 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2024-02-28T06:50:40.084 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="CentOS Stream" 2024-02-28T06:50:40.084 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="9" 2024-02-28T06:50:40.084 INFO:teuthology.orchestra.run.smithi112.stdout:ID="centos" 2024-02-28T06:50:40.084 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="rhel fedora" 2024-02-28T06:50:40.084 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="9" 2024-02-28T06:50:40.085 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el9" 2024-02-28T06:50:40.085 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-28T06:50:40.085 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2024-02-28T06:50:40.085 INFO:teuthology.orchestra.run.smithi112.stdout:LOGO="fedora-logo-icon" 2024-02-28T06:50:40.085 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-28T06:50:40.085 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://centos.org/" 2024-02-28T06:50:40.085 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-28T06:50:40.085 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-28T06:50:40.085 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-28T06:50:40.085 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2024-02-28T06:50:40.104 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T06:50:40.195 INFO:teuthology.dispatcher.supervisor:Running job 7575130 2024-02-28T06:50:40.195 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-02-28_06:39:32-fs:upgrade-main-testing-default-smithi/7575130 --name vshankar-2024-02-28_06:39:32-fs:upgrade-main-testing-default-smithi --description fs:upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/vshankar-2024-02-28_06:39:32-fs:upgrade-main-testing-default-smithi/7575130/orig.config.yaml 2024-02-28T06:50:40.198 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-02-28_06:39:32-fs:upgrade-main-testing-default-smithi/7575130 2024-02-28T06:50:40.198 INFO:teuthology.dispatcher.supervisor:Job PID: 459105 2024-02-28T06:50:40.198 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-28T06:52:40.297 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T06:54:40.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T06:56:40.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T06:58:40.789 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T07:00:40.961 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T07:02:41.140 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T07:04:41.316 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T07:06:41.484 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T07:08:41.656 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T07:10:41.824 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T07:12:41.998 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T07:14:42.147 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T07:16:42.317 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T07:18:42.488 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T07:18:42.558 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1