2024-02-19T18:29:48.261 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-19T18:29:48.262 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:29:48.391 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff8c8e55c10>, signals=[15]) 2024-02-19T18:29:48.391 INFO:teuthology.lock.ops:Start node 'smithi023.front.sepia.ceph.com' reimaging 2024-02-19T18:29:48.391 INFO:teuthology.lock.ops:Updating [smithi023.front.sepia.ceph.com]: reset os type and version on server 2024-02-19T18:29:48.392 INFO:teuthology.lock.ops:Updating smithi023.front.sepia.ceph.com on lock server 2024-02-19T18:29:48.418 INFO:teuthology.lock.ops:Start node 'smithi044.front.sepia.ceph.com' reimaging 2024-02-19T18:29:48.419 INFO:teuthology.lock.ops:Updating [smithi044.front.sepia.ceph.com]: reset os type and version on server 2024-02-19T18:29:48.419 INFO:teuthology.lock.ops:Updating smithi044.front.sepia.ceph.com on lock server 2024-02-19T18:29:48.543 DEBUG:teuthology.provision.fog.smithi023:Requesting image smithi_centos_9.stream (ID 10) 2024-02-19T18:29:48.554 DEBUG:teuthology.provision.fog.smithi044:Requesting image smithi_centos_9.stream (ID 10) 2024-02-19T18:29:48.591 INFO:teuthology.provision.fog.smithi023:Scheduling deploy of centos 9.stream 2024-02-19T18:29:48.605 INFO:teuthology.provision.fog.smithi044:Scheduling deploy of centos 9.stream 2024-02-19T18:29:49.045 INFO:teuthology.orchestra.console.smithi044:Power off 2024-02-19T18:29:49.045 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-19T18:29:49.058 INFO:teuthology.orchestra.console.smithi023:Power off 2024-02-19T18:29:49.059 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-19T18:29:49.068 DEBUG:teuthology.orchestra.console.smithi044:power off output: Chassis Power Control: Down/Off 2024-02-19T18:29:49.068 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:29:49.081 DEBUG:teuthology.orchestra.console.smithi023:power off output: Chassis Power Control: Down/Off 2024-02-19T18:29:49.081 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:29:49.093 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is on 2024-02-19T18:29:49.105 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is on 2024-02-19T18:29:53.096 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:29:53.106 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:29:53.205 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is on 2024-02-19T18:29:53.214 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is on 2024-02-19T18:29:57.208 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:29:57.215 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:29:57.317 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is off 2024-02-19T18:29:57.323 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is off 2024-02-19T18:29:57.418 INFO:teuthology.orchestra.console.smithi044:Power off completed 2024-02-19T18:29:57.424 INFO:teuthology.orchestra.console.smithi023:Power off completed 2024-02-19T18:29:57.519 INFO:teuthology.orchestra.console.smithi044:Power on 2024-02-19T18:29:57.519 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-19T18:29:57.527 INFO:teuthology.orchestra.console.smithi023:Power on 2024-02-19T18:29:57.527 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-19T18:29:57.540 DEBUG:teuthology.orchestra.console.smithi044:power on output: Chassis Power Control: Up/On 2024-02-19T18:29:57.540 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:29:57.550 DEBUG:teuthology.orchestra.console.smithi023:power on output: Chassis Power Control: Up/On 2024-02-19T18:29:57.550 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:29:57.561 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is off 2024-02-19T18:29:57.573 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is off 2024-02-19T18:30:01.563 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:30:01.574 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:30:01.673 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is off 2024-02-19T18:30:01.683 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is off 2024-02-19T18:30:05.678 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:30:05.685 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:30:05.788 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is on 2024-02-19T18:30:05.793 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is on 2024-02-19T18:30:05.889 INFO:teuthology.orchestra.console.smithi044:Power on completed 2024-02-19T18:30:05.894 INFO:teuthology.orchestra.console.smithi023:Power on completed 2024-02-19T18:30:05.990 INFO:teuthology.provision.fog.smithi044:Waiting for deploy to finish 2024-02-19T18:30:05.994 INFO:teuthology.provision.fog.smithi023:Waiting for deploy to finish 2024-02-19T18:32:34.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:32:38.012 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44 2024-02-19T18:32:44.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:32:47.072 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44 2024-02-19T18:32:53.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:32:56.156 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44 2024-02-19T18:33:02.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:33:05.244 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44 2024-02-19T18:33:11.249 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:33:14.300 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44 2024-02-19T18:33:20.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:33:23.392 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44 2024-02-19T18:33:29.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:33:30.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:33:33.532 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2024-02-19T18:33:39.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:33:42.591 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2024-02-19T18:33:48.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:33:51.676 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2024-02-19T18:33:57.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:34:00.732 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2024-02-19T18:34:06.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:34:09.820 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2024-02-19T18:34:15.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:34:18.908 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2024-02-19T18:34:24.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:34:27.964 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2024-02-19T18:34:29.400 WARNING:teuthology.provision.fog.smithi044:timed out 2024-02-19T18:34:33.969 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:34:35.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:34:35.681 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-19T18:34:35.681 DEBUG:teuthology.orchestra.run.smithi044:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-19T18:34:36.011 INFO:teuthology.provision.fog.smithi044:Node is ready 2024-02-19T18:34:36.011 DEBUG:teuthology.orchestra.run.smithi044:> hostname 2024-02-19T18:34:36.025 INFO:teuthology.orchestra.run.smithi044.stdout:smithi044.front.sepia.ceph.com 2024-02-19T18:34:36.026 DEBUG:teuthology.orchestra.run.smithi044:> grep smithi044.front.sepia.ceph.com /etc/hosts 2024-02-19T18:34:36.081 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44 smithi044.front.sepia.ceph.com smithi044 2024-02-19T18:34:36.081 DEBUG:teuthology.orchestra.run.smithi044:> sudo hostname smithi044 2024-02-19T18:34:36.194 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i -e 's/smithi044.front.sepia.ceph.com/smithi044/g' /etc/hosts 2024-02-19T18:34:36.226 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i -e 's/172.21.15.44/172.21.15.44/g' /etc/hosts 2024-02-19T18:34:36.298 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i -e 's/smithi044.front.sepia.ceph.com/smithi044/g' /etc/hostname 2024-02-19T18:34:36.369 DEBUG:teuthology.orchestra.run.smithi044:> sudo hostname smithi044 2024-02-19T18:34:36.439 DEBUG:teuthology.orchestra.run.smithi044:> cat /etc/os-release 2024-02-19T18:34:36.494 INFO:teuthology.orchestra.run.smithi044.stdout:NAME="CentOS Stream" 2024-02-19T18:34:36.494 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION="9" 2024-02-19T18:34:36.494 INFO:teuthology.orchestra.run.smithi044.stdout:ID="centos" 2024-02-19T18:34:36.494 INFO:teuthology.orchestra.run.smithi044.stdout:ID_LIKE="rhel fedora" 2024-02-19T18:34:36.494 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_ID="9" 2024-02-19T18:34:36.495 INFO:teuthology.orchestra.run.smithi044.stdout:PLATFORM_ID="platform:el9" 2024-02-19T18:34:36.495 INFO:teuthology.orchestra.run.smithi044.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-19T18:34:36.495 INFO:teuthology.orchestra.run.smithi044.stdout:ANSI_COLOR="0;31" 2024-02-19T18:34:36.495 INFO:teuthology.orchestra.run.smithi044.stdout:LOGO="fedora-logo-icon" 2024-02-19T18:34:36.495 INFO:teuthology.orchestra.run.smithi044.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-19T18:34:36.495 INFO:teuthology.orchestra.run.smithi044.stdout:HOME_URL="https://centos.org/" 2024-02-19T18:34:36.495 INFO:teuthology.orchestra.run.smithi044.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-19T18:34:36.495 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-19T18:34:36.495 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-19T18:34:36.496 INFO:teuthology.provision.fog.smithi044:Deploy complete! 2024-02-19T18:34:36.497 DEBUG:teuthology.parallel:result is None 2024-02-19T18:34:37.020 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2024-02-19T18:34:43.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:34:46.076 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2024-02-19T18:34:52.083 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:34:55.164 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2024-02-19T18:35:01.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:36:01.232 WARNING:teuthology.provision.fog.smithi023:timed out 2024-02-19T18:36:07.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:36:07.468 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-19T18:36:07.468 DEBUG:teuthology.orchestra.run.smithi023:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-19T18:36:07.795 INFO:teuthology.provision.fog.smithi023:Node is ready 2024-02-19T18:36:07.795 DEBUG:teuthology.orchestra.run.smithi023:> hostname 2024-02-19T18:36:07.810 INFO:teuthology.orchestra.run.smithi023.stdout:smithi023.front.sepia.ceph.com 2024-02-19T18:36:07.811 DEBUG:teuthology.orchestra.run.smithi023:> grep smithi023.front.sepia.ceph.com /etc/hosts 2024-02-19T18:36:07.866 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23 smithi023.front.sepia.ceph.com smithi023 2024-02-19T18:36:07.866 DEBUG:teuthology.orchestra.run.smithi023:> sudo hostname smithi023 2024-02-19T18:36:07.987 DEBUG:teuthology.orchestra.run.smithi023:> sudo sed -i -e 's/smithi023.front.sepia.ceph.com/smithi023/g' /etc/hosts 2024-02-19T18:36:08.018 DEBUG:teuthology.orchestra.run.smithi023:> sudo sed -i -e 's/172.21.15.23/172.21.15.23/g' /etc/hosts 2024-02-19T18:36:08.088 DEBUG:teuthology.orchestra.run.smithi023:> sudo sed -i -e 's/smithi023.front.sepia.ceph.com/smithi023/g' /etc/hostname 2024-02-19T18:36:08.159 DEBUG:teuthology.orchestra.run.smithi023:> sudo hostname smithi023 2024-02-19T18:36:08.229 DEBUG:teuthology.orchestra.run.smithi023:> cat /etc/os-release 2024-02-19T18:36:08.283 INFO:teuthology.orchestra.run.smithi023.stdout:NAME="CentOS Stream" 2024-02-19T18:36:08.284 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION="9" 2024-02-19T18:36:08.284 INFO:teuthology.orchestra.run.smithi023.stdout:ID="centos" 2024-02-19T18:36:08.284 INFO:teuthology.orchestra.run.smithi023.stdout:ID_LIKE="rhel fedora" 2024-02-19T18:36:08.284 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION_ID="9" 2024-02-19T18:36:08.284 INFO:teuthology.orchestra.run.smithi023.stdout:PLATFORM_ID="platform:el9" 2024-02-19T18:36:08.284 INFO:teuthology.orchestra.run.smithi023.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-19T18:36:08.284 INFO:teuthology.orchestra.run.smithi023.stdout:ANSI_COLOR="0;31" 2024-02-19T18:36:08.284 INFO:teuthology.orchestra.run.smithi023.stdout:LOGO="fedora-logo-icon" 2024-02-19T18:36:08.284 INFO:teuthology.orchestra.run.smithi023.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-19T18:36:08.284 INFO:teuthology.orchestra.run.smithi023.stdout:HOME_URL="https://centos.org/" 2024-02-19T18:36:08.284 INFO:teuthology.orchestra.run.smithi023.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-19T18:36:08.284 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-19T18:36:08.285 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-19T18:36:08.285 INFO:teuthology.provision.fog.smithi023:Deploy complete! 2024-02-19T18:36:08.285 DEBUG:teuthology.parallel:result is None 2024-02-19T18:36:08.491 INFO:teuthology.lock.ops:Checking smithi023.front.sepia.ceph.com 2024-02-19T18:36:08.491 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-19T18:36:08.517 INFO:teuthology.lock.ops:Checking smithi044.front.sepia.ceph.com 2024-02-19T18:36:08.517 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-19T18:36:08.535 INFO:teuthology.lock.ops:Updating [smithi023.front.sepia.ceph.com]: set os type and version on server 2024-02-19T18:36:08.535 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi023.front.sepia.ceph.com' 2024-02-19T18:36:08.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:36:08.632 DEBUG:teuthology.orchestra.run.smithi023:> true 2024-02-19T18:36:08.698 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi023.front.sepia.ceph.com' 2024-02-19T18:36:08.698 DEBUG:teuthology.orchestra.run.smithi023:> uname -m 2024-02-19T18:36:08.753 INFO:teuthology.orchestra.run.smithi023.stdout:x86_64 2024-02-19T18:36:08.753 DEBUG:teuthology.orchestra.run.smithi023:> cat /etc/os-release 2024-02-19T18:36:08.808 INFO:teuthology.orchestra.run.smithi023.stdout:NAME="CentOS Stream" 2024-02-19T18:36:08.808 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION="9" 2024-02-19T18:36:08.808 INFO:teuthology.orchestra.run.smithi023.stdout:ID="centos" 2024-02-19T18:36:08.808 INFO:teuthology.orchestra.run.smithi023.stdout:ID_LIKE="rhel fedora" 2024-02-19T18:36:08.808 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION_ID="9" 2024-02-19T18:36:08.809 INFO:teuthology.orchestra.run.smithi023.stdout:PLATFORM_ID="platform:el9" 2024-02-19T18:36:08.809 INFO:teuthology.orchestra.run.smithi023.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-19T18:36:08.809 INFO:teuthology.orchestra.run.smithi023.stdout:ANSI_COLOR="0;31" 2024-02-19T18:36:08.809 INFO:teuthology.orchestra.run.smithi023.stdout:LOGO="fedora-logo-icon" 2024-02-19T18:36:08.809 INFO:teuthology.orchestra.run.smithi023.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-19T18:36:08.809 INFO:teuthology.orchestra.run.smithi023.stdout:HOME_URL="https://centos.org/" 2024-02-19T18:36:08.809 INFO:teuthology.orchestra.run.smithi023.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-19T18:36:08.809 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-19T18:36:08.809 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-19T18:36:08.809 INFO:teuthology.lock.ops:Updating smithi023.front.sepia.ceph.com on lock server 2024-02-19T18:36:08.834 INFO:teuthology.lock.ops:Updating [smithi044.front.sepia.ceph.com]: set os type and version on server 2024-02-19T18:36:08.834 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-02-19T18:36:08.835 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:36:08.937 DEBUG:teuthology.orchestra.run.smithi044:> true 2024-02-19T18:36:09.122 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-02-19T18:36:09.122 DEBUG:teuthology.orchestra.run.smithi044:> uname -m 2024-02-19T18:36:09.177 INFO:teuthology.orchestra.run.smithi044.stdout:x86_64 2024-02-19T18:36:09.178 DEBUG:teuthology.orchestra.run.smithi044:> cat /etc/os-release 2024-02-19T18:36:09.233 INFO:teuthology.orchestra.run.smithi044.stdout:NAME="CentOS Stream" 2024-02-19T18:36:09.233 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION="9" 2024-02-19T18:36:09.233 INFO:teuthology.orchestra.run.smithi044.stdout:ID="centos" 2024-02-19T18:36:09.233 INFO:teuthology.orchestra.run.smithi044.stdout:ID_LIKE="rhel fedora" 2024-02-19T18:36:09.233 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_ID="9" 2024-02-19T18:36:09.233 INFO:teuthology.orchestra.run.smithi044.stdout:PLATFORM_ID="platform:el9" 2024-02-19T18:36:09.233 INFO:teuthology.orchestra.run.smithi044.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-19T18:36:09.233 INFO:teuthology.orchestra.run.smithi044.stdout:ANSI_COLOR="0;31" 2024-02-19T18:36:09.233 INFO:teuthology.orchestra.run.smithi044.stdout:LOGO="fedora-logo-icon" 2024-02-19T18:36:09.233 INFO:teuthology.orchestra.run.smithi044.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-19T18:36:09.233 INFO:teuthology.orchestra.run.smithi044.stdout:HOME_URL="https://centos.org/" 2024-02-19T18:36:09.233 INFO:teuthology.orchestra.run.smithi044.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-19T18:36:09.234 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-19T18:36:09.234 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-19T18:36:09.234 INFO:teuthology.lock.ops:Updating smithi044.front.sepia.ceph.com on lock server 2024-02-19T18:36:09.259 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:36:09.349 INFO:teuthology.dispatcher.supervisor:Running job 7566615 2024-02-19T18:36:09.350 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-02-19_18:28:45-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7566615 --name pdonnell-2024-02-19_18:28:45-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi --description fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 0a 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/pdonnell-2024-02-19_18:28:45-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7566615/orig.config.yaml 2024-02-19T18:36:09.352 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-02-19_18:28:45-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7566615 2024-02-19T18:36:09.352 INFO:teuthology.dispatcher.supervisor:Job PID: 3450545 2024-02-19T18:36:09.352 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-19T18:38:09.450 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:40:09.617 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:42:09.776 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:44:09.944 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:46:10.188 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:48:10.424 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:50:10.597 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:52:10.761 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:54:10.933 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:56:11.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:58:11.260 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:00:11.430 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:02:11.596 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:04:11.769 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:06:11.936 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:08:12.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:10:12.265 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:12:12.435 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:14:12.566 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:16:12.725 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:18:12.892 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:20:13.057 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:22:13.208 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:24:13.372 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:26:13.544 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:28:13.717 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:30:13.882 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:32:14.045 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:34:14.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:36:14.361 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:38:14.449 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:40:14.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:42:14.788 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:44:14.934 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:46:15.121 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:48:15.294 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:50:15.430 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:52:15.596 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:54:15.709 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:56:15.880 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:58:16.034 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:00:16.200 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:02:16.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:04:16.513 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:06:16.676 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:08:16.857 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:10:17.037 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:12:17.212 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:14:17.385 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:16:17.558 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:18:17.725 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:20:17.884 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:22:18.053 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:24:18.225 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:26:18.392 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:28:18.561 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:30:18.733 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:32:18.906 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:34:19.069 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:36:19.237 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:38:19.405 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:40:19.577 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:42:19.745 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:44:19.933 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:44:19.998 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1