2024-02-15T13:21:38.924 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-15T13:21:38.924 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-15T13:21:39.060 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fbb96e7bc10>, signals=[15]) 2024-02-15T13:21:39.061 INFO:teuthology.lock.ops:Start node 'smithi023.front.sepia.ceph.com' reimaging 2024-02-15T13:21:39.061 INFO:teuthology.lock.ops:Updating [smithi023.front.sepia.ceph.com]: reset os type and version on server 2024-02-15T13:21:39.061 INFO:teuthology.lock.ops:Updating smithi023.front.sepia.ceph.com on lock server 2024-02-15T13:21:39.084 INFO:teuthology.lock.ops:Start node 'smithi121.front.sepia.ceph.com' reimaging 2024-02-15T13:21:39.085 INFO:teuthology.lock.ops:Updating [smithi121.front.sepia.ceph.com]: reset os type and version on server 2024-02-15T13:21:39.085 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server 2024-02-15T13:21:39.202 DEBUG:teuthology.provision.fog.smithi023:Requesting image smithi_centos_8.stream (ID 3) 2024-02-15T13:21:39.219 DEBUG:teuthology.provision.fog.smithi121:Requesting image smithi_centos_8.stream (ID 3) 2024-02-15T13:21:39.248 INFO:teuthology.provision.fog.smithi023:Scheduling deploy of centos 8.stream 2024-02-15T13:21:39.267 INFO:teuthology.provision.fog.smithi121:Scheduling deploy of centos 8.stream 2024-02-15T13:21:39.516 INFO:teuthology.orchestra.console.smithi023:Power off 2024-02-15T13:21:39.516 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-15T13:21:39.529 INFO:teuthology.orchestra.console.smithi121:Power off 2024-02-15T13:21:39.530 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-15T13:21:39.542 DEBUG:teuthology.orchestra.console.smithi023:power off output: Chassis Power Control: Down/Off 2024-02-15T13:21:39.542 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-15T13:21:39.551 DEBUG:teuthology.orchestra.console.smithi121:power off output: Chassis Power Control: Down/Off 2024-02-15T13:21:39.552 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-15T13:21:39.564 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is on 2024-02-15T13:21:39.573 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is on 2024-02-15T13:21:43.568 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-15T13:21:43.576 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-15T13:21:43.678 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is on 2024-02-15T13:21:43.685 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is on 2024-02-15T13:21:47.682 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-15T13:21:47.690 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-15T13:21:47.792 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is off 2024-02-15T13:21:47.800 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is on 2024-02-15T13:21:47.894 INFO:teuthology.orchestra.console.smithi023:Power off completed 2024-02-15T13:21:47.994 INFO:teuthology.orchestra.console.smithi023:Power on 2024-02-15T13:21:47.995 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-15T13:21:48.020 DEBUG:teuthology.orchestra.console.smithi023:power on output: Chassis Power Control: Up/On 2024-02-15T13:21:48.021 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-15T13:21:48.043 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is off 2024-02-15T13:21:51.804 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-15T13:21:51.913 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is off 2024-02-15T13:21:52.014 INFO:teuthology.orchestra.console.smithi121:Power off completed 2024-02-15T13:21:52.044 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-15T13:21:52.115 INFO:teuthology.orchestra.console.smithi121:Power on 2024-02-15T13:21:52.115 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-15T13:21:52.136 DEBUG:teuthology.orchestra.console.smithi121:power on output: Chassis Power Control: Up/On 2024-02-15T13:21:52.137 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-15T13:21:52.155 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is on 2024-02-15T13:21:52.159 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is off 2024-02-15T13:21:52.256 INFO:teuthology.orchestra.console.smithi023:Power on completed 2024-02-15T13:21:52.357 INFO:teuthology.provision.fog.smithi023:Waiting for deploy to finish 2024-02-15T13:21:56.164 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-15T13:21:56.273 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is off 2024-02-15T13:22:00.277 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-15T13:22:00.386 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is on 2024-02-15T13:22:00.487 INFO:teuthology.orchestra.console.smithi121:Power on completed 2024-02-15T13:22:00.587 INFO:teuthology.provision.fog.smithi121:Waiting for deploy to finish 2024-02-15T13:24:46.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T13:24:49.564 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2024-02-15T13:24:55.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T13:24:58.620 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2024-02-15T13:25:04.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T13:25:07.676 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2024-02-15T13:25:08.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T13:25:08.539 ERROR:teuthology.orchestra.connection:Error authenticating with smithi023.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-02-15T13:25:13.677 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T13:25:16.732 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2024-02-15T13:25:22.734 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T13:25:25.788 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2024-02-15T13:25:31.789 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T13:25:34.844 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2024-02-15T13:25:40.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T13:25:59.232 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2024-02-15T13:26:05.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T13:26:08.320 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2024-02-15T13:26:12.543 WARNING:teuthology.provision.fog.smithi023:timed out 2024-02-15T13:26:14.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T13:26:14.852 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-15T13:26:14.853 DEBUG:teuthology.orchestra.run.smithi121:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-15T13:26:18.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T13:26:36.860 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2024-02-15T13:26:39.993 INFO:teuthology.provision.fog.smithi121:Node is ready 2024-02-15T13:26:39.993 DEBUG:teuthology.orchestra.run.smithi121:> hostname 2024-02-15T13:26:40.017 INFO:teuthology.orchestra.run.smithi121.stdout:smithi121.front.sepia.ceph.com 2024-02-15T13:26:40.017 DEBUG:teuthology.orchestra.run.smithi121:> grep smithi121.front.sepia.ceph.com /etc/hosts 2024-02-15T13:26:40.077 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121 smithi121.front.sepia.ceph.com smithi121 2024-02-15T13:26:40.077 DEBUG:teuthology.orchestra.run.smithi121:> sudo hostname smithi121 2024-02-15T13:26:40.197 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i -e 's/smithi121.front.sepia.ceph.com/smithi121/g' /etc/hosts 2024-02-15T13:26:40.228 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i -e 's/172.21.15.121/172.21.15.121/g' /etc/hosts 2024-02-15T13:26:40.298 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i -e 's/smithi121.front.sepia.ceph.com/smithi121/g' /etc/hostname 2024-02-15T13:26:40.369 DEBUG:teuthology.orchestra.run.smithi121:> sudo hostname smithi121 2024-02-15T13:26:40.439 DEBUG:teuthology.orchestra.run.smithi121:> cat /etc/os-release 2024-02-15T13:26:40.497 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="CentOS Stream" 2024-02-15T13:26:40.497 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="8" 2024-02-15T13:26:40.498 INFO:teuthology.orchestra.run.smithi121.stdout:ID="centos" 2024-02-15T13:26:40.498 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE="rhel fedora" 2024-02-15T13:26:40.498 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="8" 2024-02-15T13:26:40.498 INFO:teuthology.orchestra.run.smithi121.stdout:PLATFORM_ID="platform:el8" 2024-02-15T13:26:40.498 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-15T13:26:40.498 INFO:teuthology.orchestra.run.smithi121.stdout:ANSI_COLOR="0;31" 2024-02-15T13:26:40.498 INFO:teuthology.orchestra.run.smithi121.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-15T13:26:40.498 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://centos.org/" 2024-02-15T13:26:40.498 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-15T13:26:40.498 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-15T13:26:40.498 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-15T13:26:40.499 INFO:teuthology.provision.fog.smithi121:Deploy complete! 2024-02-15T13:26:40.500 DEBUG:teuthology.parallel:result is None 2024-02-15T13:26:42.862 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T13:27:42.865 WARNING:teuthology.provision.fog.smithi023:timed out 2024-02-15T13:27:48.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T13:27:49.108 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-15T13:27:49.109 DEBUG:teuthology.orchestra.run.smithi023:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-15T13:27:49.378 INFO:teuthology.provision.fog.smithi023:Node is ready 2024-02-15T13:27:49.378 DEBUG:teuthology.orchestra.run.smithi023:> hostname 2024-02-15T13:27:49.401 INFO:teuthology.orchestra.run.smithi023.stdout:smithi023.front.sepia.ceph.com 2024-02-15T13:27:49.401 DEBUG:teuthology.orchestra.run.smithi023:> grep smithi023.front.sepia.ceph.com /etc/hosts 2024-02-15T13:27:49.460 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23 smithi023.front.sepia.ceph.com smithi023 2024-02-15T13:27:49.461 DEBUG:teuthology.orchestra.run.smithi023:> sudo hostname smithi023 2024-02-15T13:27:49.572 DEBUG:teuthology.orchestra.run.smithi023:> sudo sed -i -e 's/smithi023.front.sepia.ceph.com/smithi023/g' /etc/hosts 2024-02-15T13:27:49.602 DEBUG:teuthology.orchestra.run.smithi023:> sudo sed -i -e 's/172.21.15.23/172.21.15.23/g' /etc/hosts 2024-02-15T13:27:49.671 DEBUG:teuthology.orchestra.run.smithi023:> sudo sed -i -e 's/smithi023.front.sepia.ceph.com/smithi023/g' /etc/hostname 2024-02-15T13:27:49.740 DEBUG:teuthology.orchestra.run.smithi023:> sudo hostname smithi023 2024-02-15T13:27:49.808 DEBUG:teuthology.orchestra.run.smithi023:> cat /etc/os-release 2024-02-15T13:27:49.866 INFO:teuthology.orchestra.run.smithi023.stdout:NAME="CentOS Stream" 2024-02-15T13:27:49.866 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION="8" 2024-02-15T13:27:49.866 INFO:teuthology.orchestra.run.smithi023.stdout:ID="centos" 2024-02-15T13:27:49.866 INFO:teuthology.orchestra.run.smithi023.stdout:ID_LIKE="rhel fedora" 2024-02-15T13:27:49.866 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION_ID="8" 2024-02-15T13:27:49.867 INFO:teuthology.orchestra.run.smithi023.stdout:PLATFORM_ID="platform:el8" 2024-02-15T13:27:49.867 INFO:teuthology.orchestra.run.smithi023.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-15T13:27:49.867 INFO:teuthology.orchestra.run.smithi023.stdout:ANSI_COLOR="0;31" 2024-02-15T13:27:49.867 INFO:teuthology.orchestra.run.smithi023.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-15T13:27:49.867 INFO:teuthology.orchestra.run.smithi023.stdout:HOME_URL="https://centos.org/" 2024-02-15T13:27:49.867 INFO:teuthology.orchestra.run.smithi023.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-15T13:27:49.867 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-15T13:27:49.867 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-15T13:27:49.867 INFO:teuthology.provision.fog.smithi023:Deploy complete! 2024-02-15T13:27:49.868 DEBUG:teuthology.parallel:result is None 2024-02-15T13:27:50.022 INFO:teuthology.lock.ops:Checking smithi023.front.sepia.ceph.com 2024-02-15T13:27:50.023 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-15T13:27:50.049 INFO:teuthology.lock.ops:Checking smithi121.front.sepia.ceph.com 2024-02-15T13:27:50.049 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-15T13:27:50.066 INFO:teuthology.lock.ops:Updating [smithi023.front.sepia.ceph.com]: set os type and version on server 2024-02-15T13:27:50.067 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi023.front.sepia.ceph.com' 2024-02-15T13:27:50.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T13:27:50.140 DEBUG:teuthology.orchestra.run.smithi023:> true 2024-02-15T13:27:50.209 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi023.front.sepia.ceph.com' 2024-02-15T13:27:50.209 DEBUG:teuthology.orchestra.run.smithi023:> uname -m 2024-02-15T13:27:50.267 INFO:teuthology.orchestra.run.smithi023.stdout:x86_64 2024-02-15T13:27:50.267 DEBUG:teuthology.orchestra.run.smithi023:> cat /etc/os-release 2024-02-15T13:27:50.325 INFO:teuthology.orchestra.run.smithi023.stdout:NAME="CentOS Stream" 2024-02-15T13:27:50.325 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION="8" 2024-02-15T13:27:50.325 INFO:teuthology.orchestra.run.smithi023.stdout:ID="centos" 2024-02-15T13:27:50.325 INFO:teuthology.orchestra.run.smithi023.stdout:ID_LIKE="rhel fedora" 2024-02-15T13:27:50.325 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION_ID="8" 2024-02-15T13:27:50.325 INFO:teuthology.orchestra.run.smithi023.stdout:PLATFORM_ID="platform:el8" 2024-02-15T13:27:50.325 INFO:teuthology.orchestra.run.smithi023.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-15T13:27:50.326 INFO:teuthology.orchestra.run.smithi023.stdout:ANSI_COLOR="0;31" 2024-02-15T13:27:50.326 INFO:teuthology.orchestra.run.smithi023.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-15T13:27:50.326 INFO:teuthology.orchestra.run.smithi023.stdout:HOME_URL="https://centos.org/" 2024-02-15T13:27:50.326 INFO:teuthology.orchestra.run.smithi023.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-15T13:27:50.326 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-15T13:27:50.326 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-15T13:27:50.326 INFO:teuthology.lock.ops:Updating smithi023.front.sepia.ceph.com on lock server 2024-02-15T13:27:50.349 INFO:teuthology.lock.ops:Updating [smithi121.front.sepia.ceph.com]: set os type and version on server 2024-02-15T13:27:50.349 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-02-15T13:27:50.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T13:27:50.424 DEBUG:teuthology.orchestra.run.smithi121:> true 2024-02-15T13:27:50.494 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-02-15T13:27:50.494 DEBUG:teuthology.orchestra.run.smithi121:> uname -m 2024-02-15T13:27:50.554 INFO:teuthology.orchestra.run.smithi121.stdout:x86_64 2024-02-15T13:27:50.554 DEBUG:teuthology.orchestra.run.smithi121:> cat /etc/os-release 2024-02-15T13:27:50.614 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="CentOS Stream" 2024-02-15T13:27:50.614 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="8" 2024-02-15T13:27:50.614 INFO:teuthology.orchestra.run.smithi121.stdout:ID="centos" 2024-02-15T13:27:50.614 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE="rhel fedora" 2024-02-15T13:27:50.614 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="8" 2024-02-15T13:27:50.614 INFO:teuthology.orchestra.run.smithi121.stdout:PLATFORM_ID="platform:el8" 2024-02-15T13:27:50.614 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-15T13:27:50.614 INFO:teuthology.orchestra.run.smithi121.stdout:ANSI_COLOR="0;31" 2024-02-15T13:27:50.614 INFO:teuthology.orchestra.run.smithi121.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-15T13:27:50.614 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://centos.org/" 2024-02-15T13:27:50.614 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-15T13:27:50.614 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-15T13:27:50.614 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-15T13:27:50.615 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server 2024-02-15T13:27:50.632 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-15T13:27:50.729 INFO:teuthology.dispatcher.supervisor:Running job 7561014 2024-02-15T13:27:50.729 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-02-15_13:19:49-fs:upgrade:mds_upgrade_sequence-reef-distro-default-smithi/7561014 --name pdonnell-2024-02-15_13:19:49-fs:upgrade:mds_upgrade_sequence-reef-distro-default-smithi --description fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/pdonnell-2024-02-15_13:19:49-fs:upgrade:mds_upgrade_sequence-reef-distro-default-smithi/7561014/orig.config.yaml 2024-02-15T13:27:50.732 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-02-15_13:19:49-fs:upgrade:mds_upgrade_sequence-reef-distro-default-smithi/7561014 2024-02-15T13:27:50.732 INFO:teuthology.dispatcher.supervisor:Job PID: 1764072 2024-02-15T13:27:50.733 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-15T13:29:50.734 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-15T13:31:50.812 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-15T13:33:50.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-15T13:35:50.962 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-15T13:37:51.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-15T13:39:51.119 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-15T13:41:51.194 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-15T13:43:51.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-15T13:45:51.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-15T13:45:51.409 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1