2024-02-17T16:16:22.565 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-17T16:16:22.566 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T16:16:22.708 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7efea94c9c10>, signals=[15]) 2024-02-17T16:16:22.709 INFO:teuthology.lock.ops:Start node 'smithi079.front.sepia.ceph.com' reimaging 2024-02-17T16:16:22.709 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: reset os type and version on server 2024-02-17T16:16:22.709 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2024-02-17T16:16:22.727 INFO:teuthology.lock.ops:Start node 'smithi121.front.sepia.ceph.com' reimaging 2024-02-17T16:16:22.727 INFO:teuthology.lock.ops:Updating [smithi121.front.sepia.ceph.com]: reset os type and version on server 2024-02-17T16:16:22.727 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server 2024-02-17T16:16:22.837 DEBUG:teuthology.provision.fog.smithi079:Requesting image smithi_centos_9.stream (ID 10) 2024-02-17T16:16:22.863 DEBUG:teuthology.provision.fog.smithi121:Requesting image smithi_centos_9.stream (ID 10) 2024-02-17T16:16:22.895 INFO:teuthology.provision.fog.smithi079:Scheduling deploy of centos 9.stream 2024-02-17T16:16:22.921 INFO:teuthology.provision.fog.smithi121:Scheduling deploy of centos 9.stream 2024-02-17T16:16:23.110 INFO:teuthology.orchestra.console.smithi079:Power off 2024-02-17T16:16:23.110 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-17T16:16:23.132 DEBUG:teuthology.orchestra.console.smithi079:power off output: Chassis Power Control: Down/Off 2024-02-17T16:16:23.133 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T16:16:23.146 INFO:teuthology.orchestra.console.smithi121:Power off 2024-02-17T16:16:23.147 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-17T16:16:23.155 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2024-02-17T16:16:23.166 DEBUG:teuthology.orchestra.console.smithi121:power off output: Chassis Power Control: Down/Off 2024-02-17T16:16:23.166 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T16:16:23.192 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is off 2024-02-17T16:16:23.257 INFO:teuthology.orchestra.console.smithi079:Power off completed 2024-02-17T16:16:23.293 INFO:teuthology.orchestra.console.smithi121:Power off completed 2024-02-17T16:16:23.358 INFO:teuthology.orchestra.console.smithi079:Power on 2024-02-17T16:16:23.358 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-17T16:16:23.379 DEBUG:teuthology.orchestra.console.smithi079:power on output: Chassis Power Control: Up/On 2024-02-17T16:16:23.379 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T16:16:23.394 INFO:teuthology.orchestra.console.smithi121:Power on 2024-02-17T16:16:23.394 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-17T16:16:23.402 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2024-02-17T16:16:23.416 DEBUG:teuthology.orchestra.console.smithi121:power on output: Chassis Power Control: Up/On 2024-02-17T16:16:23.416 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T16:16:23.437 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is off 2024-02-17T16:16:27.404 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T16:16:27.439 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T16:16:27.517 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on 2024-02-17T16:16:27.548 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is off 2024-02-17T16:16:27.618 INFO:teuthology.orchestra.console.smithi079:Power on completed 2024-02-17T16:16:27.719 INFO:teuthology.provision.fog.smithi079:Waiting for deploy to finish 2024-02-17T16:16:31.553 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T16:16:31.662 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is on 2024-02-17T16:16:31.763 INFO:teuthology.orchestra.console.smithi121:Power on completed 2024-02-17T16:16:31.864 INFO:teuthology.provision.fog.smithi121:Waiting for deploy to finish 2024-02-17T16:18:58.617 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T16:19:01.696 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-02-17T16:19:02.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T16:19:05.756 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2024-02-17T16:19:07.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T16:19:10.780 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-02-17T16:19:11.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T16:19:14.815 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2024-02-17T16:19:16.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T16:19:19.836 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-02-17T16:19:20.817 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T16:19:23.868 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2024-02-17T16:19:25.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T16:19:28.892 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-02-17T16:19:29.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T16:19:32.924 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2024-02-17T16:19:34.895 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T16:19:37.948 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-02-17T16:19:38.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T16:19:41.980 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2024-02-17T16:19:43.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T16:19:47.004 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-02-17T16:19:47.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T16:19:51.036 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2024-02-17T16:19:53.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T16:19:56.060 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-02-17T16:19:57.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T16:20:00.092 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2024-02-17T16:20:02.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T16:20:06.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T16:21:02.121 WARNING:teuthology.provision.fog.smithi079:timed out 2024-02-17T16:21:06.102 WARNING:teuthology.provision.fog.smithi121:timed out 2024-02-17T16:21:08.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T16:21:08.524 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-17T16:21:08.524 DEBUG:teuthology.orchestra.run.smithi079:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-17T16:21:08.850 INFO:teuthology.provision.fog.smithi079:Node is ready 2024-02-17T16:21:08.850 DEBUG:teuthology.orchestra.run.smithi079:> hostname 2024-02-17T16:21:08.866 INFO:teuthology.orchestra.run.smithi079.stdout:smithi079.front.sepia.ceph.com 2024-02-17T16:21:08.866 DEBUG:teuthology.orchestra.run.smithi079:> grep smithi079.front.sepia.ceph.com /etc/hosts 2024-02-17T16:21:08.921 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79 smithi079.front.sepia.ceph.com smithi079 2024-02-17T16:21:08.921 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname smithi079 2024-02-17T16:21:09.019 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi079.front.sepia.ceph.com/smithi079/g' /etc/hosts 2024-02-17T16:21:09.047 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/172.21.15.79/172.21.15.79/g' /etc/hosts 2024-02-17T16:21:09.114 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi079.front.sepia.ceph.com/smithi079/g' /etc/hostname 2024-02-17T16:21:09.181 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname smithi079 2024-02-17T16:21:09.248 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2024-02-17T16:21:09.302 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="CentOS Stream" 2024-02-17T16:21:09.302 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="9" 2024-02-17T16:21:09.302 INFO:teuthology.orchestra.run.smithi079.stdout:ID="centos" 2024-02-17T16:21:09.302 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="rhel fedora" 2024-02-17T16:21:09.302 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="9" 2024-02-17T16:21:09.302 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el9" 2024-02-17T16:21:09.302 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-17T16:21:09.302 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31" 2024-02-17T16:21:09.302 INFO:teuthology.orchestra.run.smithi079.stdout:LOGO="fedora-logo-icon" 2024-02-17T16:21:09.302 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-17T16:21:09.302 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://centos.org/" 2024-02-17T16:21:09.302 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-17T16:21:09.303 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-17T16:21:09.303 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-17T16:21:09.303 INFO:teuthology.provision.fog.smithi079:Deploy complete! 2024-02-17T16:21:09.305 DEBUG:teuthology.parallel:result is None 2024-02-17T16:21:12.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T16:21:12.310 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-17T16:21:12.310 DEBUG:teuthology.orchestra.run.smithi121:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-17T16:21:12.638 INFO:teuthology.provision.fog.smithi121:Node is ready 2024-02-17T16:21:12.639 DEBUG:teuthology.orchestra.run.smithi121:> hostname 2024-02-17T16:21:12.653 INFO:teuthology.orchestra.run.smithi121.stdout:smithi121.front.sepia.ceph.com 2024-02-17T16:21:12.695 DEBUG:teuthology.orchestra.run.smithi121:> grep smithi121.front.sepia.ceph.com /etc/hosts 2024-02-17T16:21:12.710 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121 smithi121.front.sepia.ceph.com smithi121 2024-02-17T16:21:12.710 DEBUG:teuthology.orchestra.run.smithi121:> sudo hostname smithi121 2024-02-17T16:21:12.819 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i -e 's/smithi121.front.sepia.ceph.com/smithi121/g' /etc/hosts 2024-02-17T16:21:12.846 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i -e 's/172.21.15.121/172.21.15.121/g' /etc/hosts 2024-02-17T16:21:12.914 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i -e 's/smithi121.front.sepia.ceph.com/smithi121/g' /etc/hostname 2024-02-17T16:21:12.982 DEBUG:teuthology.orchestra.run.smithi121:> sudo hostname smithi121 2024-02-17T16:21:13.049 DEBUG:teuthology.orchestra.run.smithi121:> cat /etc/os-release 2024-02-17T16:21:13.104 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="CentOS Stream" 2024-02-17T16:21:13.104 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="9" 2024-02-17T16:21:13.104 INFO:teuthology.orchestra.run.smithi121.stdout:ID="centos" 2024-02-17T16:21:13.104 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE="rhel fedora" 2024-02-17T16:21:13.104 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="9" 2024-02-17T16:21:13.104 INFO:teuthology.orchestra.run.smithi121.stdout:PLATFORM_ID="platform:el9" 2024-02-17T16:21:13.104 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-17T16:21:13.104 INFO:teuthology.orchestra.run.smithi121.stdout:ANSI_COLOR="0;31" 2024-02-17T16:21:13.104 INFO:teuthology.orchestra.run.smithi121.stdout:LOGO="fedora-logo-icon" 2024-02-17T16:21:13.104 INFO:teuthology.orchestra.run.smithi121.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-17T16:21:13.104 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://centos.org/" 2024-02-17T16:21:13.105 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-17T16:21:13.105 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-17T16:21:13.105 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-17T16:21:13.105 INFO:teuthology.provision.fog.smithi121:Deploy complete! 2024-02-17T16:21:13.105 DEBUG:teuthology.parallel:result is None 2024-02-17T16:21:13.271 INFO:teuthology.lock.ops:Checking smithi079.front.sepia.ceph.com 2024-02-17T16:21:13.272 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-17T16:21:13.294 INFO:teuthology.lock.ops:Checking smithi121.front.sepia.ceph.com 2024-02-17T16:21:13.294 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-17T16:21:13.320 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: set os type and version on server 2024-02-17T16:21:13.320 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-02-17T16:21:13.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T16:21:13.411 DEBUG:teuthology.orchestra.run.smithi079:> true 2024-02-17T16:21:13.479 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-02-17T16:21:13.479 DEBUG:teuthology.orchestra.run.smithi079:> uname -m 2024-02-17T16:21:13.535 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64 2024-02-17T16:21:13.536 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2024-02-17T16:21:13.591 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="CentOS Stream" 2024-02-17T16:21:13.592 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="9" 2024-02-17T16:21:13.592 INFO:teuthology.orchestra.run.smithi079.stdout:ID="centos" 2024-02-17T16:21:13.592 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="rhel fedora" 2024-02-17T16:21:13.592 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="9" 2024-02-17T16:21:13.592 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el9" 2024-02-17T16:21:13.592 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-17T16:21:13.592 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31" 2024-02-17T16:21:13.592 INFO:teuthology.orchestra.run.smithi079.stdout:LOGO="fedora-logo-icon" 2024-02-17T16:21:13.592 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-17T16:21:13.592 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://centos.org/" 2024-02-17T16:21:13.592 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-17T16:21:13.592 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-17T16:21:13.592 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-17T16:21:13.593 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2024-02-17T16:21:13.611 INFO:teuthology.lock.ops:Updating [smithi121.front.sepia.ceph.com]: set os type and version on server 2024-02-17T16:21:13.611 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-02-17T16:21:13.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T16:21:13.698 DEBUG:teuthology.orchestra.run.smithi121:> true 2024-02-17T16:21:13.766 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-02-17T16:21:13.766 DEBUG:teuthology.orchestra.run.smithi121:> uname -m 2024-02-17T16:21:13.820 INFO:teuthology.orchestra.run.smithi121.stdout:x86_64 2024-02-17T16:21:13.821 DEBUG:teuthology.orchestra.run.smithi121:> cat /etc/os-release 2024-02-17T16:21:13.874 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="CentOS Stream" 2024-02-17T16:21:13.875 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="9" 2024-02-17T16:21:13.875 INFO:teuthology.orchestra.run.smithi121.stdout:ID="centos" 2024-02-17T16:21:13.875 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE="rhel fedora" 2024-02-17T16:21:13.875 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="9" 2024-02-17T16:21:13.875 INFO:teuthology.orchestra.run.smithi121.stdout:PLATFORM_ID="platform:el9" 2024-02-17T16:21:13.875 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-17T16:21:13.875 INFO:teuthology.orchestra.run.smithi121.stdout:ANSI_COLOR="0;31" 2024-02-17T16:21:13.875 INFO:teuthology.orchestra.run.smithi121.stdout:LOGO="fedora-logo-icon" 2024-02-17T16:21:13.875 INFO:teuthology.orchestra.run.smithi121.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-17T16:21:13.875 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://centos.org/" 2024-02-17T16:21:13.875 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-17T16:21:13.875 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-17T16:21:13.875 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-17T16:21:13.876 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server 2024-02-17T16:21:13.894 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T16:21:13.986 INFO:teuthology.dispatcher.supervisor:Running job 7563480 2024-02-17T16:21:13.986 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-02-16_20:14:07-orch-main-distro-default-smithi/7563480 --name yuriw-2024-02-16_20:14:07-orch-main-distro-default-smithi --description orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/yuriw-2024-02-16_20:14:07-orch-main-distro-default-smithi/7563480/orig.config.yaml 2024-02-17T16:21:13.989 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-02-16_20:14:07-orch-main-distro-default-smithi/7563480 2024-02-17T16:21:13.989 INFO:teuthology.dispatcher.supervisor:Job PID: 474473 2024-02-17T16:21:13.990 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-17T16:23:14.065 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T16:25:14.237 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T16:27:14.405 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T16:29:14.581 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T16:31:14.753 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T16:33:14.917 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T16:35:15.089 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T16:37:15.253 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T16:39:15.370 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T16:41:15.536 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T16:43:15.701 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T16:45:15.872 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T16:47:16.049 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T16:49:16.226 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T16:51:16.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T16:53:16.562 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T16:55:16.728 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T16:57:16.896 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T16:59:17.072 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T17:01:17.249 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T17:03:17.397 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T17:05:17.564 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T17:07:17.729 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T17:09:17.904 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T17:11:18.073 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T17:13:18.233 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T17:15:18.405 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T17:17:18.573 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T17:19:18.744 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T17:21:18.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T17:23:19.076 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T17:25:19.257 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T17:27:19.424 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T17:29:19.601 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T17:31:19.801 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T17:33:19.977 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T17:35:20.157 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T17:37:20.329 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T17:39:20.507 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T17:41:20.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T17:43:20.864 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T17:45:21.037 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T17:47:21.214 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T17:49:21.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T17:51:21.553 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T17:53:21.725 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T17:55:21.892 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T17:57:22.057 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T17:59:22.229 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T18:01:22.393 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T18:03:22.565 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T18:05:22.725 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T18:07:22.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T18:09:23.044 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T18:11:23.224 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T18:13:23.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T18:15:23.552 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T18:17:23.729 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T18:19:23.913 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T18:21:24.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T18:23:24.252 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T18:25:24.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T18:27:24.578 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T18:29:24.749 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T18:31:24.917 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T18:33:25.084 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T18:35:25.265 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T18:37:25.433 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T18:39:25.721 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T18:41:25.892 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T18:43:26.064 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T18:45:26.242 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T18:47:26.425 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T18:49:26.580 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T18:51:26.756 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T18:53:26.921 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T18:55:27.101 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T18:57:27.293 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T18:59:27.473 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T19:01:27.614 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T19:03:27.753 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T19:05:27.925 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T19:07:28.094 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T19:09:28.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T19:11:28.425 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T19:13:28.602 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T19:15:28.733 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T19:17:28.893 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T19:19:29.069 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T19:21:30.237 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T19:23:30.400 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T19:25:30.557 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T19:27:30.724 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T19:29:30.904 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T19:31:31.077 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T19:33:31.248 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T19:35:31.413 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T19:37:31.763 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T19:39:31.929 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T19:41:32.104 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T19:43:32.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T19:45:32.459 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T19:47:32.633 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T19:49:32.813 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T19:51:32.977 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T19:53:33.081 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T19:55:33.257 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T19:57:33.433 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T19:59:33.589 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T20:01:33.761 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T20:03:34.138 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T20:05:34.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T20:05:34.375 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1