2026-02-24T07:40:10.516 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-24T07:40:10.517 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-24T07:40:10.587 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-24T07:40:10.775 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb4b6caf560>, signals=[15]) 2026-02-24T07:40:10.776 INFO:teuthology.lock.ops:Start node 'trial009.front.sepia.ceph.com' reimaging 2026-02-24T07:40:10.776 INFO:teuthology.lock.ops:Updating [trial009.front.sepia.ceph.com]: reset os type and version on server 2026-02-24T07:40:10.776 INFO:teuthology.lock.ops:Updating trial009.front.sepia.ceph.com on lock server 2026-02-24T07:40:10.834 INFO:teuthology.lock.ops:Start node 'trial089.front.sepia.ceph.com' reimaging 2026-02-24T07:40:10.834 INFO:teuthology.lock.ops:Updating [trial089.front.sepia.ceph.com]: reset os type and version on server 2026-02-24T07:40:10.834 INFO:teuthology.lock.ops:Updating trial089.front.sepia.ceph.com on lock server 2026-02-24T07:40:11.069 DEBUG:teuthology.provision.fog.trial009:Requesting image trial_rocky_10.1 (ID 4) 2026-02-24T07:40:11.078 DEBUG:teuthology.provision.fog.trial089:Requesting image trial_rocky_10.1 (ID 4) 2026-02-24T07:40:11.113 INFO:teuthology.provision.fog.trial009:Scheduling deploy of rocky 10.1 2026-02-24T07:40:11.130 INFO:teuthology.provision.fog.trial089:Scheduling deploy of rocky 10.1 2026-02-24T07:40:12.941 INFO:teuthology.orchestra.console.trial009:Power off 2026-02-24T07:40:12.941 DEBUG:teuthology.orchestra.console.trial009:pexpect command: ipmitool -H trial009.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-24T07:40:12.960 INFO:teuthology.orchestra.console.trial089:Power off 2026-02-24T07:40:12.960 DEBUG:teuthology.orchestra.console.trial089:pexpect command: ipmitool -H trial089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-24T07:40:12.981 DEBUG:teuthology.orchestra.console.trial009:power off output: Chassis Power Control: Down/Off 2026-02-24T07:40:12.998 DEBUG:teuthology.orchestra.console.trial089:power off output: Chassis Power Control: Down/Off 2026-02-24T07:40:16.986 DEBUG:teuthology.orchestra.console.trial009:pexpect command: ipmitool -H trial009.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-24T07:40:16.999 DEBUG:teuthology.orchestra.console.trial089:pexpect command: ipmitool -H trial089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-24T07:40:17.096 DEBUG:teuthology.orchestra.console.trial009:check power output: Chassis Power is off 2026-02-24T07:40:17.096 INFO:teuthology.orchestra.console.trial009:Power off completed 2026-02-24T07:40:17.107 DEBUG:teuthology.orchestra.console.trial089:check power output: Chassis Power is off 2026-02-24T07:40:17.107 INFO:teuthology.orchestra.console.trial089:Power off completed 2026-02-24T07:40:17.198 INFO:teuthology.orchestra.console.trial009:Power on 2026-02-24T07:40:17.198 DEBUG:teuthology.orchestra.console.trial009:pexpect command: ipmitool -H trial009.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-24T07:40:17.208 INFO:teuthology.orchestra.console.trial089:Power on 2026-02-24T07:40:17.209 DEBUG:teuthology.orchestra.console.trial089:pexpect command: ipmitool -H trial089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-24T07:40:17.238 DEBUG:teuthology.orchestra.console.trial009:power on output: Chassis Power Control: Up/On 2026-02-24T07:40:17.248 DEBUG:teuthology.orchestra.console.trial089:power on output: Chassis Power Control: Up/On 2026-02-24T07:40:21.239 DEBUG:teuthology.orchestra.console.trial009:pexpect command: ipmitool -H trial009.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-24T07:40:21.249 DEBUG:teuthology.orchestra.console.trial089:pexpect command: ipmitool -H trial089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-24T07:40:21.349 DEBUG:teuthology.orchestra.console.trial009:check power output: Chassis Power is on 2026-02-24T07:40:21.349 INFO:teuthology.orchestra.console.trial009:Power on completed 2026-02-24T07:40:21.356 DEBUG:teuthology.orchestra.console.trial089:check power output: Chassis Power is on 2026-02-24T07:40:21.356 INFO:teuthology.orchestra.console.trial089:Power on completed 2026-02-24T07:40:21.451 INFO:teuthology.provision.fog.trial009:Waiting for deploy to finish 2026-02-24T07:40:21.457 INFO:teuthology.provision.fog.trial089:Waiting for deploy to finish 2026-02-24T07:42:09.837 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T07:42:09.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial009.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T07:42:12.928 WARNING:teuthology.provision.fog.trial089:[Errno None] Unable to connect to port 22 on 10.20.193.89 2026-02-24T07:42:12.928 WARNING:teuthology.provision.fog.trial009:[Errno None] Unable to connect to port 22 on 10.20.193.9 2026-02-24T07:42:18.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T07:42:18.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial009.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T07:42:22.016 WARNING:teuthology.provision.fog.trial089:[Errno None] Unable to connect to port 22 on 10.20.193.89 2026-02-24T07:42:22.016 WARNING:teuthology.provision.fog.trial009:[Errno None] Unable to connect to port 22 on 10.20.193.9 2026-02-24T07:42:28.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T07:42:28.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial009.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T07:42:31.103 WARNING:teuthology.provision.fog.trial089:[Errno None] Unable to connect to port 22 on 10.20.193.89 2026-02-24T07:42:31.104 WARNING:teuthology.provision.fog.trial009:[Errno None] Unable to connect to port 22 on 10.20.193.9 2026-02-24T07:42:37.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T07:42:37.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial009.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T07:42:40.192 WARNING:teuthology.provision.fog.trial089:[Errno None] Unable to connect to port 22 on 10.20.193.89 2026-02-24T07:42:40.192 WARNING:teuthology.provision.fog.trial009:[Errno None] Unable to connect to port 22 on 10.20.193.9 2026-02-24T07:42:46.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T07:42:46.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial009.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T07:42:49.281 WARNING:teuthology.provision.fog.trial089:[Errno None] Unable to connect to port 22 on 10.20.193.89 2026-02-24T07:42:49.281 WARNING:teuthology.provision.fog.trial009:[Errno None] Unable to connect to port 22 on 10.20.193.9 2026-02-24T07:42:55.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T07:42:55.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial009.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T07:43:31.352 ERROR:teuthology.orchestra.connection:Error authenticating with trial009.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-24T07:43:31.377 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-24T07:43:31.377 DEBUG:teuthology.orchestra.run.trial089:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-24T07:43:35.464 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-24T07:43:35.465 DEBUG:teuthology.orchestra.run.trial009:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-24T07:43:35.661 INFO:teuthology.provision.fog.trial009:Node is ready 2026-02-24T07:43:35.661 DEBUG:teuthology.orchestra.run.trial009:> hostname 2026-02-24T07:43:35.719 INFO:teuthology.orchestra.run.trial009.stdout:trial009.front.sepia.ceph.com 2026-02-24T07:43:35.719 DEBUG:teuthology.orchestra.run.trial009:> grep trial009.front.sepia.ceph.com /etc/hosts 2026-02-24T07:43:35.777 INFO:teuthology.orchestra.run.trial009.stdout:10.20.193.9 trial009.front.sepia.ceph.com trial009 2026-02-24T07:43:35.778 DEBUG:teuthology.orchestra.run.trial009:> sudo hostname trial009 2026-02-24T07:43:35.850 DEBUG:teuthology.orchestra.run.trial009:> sudo sed -i -e 's/trial009.front.sepia.ceph.com/trial009/g' /etc/hosts 2026-02-24T07:43:35.919 DEBUG:teuthology.orchestra.run.trial009:> sudo sed -i -e 's/10.20.193.9/10.20.193.9/g' /etc/hosts 2026-02-24T07:43:35.987 DEBUG:teuthology.orchestra.run.trial009:> sudo sed -i -e 's/trial009.front.sepia.ceph.com/trial009/g' /etc/hostname 2026-02-24T07:43:36.053 DEBUG:teuthology.orchestra.run.trial009:> sudo hostname trial009 2026-02-24T07:43:36.120 DEBUG:teuthology.orchestra.run.trial009:> cat /etc/os-release 2026-02-24T07:43:36.177 INFO:teuthology.orchestra.run.trial009.stdout:NAME="Rocky Linux" 2026-02-24T07:43:36.177 INFO:teuthology.orchestra.run.trial009.stdout:VERSION="10.1 (Red Quartz)" 2026-02-24T07:43:36.177 INFO:teuthology.orchestra.run.trial009.stdout:ID="rocky" 2026-02-24T07:43:36.177 INFO:teuthology.orchestra.run.trial009.stdout:ID_LIKE="rhel centos fedora" 2026-02-24T07:43:36.177 INFO:teuthology.orchestra.run.trial009.stdout:VERSION_ID="10.1" 2026-02-24T07:43:36.177 INFO:teuthology.orchestra.run.trial009.stdout:PLATFORM_ID="platform:el10" 2026-02-24T07:43:36.178 INFO:teuthology.orchestra.run.trial009.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-24T07:43:36.178 INFO:teuthology.orchestra.run.trial009.stdout:ANSI_COLOR="0;32" 2026-02-24T07:43:36.178 INFO:teuthology.orchestra.run.trial009.stdout:LOGO="fedora-logo-icon" 2026-02-24T07:43:36.178 INFO:teuthology.orchestra.run.trial009.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-24T07:43:36.178 INFO:teuthology.orchestra.run.trial009.stdout:HOME_URL="https://rockylinux.org/" 2026-02-24T07:43:36.178 INFO:teuthology.orchestra.run.trial009.stdout:VENDOR_NAME="RESF" 2026-02-24T07:43:36.178 INFO:teuthology.orchestra.run.trial009.stdout:VENDOR_URL="https://resf.org/" 2026-02-24T07:43:36.178 INFO:teuthology.orchestra.run.trial009.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-24T07:43:36.178 INFO:teuthology.orchestra.run.trial009.stdout:SUPPORT_END="2035-05-31" 2026-02-24T07:43:36.178 INFO:teuthology.orchestra.run.trial009.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-24T07:43:36.178 INFO:teuthology.orchestra.run.trial009.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-24T07:43:36.179 INFO:teuthology.orchestra.run.trial009.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-24T07:43:36.179 INFO:teuthology.orchestra.run.trial009.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-24T07:43:36.180 INFO:teuthology.provision.fog.trial009:Deploy complete! 2026-02-24T07:43:36.180 DEBUG:teuthology.parallel:result is None 2026-02-24T07:43:36.669 INFO:teuthology.provision.fog.trial089:Node is ready 2026-02-24T07:43:36.670 DEBUG:teuthology.orchestra.run.trial089:> hostname 2026-02-24T07:43:36.688 INFO:teuthology.orchestra.run.trial089.stdout:trial089.front.sepia.ceph.com 2026-02-24T07:43:36.688 DEBUG:teuthology.orchestra.run.trial089:> grep trial089.front.sepia.ceph.com /etc/hosts 2026-02-24T07:43:36.746 INFO:teuthology.orchestra.run.trial089.stdout:10.20.193.89 trial089.front.sepia.ceph.com trial089 2026-02-24T07:43:36.746 DEBUG:teuthology.orchestra.run.trial089:> sudo hostname trial089 2026-02-24T07:43:36.819 DEBUG:teuthology.orchestra.run.trial089:> sudo sed -i -e 's/trial089.front.sepia.ceph.com/trial089/g' /etc/hosts 2026-02-24T07:43:36.886 DEBUG:teuthology.orchestra.run.trial089:> sudo sed -i -e 's/10.20.193.89/10.20.193.89/g' /etc/hosts 2026-02-24T07:43:36.953 DEBUG:teuthology.orchestra.run.trial089:> sudo sed -i -e 's/trial089.front.sepia.ceph.com/trial089/g' /etc/hostname 2026-02-24T07:43:37.020 DEBUG:teuthology.orchestra.run.trial089:> sudo hostname trial089 2026-02-24T07:43:37.085 DEBUG:teuthology.orchestra.run.trial089:> cat /etc/os-release 2026-02-24T07:43:37.143 INFO:teuthology.orchestra.run.trial089.stdout:NAME="Rocky Linux" 2026-02-24T07:43:37.144 INFO:teuthology.orchestra.run.trial089.stdout:VERSION="10.1 (Red Quartz)" 2026-02-24T07:43:37.144 INFO:teuthology.orchestra.run.trial089.stdout:ID="rocky" 2026-02-24T07:43:37.144 INFO:teuthology.orchestra.run.trial089.stdout:ID_LIKE="rhel centos fedora" 2026-02-24T07:43:37.144 INFO:teuthology.orchestra.run.trial089.stdout:VERSION_ID="10.1" 2026-02-24T07:43:37.144 INFO:teuthology.orchestra.run.trial089.stdout:PLATFORM_ID="platform:el10" 2026-02-24T07:43:37.144 INFO:teuthology.orchestra.run.trial089.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-24T07:43:37.144 INFO:teuthology.orchestra.run.trial089.stdout:ANSI_COLOR="0;32" 2026-02-24T07:43:37.144 INFO:teuthology.orchestra.run.trial089.stdout:LOGO="fedora-logo-icon" 2026-02-24T07:43:37.144 INFO:teuthology.orchestra.run.trial089.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-24T07:43:37.145 INFO:teuthology.orchestra.run.trial089.stdout:HOME_URL="https://rockylinux.org/" 2026-02-24T07:43:37.145 INFO:teuthology.orchestra.run.trial089.stdout:VENDOR_NAME="RESF" 2026-02-24T07:43:37.145 INFO:teuthology.orchestra.run.trial089.stdout:VENDOR_URL="https://resf.org/" 2026-02-24T07:43:37.145 INFO:teuthology.orchestra.run.trial089.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-24T07:43:37.145 INFO:teuthology.orchestra.run.trial089.stdout:SUPPORT_END="2035-05-31" 2026-02-24T07:43:37.145 INFO:teuthology.orchestra.run.trial089.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-24T07:43:37.145 INFO:teuthology.orchestra.run.trial089.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-24T07:43:37.145 INFO:teuthology.orchestra.run.trial089.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-24T07:43:37.145 INFO:teuthology.orchestra.run.trial089.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-24T07:43:37.146 INFO:teuthology.provision.fog.trial089:Deploy complete! 2026-02-24T07:43:37.147 DEBUG:teuthology.parallel:result is None 2026-02-24T07:43:37.538 INFO:teuthology.lock.ops:Checking trial009.front.sepia.ceph.com 2026-02-24T07:43:37.538 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-24T07:43:37.642 INFO:teuthology.lock.ops:Checking trial089.front.sepia.ceph.com 2026-02-24T07:43:37.642 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-24T07:43:37.705 INFO:teuthology.lock.ops:Updating [trial009.front.sepia.ceph.com]: set os type and version on server 2026-02-24T07:43:37.705 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial009.front.sepia.ceph.com' 2026-02-24T07:43:37.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial009.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T07:43:37.766 DEBUG:teuthology.orchestra.run.trial009:> true 2026-02-24T07:43:37.849 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial009.front.sepia.ceph.com' 2026-02-24T07:43:37.849 DEBUG:teuthology.orchestra.run.trial009:> uname -m 2026-02-24T07:43:37.907 INFO:teuthology.orchestra.run.trial009.stdout:x86_64 2026-02-24T07:43:37.908 DEBUG:teuthology.orchestra.run.trial009:> cat /etc/os-release 2026-02-24T07:43:37.966 INFO:teuthology.orchestra.run.trial009.stdout:NAME="Rocky Linux" 2026-02-24T07:43:37.966 INFO:teuthology.orchestra.run.trial009.stdout:VERSION="10.1 (Red Quartz)" 2026-02-24T07:43:37.966 INFO:teuthology.orchestra.run.trial009.stdout:ID="rocky" 2026-02-24T07:43:37.967 INFO:teuthology.orchestra.run.trial009.stdout:ID_LIKE="rhel centos fedora" 2026-02-24T07:43:37.967 INFO:teuthology.orchestra.run.trial009.stdout:VERSION_ID="10.1" 2026-02-24T07:43:37.967 INFO:teuthology.orchestra.run.trial009.stdout:PLATFORM_ID="platform:el10" 2026-02-24T07:43:37.967 INFO:teuthology.orchestra.run.trial009.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-24T07:43:37.967 INFO:teuthology.orchestra.run.trial009.stdout:ANSI_COLOR="0;32" 2026-02-24T07:43:37.967 INFO:teuthology.orchestra.run.trial009.stdout:LOGO="fedora-logo-icon" 2026-02-24T07:43:37.967 INFO:teuthology.orchestra.run.trial009.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-24T07:43:37.967 INFO:teuthology.orchestra.run.trial009.stdout:HOME_URL="https://rockylinux.org/" 2026-02-24T07:43:37.967 INFO:teuthology.orchestra.run.trial009.stdout:VENDOR_NAME="RESF" 2026-02-24T07:43:37.967 INFO:teuthology.orchestra.run.trial009.stdout:VENDOR_URL="https://resf.org/" 2026-02-24T07:43:37.967 INFO:teuthology.orchestra.run.trial009.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-24T07:43:37.967 INFO:teuthology.orchestra.run.trial009.stdout:SUPPORT_END="2035-05-31" 2026-02-24T07:43:37.968 INFO:teuthology.orchestra.run.trial009.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-24T07:43:37.968 INFO:teuthology.orchestra.run.trial009.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-24T07:43:37.968 INFO:teuthology.orchestra.run.trial009.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-24T07:43:37.968 INFO:teuthology.orchestra.run.trial009.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-24T07:43:37.968 INFO:teuthology.lock.ops:Updating trial009.front.sepia.ceph.com on lock server 2026-02-24T07:43:38.070 INFO:teuthology.lock.ops:Updating [trial089.front.sepia.ceph.com]: set os type and version on server 2026-02-24T07:43:38.070 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-24T07:43:38.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T07:43:38.133 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-24T07:43:38.220 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-24T07:43:38.220 DEBUG:teuthology.orchestra.run.trial089:> uname -m 2026-02-24T07:43:38.277 INFO:teuthology.orchestra.run.trial089.stdout:x86_64 2026-02-24T07:43:38.278 DEBUG:teuthology.orchestra.run.trial089:> cat /etc/os-release 2026-02-24T07:43:38.336 INFO:teuthology.orchestra.run.trial089.stdout:NAME="Rocky Linux" 2026-02-24T07:43:38.337 INFO:teuthology.orchestra.run.trial089.stdout:VERSION="10.1 (Red Quartz)" 2026-02-24T07:43:38.337 INFO:teuthology.orchestra.run.trial089.stdout:ID="rocky" 2026-02-24T07:43:38.337 INFO:teuthology.orchestra.run.trial089.stdout:ID_LIKE="rhel centos fedora" 2026-02-24T07:43:38.337 INFO:teuthology.orchestra.run.trial089.stdout:VERSION_ID="10.1" 2026-02-24T07:43:38.337 INFO:teuthology.orchestra.run.trial089.stdout:PLATFORM_ID="platform:el10" 2026-02-24T07:43:38.337 INFO:teuthology.orchestra.run.trial089.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-24T07:43:38.337 INFO:teuthology.orchestra.run.trial089.stdout:ANSI_COLOR="0;32" 2026-02-24T07:43:38.337 INFO:teuthology.orchestra.run.trial089.stdout:LOGO="fedora-logo-icon" 2026-02-24T07:43:38.338 INFO:teuthology.orchestra.run.trial089.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-24T07:43:38.338 INFO:teuthology.orchestra.run.trial089.stdout:HOME_URL="https://rockylinux.org/" 2026-02-24T07:43:38.338 INFO:teuthology.orchestra.run.trial089.stdout:VENDOR_NAME="RESF" 2026-02-24T07:43:38.338 INFO:teuthology.orchestra.run.trial089.stdout:VENDOR_URL="https://resf.org/" 2026-02-24T07:43:38.338 INFO:teuthology.orchestra.run.trial089.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-24T07:43:38.338 INFO:teuthology.orchestra.run.trial089.stdout:SUPPORT_END="2035-05-31" 2026-02-24T07:43:38.338 INFO:teuthology.orchestra.run.trial089.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-24T07:43:38.338 INFO:teuthology.orchestra.run.trial089.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-24T07:43:38.338 INFO:teuthology.orchestra.run.trial089.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-24T07:43:38.338 INFO:teuthology.orchestra.run.trial089.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-24T07:43:38.339 INFO:teuthology.lock.ops:Updating trial089.front.sepia.ceph.com on lock server 2026-02-24T07:43:38.418 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-24T07:43:38.502 INFO:teuthology.dispatcher.supervisor:Running job 67744 2026-02-24T07:43:38.502 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_nmordech@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/nmordech-2026-02-24_07:22:16-rados:mgr-wip-rocky10-branch-of-the-day-2026-02-23-1771838812-tentacle-distro-default-trial/67744 --name nmordech-2026-02-24_07:22:16-rados:mgr-wip-rocky10-branch-of-the-day-2026-02-23-1771838812-tentacle-distro-default-trial --description rados:mgr/{clusters/{2-node-mgr} debug/mgr distro/{rpm_latest} mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore/{alloc$/{bitmap} base mem$/{low} onode-segment$/{512K-onoff} write$/{v1/{compr$/{no$/{no}} v1}}}} tasks/{1-install 2-ceph 3-mgrmodules 4-units/devicehealth}} -- /home/teuthworker/mnt/teuthology/nmordech-2026-02-24_07:22:16-rados:mgr-wip-rocky10-branch-of-the-day-2026-02-23-1771838812-tentacle-distro-default-trial/67744/orig.config.yaml 2026-02-24T07:43:38.502 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/nmordech-2026-02-24_07:22:16-rados:mgr-wip-rocky10-branch-of-the-day-2026-02-23-1771838812-tentacle-distro-default-trial/67744 2026-02-24T07:43:38.502 INFO:teuthology.dispatcher.supervisor:Job PID: 2929826 2026-02-24T07:43:38.502 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2026-02-24T07:45:38.603 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-24T07:47:38.777 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-24T07:49:38.952 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-24T07:51:39.130 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-24T07:51:39.226 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2026-02-24T07:51:39.342 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2026-02-24T07:51:39.836 INFO:teuthology.orchestra.console.trial009:Power off 2026-02-24T07:51:39.836 DEBUG:teuthology.orchestra.console.trial009:pexpect command: ipmitool -H trial009.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-24T07:51:39.856 INFO:teuthology.orchestra.console.trial089:Power off 2026-02-24T07:51:39.856 DEBUG:teuthology.orchestra.console.trial089:pexpect command: ipmitool -H trial089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-24T07:51:39.876 DEBUG:teuthology.orchestra.console.trial009:power off output: Chassis Power Control: Down/Off 2026-02-24T07:51:39.894 DEBUG:teuthology.orchestra.console.trial089:power off output: Chassis Power Control: Down/Off 2026-02-24T07:51:43.881 DEBUG:teuthology.orchestra.console.trial009:pexpect command: ipmitool -H trial009.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-24T07:51:43.895 DEBUG:teuthology.orchestra.console.trial089:pexpect command: ipmitool -H trial089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-24T07:51:43.991 DEBUG:teuthology.orchestra.console.trial009:check power output: Chassis Power is on 2026-02-24T07:51:44.003 DEBUG:teuthology.orchestra.console.trial089:check power output: Chassis Power is on 2026-02-24T07:51:47.994 DEBUG:teuthology.orchestra.console.trial009:pexpect command: ipmitool -H trial009.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-24T07:51:48.004 DEBUG:teuthology.orchestra.console.trial089:pexpect command: ipmitool -H trial089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-24T07:51:48.103 DEBUG:teuthology.orchestra.console.trial009:check power output: Chassis Power is off 2026-02-24T07:51:48.103 INFO:teuthology.orchestra.console.trial009:Power off completed 2026-02-24T07:51:48.111 DEBUG:teuthology.orchestra.console.trial089:check power output: Chassis Power is off 2026-02-24T07:51:48.111 INFO:teuthology.orchestra.console.trial089:Power off completed 2026-02-24T07:51:48.348 INFO:teuthology.lock.ops:unlocked: trial009.front.sepia.ceph.com 2026-02-24T07:51:48.360 INFO:teuthology.lock.ops:unlocked: trial089.front.sepia.ceph.com