2026-02-13T01:10:25.235 INFO:root:teuthology version: 1.2.4.dev9+ga2c505dae 2026-02-13T01:10:25.235 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T01:10:25.309 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T01:10:25.493 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x78aacf109e40>, signals=[15]) 2026-02-13T01:10:25.493 INFO:teuthology.lock.ops:Start node 'trial089.front.sepia.ceph.com' reimaging 2026-02-13T01:10:25.493 INFO:teuthology.lock.ops:Updating [trial089.front.sepia.ceph.com]: reset os type and version on server 2026-02-13T01:10:25.493 INFO:teuthology.lock.ops:Updating trial089.front.sepia.ceph.com on lock server 2026-02-13T01:10:25.550 INFO:teuthology.lock.ops:Start node 'trial099.front.sepia.ceph.com' reimaging 2026-02-13T01:10:25.551 INFO:teuthology.lock.ops:Updating [trial099.front.sepia.ceph.com]: reset os type and version on server 2026-02-13T01:10:25.551 INFO:teuthology.lock.ops:Updating trial099.front.sepia.ceph.com on lock server 2026-02-13T01:10:25.737 DEBUG:teuthology.provision.fog.trial089:Requesting image trial_rocky_10.1 (ID 4) 2026-02-13T01:10:25.758 INFO:teuthology.provision.fog.trial089:Scheduling deploy of rocky 10.1 2026-02-13T01:10:25.765 DEBUG:teuthology.provision.fog.trial099:Requesting image trial_rocky_10.1 (ID 4) 2026-02-13T01:10:25.799 INFO:teuthology.provision.fog.trial099:Scheduling deploy of rocky 10.1 2026-02-13T01:10:27.857 INFO:teuthology.orchestra.console.trial099:Power off 2026-02-13T01:10:27.857 DEBUG:teuthology.orchestra.console.trial099:pexpect command: ipmitool -H trial099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-13T01:10:27.875 INFO:teuthology.orchestra.console.trial089:Power off 2026-02-13T01:10:27.875 DEBUG:teuthology.orchestra.console.trial089:pexpect command: ipmitool -H trial089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-13T01:10:27.894 DEBUG:teuthology.orchestra.console.trial099:power off output: Chassis Power Control: Down/Off 2026-02-13T01:10:27.913 DEBUG:teuthology.orchestra.console.trial089:power off output: Chassis Power Control: Down/Off 2026-02-13T01:10:31.899 DEBUG:teuthology.orchestra.console.trial099:pexpect command: ipmitool -H trial099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T01:10:31.913 DEBUG:teuthology.orchestra.console.trial089:pexpect command: ipmitool -H trial089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T01:10:32.008 DEBUG:teuthology.orchestra.console.trial099:check power output: Chassis Power is off 2026-02-13T01:10:32.008 INFO:teuthology.orchestra.console.trial099:Power off completed 2026-02-13T01:10:32.022 DEBUG:teuthology.orchestra.console.trial089:check power output: Chassis Power is off 2026-02-13T01:10:32.022 INFO:teuthology.orchestra.console.trial089:Power off completed 2026-02-13T01:10:32.110 INFO:teuthology.orchestra.console.trial099:Power on 2026-02-13T01:10:32.110 DEBUG:teuthology.orchestra.console.trial099:pexpect command: ipmitool -H trial099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-13T01:10:32.123 INFO:teuthology.orchestra.console.trial089:Power on 2026-02-13T01:10:32.123 DEBUG:teuthology.orchestra.console.trial089:pexpect command: ipmitool -H trial089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-13T01:10:32.151 DEBUG:teuthology.orchestra.console.trial099:power on output: Chassis Power Control: Up/On 2026-02-13T01:10:32.162 DEBUG:teuthology.orchestra.console.trial089:power on output: Chassis Power Control: Up/On 2026-02-13T01:10:36.155 DEBUG:teuthology.orchestra.console.trial099:pexpect command: ipmitool -H trial099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T01:10:36.162 DEBUG:teuthology.orchestra.console.trial089:pexpect command: ipmitool -H trial089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T01:10:36.265 DEBUG:teuthology.orchestra.console.trial099:check power output: Chassis Power is on 2026-02-13T01:10:36.266 INFO:teuthology.orchestra.console.trial099:Power on completed 2026-02-13T01:10:36.271 DEBUG:teuthology.orchestra.console.trial089:check power output: Chassis Power is off 2026-02-13T01:10:36.367 INFO:teuthology.provision.fog.trial099:Waiting for deploy to finish 2026-02-13T01:10:40.274 DEBUG:teuthology.orchestra.console.trial089:pexpect command: ipmitool -H trial089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T01:10:40.384 DEBUG:teuthology.orchestra.console.trial089:check power output: Chassis Power is on 2026-02-13T01:10:40.384 INFO:teuthology.orchestra.console.trial089:Power on completed 2026-02-13T01:10:40.485 INFO:teuthology.provision.fog.trial089:Waiting for deploy to finish 2026-02-13T01:13:04.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T01:13:18.749 WARNING:teuthology.provision.fog.trial089:[Errno None] Unable to connect to port 22 on 10.20.193.89 2026-02-13T01:13:24.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T01:13:27.837 WARNING:teuthology.provision.fog.trial089:[Errno None] Unable to connect to port 22 on 10.20.193.89 2026-02-13T01:13:30.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T01:13:33.841 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T01:13:34.045 WARNING:teuthology.provision.fog.trial099:[Errno None] Unable to connect to port 22 on 10.20.193.99 2026-02-13T01:13:40.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T01:13:43.133 WARNING:teuthology.provision.fog.trial099:[Errno None] Unable to connect to port 22 on 10.20.193.99 2026-02-13T01:13:49.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T01:13:52.221 WARNING:teuthology.provision.fog.trial099:[Errno None] Unable to connect to port 22 on 10.20.193.99 2026-02-13T01:13:58.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T01:14:01.310 WARNING:teuthology.provision.fog.trial099:[Errno None] Unable to connect to port 22 on 10.20.193.99 2026-02-13T01:14:07.316 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T01:14:10.103 ERROR:teuthology.orchestra.connection:Error authenticating with trial089.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-13T01:14:14.192 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-13T01:14:14.192 DEBUG:teuthology.orchestra.run.trial089:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-13T01:14:19.741 INFO:teuthology.provision.fog.trial089:Node is ready 2026-02-13T01:14:19.741 DEBUG:teuthology.orchestra.run.trial089:> hostname 2026-02-13T01:14:19.759 INFO:teuthology.orchestra.run.trial089.stdout:trial089.front.sepia.ceph.com 2026-02-13T01:14:19.760 DEBUG:teuthology.orchestra.run.trial089:> grep trial089.front.sepia.ceph.com /etc/hosts 2026-02-13T01:14:19.817 INFO:teuthology.orchestra.run.trial089.stdout:10.20.193.89 trial089.front.sepia.ceph.com trial089 2026-02-13T01:14:19.818 DEBUG:teuthology.orchestra.run.trial089:> sudo hostname trial089 2026-02-13T01:14:19.891 DEBUG:teuthology.orchestra.run.trial089:> sudo sed -i -e 's/trial089.front.sepia.ceph.com/trial089/g' /etc/hosts 2026-02-13T01:14:19.958 DEBUG:teuthology.orchestra.run.trial089:> sudo sed -i -e 's/10.20.193.89/10.20.193.89/g' /etc/hosts 2026-02-13T01:14:20.025 DEBUG:teuthology.orchestra.run.trial089:> sudo sed -i -e 's/trial089.front.sepia.ceph.com/trial089/g' /etc/hostname 2026-02-13T01:14:20.091 DEBUG:teuthology.orchestra.run.trial089:> sudo hostname trial089 2026-02-13T01:14:20.157 DEBUG:teuthology.orchestra.run.trial089:> cat /etc/os-release 2026-02-13T01:14:20.214 INFO:teuthology.orchestra.run.trial089.stdout:NAME="Rocky Linux" 2026-02-13T01:14:20.214 INFO:teuthology.orchestra.run.trial089.stdout:VERSION="10.1 (Red Quartz)" 2026-02-13T01:14:20.214 INFO:teuthology.orchestra.run.trial089.stdout:ID="rocky" 2026-02-13T01:14:20.214 INFO:teuthology.orchestra.run.trial089.stdout:ID_LIKE="rhel centos fedora" 2026-02-13T01:14:20.214 INFO:teuthology.orchestra.run.trial089.stdout:VERSION_ID="10.1" 2026-02-13T01:14:20.215 INFO:teuthology.orchestra.run.trial089.stdout:PLATFORM_ID="platform:el10" 2026-02-13T01:14:20.215 INFO:teuthology.orchestra.run.trial089.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-13T01:14:20.215 INFO:teuthology.orchestra.run.trial089.stdout:ANSI_COLOR="0;32" 2026-02-13T01:14:20.215 INFO:teuthology.orchestra.run.trial089.stdout:LOGO="fedora-logo-icon" 2026-02-13T01:14:20.215 INFO:teuthology.orchestra.run.trial089.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-13T01:14:20.215 INFO:teuthology.orchestra.run.trial089.stdout:HOME_URL="https://rockylinux.org/" 2026-02-13T01:14:20.215 INFO:teuthology.orchestra.run.trial089.stdout:VENDOR_NAME="RESF" 2026-02-13T01:14:20.215 INFO:teuthology.orchestra.run.trial089.stdout:VENDOR_URL="https://resf.org/" 2026-02-13T01:14:20.215 INFO:teuthology.orchestra.run.trial089.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-13T01:14:20.215 INFO:teuthology.orchestra.run.trial089.stdout:SUPPORT_END="2035-05-31" 2026-02-13T01:14:20.215 INFO:teuthology.orchestra.run.trial089.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-13T01:14:20.216 INFO:teuthology.orchestra.run.trial089.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-13T01:14:20.216 INFO:teuthology.orchestra.run.trial089.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-13T01:14:20.216 INFO:teuthology.orchestra.run.trial089.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-13T01:14:20.217 INFO:teuthology.provision.fog.trial089:Deploy complete! 2026-02-13T01:14:20.218 DEBUG:teuthology.parallel:result is None 2026-02-13T01:14:43.379 ERROR:teuthology.orchestra.connection:Error authenticating with trial099.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-13T01:14:47.473 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-13T01:14:47.474 DEBUG:teuthology.orchestra.run.trial099:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-13T01:14:52.563 INFO:teuthology.provision.fog.trial099:Node is ready 2026-02-13T01:14:52.563 DEBUG:teuthology.orchestra.run.trial099:> hostname 2026-02-13T01:14:52.581 INFO:teuthology.orchestra.run.trial099.stdout:trial099.front.sepia.ceph.com 2026-02-13T01:14:52.582 DEBUG:teuthology.orchestra.run.trial099:> grep trial099.front.sepia.ceph.com /etc/hosts 2026-02-13T01:14:52.639 INFO:teuthology.orchestra.run.trial099.stdout:10.20.193.99 trial099.front.sepia.ceph.com trial099 2026-02-13T01:14:52.639 DEBUG:teuthology.orchestra.run.trial099:> sudo hostname trial099 2026-02-13T01:14:52.712 DEBUG:teuthology.orchestra.run.trial099:> sudo sed -i -e 's/trial099.front.sepia.ceph.com/trial099/g' /etc/hosts 2026-02-13T01:14:52.779 DEBUG:teuthology.orchestra.run.trial099:> sudo sed -i -e 's/10.20.193.99/10.20.193.99/g' /etc/hosts 2026-02-13T01:14:52.846 DEBUG:teuthology.orchestra.run.trial099:> sudo sed -i -e 's/trial099.front.sepia.ceph.com/trial099/g' /etc/hostname 2026-02-13T01:14:52.913 DEBUG:teuthology.orchestra.run.trial099:> sudo hostname trial099 2026-02-13T01:14:52.980 DEBUG:teuthology.orchestra.run.trial099:> cat /etc/os-release 2026-02-13T01:14:53.038 INFO:teuthology.orchestra.run.trial099.stdout:NAME="Rocky Linux" 2026-02-13T01:14:53.038 INFO:teuthology.orchestra.run.trial099.stdout:VERSION="10.1 (Red Quartz)" 2026-02-13T01:14:53.038 INFO:teuthology.orchestra.run.trial099.stdout:ID="rocky" 2026-02-13T01:14:53.038 INFO:teuthology.orchestra.run.trial099.stdout:ID_LIKE="rhel centos fedora" 2026-02-13T01:14:53.038 INFO:teuthology.orchestra.run.trial099.stdout:VERSION_ID="10.1" 2026-02-13T01:14:53.038 INFO:teuthology.orchestra.run.trial099.stdout:PLATFORM_ID="platform:el10" 2026-02-13T01:14:53.039 INFO:teuthology.orchestra.run.trial099.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-13T01:14:53.039 INFO:teuthology.orchestra.run.trial099.stdout:ANSI_COLOR="0;32" 2026-02-13T01:14:53.039 INFO:teuthology.orchestra.run.trial099.stdout:LOGO="fedora-logo-icon" 2026-02-13T01:14:53.039 INFO:teuthology.orchestra.run.trial099.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-13T01:14:53.039 INFO:teuthology.orchestra.run.trial099.stdout:HOME_URL="https://rockylinux.org/" 2026-02-13T01:14:53.039 INFO:teuthology.orchestra.run.trial099.stdout:VENDOR_NAME="RESF" 2026-02-13T01:14:53.039 INFO:teuthology.orchestra.run.trial099.stdout:VENDOR_URL="https://resf.org/" 2026-02-13T01:14:53.039 INFO:teuthology.orchestra.run.trial099.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-13T01:14:53.039 INFO:teuthology.orchestra.run.trial099.stdout:SUPPORT_END="2035-05-31" 2026-02-13T01:14:53.039 INFO:teuthology.orchestra.run.trial099.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-13T01:14:53.039 INFO:teuthology.orchestra.run.trial099.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-13T01:14:53.039 INFO:teuthology.orchestra.run.trial099.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-13T01:14:53.040 INFO:teuthology.orchestra.run.trial099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-13T01:14:53.040 INFO:teuthology.provision.fog.trial099:Deploy complete! 2026-02-13T01:14:53.040 DEBUG:teuthology.parallel:result is None 2026-02-13T01:14:53.441 INFO:teuthology.lock.ops:Checking trial089.front.sepia.ceph.com 2026-02-13T01:14:53.441 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-13T01:14:53.547 INFO:teuthology.lock.ops:Checking trial099.front.sepia.ceph.com 2026-02-13T01:14:53.547 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-13T01:14:53.610 INFO:teuthology.lock.ops:Updating [trial089.front.sepia.ceph.com]: set os type and version on server 2026-02-13T01:14:53.610 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-13T01:14:53.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T01:14:53.671 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-13T01:14:53.851 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-13T01:14:53.851 DEBUG:teuthology.orchestra.run.trial089:> uname -m 2026-02-13T01:14:53.910 INFO:teuthology.orchestra.run.trial089.stdout:x86_64 2026-02-13T01:14:53.910 DEBUG:teuthology.orchestra.run.trial089:> cat /etc/os-release 2026-02-13T01:14:53.968 INFO:teuthology.orchestra.run.trial089.stdout:NAME="Rocky Linux" 2026-02-13T01:14:53.968 INFO:teuthology.orchestra.run.trial089.stdout:VERSION="10.1 (Red Quartz)" 2026-02-13T01:14:53.968 INFO:teuthology.orchestra.run.trial089.stdout:ID="rocky" 2026-02-13T01:14:53.969 INFO:teuthology.orchestra.run.trial089.stdout:ID_LIKE="rhel centos fedora" 2026-02-13T01:14:53.969 INFO:teuthology.orchestra.run.trial089.stdout:VERSION_ID="10.1" 2026-02-13T01:14:53.969 INFO:teuthology.orchestra.run.trial089.stdout:PLATFORM_ID="platform:el10" 2026-02-13T01:14:53.969 INFO:teuthology.orchestra.run.trial089.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-13T01:14:53.969 INFO:teuthology.orchestra.run.trial089.stdout:ANSI_COLOR="0;32" 2026-02-13T01:14:53.969 INFO:teuthology.orchestra.run.trial089.stdout:LOGO="fedora-logo-icon" 2026-02-13T01:14:53.969 INFO:teuthology.orchestra.run.trial089.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-13T01:14:53.969 INFO:teuthology.orchestra.run.trial089.stdout:HOME_URL="https://rockylinux.org/" 2026-02-13T01:14:53.969 INFO:teuthology.orchestra.run.trial089.stdout:VENDOR_NAME="RESF" 2026-02-13T01:14:53.969 INFO:teuthology.orchestra.run.trial089.stdout:VENDOR_URL="https://resf.org/" 2026-02-13T01:14:53.970 INFO:teuthology.orchestra.run.trial089.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-13T01:14:53.970 INFO:teuthology.orchestra.run.trial089.stdout:SUPPORT_END="2035-05-31" 2026-02-13T01:14:53.970 INFO:teuthology.orchestra.run.trial089.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-13T01:14:53.970 INFO:teuthology.orchestra.run.trial089.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-13T01:14:53.970 INFO:teuthology.orchestra.run.trial089.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-13T01:14:53.970 INFO:teuthology.orchestra.run.trial089.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-13T01:14:53.971 INFO:teuthology.lock.ops:Updating trial089.front.sepia.ceph.com on lock server 2026-02-13T01:14:54.074 INFO:teuthology.lock.ops:Updating [trial099.front.sepia.ceph.com]: set os type and version on server 2026-02-13T01:14:54.075 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial099.front.sepia.ceph.com' 2026-02-13T01:14:54.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T01:14:54.145 DEBUG:teuthology.orchestra.run.trial099:> true 2026-02-13T01:14:54.232 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial099.front.sepia.ceph.com' 2026-02-13T01:14:54.232 DEBUG:teuthology.orchestra.run.trial099:> uname -m 2026-02-13T01:14:54.290 INFO:teuthology.orchestra.run.trial099.stdout:x86_64 2026-02-13T01:14:54.290 DEBUG:teuthology.orchestra.run.trial099:> cat /etc/os-release 2026-02-13T01:14:54.348 INFO:teuthology.orchestra.run.trial099.stdout:NAME="Rocky Linux" 2026-02-13T01:14:54.348 INFO:teuthology.orchestra.run.trial099.stdout:VERSION="10.1 (Red Quartz)" 2026-02-13T01:14:54.348 INFO:teuthology.orchestra.run.trial099.stdout:ID="rocky" 2026-02-13T01:14:54.348 INFO:teuthology.orchestra.run.trial099.stdout:ID_LIKE="rhel centos fedora" 2026-02-13T01:14:54.348 INFO:teuthology.orchestra.run.trial099.stdout:VERSION_ID="10.1" 2026-02-13T01:14:54.348 INFO:teuthology.orchestra.run.trial099.stdout:PLATFORM_ID="platform:el10" 2026-02-13T01:14:54.348 INFO:teuthology.orchestra.run.trial099.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-13T01:14:54.349 INFO:teuthology.orchestra.run.trial099.stdout:ANSI_COLOR="0;32" 2026-02-13T01:14:54.349 INFO:teuthology.orchestra.run.trial099.stdout:LOGO="fedora-logo-icon" 2026-02-13T01:14:54.349 INFO:teuthology.orchestra.run.trial099.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-13T01:14:54.349 INFO:teuthology.orchestra.run.trial099.stdout:HOME_URL="https://rockylinux.org/" 2026-02-13T01:14:54.349 INFO:teuthology.orchestra.run.trial099.stdout:VENDOR_NAME="RESF" 2026-02-13T01:14:54.349 INFO:teuthology.orchestra.run.trial099.stdout:VENDOR_URL="https://resf.org/" 2026-02-13T01:14:54.349 INFO:teuthology.orchestra.run.trial099.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-13T01:14:54.349 INFO:teuthology.orchestra.run.trial099.stdout:SUPPORT_END="2035-05-31" 2026-02-13T01:14:54.349 INFO:teuthology.orchestra.run.trial099.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-13T01:14:54.349 INFO:teuthology.orchestra.run.trial099.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-13T01:14:54.349 INFO:teuthology.orchestra.run.trial099.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-13T01:14:54.349 INFO:teuthology.orchestra.run.trial099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-13T01:14:54.350 INFO:teuthology.lock.ops:Updating trial099.front.sepia.ceph.com on lock server 2026-02-13T01:14:54.452 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T01:14:54.559 INFO:teuthology.dispatcher.supervisor:Running job 47444 2026-02-13T01:14:54.559 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47444 --name pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial --description fs/functional/{0-use-snaprealm/{global} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rpm_latest} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/mds_creation_retry} -- /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47444/orig.config.yaml 2026-02-13T01:14:54.560 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47444 2026-02-13T01:14:54.560 INFO:teuthology.dispatcher.supervisor:Job PID: 1004613 2026-02-13T01:14:54.560 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2026-02-13T01:16:54.660 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T01:18:54.779 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T01:20:54.954 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T01:22:55.119 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T01:24:55.221 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T01:26:55.428 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T01:26:55.517 INFO:teuthology.dispatcher.supervisor:Success! 2026-02-13T01:26:55.632 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2026-02-13T01:26:56.148 INFO:teuthology.orchestra.console.trial099:Power off 2026-02-13T01:26:56.148 DEBUG:teuthology.orchestra.console.trial099:pexpect command: ipmitool -H trial099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-13T01:26:56.158 INFO:teuthology.orchestra.console.trial089:Power off 2026-02-13T01:26:56.158 DEBUG:teuthology.orchestra.console.trial089:pexpect command: ipmitool -H trial089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-13T01:26:56.187 DEBUG:teuthology.orchestra.console.trial099:power off output: Chassis Power Control: Down/Off 2026-02-13T01:26:56.196 DEBUG:teuthology.orchestra.console.trial089:power off output: Chassis Power Control: Down/Off 2026-02-13T01:27:00.192 DEBUG:teuthology.orchestra.console.trial099:pexpect command: ipmitool -H trial099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T01:27:00.199 DEBUG:teuthology.orchestra.console.trial089:pexpect command: ipmitool -H trial089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T01:27:00.301 DEBUG:teuthology.orchestra.console.trial099:check power output: Chassis Power is on 2026-02-13T01:27:00.307 DEBUG:teuthology.orchestra.console.trial089:check power output: Chassis Power is on 2026-02-13T01:27:04.306 DEBUG:teuthology.orchestra.console.trial099:pexpect command: ipmitool -H trial099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T01:27:04.315 DEBUG:teuthology.orchestra.console.trial089:pexpect command: ipmitool -H trial089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T01:27:04.416 DEBUG:teuthology.orchestra.console.trial099:check power output: Chassis Power is off 2026-02-13T01:27:04.417 INFO:teuthology.orchestra.console.trial099:Power off completed 2026-02-13T01:27:04.425 DEBUG:teuthology.orchestra.console.trial089:check power output: Chassis Power is off 2026-02-13T01:27:04.425 INFO:teuthology.orchestra.console.trial089:Power off completed 2026-02-13T01:27:04.662 INFO:teuthology.lock.ops:unlocked: trial099.front.sepia.ceph.com 2026-02-13T01:27:04.674 INFO:teuthology.lock.ops:unlocked: trial089.front.sepia.ceph.com