2026-02-13T01:10:29.321 INFO:root:teuthology version: 1.2.4.dev9+ga2c505dae 2026-02-13T01:10:29.321 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T01:10:29.396 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T01:10:29.585 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x76a66b6296c0>, signals=[15]) 2026-02-13T01:10:29.585 INFO:teuthology.lock.ops:Start node 'trial048.front.sepia.ceph.com' reimaging 2026-02-13T01:10:29.585 INFO:teuthology.lock.ops:Updating [trial048.front.sepia.ceph.com]: reset os type and version on server 2026-02-13T01:10:29.585 INFO:teuthology.lock.ops:Updating trial048.front.sepia.ceph.com on lock server 2026-02-13T01:10:29.643 INFO:teuthology.lock.ops:Start node 'trial098.front.sepia.ceph.com' reimaging 2026-02-13T01:10:29.643 INFO:teuthology.lock.ops:Updating [trial098.front.sepia.ceph.com]: reset os type and version on server 2026-02-13T01:10:29.643 INFO:teuthology.lock.ops:Updating trial098.front.sepia.ceph.com on lock server 2026-02-13T01:10:29.829 DEBUG:teuthology.provision.fog.trial048:Requesting image trial_rocky_10.1 (ID 4) 2026-02-13T01:10:29.856 DEBUG:teuthology.provision.fog.trial098:Requesting image trial_rocky_10.1 (ID 4) 2026-02-13T01:10:29.867 INFO:teuthology.provision.fog.trial048:Scheduling deploy of rocky 10.1 2026-02-13T01:10:29.883 INFO:teuthology.provision.fog.trial098:Scheduling deploy of rocky 10.1 2026-02-13T01:10:32.495 INFO:teuthology.orchestra.console.trial098:Power off 2026-02-13T01:10:32.495 DEBUG:teuthology.orchestra.console.trial098:pexpect command: ipmitool -H trial098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-13T01:10:32.533 DEBUG:teuthology.orchestra.console.trial098:power off output: Chassis Power Control: Down/Off 2026-02-13T01:10:32.642 INFO:teuthology.orchestra.console.trial048:Power off 2026-02-13T01:10:32.642 DEBUG:teuthology.orchestra.console.trial048:pexpect command: ipmitool -H trial048.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-13T01:10:32.681 DEBUG:teuthology.orchestra.console.trial048:power off output: Chassis Power Control: Down/Off 2026-02-13T01:10:36.538 DEBUG:teuthology.orchestra.console.trial098:pexpect command: ipmitool -H trial098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T01:10:36.646 DEBUG:teuthology.orchestra.console.trial098:check power output: Chassis Power is off 2026-02-13T01:10:36.646 INFO:teuthology.orchestra.console.trial098:Power off completed 2026-02-13T01:10:36.682 DEBUG:teuthology.orchestra.console.trial048:pexpect command: ipmitool -H trial048.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T01:10:36.747 INFO:teuthology.orchestra.console.trial098:Power on 2026-02-13T01:10:36.747 DEBUG:teuthology.orchestra.console.trial098:pexpect command: ipmitool -H trial098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-13T01:10:36.785 DEBUG:teuthology.orchestra.console.trial098:power on output: Chassis Power Control: Up/On 2026-02-13T01:10:36.791 DEBUG:teuthology.orchestra.console.trial048:check power output: Chassis Power is off 2026-02-13T01:10:36.791 INFO:teuthology.orchestra.console.trial048:Power off completed 2026-02-13T01:10:36.891 INFO:teuthology.orchestra.console.trial048:Power on 2026-02-13T01:10:36.891 DEBUG:teuthology.orchestra.console.trial048:pexpect command: ipmitool -H trial048.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-13T01:10:36.931 DEBUG:teuthology.orchestra.console.trial048:power on output: Chassis Power Control: Up/On 2026-02-13T01:10:40.789 DEBUG:teuthology.orchestra.console.trial098:pexpect command: ipmitool -H trial098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T01:10:40.898 DEBUG:teuthology.orchestra.console.trial098:check power output: Chassis Power is on 2026-02-13T01:10:40.898 INFO:teuthology.orchestra.console.trial098:Power on completed 2026-02-13T01:10:40.932 DEBUG:teuthology.orchestra.console.trial048:pexpect command: ipmitool -H trial048.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T01:10:41.000 INFO:teuthology.provision.fog.trial098:Waiting for deploy to finish 2026-02-13T01:10:41.040 DEBUG:teuthology.orchestra.console.trial048:check power output: Chassis Power is off 2026-02-13T01:10:45.045 DEBUG:teuthology.orchestra.console.trial048:pexpect command: ipmitool -H trial048.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T01:10:45.155 DEBUG:teuthology.orchestra.console.trial048:check power output: Chassis Power is on 2026-02-13T01:10:45.155 INFO:teuthology.orchestra.console.trial048:Power on completed 2026-02-13T01:10:45.256 INFO:teuthology.provision.fog.trial048:Waiting for deploy to finish 2026-02-13T01:13:55.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T01:13:59.069 WARNING:teuthology.provision.fog.trial048:[Errno None] Unable to connect to port 22 on 10.20.193.48 2026-02-13T01:14:05.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T01:14:08.158 WARNING:teuthology.provision.fog.trial048:[Errno None] Unable to connect to port 22 on 10.20.193.48 2026-02-13T01:14:14.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T01:14:17.245 WARNING:teuthology.provision.fog.trial048:[Errno None] Unable to connect to port 22 on 10.20.193.48 2026-02-13T01:14:23.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T01:14:36.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T01:14:39.901 WARNING:teuthology.provision.fog.trial098:[Errno None] Unable to connect to port 22 on 10.20.193.98 2026-02-13T01:14:45.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T01:14:48.989 WARNING:teuthology.provision.fog.trial098:[Errno None] Unable to connect to port 22 on 10.20.193.98 2026-02-13T01:14:54.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T01:14:58.077 WARNING:teuthology.provision.fog.trial098:[Errno None] Unable to connect to port 22 on 10.20.193.98 2026-02-13T01:14:59.233 ERROR:teuthology.orchestra.connection:Error authenticating with trial048.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-13T01:15:03.332 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-13T01:15:03.333 DEBUG:teuthology.orchestra.run.trial048:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-13T01:15:04.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T01:15:08.539 INFO:teuthology.provision.fog.trial048:Node is ready 2026-02-13T01:15:08.539 DEBUG:teuthology.orchestra.run.trial048:> hostname 2026-02-13T01:15:08.597 INFO:teuthology.orchestra.run.trial048.stdout:trial048.front.sepia.ceph.com 2026-02-13T01:15:08.598 DEBUG:teuthology.orchestra.run.trial048:> grep trial048.front.sepia.ceph.com /etc/hosts 2026-02-13T01:15:08.655 INFO:teuthology.orchestra.run.trial048.stdout:10.20.193.48 trial048.front.sepia.ceph.com trial048 2026-02-13T01:15:08.656 DEBUG:teuthology.orchestra.run.trial048:> sudo hostname trial048 2026-02-13T01:15:08.730 DEBUG:teuthology.orchestra.run.trial048:> sudo sed -i -e 's/trial048.front.sepia.ceph.com/trial048/g' /etc/hosts 2026-02-13T01:15:08.797 DEBUG:teuthology.orchestra.run.trial048:> sudo sed -i -e 's/10.20.193.48/10.20.193.48/g' /etc/hosts 2026-02-13T01:15:08.865 DEBUG:teuthology.orchestra.run.trial048:> sudo sed -i -e 's/trial048.front.sepia.ceph.com/trial048/g' /etc/hostname 2026-02-13T01:15:08.933 DEBUG:teuthology.orchestra.run.trial048:> sudo hostname trial048 2026-02-13T01:15:08.998 DEBUG:teuthology.orchestra.run.trial048:> cat /etc/os-release 2026-02-13T01:15:09.055 INFO:teuthology.orchestra.run.trial048.stdout:NAME="Rocky Linux" 2026-02-13T01:15:09.055 INFO:teuthology.orchestra.run.trial048.stdout:VERSION="10.1 (Red Quartz)" 2026-02-13T01:15:09.055 INFO:teuthology.orchestra.run.trial048.stdout:ID="rocky" 2026-02-13T01:15:09.055 INFO:teuthology.orchestra.run.trial048.stdout:ID_LIKE="rhel centos fedora" 2026-02-13T01:15:09.055 INFO:teuthology.orchestra.run.trial048.stdout:VERSION_ID="10.1" 2026-02-13T01:15:09.055 INFO:teuthology.orchestra.run.trial048.stdout:PLATFORM_ID="platform:el10" 2026-02-13T01:15:09.055 INFO:teuthology.orchestra.run.trial048.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-13T01:15:09.055 INFO:teuthology.orchestra.run.trial048.stdout:ANSI_COLOR="0;32" 2026-02-13T01:15:09.055 INFO:teuthology.orchestra.run.trial048.stdout:LOGO="fedora-logo-icon" 2026-02-13T01:15:09.055 INFO:teuthology.orchestra.run.trial048.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-13T01:15:09.055 INFO:teuthology.orchestra.run.trial048.stdout:HOME_URL="https://rockylinux.org/" 2026-02-13T01:15:09.055 INFO:teuthology.orchestra.run.trial048.stdout:VENDOR_NAME="RESF" 2026-02-13T01:15:09.055 INFO:teuthology.orchestra.run.trial048.stdout:VENDOR_URL="https://resf.org/" 2026-02-13T01:15:09.055 INFO:teuthology.orchestra.run.trial048.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-13T01:15:09.055 INFO:teuthology.orchestra.run.trial048.stdout:SUPPORT_END="2035-05-31" 2026-02-13T01:15:09.055 INFO:teuthology.orchestra.run.trial048.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-13T01:15:09.055 INFO:teuthology.orchestra.run.trial048.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-13T01:15:09.055 INFO:teuthology.orchestra.run.trial048.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-13T01:15:09.055 INFO:teuthology.orchestra.run.trial048.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-13T01:15:09.055 INFO:teuthology.provision.fog.trial048:Deploy complete! 2026-02-13T01:15:09.056 DEBUG:teuthology.parallel:result is None 2026-02-13T01:15:40.197 ERROR:teuthology.orchestra.connection:Error authenticating with trial098.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-13T01:15:44.277 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-13T01:15:44.277 DEBUG:teuthology.orchestra.run.trial098:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-13T01:15:44.467 INFO:teuthology.provision.fog.trial098:Node is ready 2026-02-13T01:15:44.467 DEBUG:teuthology.orchestra.run.trial098:> hostname 2026-02-13T01:15:44.523 INFO:teuthology.orchestra.run.trial098.stdout:trial098.front.sepia.ceph.com 2026-02-13T01:15:44.523 DEBUG:teuthology.orchestra.run.trial098:> grep trial098.front.sepia.ceph.com /etc/hosts 2026-02-13T01:15:44.582 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98 trial098.front.sepia.ceph.com trial098 2026-02-13T01:15:44.582 DEBUG:teuthology.orchestra.run.trial098:> sudo hostname trial098 2026-02-13T01:15:44.654 DEBUG:teuthology.orchestra.run.trial098:> sudo sed -i -e 's/trial098.front.sepia.ceph.com/trial098/g' /etc/hosts 2026-02-13T01:15:44.722 DEBUG:teuthology.orchestra.run.trial098:> sudo sed -i -e 's/10.20.193.98/10.20.193.98/g' /etc/hosts 2026-02-13T01:15:44.789 DEBUG:teuthology.orchestra.run.trial098:> sudo sed -i -e 's/trial098.front.sepia.ceph.com/trial098/g' /etc/hostname 2026-02-13T01:15:44.857 DEBUG:teuthology.orchestra.run.trial098:> sudo hostname trial098 2026-02-13T01:15:44.924 DEBUG:teuthology.orchestra.run.trial098:> cat /etc/os-release 2026-02-13T01:15:44.980 INFO:teuthology.orchestra.run.trial098.stdout:NAME="Rocky Linux" 2026-02-13T01:15:44.980 INFO:teuthology.orchestra.run.trial098.stdout:VERSION="10.1 (Red Quartz)" 2026-02-13T01:15:44.980 INFO:teuthology.orchestra.run.trial098.stdout:ID="rocky" 2026-02-13T01:15:44.980 INFO:teuthology.orchestra.run.trial098.stdout:ID_LIKE="rhel centos fedora" 2026-02-13T01:15:44.980 INFO:teuthology.orchestra.run.trial098.stdout:VERSION_ID="10.1" 2026-02-13T01:15:44.980 INFO:teuthology.orchestra.run.trial098.stdout:PLATFORM_ID="platform:el10" 2026-02-13T01:15:44.980 INFO:teuthology.orchestra.run.trial098.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-13T01:15:44.980 INFO:teuthology.orchestra.run.trial098.stdout:ANSI_COLOR="0;32" 2026-02-13T01:15:44.981 INFO:teuthology.orchestra.run.trial098.stdout:LOGO="fedora-logo-icon" 2026-02-13T01:15:44.981 INFO:teuthology.orchestra.run.trial098.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-13T01:15:44.981 INFO:teuthology.orchestra.run.trial098.stdout:HOME_URL="https://rockylinux.org/" 2026-02-13T01:15:44.981 INFO:teuthology.orchestra.run.trial098.stdout:VENDOR_NAME="RESF" 2026-02-13T01:15:44.981 INFO:teuthology.orchestra.run.trial098.stdout:VENDOR_URL="https://resf.org/" 2026-02-13T01:15:44.981 INFO:teuthology.orchestra.run.trial098.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-13T01:15:44.981 INFO:teuthology.orchestra.run.trial098.stdout:SUPPORT_END="2035-05-31" 2026-02-13T01:15:44.981 INFO:teuthology.orchestra.run.trial098.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-13T01:15:44.981 INFO:teuthology.orchestra.run.trial098.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-13T01:15:44.981 INFO:teuthology.orchestra.run.trial098.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-13T01:15:44.981 INFO:teuthology.orchestra.run.trial098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-13T01:15:44.981 INFO:teuthology.provision.fog.trial098:Deploy complete! 2026-02-13T01:15:44.981 DEBUG:teuthology.parallel:result is None 2026-02-13T01:15:45.343 INFO:teuthology.lock.ops:Checking trial048.front.sepia.ceph.com 2026-02-13T01:15:45.344 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-13T01:15:45.419 INFO:teuthology.lock.ops:Checking trial098.front.sepia.ceph.com 2026-02-13T01:15:45.419 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-13T01:15:45.477 INFO:teuthology.lock.ops:Updating [trial048.front.sepia.ceph.com]: set os type and version on server 2026-02-13T01:15:45.477 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-13T01:15:45.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T01:15:45.538 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-13T01:15:45.707 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-13T01:15:45.707 DEBUG:teuthology.orchestra.run.trial048:> uname -m 2026-02-13T01:15:45.765 INFO:teuthology.orchestra.run.trial048.stdout:x86_64 2026-02-13T01:15:45.766 DEBUG:teuthology.orchestra.run.trial048:> cat /etc/os-release 2026-02-13T01:15:45.823 INFO:teuthology.orchestra.run.trial048.stdout:NAME="Rocky Linux" 2026-02-13T01:15:45.823 INFO:teuthology.orchestra.run.trial048.stdout:VERSION="10.1 (Red Quartz)" 2026-02-13T01:15:45.823 INFO:teuthology.orchestra.run.trial048.stdout:ID="rocky" 2026-02-13T01:15:45.823 INFO:teuthology.orchestra.run.trial048.stdout:ID_LIKE="rhel centos fedora" 2026-02-13T01:15:45.823 INFO:teuthology.orchestra.run.trial048.stdout:VERSION_ID="10.1" 2026-02-13T01:15:45.823 INFO:teuthology.orchestra.run.trial048.stdout:PLATFORM_ID="platform:el10" 2026-02-13T01:15:45.823 INFO:teuthology.orchestra.run.trial048.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-13T01:15:45.823 INFO:teuthology.orchestra.run.trial048.stdout:ANSI_COLOR="0;32" 2026-02-13T01:15:45.824 INFO:teuthology.orchestra.run.trial048.stdout:LOGO="fedora-logo-icon" 2026-02-13T01:15:45.824 INFO:teuthology.orchestra.run.trial048.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-13T01:15:45.824 INFO:teuthology.orchestra.run.trial048.stdout:HOME_URL="https://rockylinux.org/" 2026-02-13T01:15:45.824 INFO:teuthology.orchestra.run.trial048.stdout:VENDOR_NAME="RESF" 2026-02-13T01:15:45.824 INFO:teuthology.orchestra.run.trial048.stdout:VENDOR_URL="https://resf.org/" 2026-02-13T01:15:45.824 INFO:teuthology.orchestra.run.trial048.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-13T01:15:45.824 INFO:teuthology.orchestra.run.trial048.stdout:SUPPORT_END="2035-05-31" 2026-02-13T01:15:45.824 INFO:teuthology.orchestra.run.trial048.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-13T01:15:45.824 INFO:teuthology.orchestra.run.trial048.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-13T01:15:45.824 INFO:teuthology.orchestra.run.trial048.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-13T01:15:45.824 INFO:teuthology.orchestra.run.trial048.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-13T01:15:45.825 INFO:teuthology.lock.ops:Updating trial048.front.sepia.ceph.com on lock server 2026-02-13T01:15:45.929 INFO:teuthology.lock.ops:Updating [trial098.front.sepia.ceph.com]: set os type and version on server 2026-02-13T01:15:45.929 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial098.front.sepia.ceph.com' 2026-02-13T01:15:45.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T01:15:46.000 DEBUG:teuthology.orchestra.run.trial098:> true 2026-02-13T01:15:46.080 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial098.front.sepia.ceph.com' 2026-02-13T01:15:46.080 DEBUG:teuthology.orchestra.run.trial098:> uname -m 2026-02-13T01:15:46.138 INFO:teuthology.orchestra.run.trial098.stdout:x86_64 2026-02-13T01:15:46.138 DEBUG:teuthology.orchestra.run.trial098:> cat /etc/os-release 2026-02-13T01:15:46.197 INFO:teuthology.orchestra.run.trial098.stdout:NAME="Rocky Linux" 2026-02-13T01:15:46.197 INFO:teuthology.orchestra.run.trial098.stdout:VERSION="10.1 (Red Quartz)" 2026-02-13T01:15:46.197 INFO:teuthology.orchestra.run.trial098.stdout:ID="rocky" 2026-02-13T01:15:46.197 INFO:teuthology.orchestra.run.trial098.stdout:ID_LIKE="rhel centos fedora" 2026-02-13T01:15:46.197 INFO:teuthology.orchestra.run.trial098.stdout:VERSION_ID="10.1" 2026-02-13T01:15:46.197 INFO:teuthology.orchestra.run.trial098.stdout:PLATFORM_ID="platform:el10" 2026-02-13T01:15:46.197 INFO:teuthology.orchestra.run.trial098.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-13T01:15:46.197 INFO:teuthology.orchestra.run.trial098.stdout:ANSI_COLOR="0;32" 2026-02-13T01:15:46.198 INFO:teuthology.orchestra.run.trial098.stdout:LOGO="fedora-logo-icon" 2026-02-13T01:15:46.198 INFO:teuthology.orchestra.run.trial098.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-13T01:15:46.198 INFO:teuthology.orchestra.run.trial098.stdout:HOME_URL="https://rockylinux.org/" 2026-02-13T01:15:46.198 INFO:teuthology.orchestra.run.trial098.stdout:VENDOR_NAME="RESF" 2026-02-13T01:15:46.198 INFO:teuthology.orchestra.run.trial098.stdout:VENDOR_URL="https://resf.org/" 2026-02-13T01:15:46.198 INFO:teuthology.orchestra.run.trial098.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-13T01:15:46.198 INFO:teuthology.orchestra.run.trial098.stdout:SUPPORT_END="2035-05-31" 2026-02-13T01:15:46.198 INFO:teuthology.orchestra.run.trial098.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-13T01:15:46.198 INFO:teuthology.orchestra.run.trial098.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-13T01:15:46.198 INFO:teuthology.orchestra.run.trial098.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-13T01:15:46.198 INFO:teuthology.orchestra.run.trial098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-13T01:15:46.199 INFO:teuthology.lock.ops:Updating trial098.front.sepia.ceph.com on lock server 2026-02-13T01:15:46.303 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T01:15:46.401 INFO:teuthology.dispatcher.supervisor:Running job 47452 2026-02-13T01:15:46.401 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47452 --name pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial --description fs/multifs/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{rpm_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rpm_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health} tasks/multifs-auth} -- /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47452/orig.config.yaml 2026-02-13T01:15:46.401 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47452 2026-02-13T01:15:46.401 INFO:teuthology.dispatcher.supervisor:Job PID: 1004935 2026-02-13T01:15:46.401 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2026-02-13T01:17:46.473 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T01:19:46.608 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T01:21:46.812 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T01:23:46.997 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T01:25:47.122 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T01:27:47.217 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T01:29:47.409 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T01:31:47.601 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T01:33:47.806 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T01:35:48.015 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T01:37:48.205 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T01:39:48.317 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T01:41:48.498 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T01:43:48.706 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T01:45:48.880 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T01:45:48.951 INFO:teuthology.dispatcher.supervisor:Success! 2026-02-13T01:45:49.062 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2026-02-13T01:45:49.558 INFO:teuthology.orchestra.console.trial048:Power off 2026-02-13T01:45:49.558 DEBUG:teuthology.orchestra.console.trial048:pexpect command: ipmitool -H trial048.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-13T01:45:49.578 INFO:teuthology.orchestra.console.trial098:Power off 2026-02-13T01:45:49.578 DEBUG:teuthology.orchestra.console.trial098:pexpect command: ipmitool -H trial098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-13T01:45:49.599 DEBUG:teuthology.orchestra.console.trial048:power off output: Chassis Power Control: Down/Off 2026-02-13T01:45:49.614 DEBUG:teuthology.orchestra.console.trial098:power off output: Chassis Power Control: Down/Off 2026-02-13T01:45:53.603 DEBUG:teuthology.orchestra.console.trial048:pexpect command: ipmitool -H trial048.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T01:45:53.615 DEBUG:teuthology.orchestra.console.trial098:pexpect command: ipmitool -H trial098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T01:45:53.712 DEBUG:teuthology.orchestra.console.trial048:check power output: Chassis Power is on 2026-02-13T01:45:53.723 DEBUG:teuthology.orchestra.console.trial098:check power output: Chassis Power is on 2026-02-13T01:45:57.717 DEBUG:teuthology.orchestra.console.trial048:pexpect command: ipmitool -H trial048.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T01:45:57.726 DEBUG:teuthology.orchestra.console.trial098:pexpect command: ipmitool -H trial098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T01:45:57.828 DEBUG:teuthology.orchestra.console.trial048:check power output: Chassis Power is off 2026-02-13T01:45:57.828 INFO:teuthology.orchestra.console.trial048:Power off completed 2026-02-13T01:45:57.836 DEBUG:teuthology.orchestra.console.trial098:check power output: Chassis Power is off 2026-02-13T01:45:57.836 INFO:teuthology.orchestra.console.trial098:Power off completed 2026-02-13T01:45:58.071 INFO:teuthology.lock.ops:unlocked: trial048.front.sepia.ceph.com 2026-02-13T01:45:58.090 INFO:teuthology.lock.ops:unlocked: trial098.front.sepia.ceph.com